Database: The Last Line of Defense for AI Agents

She has been an integral part of Oracle for two decades, humorously noting that she started her career at the age of 12.

Having spent a significant portion of her professional life at Oracle, Malcolm brings extensive experience to her current role, focusing on the strategic aspects of database product management.

This led to a critical reevaluation of AI's role in the workplace.

The 'token maxing' era of 2025 marked a pivotal shift in focus towards developing and implementing responsible AI practices, recognizing the need for more holistic integration rather than just individual acceleration.

Kay Malcolm highlighted a significant challenge where teams in the Netherlands and the US struggled with code integration due to a loss of context. Although the code was checked in, the critical contextual information from the development environment, Codeex, was not.

GitHub effectively tracked code changes, but it failed to capture the underlying 'human intent' behind those changes, creating a disconnect that hindered global team collaboration.

This layer became crucial for maintaining coherence and direction.

With AI now considered a 'new team member,' there's a heightened need to integrate it into existing workflows, requiring structured methods to track its contributions and manage its interactions within the team.

Tools define how the agent performs its actions, and context, often perceived as the context window, is crucial for its understanding.

Guard rails are essential components, serving as a 'harness' that provides necessary control and safety for the model's operations within an enterprise environment.

Memory, in this analogy, functions as the central nervous system, providing the critical connection between the model (brain) and its ability to act and interact with the world through the harness.

AI memory systems are categorized into several types to support enterprise agents, starting with short-term memory, which handles data within a specific session. Long-term memory, in contrast, ensures data persistence across multiple sessions, allowing agents to retain information over extended periods.

Further distinctions include episodic memory for recalling specific events, procedural memory for learned skills, and semantic memory for factual knowledge. Among these, semantic memory is particularly vital for enterprise-level agent deployment, as it enables deep understanding and contextual relevance necessary for complex business operations.

Operating separate systems for structured, unstructured, and graph data creates significant administrative overhead, as each requires independent security, patching, and management. Malcolm recalled that for every database system a DBA managed, she had to attend two meetings, emphasizing the compounding administrative burden.

Each additional database type exponentially increases the number of meetings and tasks for database administrators, leading to increased complexity and professional burnout. This fragmentation not only complicates maintenance but also introduces compliance challenges, such as those related to Sarbanes-Oxley, which Malcolm noted still causes a visceral reaction due to its complexity.

These inaccuracies could jeopardize lives by misguiding decisions on critical operations.

Early workarounds for such data complexity involved crafting intricate nested SQL queries to analyze relationships and uncover more reliable insights. However, the persistent need for more effective relationship modeling often led to the adoption of specialized databases like Neo4j, designed to handle complex interconnections more efficiently and reduce the occurrence of misleading signals.

Modern AI agents face significant challenges when data is scattered across multiple specialized databases, including relational, unstructured JSON, graph, and vector databases. This fragmentation complicates the agent's ability to establish a reliable 'single source of truth.'

Fragmented data storage forces AI agents to infer information by piecing together data from disparate sources, which significantly increases token usage. This not only makes operations more costly but also elevates the likelihood of errors and misinterpretations.

Managing state across various file systems and distinct databases undermines the overall reliability and performance of enterprise agents. The lack of a unified data environment impedes the agent's capacity to maintain consistent context and make accurate, timely decisions.

This scattered data landscape ultimately erodes trust in the agent's outputs, making it difficult for organizations to confidently rely on AI for critical business functions.