Designing AI Agents as Peers to Human Operators
This design ensures that agents operate alongside humans, maintaining a human-in-the-loop strategy, particularly for sales workflows, to guarantee safety and oversight.
Flora Liu details Notion's architectural shift, positioning AI agents as peers to human operators within existing systems to centralize customer data and automate sales workflows, aiming for significant productivity gains and improved deal throughput.
This design ensures that agents operate alongside humans, maintaining a human-in-the-loop strategy, particularly for sales workflows, to guarantee safety and oversight.
Notion prioritizes security by preventing AI agents from directly communicating with customers, ensuring human approval for all agent actions in sales assist workflows. Contact forms are treated as untrusted input, reinforcing security measures. Furthermore, the company has consolidated previously fragmented eligibility rules into a single, centralized classifier to streamline operations and enhance control.
This lean team strategy focuses on developing what is considered unique and proprietary, renting other services. The company believes that a deep understanding of its customers provides a crucial competitive advantage.
Notion centralizes its customer data using Snowflake as the primary data warehouse to compute customer truth, ingesting data from all Go-To-Market (GTM) vendors. DynamoDB is utilized as a key-value store for low-latency queries, ensuring quick access to critical information. Unstructured artifacts, such as research summaries, are also keyed by consistent IDs to maintain data integrity and accessibility across the system.
This consolidation enables both humans and AI agents to operate on the same data source, fostering seamless collaboration. Teams can efficiently explore context, investigate accounts, answer questions, and even trigger actions like sending to Nooks or Outreach directly within the Notion platform.
These signals encompass both user-driven events and external events, such as news of company funding. When no direct signal is present, a predictive engine takes over to manage marketing tasks proactively. This framework allows Notion to respond dynamically to customer behavior and market changes.
Temporal manages crucial aspects such as retries, deduplication, and failure recovery, ensuring the robustness of these automated processes. This system prevents individual job failures from disrupting the entire batch, maintaining operational efficiency.
Additionally, Gong transcripts are parsed to extract key MEDDPICC metrics, providing valuable insights. Every step executed by the Large Language Model (LLM) is meticulously traced to enable continuous quality evaluation and improvement over time, ensuring the system consistently enhances its performance.
Notion's rebuilt system integrates engagement history directly back into the decision layer, enabling the system to autonomously determine whether to continue a thread, advance to the next step, or pivot. This continuous feedback loop allows for systemic self-healing, where outcome data informs future decisions. Verification loops are critical in this process, ensuring ongoing improvement and adaptability.
Agents query a centralized context layer, providing immediate access to comprehensive insights. Notion's custom agents enable recurring automated workflows, further streamlining sales operations and improving efficiency.
They used to find all of this across many different tabs and now they can just come here each day.
Notion aims to raise the overall performance floor for its entire sales team by providing reps with pre-researched outreach drafts, thereby preserving human judgment while eliminating the need to start from a blank slate. New representatives can quickly learn effective playbooks derived from top-performing patterns. This approach significantly enhances both team productivity and onboarding efficiency.
Notion employs a strategic framework that distinguishes between orchestration tools, which can be acquired, and internal context layers, which are built in-house. Internal agents are developed specifically on Notion's unique data model to leverage its proprietary strengths. The company firmly refuses to outsource the context layer, viewing it as a critical component of its competitive edge.
Marketing efforts have also demonstrated a 63% higher likelihood for next-step actions. These results validate the efficacy of Notion's 'decide-act-learn' system thesis, confirming its positive impact on deal throughput and overall sales efficiency.
Only legible and well-documented processes should be encoded into the system. It is crucial to design agents as independent operators rather than merely co-pilots, ensuring they function as integral parts of the workflow. A shared substrate is essential for seamless collaboration between humans and agents, preventing system drift.
Answers come from the transcript, with the exact spot cited.
Want the next article from AI Engineer?
When AI Engineer publishes, we'll write it up like the one you just read and email it to you.
AI Engineer published 91 in the last 7 days.
Continuous Improvement for AI AgentsAI Engineer3 hours ago · 44:22 · 93 views · Created 3 hours ago
Beyond RAG: Building Relational Context EnginesAI Engineer11 hours ago · 38:18 · 100 views · Created 11 hours ago
Akamai Functions Achieve Zero Cold Starts for AIAI Engineeryesterday · 22:37 · 205 views · Created yesterday