ChatGPT Unveils 20 New Features at DevDay

ChatGPT, Codex, and general AI utility stand to be transformed by 20 new updates released during DevDay. These advancements are set to change how users interact with artificial intelligence forever.

A major highlight included the introduction of DOT, a new agent platform, alongside a more cost-effective model, GPT-6.1 So-L, which offers performance comparable to Astra, and a new 'fast mode' capable of generating code eight times faster than previous iterations.

Users can connect this virtual agent to communication tools such as email, Slack, and phone calls by selecting 'create your dot' via the home icon in the desktop app. This personalized agent is designed to streamline various personal and professional tasks.

Users can configure DOT to connect with communication tools such as email, Slack, and phone calls, initiating the setup process by selecting 'create your dot' from the home icon within the ChatGPT desktop app.

DOT offers comprehensive control over users' email and calendar, enabling it to read and analyze specific emails to extract crucial information, such as details about 3D printer models.

Based on the retrieved data, DOT can generate innovative project ideas and compile information into the new 'Pages' feature, facilitating efficient information management.

The agent's workflow supports direct actions, allowing users to request it to send emails and integrate with plugins like Gmail to automate communication processes.

Users can directly call their DOT agent through the ChatGPT iOS app, enabling real-time voice interaction for various tasks.

During calls, the agent can perform cross-platform operations, such as verifying sent emails, and also integrates with Slack to share documents or messages with team members, handling multi-step requests like sending specific links to colleagues instantly.

Dot can be connected to Slack via a plugin within the ChatGPT app, allowing it to message specific team members directly, such as John.

Users can interact with the agent within Slack's 'Agents and apps' section, where Dot aggregates information from email and other Slack threads to provide context-aware and relevant responses.

Dot now allows users to edit documents using direct voice input, performing formatting tasks like adding tables and teasers.

The agent can convert plain text into interactive 'prompt blocks' for improved usability, making documents more dynamic and engaging.

All changes made through voice commands are immediately reflected within the ChatGPT interface, providing a seamless editing experience.

Dot can be added to specific Slack channels, enabling multiple team members to trigger the agent simultaneously using @mentions, fostering enhanced team collaboration.

The agent provides summary updates and outlines next steps for project workflows, maintaining full context across shared channels and personal communications.

OpenAI is preparing to enable Dot interaction through iMessage, which will allow users to command the agent directly from their text messaging application.

This expansion means users can access the agent with its integrated plugins and virtual computer capabilities directly from their mobile messaging.

With a cloud-based browser, the agent handles complex computer-based operations like filling out forms or testing websites through the ChatGPT interface.

Users can manually interact with this virtual desktop environment through the ChatGPT app interface, giving the agent the infrastructure needed to handle complex computer-based operations autonomously.

This new model is notably five times cheaper than the existing GPT-4 Astra model, significantly reducing operational costs for developers. While Astra costs $10 per million tokens input and $50 per million tokens output, totaling $60, GPT-6.1 So-L is priced at $2 per million tokens input and $10 per million tokens output, amounting to $12 in total.

The substantial cost reduction is expected to make advanced AI capabilities more accessible and economically viable for a broader range of development projects.

Integrated AI chat and note-taking features enable users to coordinate with agents to build documents, interactive charts, and websites within a Notion-style environment.

This new feature functions similarly to Notion, offering a note-taking environment with integrated AI chat capabilities, and includes advanced features such as mermaid diagram generation, interactive charts, and prompt formatting shortcuts.

Users can issue commands directly to agents to populate documents with structured content, including tables and callouts, streamlining the content creation process.

Users can now request charts by describing them, such as a pie chart for features, with the generated charts being interactive and directly embeddable into documents.

A full document editor has been integrated into the ChatGPT interface, enabling seamless content creation and data visualization within the platform.

Documents can be easily shared through direct links or via AI-automated email delivery, simplifying communication workflows.

Users can command the AI to send specific documents to team members instantly, enhancing efficiency in team projects.

A new meeting plugin is set to be released, which will automatically record and transcribe meetings.

This plugin will be integrated into GPT Space, featuring a dedicated tab to facilitate task management and simplify meeting reviews.

Third-party applications, such as Magic Path, can now operate directly within the ChatGPT desktop app, enabling users to leverage ChatGPT tokens to execute actions in external apps like Figma.

According to Petro Kirano, CEO of Magic Path, their company has experienced over 2,000% growth since the announcement of this integration feature.

This capability presents a significant opportunity for product builders to make their offerings fully agent-native or directly integrated into the ChatGPT desktop app, thereby expanding their reach.

Developers can now easily integrate 'Sign in with ChatGPT' into their applications, allowing users to log in with their existing ChatGPT accounts.

This feature enables users to utilize their ChatGPT account credits to pay for services within third-party applications, such as Devon, simplifying payment processes.

The integration significantly streamlines app building for developers by eliminating the necessity of constructing proprietary agents from scratch.

More apps are expected to adopt this login method, offering users a unified authentication and payment experience across various platforms.

A new side panel within Codex now allows for direct management and review of pull requests (PRs), streamlining the code review process.

This integration provides developers with an efficient way to monitor and address changes made during the application development lifecycle directly within their environment.

A single platform API key now replaces the need for multiple keys, streamlining the creation of agentic applications through the new Agents API.

This new API allows applications to leverage 'computer use' via an OpenAI-hosted browser, enhancing the capabilities of agentic apps.

The speaker intends to utilize this Agents API for upcoming hardware agent projects, signaling a future where AI agents can more seamlessly integrate into and control physical systems.