OpenAI launches GPT-Live, a full-duplex voice upgrade that lets ChatGPT talk more like a person

Read full story on VentureBeat
Share
OpenAI launches GPT-Live, a full-duplex voice upgrade that lets ChatGPT talk more like a person
AI disclosure

Summary

<p><a href="https://openai.com/">OpenAI</a> on Wednesday launched <a href="https://openai.com/index/introducing-gpt-live/">GPT-Live</a>, a pair of new voice models that fundamentally redesign how people talk to ChatGPT — replacing the company&#x27;s existing <a href="https://www.reddit.com/r/ChatGPT/comments/1fsna89/advanced_voice_mode_is_amazing/">Advanced Voice Mode</a> with an architecture that can listen and speak simultaneously, much like an actual human conversation.</p><p>The two models, <a href="https://openai.com/index/introducing-gpt-live/">GPT-Live-1</a> and <a href="https://openai.com/index/introducing-gpt-live/">GPT-Live-1 mini</a>, are rolling out globally starting today across iOS, Android, and ChatGPT.com. GPT-Live-1 becomes the default voice model for paid ChatGPT users on the Go, Plus, and Pro tiers, while GPT-Live-1 mini serves free-tier users. OpenAI also plans to bring the models to the API, and developers can sign up to be notified.</p><p>The release marks the third generation of ChatGPT&#x27;s voice technology in roughly two years — and OpenAI&#x27;s clearest bid yet to turn its chatbot into something that feels less like querying a search engine and more like talking to a colleague.</p><div></div><h2><b>Why full-duplex voice changes everything about talking to AI</b></h2><p>The defining technical advance in <a href="https://openai.com/index/introducing-gpt-live/">GPT-Live</a> is what OpenAI calls a &quot;<a href="https://openai.com/index/introducing-gpt-live/">full-duplex architecture</a>.&quot; In telecommunications, full-duplex means both parties on a phone call can talk and listen at the same time. Applied to AI, it means the model continuously processes your incoming audio even while it generates its own spoken response — no more waiting for a clean silence gap to figure out when you&#x27;ve finished a thought.</p><p>&quot;Instead of processing a sequence of separate messages, GPT-Live continuously processes input while generating output,&quot; OpenAI wrote in its research blog. &quot;The model can therefore make interaction decisions many times per second: whether to speak, continue listening, pause, interrupt, or invoke a tool.&quot;</p><p>In practice, that translates to a voice assistant that can insert conversational acknowledgments — &quot;mhmm,&quot; &quot;yeah,&quot; &quot;got it&quot; — while you&#x27;re still talking, pick up on a natural pause without jumping in prematurely, and handle rapid interruptions without derailing the entire exchange. </p><p>OpenAI&#x27;s previous <a href="https://techcrunch.com/2024/09/24/openai-rolls-out-advanced-voice-mode-with-more-voices-and-a-new-look/">Advanced Voice Mode</a>, launched to paid users in September 2024, processed and generated audio within a single model but still operated on rigid turn-by-turn exchanges. As OpenAI acknowledged in the announcement, &quot;because turn detection is based on silence, even a brief pause or background noise could be mistaken for the end of turn — causing the model to interrupt at unnatural times.&quot;</p><p>That brittleness created a product that, while impressive in demos, could be deeply frustrating in extended real-world use. Background chatter in a coffee shop could trigger a response. A thinking pause might get swallowed. The experience felt, as one researcher put it on X shortly after the announcement, like &quot;<a href="https://x.com/SarahDiaChen/status/2074908276790087748">walkie-talkie turn taking</a>.&quot; GPT-Live is designed to end that era.</p><div></div><h2><b>How OpenAI split voice and intelligence into two separate layers</b></h2><p><a href="https://openai.com/index/introducing-gpt-live/">GPT-Live</a> introduces a second structural change that may prove just as consequential for enterprise adoption: it decouples the voice interaction layer from the reasoning layer.</p><p>When a user asks a straightforward question, <a href="https://openai.com/index/introducing-gpt-live/">GPT-Live</a> handles it directly. But when the query demands web search, deeper reasoning, or more complex agentic work, GPT-Live delegates the task to a frontier model running in the background — at launch, GPT-5.5, the large language model OpenAI released in April — and continues talking with the user while the computation happens asynchronously.</p><p>&quot;While it works, GPT-Live can keep talking with you and maintain the flow of conversation,&quot; OpenAI explains. &quot;As we release new frontier models, we&#x27;ll continuously update the model used by GPT-Live.&quot;</p><p>This delegation model is a meaningful architectural bet. Rather than building a single monolithic voice model that tries to be both conversationally fluid and deeply intelligent, OpenAI has split the problem in two: a voice-native model optimized for real-time interaction, and a separate reasoning engine that can be swapped out as the state of the art improves. </p><p>It is, in effect, a modular design — one that allows OpenAI to upgrade the intelligence of its voice assistant without retraining the voice model itself. The implications for enterprise and developer workflows are significant. A voice agent built on this architecture could maintain a natural conversation with a customer while simultaneously querying databases, searching the web, or performing multi-step reasoning — tasks that would have introduced several seconds of dead air under the old pipeline.</p><div></div><h2><b>The three generations of ChatGPT voice, from clunky pipeline to continuous stream</b></h2><p>To understand how far voice AI has come, it helps to trace the three generations that led to <a href="https://openai.com/index/introducing-gpt-live/">GPT-Live</a>.</p><p>The original <a href="https://techcrunch.com/2023/09/25/openai-chatgpt-voice/">ChatGPT Voice</a>, launched in 2023, used a cascaded pipeline — a speech-to-text model (<a href="https://openai.com/index/whisper/">Whisper</a>) transcribed what you said, a large language model (<a href="https://openai.com/index/gpt-4-research/">GPT-4</a>) generated a text response, and a text-to-speech model converted that response back into audio. Each handoff introduced latency and lost information. </p><p>As OpenAI noted, &quot;the complexity came at a cost: information could be lost across models, and responses were slow and stilted.&quot; That cascaded approach was the industry standard, and its limitations were well-documented. As the blog <a href="https://www.openhelm.ai/blog/openai-realtime-api-voice-agents-launch">OpenHelm</a> noted in an October 2024 analysis of OpenAI&#x27;s Realtime API, the old pipeline stacked up to roughly 1,700 milliseconds of latency — nearly two full seconds of dead air before the first word of a response. Managing the state between the three separate APIs consumed an enormous amount of engineering effort.</p><p>OpenAI&#x27;s Advanced Voice Mode, which began its limited rollout to paid ChatGPT Plus users in July 2024 before expanding more broadly in September 2024, collapsed that three-model pipeline into a single model that processed audio natively. As <a href="https://techcrunch.com/2024/09/24/openai-rolls-out-advanced-voice-mode-with-more-voices-and-a-new-look/">TechCrunch reported</a> at the time, the rollout came with five new voices — Arbor, Maple, Sol, Spruce, and Vale — alongside improved accent handling and smoother conversations. </p><p>The feature also launched on the web in November 2024, extending it beyond mobile. But Advanced Voice Mode still operated through discrete, alternating turns — and it launched into the shadow of a PR debacle that OpenAI is still working to leave behind.</p><h2><b>The Scarlett Johansson controversy still shadows OpenAI&#x27;s voice ambitions</b></h2><p>Advanced Voice Mode arrived in the wake of one of OpenAI&#x27;s most damaging self-inflicted crises. During the GPT-4o launch in May 2024, the company showcased a voice called &quot;Sky&quot; that many listeners immediately noted sounded <a href="https://www.npr.org/2024/05/31/g-s1-2263/voice-lab-analysis-striking-similarity-scarlett-johansson-chatgpt-sky-openai">strikingly similar to Scarlett Johansson</a>, who famously voiced an AI companion in the 2013 film <a href="https://en.wikipedia.org/wiki/Her_(2013_film)"><i>Her</i></a>.</p><p>Johansson said she had <a href="https://www.cnbc.com/2024/05/20/scarlett-johansson-says-openai-ripped-off-her-voice-.html">declined OpenAI CEO Sam Altman&#x27;s offer</a> to voice the system, then was &quot;shocked, angered and in disbelief&quot; when the product launched with a voice her own friends couldn&#x27;t distinguish from hers, as NBC News reported. Altman had tweeted just the word &quot;her&quot; the day the product launched.</p><p>OpenAI pulled the voice and apologized, but the incident <a href="https://www.nbcnews.com/tech/sag-aftra-applauds-scarlett-johansson-rebuking-openai-voice-sounded-rcna153256">drew public scrutiny from SAG-AFTRA</a> and <a href="https://www.npr.org/2024/05/20/1252495087/openai-pulls-ai-voice-that-was-compared-to-scarlett-johansson-in-the-movie-her">members of Congress</a>, and crystallized broader concerns about AI companies moving fast with creative IP.</p><p>The Hollywood labor union said the issue underscored &quot;why we&#x27;re strongly championing federal legislation that would protect their voices and likenesses ... from unauthorized digital replication,&quot; as <a href="https://www.nbcnews.com/tech/sag-aftra-applauds-scarlett-johansson-rebuking-openai-voice-sounded-rcna153256">NBC News reported</a>. Forbes contributor <a href="https://www.forbes.com/sites/paultassi/2024/05/21/chatgpt-4o-scarlett-johansson-and-missing-the-point-of-her/">Paul Tassi wrote</a> at the time that Altman, &quot;by holding up <i>Her</i> on a pedestal of something to strive for, has missed the point of that film&quot; — in which the protagonist&#x27;s relationship with his AI companion ultimately does him more harm than good.</p><p><a href="https://openai.com/index/introducing-gpt-live/">GPT-Live</a> appears designed, in part, to move past those controversies. OpenAI says it has &quot;remastered the nine distinct voices in ChatGPT for GPT-Live&quot; and notes the system &quot;is designed for conversation, not voice impersonation,&quot; with &quot;safeguards to prevent it from imitating a real person&#x27;s voice.&quot;</p><h2><b>What 150 million weekly voice users will actually notice today</b></h2><p>OpenAI disclosed that more than <a href="https://openai.com/index/introducing-gpt-live/">150 million people</a> talk to ChatGPT using voice and dictation features each week — a notable slice of the platform&#x27;s 900 million total weekly active users. The voice experience has grown into a substantial product in its own right, used for language practice, bedtime stories, commute-time chat, and hands-free everyday help.</p><p>The new product features reflect that usage. <a href="https://openai.com/index/introducing-gpt-live/">GPT-Live</a> introduces rich visual cards that surface during voice conversations — weather forecasts, stock data, sports scores, and maps — giving users something to glance at without breaking the flow of speech.</p><p>Users can now choose between three reasoning levels for answers: Instant for quick responses, Medium for moderate thinking, and High for more complex work. And if you take a moment to think, &quot;ChatGPT Voice now waits instead of jumping in and interrupting,&quot; OpenAI wrote. &quot;If you ask it to stay quiet and listen, it will. And when there&#x27;s background noise, like passing traffic or nearby conversations, ChatGPT is better at focusing on your voice instead of getting distracted.&quot;</p><p>Early reactions from users with preview access were cautiously positive. &quot;I had early access to sol. it is a phenomenal model,&quot; <a href="https://x.com/jakeottiger/status/2074714639292625154">wrote one user on X</a>, adding it is “much better at frontend, long context knowledge work, and its vibes are much better.” <a href="https://x.com/SarahDiaChen/status/2074908276790087748">Another observer</a> cut to the heart of the matter: &quot;The smarts are not new here, GPT-Live hands hard questions to GPT-5.5. What is new is the feel: full-duplex voice that listens while it talks.&quot;</p><h2><b>New voice-specific safety tests reveal where the risks still live</b></h2><p>The <a href="https://deploymentsafety.openai.com/gpt-live">GPT-Live system card</a>, published alongside the announcement, reveals a safety strategy built around the particular risks of real-time voice interaction — a domain where the speed and intimacy of conversation create hazards that text-based chat does not.</p><p>OpenAI expanded its safety evaluations to include audio-native tests, using both real user voice samples (from those who opted in) and synthetically generated prompts targeting edge cases across categories like self-harm, sexual content, illicit behavior, emotional reliance, mental health, and hate speech.</p><p>On the synthetic evaluations — which OpenAI described as deliberately adversarial — GPT-Live-1 showed substantial improvements over Advanced Voice Mode. In illicit behavior, for instance, the safety score rose from 0.63 to 0.97. On self-harm, it climbed from 0.72 to 0.98. Hate speech achieved a perfect 1.00, up from 0.87.</p><p>On the production-prompt evaluations — which used real user audio and reflected more ambiguous, borderline scenarios — the picture was more mixed. GPT-Live-1 matched or improved on Advanced Voice Mode in most categories but showed a slight regression on emotional reliance (from 0.88 to 0.82), though OpenAI noted the change was not statistically significant.</p><p>The company built real-time safeguards that can intervene while the model is speaking — steering toward safer responses, surfacing crisis resources, or ending the voice conversation entirely in higher-risk situations. It also designed additional protections for teen users and adapted self-harm support flows for voice, including crisis helpline integration.</p><p>Perhaps most notably, OpenAI said it is &quot;rolling out longer-term measurement and post-launch monitoring focused on emotional reliance&quot; — an acknowledgment that the very naturalness GPT-Live strives for creates its own category of risk.</p><h2><b>Google, ByteDance, and Nvidia are already in the full-duplex race</b></h2><p>While OpenAI was refining its safety guardrails, its rivals were shipping full-duplex systems of their own. Google&#x27;s <a href="https://gemini.google/overview/gemini-live/">Gemini Live</a>, which supports full-duplex conversation alongside camera and screen sharing — capabilities GPT-Live notably lacks at launch — is already available in the Gemini app. Google released <a href="https://blog.google/innovation-and-ai/models-and-research/gemini-models/gemini-3-1-flash-live/">Gemini 3.1 Flash Live</a> in March as its highest-quality real-time audio model, targeting low-latency voice interactions for developers.</p><p>ByteDance launched <a href="https://seeduplex.io/">Seeduplex</a> in April, claiming to be the first production-scale full-duplex speech AI deployed at scale, inside its Doubao app. Seeduplex reported roughly a 50 percent reduction in false-response and false-interruption rates compared to ByteDance&#x27;s previous half-duplex system. And Nvidia&#x27;s <a href="https://research.nvidia.com/labs/adlr/personaplex/">PersonaPlex</a>, released in January, brought customizable voice and role control to full-duplex models, breaking what had been a constraint where natural-sounding models were locked into a single fixed voice.</p><p>The competitive picture is clear: full-duplex voice interaction is quickly becoming table stakes for consumer AI products, not a differentiator. OpenAI&#x27;s advantage lies in the scale of its existing user base, its integration with GPT-5.5&#x27;s reasoning capabilities, and the breadth of the ChatGPT ecosystem.</p><p>But the window in which any one company has a monopoly on natural-sounding voice AI has already closed. OpenAI also acknowledged several gaps. GPT-Live does not support voice with video or screen sharing at launch. Language support is limited, with the company noting that &quot;for certain languages, the model may have a non-native accent or gaps in fluency.&quot; And API access is not available on day one, meaning enterprise developers cannot yet build on GPT-Live directly — a constraint that will slow the model&#x27;s penetration into commercial voice-agent workflows where competitors like Google, ElevenLabs, and Deepgram already have developer-facing products.</p><h2><b>The end of the chat box may be closer than anyone expected</b></h2><p><a href="https://openai.com/index/introducing-gpt-live/">GPT-Live</a> is essentially OpenAI&#x27;s most significant bet yet on voice as the primary interface for AI — not just a convenience feature bolted onto a text chatbot, but a purpose-built interaction layer that sits between the user and the company&#x27;s most powerful models.</p><p>&quot;Over time, we believe this research will also unlock the ability to use voice for increasingly complex, longer-running, and more agentic work,&quot; OpenAI wrote. That ambition — using natural voice as the front end for autonomous AI agents that can perform multi-step tasks — is the logical endpoint of the full-duplex plus delegation architecture.</p><p>Imagine telling your phone to book a flight, negotiate with your insurance company, or debug a production server, all through a conversation that feels as natural as talking to an assistant who also happens to have the intelligence of a frontier AI model.</p><p>Two years ago, talking to ChatGPT meant dictating into a microphone and waiting nearly two seconds for a stilted reply. One year ago, it meant a smoother exchange that still felt like a polite, slightly awkward phone call with someone who insisted on waiting for you to finish every sentence. Today, it means something closer to a real conversation — imperfect, still constrained in some languages and missing video, but unmistakably closer. OpenAI once got into trouble for wanting to recreate the movie <i>Her</i>. With GPT-Live, the company may finally be reckoning with the harder question the film actually posed: not whether AI can sound human enough to talk to, but what happens to us when it does.</p>

Original reporting

Open original source

Related coverage

Read full article on VentureBeat

Get the AFBytes Brief

Major stories, AI-assisted analysis, and what to watch next. Free, monthly, unsubscribe anytime.