As winter descended on San Francisco in late 2022, OpenAI quietly pushed a new service dubbed ChatGPT live with a blog post<\/a> and a single tweet<\/a> from CEO Sam Altman. The team labeled it a \u201clow-key research preview\u201d \u2014 they had good reason to set expectations low.\u00a0<\/p>\n<\/div>\n \u201cIt couldn\u2019t even do arithmetic,\u201d Liam Fedus, OpenAI\u2019s head of post-training says. It was also prone to hallucinating or making things up, adds Christina Kim, a researcher on the mid-training team.<\/p>\n<\/div>\n Ultimately, ChatGPT would become anything but low-key.<\/p>\n<\/div>\n While the OpenAI researchers slept, users in Japan flooded ChatGPT\u2019s servers, crashing the site only hours after launch. That was just the beginning. <\/p>\n<\/div>\n \u201cThe dashboards at that time were just always red,\u201d recalls Kim. The launch coincided with NeurIPS, the world\u2019s premier AI conference, and soon ChatGPT was the only thing anyone there could talk about. ChatGPT\u2019s error page \u2014 \u201cChatGPT is at capacity right now\u201d \u2014 would become a familiar sight.<\/p>\n<\/div>\n \u201cWe had the initial launch meeting in this small room, and it wasn\u2019t like the world just lit on fire all of a sudden,\u201d Fedus says during a recent interview from OpenAI\u2019s headquarters. \u201cWe\u2019re like, \u2018Okay, cool. I guess it\u2019s out there now.\u2019 But it was the next day when we realized \u2014 oh, wait, this is big.\u201d<\/p>\n<\/div>\n \u201cThe dashboards at that time were just always red.\u201d<\/p>\n<\/div>\n<\/div>\n Two years later, ChatGPT still hasn\u2019t cracked advanced arithmetic or become factually reliable. It hasn\u2019t mattered. The chatbot has evolved from a prototype to a $4 billion revenue engine with 300 million weekly active users. It has shaken the foundations of the tech industry, even as OpenAI loses money (and cofounders) hand over fist while competitors like Anthropic threaten its lead.<\/p>\n<\/div>\n Whether used as praise or pejorative<\/a>, \u201cChatGPT\u201d has become almost synonymous with generative AI. Over a series of recent video calls, I sat down with Fedus, Kim, ChatGPT head of product Nick Turley, and ChatGPT engineering lead Sulman Choudhry to talk about ChatGPT\u2019s origins and where it\u2019s going next.<\/p>\n<\/div>\n ChatGPT was effectively born in December 2021 with an OpenAI project dubbed<\/a> WebGPT: an AI tool that could search the internet and write answers. The team took inspiration from WebGPT\u2019s conversational interface and began plugging a similar interface into GPT-3.5, a successor to the GPT-3 text model released in 2020. They gave it the clunky name \u201cChat with GPT-3.5\u201d until, in what Turley recalls as a split-second decision, they simplified it to ChatGPT.\u00a0<\/p>\n<\/div>\n The name could have been the even more straightforward \u201cChat,\u201d and in retrospect, he thinks perhaps it should have been. \u201cThe entire world got used to this odd, weird name, we\u2019re probably stuck with it. But obviously, knowing what I know now, I wish we picked a slightly easier to pronounce name,\u201d he says. (It was recently revealed<\/a> that OpenAI purchased the domain chat.com for more than $10 million of cash and stock in mid-2023.)<\/p>\n<\/div>\n As the team discovered the model\u2019s obvious limitations, they debated whether to narrow its focus by\u00a0launching a tool for help with meetings, writing, or coding. But OpenAI cofounder John Schulman (who has since left<\/a> for Anthropic) advocated for keeping the focus broad. <\/p>\n<\/div>\n The team describes it as a risky bet at the time; chatbots were viewed as an unremarkable backwater of machine learning, they thought, with no successful precedents. Adding to their concerns, Facebook\u2019s Galactica AI bot had just spectacularly flamed out<\/a> and been pulled offline after generating false research.<\/p>\n<\/div>\n The team grappled with timing. GPT-4 was already in development with advanced features like Code Interpreter and web browsing, so it would make sense to wait to release ChatGPT atop the more capable model. Kim and Fedus also recall people wanting to wait and launch something more polished, especially after seeing other companies\u2019 undercooked bots fail. <\/p>\n<\/div>\n Despite early concerns about chatbots being a dead end, The New York Times<\/em> has reported<\/a> that other team members worried competitors would beat OpenAI to market with a fresh wave of bots. The deciding vote was Schulman, Fedus and Kim say. He pushed for an early release, alongside Altman, both believing it was important to get AI into peoples\u2019 hands quickly.<\/p>\n<\/div>\n OpenAI had demoed a chatbot<\/a> at Microsoft Build earlier that year and generated virtually no buzz. On top of that, many of ChatGPT\u2019s early users didn\u2019t seem to be actually using<\/em> it that much. The team shared their prototype with about 50 friends and family members. Turley \u201cpersonally emailed every single one of them\u201d every day to check in. While Fedus couldn\u2019t recall exact figures, he recalls that about 10 percent of that early test group used it every day.<\/p>\n<\/div>\n Image: Cath Virginia \/ The Verge, Getty Images<\/cite><\/p>\n<\/div>\n<\/div>\n Later, the team would see this as an indication they\u2019d created something with potential staying power. <\/p>\n<\/div>\n \u201cWe had two friends who basically were on it from the start of their work day \u2014 and they were founders,\u201d Kim recalls. \u201cThey were on it basically for 12 to 16 hours a day, just talking to it all day.\u201d With just two weeks before the end of November, Schulman made the final call: OpenAI would launch ChatGPT on the last day of that month.<\/p>\n<\/div>\n The team canceled their Thanksgiving plans and began a two-week sprint to public release. Much of the system was built at this point, Kim says, but its security vulnerabilities were untested. So they focused heavily on red teaming, or stress testing the system for potential safety problems.\u00a0<\/p>\n<\/div>\n \u201cIf I had known it was going to be a big deal, I would certainly not want to ship it right before a winter holiday week before we were all going to go home,\u201d Turley says. \u201cI remember working very hard, but I also remember thinking, \u2018Okay, let\u2019s get this thing out, and then we\u2019ll come back after the holiday to look at the learnings, to see what people want out of an AI assistant.\u2019\u201d<\/p>\n<\/div>\n In an internal Slack poll, OpenAI employees guessed how many users they would get. Most predictions ranged from a mere 10,000 to 50,000. When someone suggested it might reach a million users, others jumped in to say that was wildly optimistic.<\/p>\n<\/div>\n On launch day, they realized they\u2019d all been incredibly wrong.<\/p>\n<\/div>\n After Japan crashed their servers, and red dashboards and error messages abounded, the team was anxiously picking up the pieces and refreshing Twitter to gauge public reaction, Kim says. They believed the reaction to ChatGPT could only go one of two ways: total indifference or active contempt. They worried people might discover problematic ways to use it (like attempting to jailbreak it), and the uncertainty of how the public would receive their creation kept them in a state of nervous anticipation.<\/p>\n<\/div>\n The launch was met with mixed emotions. ChatGPT quickly started facing criticism over accuracy issues and bias. Many schools ran to immediately ban it over cheating concerns. Some users on Reddit<\/a> likened it to the early days of Google (and were shocked it was free). For its part, Google dubbed<\/a> the chatbot a \u201ccode red\u201d threat. <\/p>\n<\/div>\n OpenAI would wind up surpassing its most ambitious 1-million-user target within five days of launch. Two months after its debut, ChatGPT garnered more than 30 million users.<\/p>\n<\/div>\n When someone suggested it might reach a million users, others jumped in to say that was wildly optimistic.<\/p>\n<\/div>\n<\/div>\n Within weeks of ChatGPT\u2019s November 30th launch, the team started rolling out updates incorporating user feedback (like its tendency to give overly verbose answers). The initial chaos had settled, user numbers were still climbing, and the team had a sobering realization: if they wanted to keep this momentum, things would have to change. The small group that launched a \u201clow-key research preview\u201d \u2014 a term that would become a running joke at OpenAI \u2014 would need to get a lot bigger.<\/p>\n<\/div>\n Over the coming months and years, ChatGPT\u2019s team would grow enormously and shift priorities \u2014 sometimes to the chagrin of many early staffers. Top researcher Jan Leike, who played a crucial role in refining ChatGPT\u2019s conversational abilities and ensuring its outputs aligned with user expectations, quit this year<\/a> to join Anthropic after claiming that \u201csafety culture and processes have taken a backseat to shiny products\u201d at OpenAI.<\/p>\n<\/div>\n These days, OpenAI is focused on figuring out what the future of ChatGPT looks like. <\/p>\n<\/div>\n \u201cI\u2019d be very surprised if a year from now this thing still looks like a chatbot,\u201d Turley says, adding that current chat-based interactions would soon feel as outdated as \u201990s instant messaging. \u201cWe\u2019ve gotten pretty sidetracked by just making the chatbot great, but really, it\u2019s not what we meant to build. We meant to build something much more useful than that.\u201d<\/p>\n<\/div>\n I talk with Turley over a video call as he sits in a vast conference room in OpenAI\u2019s San Francisco headquarters that epitomizes the company\u2019s transformation. The office is all sweeping curves and polished minimalism, a far cry from its original office that was often described as a drab, historic warehouse<\/a>. <\/p>\n<\/div>\n With roughly 2,000 employees, OpenAI has evolved from a scrappy research lab into a $150 billion tech powerhouse. The team is spread across numerous projects, including building underlying foundation models and developing non-text tools like the video generator, Sora. ChatGPT is still OpenAI\u2019s highest-profile product by far. Its popularity has come with a lot of headaches.\u00a0<\/p>\n<\/div>\n \u201cI\u2019d be very surprised if a year from now this thing still looks like a chatbot\u201d<\/p>\n<\/div>\n<\/div>\n ChatGPT still spins elaborate lies with unwavering confidence, but now they\u2019re being cited in court filings<\/a> and political discourse<\/a>. It has allowed for an impressive amount of experimentation and creativity, but some of its most distinctive use cases turned out to be spam, scams, and AI-written college term papers. <\/p>\n<\/div>\n While some publications (include The Verge<\/em>\u2019s parent company, Vox Media<\/em>) are choosing to partner with OpenAI<\/a>, others like The New York Times<\/em> are opting to sue it for copyright infringement<\/a>. And OpenAI is burning through cash at a staggering rate<\/a> to keep the lights on.<\/p>\n<\/div>\n Turley acknowledges that ChatGPT\u2019s hallucinations are still a problem. \u201cOur early adopters were very comfortable with the limitations of ChatGPT,\u201d he says. \u201cIt\u2019s okay that you\u2019re going to double check what it said. You\u2019re going to know how to prompt around it. But the vast majority of the world, they\u2019re not engineers, and they shouldn\u2019t have to be. They should just use this thing and rely on it like any other tool, and we\u2019re not there yet.\u201d<\/p>\n<\/div>\n Accuracy is one of the ChatGPT team\u2019s three focus areas for 2025. The others are speed and presentation (i.e., aesthetics). <\/p>\n<\/div>\n \u201cI think we have a long way to go in making ChatGPT more accurate and better at citing its sources and iterating on the quality of this product,\u201d Turley says.<\/p>\n<\/div>\n OpenAI is also still figuring out how to monetize ChatGPT. Despite deploying increasingly powerful and costly AI models, the company has maintained a limited free tier and a $20 monthly ChatGPT Plus service since February 2023. <\/p>\n<\/div>\n When I ask Turley about rumors of<\/a> a future $2,000 subscription, or if advertising will be baked into ChatGPT, he says there is \u201cno current plan to raise prices.\u201d As for ads: \u201cWe don\u2019t care about how much time you spend on ChatGPT.\u201d\u00a0<\/p>\n<\/div>\n \u201cThey should just use this thing and rely on it like any other tool, and we\u2019re not there yet.\u201d<\/p>\n<\/div>\n<\/div>\n \u201cI\u2019m really proud of the fact that we have incentives that are incredibly aligned with our users,\u201d he says. Those who \u201cuse our product a lot pay us money, which is a very, very, upfront and direct transaction. I\u2019m proud of that. Maybe we\u2019ll have a technology that\u2019s much more expensive to serve and we\u2019re going to have to rethink that model. You gotta remain humble about where the technology is going to go.\u201d<\/p>\n<\/div>\n Only days after Turley tells me this, ChatGPT did get a new $200 price tag<\/a> for a pro tier that includes access to a specialized reasoning model. Its main $20 Plus tier is sticking around but it\u2019s clearly not the ceiling for what OpenAI thinks people will pay.<\/p>\n<\/div>\n ChatGPT and other OpenAI services require vast amounts of computing power and data storage to keep its services running smoothly. On top of the user base OpenAI has gained through its own products, it\u2019s poised to reach millions of more people through an Apple partnership<\/a> that integrates ChatGPT with iOS and macOS. <\/p>\n<\/div>\n That\u2019s a lot of infrastructure pressure for a relatively young tech company, says ChatGPT engineering lead Sulman Choudhry. \u201cJust keeping it up and running is a very, very big feat,\u201d he says. People love features like ChatGPT\u2019s advanced voice mode. But scaling limitations mean there\u2019s often a significant gap between the the technology\u2019s capabilities and what people can experience. \u201cThere\u2019s a very, very big delta there, and that delta is sort of how you scale the technology and how you scale infrastructure.\u201d<\/p>\n<\/div>\n Even as OpenAI grapples with these problems, it\u2019s trying to work itself deeper into users\u2019 lives. The company is racing to build agents, or AI tools that can perform complex, multistep tasks autonomously. In the AI world, these are called tasks with a longer \u201ctime horizon,\u201d requiring the AI to maintain coherence over a longer period while handling multiple steps. For instance, earlier this year<\/a> at the company\u2019s Dev Day conference, OpenAI showcased AI agents that could make phone calls to place food orders and make hotel reservations in multiple languages.<\/p>\n<\/div>\n For Turley and others, this is where the stakes will get particularly steep. Agents could make AI far more useful by moving what it can do outside the chatbot interface. The shift could also grant these tools an alarming level of access to the rest of your digital life. <\/p>\n<\/div>\n \u201cI\u2019m really excited to see where things go in a more agentic direction with AI,\u201d Kim tells me. \u201cRight now, you go to the model with your question but I\u2019m excited to see the model more integrated into your life and doing things proactively, and taking actions on your behalf\u201d<\/p>\n<\/div>\n The goal of ChatGPT isn\u2019t to be just a chatbot, says Fedus. As it exists today, ChatGPT is \u201cpretty constrained\u201d by its interface and compute. He says the goal is to create an entity that you can talk to, call, and trust to work for you. Fedus thinks systems like OpenAI\u2019s \u201creasoning\u201d line of models, which create a trail of checkable steps explaining their logic, could make it more reliable for these kinds of tasks.<\/p>\n<\/div>\n Turley says that, contrary to some reports<\/a>, \u201cI don\u2019t think there\u2019s going to be such a thing as an OpenAI agent.\u201d What you will see is \u201cincreasingly agentic functionality inside of ChatGPT,\u201d though. \u201cOur focus is going to be to release this stuff as gradually as possible. The last thing I want is a big bang release where this stuff can suddenly go out and do things over hours of time with all your stuff.\u201d<\/p>\n<\/div>\n \u201cThe last thing I want is a big bang release\u201d<\/p>\n<\/div>\n<\/div>\n By ChatGPT\u2019s third anniversary next year, OpenAI will probably look a lot different than it does today. The company will likely raise billions more dollars in 2025, release its next big \u201cOrion\u201d model, face growing competition, and have to navigate the complexity of a new US president and his AI czar<\/a>. <\/p>\n<\/div>\n Turley hopes 2024\u2019s version of ChatGPT will soon feel as quaint as AOL Instant Messenger. A year from now, we\u2019ll probably laugh at how basic it was, he says. \u201cRemember when all we could do was ask it questions?\u201d<\/p>\n<\/div>\n<\/div>\nA \u201cweird\u201d name and a scrappy start<\/h3>\n<\/p>\n
Increasingly powerful and expensive\u00a0<\/h3>\n<\/p>\n