\n<\/p>\n
Today, Cerebras Systems is a public company that sells AI chips for inference<\/a> to giants like OpenAI and AWS. It held a blockbuster IPO on Thursday<\/a>, with both of its co-founders billionaires, and ended the week worth about $60 billion.<\/p>\n But in 2019, when it was three years old, it came dangerously close to failure \u2013 incinerating a shocking amount of money. It was trying to solve a technical problem no one in the semiconductor industry thought could be done.\u00a0<\/p>\n \u201cWe were spending about $8 million a month,\u201d founder CEO Andrew Feldman told TechCrunch of that period. \u201cAt this point, we had incinerated nearly $200 million trying to solve one technical problem.\u201d\u00a0<\/p>\n Every few weeks, Feldman was forced to make the painful walk of shame to the board meeting to report another failure and more money burned.\u00a0<\/p>\n But he had no choice. Without a solution, Cerebras was dead anyway. <\/p>\n It was founded with an idea that was simple on paper. The microprocessor industry had spent its entire 50+ years making CPUs faster and cheaper by cramming more transistors onto a silicon wafer and dicing wafers into ever tinier pieces.\u00a0But AI required so much compute power, many chips had to be strung together and then forced to communicate with each other. Cerebras\u2019 founders believed turning a whole, even bigger wafer into one giant, powerful chip, would work faster.\u00a0<\/p>\n The problem was, no one had ever successfully done this before, for any reason, AI or not. Orchestrating that many microscopic electronic components onto a larger, but still thin, surface introduced compounding engineering problems.\u00a0<\/p>\n Once Cerebras crossed the first threshold of designing the mega chip and then manufacturing it with TSMC, the team hit the real roadblock.\u00a0<\/p>\n They couldn\u2019t solve \u201cpackaging.\u201d This involves everything after manufacturing the silicon itself: adhering it to a motherboard, getting power to it, dealing with heating and cooling as well as the pipes that would deliver and return data, Feldman said.\u00a0<\/p>\n Cerebras\u2019 chips \u201cwere 58 times larger. We were using 40 times as much power as anybody had ever used,\u201d he said. There were no premade heat sinks. No vendors. No manufacturing partners. The brightest minds in microprocessor engineering had tried for decades to build such big, yet more dense chips, and failed.\u00a0<\/p>\n The Cerebras team was left with trial and error in which \u201cwe destroyed an enormous number of chips\u201d and an enormous amount of cash. But without functional packaging, the chip was useless.\u00a0<\/p>\n After exhaustive analysis of each failure, the team finally solved enough problems: how to cool it and move data around. In one instance, they had to invent their own machine that could bolt-in 40 screws simultaneously to secure the wafer to a board without cracking it.\u00a0<\/p>\n Feldman still remembers the day in July 2019 when it all, miraculously, worked.<\/p>\n They installed the packaged chip into a computer, turned it on and the entire founding team (pictured below) \u201cjust stood in the lab and stared at it,\u201d he said. \u201cWatching a computer run is about as exciting as watching paint dry. But there we were watching lights flashing on the computer, stunned that we’d solved this.\u201d\u00a0<\/p>\n \u201cThat was one of the greatest moments of my life,\u201d he said.\u00a0That’s significant, because this same founding team had previously built and sold a pioneering cloud server startup, SeaMicro, to AMD for $334 million in 2012.<\/a><\/p>\n The day the chip finally worked was also about two years after OpenAI had talked to Cerebras acquiring it, which Feldman confirmed to TechCrunch occurred like the publicly revealed emails<\/a> said it did.\u00a0<\/p>\n Those talks fell through amidst growing squabbling among the OpenAI founders, several of whom are angel investors in Cerebras.\u00a0<\/p>\n Today OpenAI is a customer and a partner, having loaned Cerebras $1 billion secured by warrants. Those warrants conditionally grant OpenAI about 33 million shares of Cerebras\u2019 stock, the S-1 discloses. (33 million shares are worth over $9 billion at Friday’s closing price of $279.)\u00a0<\/p>\n Interestingly, Cerebras also agreed to not sell its wares to specific OpenAI competitors as part of that loan deal. Feldman wouldn\u2019t confirm that the obvious company this involves: Anthropic. He did, however say that restriction is temporary.\u00a0<\/p>\n \u201cIt’s limited in time, and it was designed to make sure that we could get OpenAI the capacity,\u201d he said. <\/p>\n The truth was, Cerebras hasn\u2019t yet grown big enough to handle multiple fast-growing model makers anyway.\u00a0 He likened selling AI compute capacity to an all-you-can eat buffet. Instead of trying to stuff itself on all potential customers, \u201cWe’re going to work with part of the buffet only, and we’re going to get comfortable with that, before we attack the rest,\u201d he said.<\/p>\n<\/div>\n When you purchase through links in our articles, we may earn a small commission<\/a>. This doesn\u2019t affect our editorial independence.<\/em><\/p>\n