\n<\/p>\n
White House science advisor Michael Kratsios said that Moonshot, the Chinese company behind the Kimi K3, the largest available open-weight LLM, built its model by copying Anthropic\u2019s Fable LLM while using chips that aren\u2019t cleared for export to China.<\/p>\n
\u201cLarge-scale, covert industrial distillation aimed at stealing proprietary U.S. technology and undermining American research is unacceptable,\u201d Kratsios wrote<\/a>, amid reported discussions about banning Chinese open-weight models<\/a> that have roiled the AI sector. Moonshot did not respond to questions about its training process, and Kratsios did not share more details about the sources of his allegations.<\/p>\n Kratsios\u2019 tweet echoed comments from Treasury Secretary Scott Bessent that \u201cwe are finding watermarks of our U.S. large language models on many of the Chinese models, and that that\u2019s unacceptable.\u201d It\u2019s not clear what those watermarks consist of, and the Treasury Department did not respond to a query. <\/p>\n However, experts are skeptical that distillation\u2014the process of querying an LLM to determine its inner workings and copy its capabilities\u2014is responsible for the advanced capabilities that Kimi K3 displays.<\/p>\n \u201cI don\u2019t think you get a model this strong and this quickly on the heels of Fable doing strictly distillation,\u201d Braden Hancock, a researcher at the Laude Institute and co-founder of Snorkel AI, told TechCrunch. \u201cThere\u2019s just not even frankly time, right? Fable\u2019s only been publicly available since July 1st. You can\u2019t distill that much data, train a model, and release it in two weeks.\u201d<\/p>\n \u201cI\u2019ve been of the opinion that distillation has becoming less and less impactful over time as the Chinese models get closer to the frontier and the training regime shifts to [reinforcement learning],\u201d Nathan Lambert, an AI researcher at the Allen Institute for AI, said in a podcast<\/a> released yesterday. \u201c[I]f it were the case, everyone would be easily able to catch up to a GLM or to a K3 by using its data for distillation. But we have not, or we won\u2019t see this, from supervised fine-tuning alone.\u201d<\/p>\n Performing distillation requires a lab to systematically query its target model in order to generate data that can be used for post-training. Sometimes this explicitly involves asking the model to articulate its chain-of-thought to understand how it solves problems. Other times, the prompts and responses from a model are used to train a new model in a process called supervised fine-tuning, or SFT.<\/p>\n It\u2019s this fine-tuning process that can result in a model ostensibly created by a third party claiming that it is Claude. Fine tuning is where, in Lambert\u2019s view, the \u201cmodel picks up its manners.\u201d<\/p>\n But Lambert says that the benefits of SFT are becoming less important as models become more complex. To distill Fable-like capabilities would likely require reinforcement learning techniques. In many cases, that means having an agent of the larger model grade the smaller model\u2019s responses, and adjusting based on the grade.<\/p>\n The more advanced techniques also require more significant infrastructure. Large reinforcement learning runs can require tens of millions of agents. Using a frontier lab\u2019s API to do that \u201cwould be insanely expensive and potentially it would probably be a time bottleneck because these models are pretty slow and to be frank might not even give you a performance uplift.\u201d<\/p>\n It seems likely that previous frontier models might have contributed to Kimi; Anthropic publicly accused<\/a> Moonshot, DeepSeek and MiniMax of systematically distilling its models earlier this year. Anthropic said it discovered millions of exchanges between its models and users it identified at those companies through IP addresses and other meta data. Those queries were \u201cdistinct from normal usage patterns, reflecting deliberate capability extraction rather than legitimate use.\u201d Anthropic didn\u2019t respond to TechCrunch\u2019s queries about Fable distillation.<\/p>\n However, distillation is seen as common among AI companies, not just in China. Elon Musk testified<\/a> earlier this year that his company SpaceXAI distilled OpenAI models to develop Grok, and that the practice was common in the industry. The line between distillation and developing synthetic data sets, for example, can be fairly blurry.<\/p>\n \u201c[I]n general, Americans are understating the technical expertise of these Chinese teams,\u201d Hancock said. \u201cOne of the founders of Moonshot was a CMU PhD student. These are legitimate researchers and engineers doing solid work. \u2026if American models ground to a halt, I think China\u2019s progress would slow, but would still continue. They\u2019re not just riding coattails here.\u201d<\/p>\n It\u2019s also hard to disentangle distillation from the second part of Kratsios\u2019 comment \u2014 that Moonshot had obtained advanced Nvidia Chips, Grace Blackwell 300s, and also accessed GB300 equipped-servers in Thailand. Those chips are banned from export to China, but a black market exists, according to Sam Bresnick, a research fellow at Georgetown\u2019s Center for Security and Emerging Technology. In May, the founder of Supermicro, a US server builder, was indicted for smuggling advanced chips into China.<\/p>\n \u201cI am a proponent of know your customer laws for data centers across the world,\u201d Bresnick said. \u201cIf you are letting a company conduct huge training runs on your state-of-the-art hardware, there needs to be a reporting mechanism for who that company is and what they\u2019re doing.\u201d<\/p>\n President Joe Biden\u2019s Department of Commerce proposed<\/a> federal know-your-customer rules for data centers in 2024, but no further progress appears to have been made under Donald Trump. Exporters shipping advanced chips abroad, however, are supposed to ensure<\/a> they are only used for approved purposes. <\/p>\n<\/div>\n When you purchase through links in our articles, we may earn a small commission<\/a>. This doesn\u2019t affect our editorial independence.<\/em><\/p>\n