{"id":83522,"date":"2024-03-18T03:53:03","date_gmt":"2024-03-18T03:53:03","guid":{"rendered":"https:\/\/entertainment.runfyers.com\/index.php\/2024\/03\/18\/xai-open-sources-base-model-of-grok-but-without-any-training-code-techcrunch\/"},"modified":"2024-03-18T03:53:03","modified_gmt":"2024-03-18T03:53:03","slug":"xai-open-sources-base-model-of-grok-but-without-any-training-code-techcrunch","status":"publish","type":"post","link":"https:\/\/entertainment.runfyers.com\/index.php\/2024\/03\/18\/xai-open-sources-base-model-of-grok-but-without-any-training-code-techcrunch\/","title":{"rendered":"xAI open-sources base model of Grok, but without any training code | TechCrunch"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div id=\"\">\n<div class=\"article__featured-image-wrapper breakout\">\n\t\t\t\n\t\t<\/div>\n<\/p><\/div>\n<div>\n<p id=\"speakable-summary\">Elon Musk\u2019s xAI has open-sourced the base code of Grok AI model, but without any training code. The company described it as the \u201c314 billion parameter Mixture-of-Expert model\u201d <a href=\"https:\/\/www.theverge.com\/24080217\/elon-musk-xai-fundraising-grok-ai\" target=\"_blank\" rel=\"noopener\">on GitHub<\/a>.<\/p>\n<p>In a blog post, xAI said that the model wasn\u2019t tuned for any particular application such as using it for conversations. The company noted that Grok-1 was trained on a \u201ccustom\u201d stack without specifying details. The model is licensed under <a href=\"https:\/\/github.com\/xai-org\/grok-1\/blob\/main\/LICENSE.txt\" target=\"_blank\" rel=\"noreferrer noopener\">Apache License 2.0<\/a>, which permits commercial use cases.<\/p>\n<p>Last week, Musk noted on X that xAI intended to <a href=\"https:\/\/techcrunch.com\/2024\/03\/11\/elon-musk-says-xai-will-open-source-grok-this-week\/\" target=\"_blank\" rel=\"noopener\">open-source the Grok model this week<\/a>. The company released <a href=\"https:\/\/techcrunch.com\/2023\/11\/22\/elon-musk-says-xais-chatbot-grok-will-launch-to-x-premium-subscribers-next-week\/\" target=\"_blank\" rel=\"noopener\">Grok in a chatbot form last year<\/a>, accessible to Premium+ users of X social network. Notably, the chatbot could access some of the X data, but the open-source model doesn\u2019t include connections to the social network.<\/p>\n<p>Many notable companies have open-sourced some of their AI models including Meta\u2019s LLaMa, Mistral, Falcon, and AI2. In February, Google also released two new open models called <a href=\"https:\/\/techcrunch.com\/2024\/02\/21\/google-launches-two-new-open-llms\/\" target=\"_blank\" rel=\"noopener\">Gemma2B and Gemma7B<\/a>.<\/p>\n<p>Some AI-powered tool makers are already talking about using Grok in their solutions. Perplexity CEO Arvind Srinivas posted on X that the company will fine-tune Grok for conversational search and make it available to Pro users.<\/p>\n<div class=\"embed breakout embed-oembed embed--twitter\">\n<blockquote class=\"twitter-tweet\" data-width=\"550\" data-dnt=\"true\">\n<p lang=\"en\" dir=\"ltr\">Yep, thanks to <a href=\"https:\/\/twitter.com\/elonmusk?ref_src=twsrc%5Etfw\" target=\"_blank\" rel=\"noopener\">@elonmusk<\/a> and xAI team for open-sourcing the base model for Grok. We will fine-tune it for conversational search and optimize the inference, and bring it up for all Pro users! <a href=\"https:\/\/t.co\/CGn6cIoivT\" target=\"_blank\">https:\/\/t.co\/CGn6cIoivT<\/a><\/p>\n<p>\u2014 Aravind Srinivas (@AravSrinivas) <a href=\"https:\/\/twitter.com\/AravSrinivas\/status\/1769485603622867394?ref_src=twsrc%5Etfw\" target=\"_blank\" rel=\"noopener\">March 17, 2024<\/a><\/p>\n<\/blockquote>\n<\/div>\n<p>Musk has been in a legal battle with OpenAI and sued <a href=\"https:\/\/techcrunch.com\/2024\/03\/01\/elon-musk-openai-sam-altman-court\/\" target=\"_blank\" rel=\"noopener\">the company earlier this month over the \u201cbetrayal\u201d of the nonprofit AI goal<\/a>. Since then, he has called out OpenAI and Sam Altman on X <a href=\"https:\/\/twitter.com\/elonmusk\/status\/1767110461772706062\" target=\"_blank\" rel=\"noopener\">multiple<\/a> <a href=\"https:\/\/x.com\/elonmusk\/status\/1769447665723470236?s=20\" target=\"_blank\">times<\/a>.<\/p>\n<\/p><\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><br \/>\n<br \/><br \/>\n<br \/><a href=\"https:\/\/techcrunch.com\/2024\/03\/17\/xai-open-sources-base-model-of-grok-but-without-any-training-code\/\" target=\"_blank\" rel=\"noopener\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Elon Musk\u2019s xAI has open-sourced the base code of Grok AI model, but without any training code. The company described it as the \u201c314 billion parameter Mixture-of-Expert model\u201d on GitHub. In a blog post, xAI said that the model wasn\u2019t tuned for any particular application such as using it for conversations. The company noted that [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":83523,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":{"0":"post-83522","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tech"},"_links":{"self":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/83522","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/comments?post=83522"}],"version-history":[{"count":0,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/83522\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media\/83523"}],"wp:attachment":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media?parent=83522"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/categories?post=83522"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/tags?post=83522"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}