\n<\/p>\n
X.ai, Elon Musk\u2019s AI startup, has revealed its latest generative AI model, Grok-1.5. Set to power social network X\u2019s Grok chatbot in the not-to-distant future (\u201cin the coming days,\u201d X.ai writes in a blog post<\/a>), Grok-1.5 appears to be an upgrade over its predecessor, Grok-1 \u2014 at least judging by the benchmark results and specifications X published.<\/p>\n Grok 1.5 benefits from \u201cimproved reasoning,\u201d according to X.ai, particularly where it concerns coding and math-related tasks. The model more than doubles Grok-1\u2019s score on a popular mathematics benchmark, MATH, and scores over ten percentage points better on the HumanEval test of programming language generation and problem-solving abilities.<\/p>\n Of course, it\u2019s difficult to predict how those results will translate in actual usage. As we recently wrote, commonly-used AI benchmarks, which measure things as esoteric as performance on graduate-level chemistry exam questions, do a poor job of capturing how the average person interacts with models today.<\/p>\n One improvement that should<\/em> lead to clear gains is the amount of context Grok-1.5 can take in compared to Grok-1.<\/p>\n Grok-1.5 has a 128,000-token context \u2014 \u201ctokens\u201d referring to bits of raw text (e.g., the word \u201cfantastic\u201d split into \u201cfan,\u201d \u201ctas\u201d and \u201ctic\u201d). Context, or context window, refers to input data (in this case, text) that a model considers before generating output (more text). Models with small context windows tend to forget the content of even very recent conversations, while models with larger contexts avoid this pitfall \u2014 and, as an added benefit, better grasp the flow of data they take in.<\/p>\n \u201c[Grok-1.5 can] utilize information from substantially longer documents,\u201d X.ai writes in the aforementioned blog post. \u201cFurthermore, the model can handle longer and more complex prompts while still maintaining its instruction-following capability as its context window expands.\u201d<\/p>\n Grok-1.5 will soon be available to early testers on X, X.ai says, accompanied by \u201cseveral new features.\u201d Musk has previously hinted at summarizing threads and replies and suggesting content for posts.<\/p>\n What sets X.ai\u2019s Grok models apart from other generative AI models is that they\u00a0respond to questions about topics that are typically off-limits to other models<\/a>, like conspiracies and controversial political ideas. The models also answer questions with \u201ca rebellious streak,\u201d as Musk has described it. It\u2019s unclear what changes, if any, Grok-1.5 brings in these areas.<\/p>\n The announcement of Grok-1.5 comes after X.ai open sourced<\/a> Grok-1, albeit without the code necessary to fine-tune or further train it. More recently, Musk said that more users on X \u2014 specifically those paying for X\u2019s $8-per-month Premium plan \u2014 would gain access to Grok, the chatbot, which was previously only available to $16-per-month X Premium+ customers.<\/p>\n<\/p><\/div>\n