{"id":75176,"date":"2024-02-12T00:38:02","date_gmt":"2024-02-12T00:38:02","guid":{"rendered":"https:\/\/entertainment.runfyers.com\/index.php\/2024\/02\/12\/googles-and-microsofts-chatbots-are-making-up-super-bowl-stats-techcrunch\/"},"modified":"2024-02-12T00:38:02","modified_gmt":"2024-02-12T00:38:02","slug":"googles-and-microsofts-chatbots-are-making-up-super-bowl-stats-techcrunch","status":"publish","type":"post","link":"https:\/\/entertainment.runfyers.com\/index.php\/2024\/02\/12\/googles-and-microsofts-chatbots-are-making-up-super-bowl-stats-techcrunch\/","title":{"rendered":"Google’s and Microsoft’s chatbots are making up Super Bowl stats | TechCrunch"},"content":{"rendered":"


\n<\/p>\n

\n
\n\t\t\t\n\t\t<\/div>\n<\/p><\/div>\n
\n

If you needed more evidence that GenAI is prone to making stuff up, Google\u2019s Gemini<\/a> chatbot, formerly Bard<\/a>, thinks that the 2024 Super Bowl already happened. It even has the (fictional) statistics to back it up.<\/p>\n

Per a Reddit thread<\/a>, Gemini, powered by Google\u2019s GenAI models of the same name<\/a>, is answering questions about Super Bowl LVIII as if the game wrapped up yesterday \u2014 or weeks before. Like many bookmakers, it seems to favor the Chiefs over the 49ers (sorry, San Francisco fans).<\/p>\n

Gemini embellishes pretty creatively, in at least one case giving a player stats breakdown suggesting Kansas Chief quarterback Patrick Mahomes ran 286 yards for two touchdowns and an interception versus Brock Purdy\u2019s 253 running yards and one touchdown.<\/p>\n

\"Gemini<\/p>\n

Image Credits:<\/strong> \/r\/smellymonster (opens in a new window)<\/span><\/a><\/p>\n<\/div>\n

It\u2019s not just Gemini. Microsoft\u2019s Copilot<\/a> chatbot, too, insists the game ended and provides erroneous citations to back up the claim. But \u2014 perhaps reflecting a San Francisco bias! \u2014 it says the 49ers, not the Chiefs, emerged victorious \u201cwith a final score of 24-21.\u201d<\/p>\n

\"Copilot<\/p>\n

Image Credits: <\/strong>Kyle Wiggers \/ TechCrunch<\/p>\n<\/div>\n

Copilot<\/a> is powered by a GenAI model similar, if not identical, to the model underpinning OpenAI\u2019s ChatGPT (GPT-4<\/a>). But in my testing, ChatGPT was loath to make the same mistake.<\/p>\n

\"ChatGPT<\/p>\n

Image Credits:<\/strong> Kyle Wiggers \/ TechCrunch<\/p>\n<\/div>\n

It\u2019s all rather silly \u2014 and possibly resolved by now, given that this reporter had no luck replicating the Gemini responses in the Reddit thread. (I\u2019d be shocked if Microsoft wasn\u2019t working on a fix as well.) But it also illustrates the major limitations of today\u2019s GenAI \u2014 and the dangers of placing too much trust in it.<\/p>\n

GenAI models have no real intelligence<\/a>. Fed an enormous number of examples usually sourced from the public web, AI models learn how likely data (e.g. text) is to occur based on patterns, including the context of any surrounding data.<\/p>\n

This probability-based approach works remarkably well at scale. But while the range of words and their probabilities are likely<\/em> to result in text that makes sense, it\u2019s far from certain. LLMs can generate something that\u2019s grammatically correct but nonsensical, for instance \u2014 like the claim about the Golden Gate. Or they can spout mistruths, propagating inaccuracies in their training data.\u00a0<\/span><\/p>\n

\n

It\u2019s not malicious on the LLMs\u2019 part. They don\u2019t have malice, and the concepts of true and false are meaningless to them. They\u2019ve simply learned to associate certain words or phrases with certain concepts, even if those associations aren\u2019t accurate.<\/p>\n

Hence Gemini\u2019s and Copilot\u2019s Super Bowl falsehoods.<\/p>\n

Google and Microsoft, like most GenAI vendors, readily acknowledge that their GenAI apps aren\u2019t perfect and are, in fact, prone to making mistakes. But these acknowledgements come in the form of small print I\u2019d argue could easily be missed.<\/p>\n<\/div>\n

Super Bowl disinformation certainly isn\u2019t the most harmful example of GenAI going off the rails. That distinction probably lies with endorsing<\/a> torture, reinforcing<\/a> ethnic and racial stereotypes or writing convincingly<\/a> about conspiracy theories. It is, however, a useful reminder to double-check statements from GenAI bots. There\u2019s a decent chance they\u2019re not true.<\/span><\/p>\n<\/p><\/div>\n


\n
Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"

If you needed more evidence that GenAI is prone to making stuff up, Google\u2019s Gemini chatbot, formerly Bard, thinks that the 2024 Super Bowl already happened. It even has the (fictional) statistics to back it up. Per a Reddit thread, Gemini, powered by Google\u2019s GenAI models of the same name, is answering questions about Super […]<\/p>\n","protected":false},"author":1,"featured_media":75177,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":{"0":"post-75176","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tech"},"_links":{"self":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/75176","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/comments?post=75176"}],"version-history":[{"count":0,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/75176\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media\/75177"}],"wp:attachment":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media?parent=75176"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/categories?post=75176"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/tags?post=75176"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}