{"id":99537,"date":"2024-05-24T00:21:39","date_gmt":"2024-05-24T00:21:39","guid":{"rendered":"https:\/\/entertainment.runfyers.com\/index.php\/2024\/05\/24\/using-memes-social-media-users-have-become-red-teams-for-half-baked-ai-features-techcrunch\/"},"modified":"2024-05-24T00:21:39","modified_gmt":"2024-05-24T00:21:39","slug":"using-memes-social-media-users-have-become-red-teams-for-half-baked-ai-features-techcrunch","status":"publish","type":"post","link":"https:\/\/entertainment.runfyers.com\/index.php\/2024\/05\/24\/using-memes-social-media-users-have-become-red-teams-for-half-baked-ai-features-techcrunch\/","title":{"rendered":"Using memes, social media users have become red teams for half-baked AI features | TechCrunch"},"content":{"rendered":"<p> <br \/>\n<\/p>\n<div>\n<p id=\"speakable-summary\" class=\"wp-block-paragraph\">\u201cRunning with scissors is a cardio exercise that can increase your heart rate and require concentration and focus,\u201d says Google\u2019s new <a href=\"https:\/\/techcrunch.com\/2024\/05\/14\/google-is-adding-more-ai-to-its-search-results\/\" target=\"_blank\" rel=\"noopener\">AI search feature<\/a>. \u201cSome say it can also improve your pores and give you strength.\u201d<\/p>\n<p class=\"wp-block-paragraph\">Google\u2019s AI feature pulled this response from a website called <a href=\"https:\/\/littleoldladycomedy.com\/2022\/06\/24\/turns-out-running-with-scissors-is-good-exercise-if-you-dont-fall-and-poke-your-eyes-out\/\" target=\"_blank\" rel=\"noopener\">Little Old Lady Comedy<\/a>, which, as its name makes clear, is a comedy blog. But the gaffe is so ridiculous that it\u2019s been circulating on social media, along with other obviously incorrect AI overviews on Google. Effectively, everyday users are now red teaming these products on social media.<\/p>\n<p class=\"wp-block-paragraph\">In cybersecurity, some companies will hire \u201cred teams\u201d \u2013 ethical hackers \u2013 who attempt to breach their products as though they\u2019re bad actors. If a red team finds a vulnerability, then the company can fix it before the product ships. Google certainly conducted a form of red teaming before releasing an AI product on Google Search, which is <a href=\"https:\/\/blog.hubspot.com\/marketing\/google-search-statistics\" target=\"_blank\" rel=\"noopener\">estimated<\/a> to process trillions of queries per day.<\/p>\n<p class=\"wp-block-paragraph\">It\u2019s surprising, then, when a highly resourced company like Google still ships products with obvious flaws. That\u2019s why it\u2019s now become a meme to clown on the failures of AI products, especially in a time when AI is becoming more ubiquitous. We\u2019ve seen this with bad spelling on <a href=\"https:\/\/techcrunch.com\/2024\/03\/21\/why-is-ai-so-bad-at-spelling\/\" target=\"_blank\" rel=\"noopener\">ChatGPT<\/a>, video generators\u2019 failure to understand <a href=\"https:\/\/arstechnica.com\/information-technology\/2024\/02\/will-smith-parodies-viral-ai-generated-video-by-actually-eating-spaghetti\/\" target=\"_blank\" rel=\"noopener\">how humans eat spaghetti<\/a>, and <a href=\"https:\/\/gizmodo.com.au\/2024\/04\/the-most-embarrassing-blunders-from-elon-musks-attempt-at-ai-generated-news\/\" target=\"_blank\" rel=\"noopener\">Grok AI<\/a> news summaries on X that, like Google, don\u2019t understand satire. But these memes could actually serve as useful feedback for companies developing and testing AI.<\/p>\n<p class=\"wp-block-paragraph\">Despite the high-profile nature of these flaws, tech companies often downplay their impact.<\/p>\n<p class=\"wp-block-paragraph\">\u201cThe examples we\u2019ve seen are generally very uncommon queries, and aren\u2019t representative of most people\u2019s experiences,\u201d Google told TechCrunch in an emailed statement. \u201cWe conducted extensive testing before launching this new experience, and will use these isolated examples as we continue to refine our systems overall.\u201d<\/p>\n<p class=\"wp-block-paragraph\">Not all users see the same AI results, and by the time a particularly bad AI suggestion gets around, the issue has often already been rectified. In a more recent case that went viral, Google suggested that if you\u2019re making pizza but <a href=\"https:\/\/x.com\/petergyang\/status\/1793480607198323196\" target=\"_blank\">the cheese won\u2019t stick<\/a>, you could add about an eighth of a cup of glue to the sauce to \u201cgive it more tackiness.\u201d As it turned out, the AI is pulling this answer from <a href=\"https:\/\/x.com\/petergyang\/status\/1793480607198323196\" target=\"_blank\">an eleven-year-old Reddit comment<\/a> from a user named \u201cf\u2013\u2013smith.\u201d<\/p>\n<figure class=\"wp-block-embed is-type-rich is-provider-twitter wp-block-embed-twitter\">\n<div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"twitter-tweet\" data-width=\"500\" data-dnt=\"true\">\n<p lang=\"en\" dir=\"ltr\">Google AI overview suggests adding glue to get cheese to stick to pizza, and it turns out the source is an 11 year old Reddit comment from user F*cksmith \ud83d\ude02 <a href=\"https:\/\/t.co\/uDPAbsAKeO\" target=\"_blank\">pic.twitter.com\/uDPAbsAKeO<\/a><\/p>\n<p>\u2014 Peter Yang (@petergyang) <a href=\"https:\/\/twitter.com\/petergyang\/status\/1793480607198323196?ref_src=twsrc%5Etfw\" target=\"_blank\" rel=\"noopener\">May 23, 2024<\/a><\/p><\/blockquote>\n<\/div>\n<\/figure>\n<p class=\"wp-block-paragraph\">Beyond being an incredible blunder, it also signals that AI content deals may be overvalued. Google has a <a href=\"https:\/\/www.reuters.com\/technology\/reddit-ai-content-licensing-deal-with-google-sources-say-2024-02-22\/\" target=\"_blank\" rel=\"noopener\">$60 million contract<\/a> with Reddit to license its content for AI model training, for instance. Reddit signed a similar deal with <a href=\"https:\/\/techcrunch.com\/2024\/05\/16\/openai-inks-deal-to-train-ai-on-reddit-data\/\" target=\"_blank\" rel=\"noopener\">OpenAI<\/a> last week, and Automattic properties WordPress.org and Tumblr are <a href=\"https:\/\/www.404media.co\/tumblr-and-wordpress-to-sell-users-data-to-train-ai-tools\/\" target=\"_blank\" rel=\"noopener\">rumored<\/a> to be in talks to sell data to Midjourney and OpenAI.<\/p>\n<p class=\"wp-block-paragraph\">To Google\u2019s credit, a lot of the errors that are circulating on social media come from unconventional searches designed to trip up the AI. At least I hope no one is seriously searching for \u201chealth benefits of running with scissors.\u201d But some of these screw-ups are more serious. Science journalist Erin Ross <a href=\"https:\/\/x.com\/ErinEARoss\/status\/1792274270128894276\" target=\"_blank\">posted on X<\/a> that Google spit out incorrect information about what to do if you get a rattlesnake bite.<\/p>\n<p class=\"wp-block-paragraph\">Ross\u2019s post, which got over 13,000 likes, shows that AI recommended applying a tourniquet to the wound, cutting the wound and sucking out the venom. According to the <a href=\"https:\/\/www.fs.usda.gov\/Internet\/FSE_DOCUMENTS\/stelprdb5393596.pdf\" target=\"_blank\" rel=\"noopener\">U.S. Forest Service<\/a>, these are all things you should <em>not <\/em>do, should you get bitten. Meanwhile on Bluesky, the author T Kingfisher amplified a post that shows Google\u2019s Gemini <a href=\"https:\/\/bsky.app\/profile\/tkingfisher.bsky.social\/post\/3kqlvdjwn222p\" target=\"_blank\" rel=\"noopener\">misidentifying a poisonous mushroom<\/a> as a common white button mushroom \u2013 screenshots of the post have <a href=\"https:\/\/x.com\/deliprao\/status\/1793652235420713301\" target=\"_blank\">spread<\/a> to other platforms as a cautionary tale.<\/p>\n<figure class=\"wp-block-embed is-type-rich is-provider-twitter wp-block-embed-twitter\">\n<div class=\"wp-block-embed__wrapper\">\n<blockquote class=\"twitter-tweet\" data-width=\"500\" data-dnt=\"true\">\n<p lang=\"en\" dir=\"ltr\">Good ol\u2019 Google AI: telling you to do the exact things you *are not supposed to do* when bitten by a rattlesnake.<\/p>\n<p>From mushrooms to snakebites, AI content is genuinely dangerous. <a href=\"https:\/\/t.co\/UZXgBjsre9\" target=\"_blank\">pic.twitter.com\/UZXgBjsre9<\/a><\/p>\n<p>\u2014 ern. (@ErinEARoss) <a href=\"https:\/\/twitter.com\/ErinEARoss\/status\/1792274270128894276?ref_src=twsrc%5Etfw\" target=\"_blank\" rel=\"noopener\">May 19, 2024<\/a><\/p><\/blockquote>\n<\/div>\n<\/figure>\n<p class=\"wp-block-paragraph\">When a bad AI response goes viral, the AI could get more confused by the new content around the topic that comes about as a result. On Wednesday, New York Times reporter Aric Toler posted <a href=\"https:\/\/x.com\/AricToler\/status\/1793327028185247921\" target=\"_blank\">a screenshot on X <\/a>that shows a query asking if a dog has ever played in the NHL. The AI\u2019s response was yes \u2013 for some reason, the AI called the Calgary Flames player Martin Pospisil a dog. Now, when you make that same query, the AI pulls up an article from <a href=\"https:\/\/www.dailydot.com\/debug\/google-ai-search-dog-nfl\/\" target=\"_blank\" rel=\"noopener\">the Daily Dot<\/a> about how Google\u2019s AI keeps thinking that dogs are playing sports. The AI is being fed its own mistakes, poisoning it further.<\/p>\n<p class=\"wp-block-paragraph\">This is the inherent problem of training these large-scale AI models on the internet: sometimes, people on the internet lie. But just like how there\u2019s <a href=\"https:\/\/en.wikipedia.org\/wiki\/Air_Bud\" target=\"_blank\" rel=\"noopener\">no rule against a dog playing basketball<\/a>, there\u2019s unfortunately no rule against big tech companies shipping bad AI products.<\/p>\n<p class=\"wp-block-paragraph\">As the saying goes: garbage in, garbage out.<\/p>\n<\/div>\n<p><script async src=\"\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><br \/>\n<br \/><br \/>\n<br \/><a href=\"https:\/\/techcrunch.com\/2024\/05\/23\/using-memes-social-media-users-have-become-red-teams-for-half-baked-ai-features\/\" target=\"_blank\" rel=\"noopener\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u201cRunning with scissors is a cardio exercise that can increase your heart rate and require concentration and focus,\u201d says Google\u2019s new AI search feature. \u201cSome say it can also improve your pores and give you strength.\u201d Google\u2019s AI feature pulled this response from a website called Little Old Lady Comedy, which, as its name makes [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":99538,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":{"0":"post-99537","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tech"},"_links":{"self":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/99537","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/comments?post=99537"}],"version-history":[{"count":0,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/99537\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media\/99538"}],"wp:attachment":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media?parent=99537"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/categories?post=99537"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/tags?post=99537"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}