recently claimed<\/a> that it\u2019s turning its aim from AGI to superintelligence.) Absent \u201csignificant architectural innovation,\u201d the DeepMind authors aren\u2019t convinced that superintelligent systems will emerge soon \u2014 if ever. <\/p>\nThe paper does find it plausible, though, that current paradigms will enable \u201crecursive AI improvement\u201d: a positive feedback loop where AI conducts its own AI research to create more sophisticated AI systems. And this could be incredibly dangerous, assert the authors.<\/p>\n
At a high level, the paper proposes and advocates for the development of techniques to block bad actors\u2019 access to hypothetical AGI, improve the understanding of AI systems\u2019 actions, and \u201charden\u201d the environments in which AI can act. It acknowledges that many of the techniques are nascent and have \u201copen research problems,\u201d but cautions against ignoring the safety challenges possibly on the horizon. <\/p>\n
\u201cThe transformative nature of AGI has the potential for both incredible benefits as well as severe harms,\u201d the authors write. \u201cAs a result, to build AGI responsibly, it is critical for frontier AI developers to proactively plan to mitigate severe harms.\u201d<\/p>\n
Some experts disagree with the paper\u2019s premises, however. <\/p>\n
Heidy\u00a0Khlaaf, chief AI scientist at the nonprofit AI Now Institute, told TechCrunch that she thinks the concept of AGI is too ill-defined to be \u201crigorously evaluated scientifically.\u201d Another AI researcher, Matthew Guzdial, an assistant professor at the University of Alberta, said that he doesn\u2019t believe recursive AI improvement is realistic at present. <\/p>\n
\u201c[Recursive improvement] is the basis for the intelligence singularity arguments,\u201d Guzdial told TechCrunch, \u201cbut we\u2019ve never seen any evidence for it working.\u201d<\/p>\n
Sandra Wachter, a researcher studying tech and regulation at Oxford, argues that a more realistic concern is AI reinforcing itself with \u201cinaccurate outputs.\u201d <\/p>\n
\u201cWith the proliferation of generative AI outputs on the internet and the gradual replacement of authentic data, models are now learning from their own outputs that are riddled with mistruths, or hallucinations,\u201d she told TechCrunch. \u201cAt this point, chatbots are predominantly used for search and truth-finding purposes. That means we are constantly at risk of being fed mistruths and believing them because they are presented in very convincing ways.\u201d<\/p>\n
Comprehensive as it may be, DeepMind\u2019s paper seems unlikely to settle the debates over just how realistic AGI is \u2014 and the areas of AI safety in most urgent need of attention.<\/p>\n<\/div>\n
\n
Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Google DeepMind on Wednesday published an exhaustive paper on its safety approach to AGI, roughly defined as AI that can accomplish any task a human can. AGI is a bit of a controversial subject in the AI field, with naysayers suggesting that it\u2019s little more than a pipe dream. Others, including major AI labs like […]<\/p>\n","protected":false},"author":1,"featured_media":159749,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":{"0":"post-159748","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tech"},"_links":{"self":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/159748","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/comments?post=159748"}],"version-history":[{"count":0,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/159748\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media\/159749"}],"wp:attachment":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media?parent=159748"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/categories?post=159748"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/tags?post=159748"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}