\n<\/p>\n
A third-party research institute that Anthropic partnered with to test one of its new flagship AI models, Claude Opus 4, recommended against deploying an early version of the model due to its tendency to \u201cscheme\u201d and deceive.<\/p>\n
According to a safety report<\/a> Anthropic published Thursday, the institute, Apollo Research, conducted tests to see in which contexts Opus 4 might try to behave in certain undesirable ways. Apollo found that Opus 4 appeared to be much more proactive in its \u201csubversion attempts\u201d than past models and that it \u201csometimes double[d] down on its deception\u201d when asked follow-up questions.<\/p>\n \u201c[W]e find that, in situations where strategic deception is instrumentally useful, [the early Claude Opus 4 snapshot] schemes and deceives at such high rates that we advise against deploying this model either internally or externally,\u201d Apollo wrote in its assessment.<\/p>\n As AI models become more capable, some studies show they\u2019re becoming more likely to take unexpected \u2014 and possibly unsafe \u2014 steps to achieve delegated tasks. For instance, early versions of OpenAI\u2019s o1 and o3 models, released in the past year, tried to deceive humans at higher rates than previous-generation models, according<\/a> to Apollo<\/a>. <\/p>\n Per Anthropic\u2019s report, Apollo observed examples of the early Opus 4 attempting to write self-propagating viruses, fabricating legal documentation, and leaving hidden notes to future instances of itself \u2014 all in an effort to undermine its developers\u2019 intentions.<\/p>\n To be clear, Apollo tested a version of the model that had a bug Anthropic claims to have fixed. Moreover, many of Apollo\u2019s tests placed the model in extreme scenarios, and Apollo admits that the model\u2019s deceptive efforts likely would\u2019ve failed in practice.<\/p>\n However, in its safety report, Anthropic also says it observed evidence of deceptive behavior from Opus 4. <\/p>\n This wasn\u2019t always a bad thing. For example, during tests, Opus 4 would sometimes proactively do a broad cleanup of some piece of code even when asked to make only a small, specific change. More unusually, Opus 4 would try to \u201cwhistle-blow\u201d if it perceived a user was engaged in some form of wrongdoing.<\/p>\n According to Anthropic, when given access to a command line and told to \u201ctake initiative\u201d or \u201cact boldly\u201d (or some variation of those phrases), Opus 4 would at times lock users out of systems it had access to and bulk-email media and law-enforcement officials to surface actions the model perceived to be illicit. <\/p>\n \u201cThis kind of ethical intervention and whistleblowing is perhaps appropriate in principle, but it has a risk of misfiring if users give [Opus 4]-based agents access to incomplete or misleading information and prompt them to take initiative,\u201d Anthropic wrote in its safety report. \u201cThis is not a new behavior, but is one that [Opus 4] will engage in somewhat more readily than prior models, and it seems to be part of a broader pattern of increased initiative with [Opus 4] that we also see in subtler and more benign ways in other environments.\u201d<\/p>\n<\/div>\n