\n<\/p>\n
OpenAI has released its GPT-4o System Card<\/a>, a research document that outlines the safety measures and risk evaluations the startup conducted before releasing its latest model.<\/p>\n<\/div>\n GPT-4o was launched publicly in May<\/a> of this year. Before its debut, OpenAI used an external group of red teamers, or security experts trying to find weaknesses in a system, to find key risks in the model (which is a fairly standard practice). They examined risks like the possibility that GPT-4o would create unauthorized clones of someone\u2019s voice, erotic and violent content, or chunks of reproduced copyrighted audio. Now, the results are being released.<\/p>\n<\/div>\n According to OpenAI\u2019s own framework, the researchers found GPT-4o to be of \u201cmedium\u201d risk. The overall risk level was taken from the highest risk rating of four overall categories: cybersecurity, biological threats<\/a>, persuasion, and model autonomy. All of these were deemed low risk except persuasion, where the researchers found some writing samples from GPT-4o could be better at swaying readers\u2019 opinions than human-written text \u2014 although the model\u2019s samples weren\u2019t more persuasive overall.<\/p>\n<\/div>\n An OpenAI spokesperson, Lindsay McCallum R\u00e9my, told The Verge<\/em> that the system card includes preparedness evaluations created by an internal team, alongside external testers listed on OpenAI\u2019s website<\/a> as Model Evaluation and Threat Research (METR) and Apollo Research, both of which build evaluations for AI systems.<\/p>\n<\/div>\n Moreover, the company is releasing a highly capable multimodal model just ahead of a US presidential election. There\u2019s a clear potential risk of the model accidentally spreading misinformation or getting hijacked by malicious actors \u2014 even if OpenAI is hoping to highlight that the company is testing real-world scenarios to prevent misuse.<\/p>\n<\/div>\n There have been plenty of calls for OpenAI to be more transparent, not just with the model\u2019s training data (is it trained on YouTube?<\/a>), but with its safety testing. In California, where OpenAI and many other leading AI labs are based, state Sen. Scott Wiener is working to pass a bill to regulate large language models, including restrictions that would hold companies legally accountable if their AI is used in harmful ways. If that bill is passed, OpenAI\u2019s frontier models would have to comply with state-mandated risk assessments before making models available for public use. But the biggest takeaway from the GPT-4o System Card is that, despite the group of external red teamers and testers, a lot of this relies on OpenAI to evaluate itself.<\/p>\n<\/div>\n