\n<\/p>\n
Quick question: Do you want AI to be so well trained, it could help husbands (or wives, for that matter) plan the perfect murder of their spouses? Probably not, right? Just as a gut reaction, that feels like a no. I wouldn\u2019t even think it was a particularly hard question.<\/p>\n
But America contains many diverse perspectives, and one such perspective<\/a> was shared by Comma AI founder and longtime jailbreaker George Hotz over the weekend.<\/p>\n The post comes in response to a bunch of big-picture AI alignment plans, most recently the AI 2040: Plan A<\/a> policy paper from the AI Futures institute. That paper envisions a world in which the world\u2019s researchers collectively choose to slow down AI development for 14 years for the good of humanity. But of course, not everyone who read the paper agrees with its premises or conclusion. <\/p>\n Hotz is in the camp who disagrees. In his post, he argues that the fast-takeoff scenario \u2014 the hypothetical where AI rapidly obtains superhuman abilities \u2014 doesn\u2019t make a lot of sense. I agree a lot of what he says here! For Hotz, the best approach to AI alignment and safety is to focus on locally controlled AI models that are closely aligned with the interests of their users.<\/p>\n That\u2019s a cool idea, particularly since it reminds me how much of current AI is built around centrally managed services like Claude and ChatGPT. There are infrastructure-related reasons why AI services developed this way: it\u2019s expensive to host these large state-of-the-art models and most people aren\u2019t using them enough throughout the day to justify truly personal AI. But those factors become less important as the technology develops. Part of what was so exciting about OpenClaw<\/a> was this experimental, DIY approach, and it would be great to see more AI products try to recapture that.<\/p>\n But Hotz is a provocateur by nature, so he doesn\u2019t stop there. He compares user-aligned AI to a gun(!), which does not complain if you use it to kill your stepmom. (I feel like there are other rules against this?) A truly aligned AI would be able to order meth-lab equipment from Amazon Prime and show you how to use it if that\u2019s what you wanted and asked for, he says. (Again, I don\u2019t think AI would be the limiting factor here.) Hotz even says he would die to defend this principle, although it\u2019s hard to imagine the series of events that would lead to that.<\/p>\n \u201cWe either live in a world with freedom or we don\u2019t,\u201d Hotz writes. If those are the options, the freedom world does sound better! Still, I don\u2019t know.<\/p>\n It\u2019s not all about freedom, right? Any structure involving a lot of people (societies, marketplaces, corporations, etc.) requires balancing equities, binding individual needs into a network of interdependent preferences and systems of accountability. And anyone deploying mass-market tech products should probably think about that network as a whole, which means taking seriously the interests of the as-yet-unmurdered spouses and stepparents of the world.<\/p>\n The freedom Hotz experiences is really a space of potential futures made possible by collective enterprise; those futures would disappear overnight if we all started behaving like little AI-powered Napoleons. Like the meme says, we live in a society.<\/p>\n Having a local AI willing to take on the corporate world for my benefit does sound cool though! I can\u2019t wait for a review unit.<\/p>\n<\/div>\n When you purchase through links in our articles, we may earn a small commission<\/a>. This doesn\u2019t affect our editorial independence.<\/em><\/p>\n