\u201cSigns of AI writing\u201d<\/a> is the best resource I\u2019ve found for nailing down whether your suspicions are warranted. (Credit to the poet Jameson Fitzpatrick, who pointed out the document on X.)<\/p>\nSince 2023, Wikipedia editors have been working to get a handle on AI submissions, a project they call Project AI Cleanup. With millions of edits coming in each day, there\u2019s plenty of material to draw on, and in classic Wikipedia-editor style, the group has produced a field guide that\u2019s both detailed and heavy on evidence.<\/p>\n
To start with, the guide confirms what we already know: automated tools are basically useless. Instead, the guide focuses on habits and turns of phrase that are rare on Wikipedia but common on the internet at large (and thus, common in the model\u2019s training data). According to the guide, AI submissions will spend a lot of time emphasizing why a subject is important, usually in generic terms like \u201ca pivotal moment\u201d or \u201ca broader movement.\u201d AI models will also spend a lot of time detailing minor media spots to make the subject seem notable \u2014 the kind of thing you\u2019d expect from a personal bio, but not from an independent source.<\/p>\n
The guide flags a particularly interesting quirk around tailing clauses with hazy claims of importance. Models will say some event or detail is \u201cemphasizing the significance\u201d of something or other, or \u201creflecting the continued relevance\u201d of some general idea. (Grammar nerds will know this as the \u201cpresent participle.\u201d) It\u2019s a bit hard to pin down, but once you can recognize it, you\u2019ll see it everywhere.<\/p>\n
There\u2019s also a tendency towards vague marketing language, which is extremely common on the internet. Landscapes are always scenic, views are always breathtaking, and everything is clean and modern. As the editors put it, \u201cit sounds more like the transcript of a TV commercial.\u201d<\/p>\n
The guide is worth reading in full, but I came away very impressed. Before this, I would have said that LLM prose was developing too fast to pin down. But the habits flagged here are deeply embedded in the way AI models are trained and deployed. They can be disguised, but it will be hard to do away with them completely. And if the general public gets more savvy about identifying AI prose, it could have all sorts of interesting consequences.<\/p>\n<\/div>\n
\n
Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"We\u2019ve all felt the creeping suspicion that something we\u2019re reading was written by a large language model \u2014 but it\u2019s remarkably difficult to pin down. For a few months last year, everyone became convinced that specific words like \u201cdelve\u201d or \u201cunderscore\u201d could give models away, but the evidence is thin, and as models have grown […]<\/p>\n","protected":false},"author":1,"featured_media":206415,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[14],"tags":[],"class_list":{"0":"post-206414","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-tech"},"_links":{"self":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/206414","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/comments?post=206414"}],"version-history":[{"count":0,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/posts\/206414\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media\/206415"}],"wp:attachment":[{"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/media?parent=206414"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/categories?post=206414"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/entertainment.runfyers.com\/index.php\/wp-json\/wp\/v2\/tags?post=206414"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}