\n<\/p>\n
Meta has announced it\u2019s testing new features on Instagram intended to help safeguard young people from unwanted nudity or sextortion scams. This includes a feature called Nudity Protection in DMs, which automatically blurs images detected as containing nudity.<\/p>\n
The tech giant will also nudge teens to protect themselves by serving a warning encouraging them to think twice about sharing intimate imagery. Meta says it hopes this will boost protection against scammers who may send nude images to trick people into sending their own images in return.<\/p>\n
It\u2019s also making changes it suggests will <\/span>make it more difficult for potential scammers and criminals to find and interact with teens.<\/span> Meta says it\u2019s developing new technology to identify accounts that are \u201cpotentially\u201d involved in sextortion scams and applying some limits to how these suspect accounts can interact with other users.\u00a0<\/span><\/p>\n In another step announced Thursday, Meta said it\u2019s increased the data it\u2019s sharing with the cross-platform online child safety program Lantern<\/a> \u2014 to include more \u201csextortion-specific signals\u201d.<\/p>\n The social networking giant has long-standing policies banning the sending of unwanted nudes or seeking to coerce other users into sending intimate images. However that doesn\u2019t stop these problems being rife online \u2014 and causing misery for scores of teens and young people, sometimes with extremely tragic results<\/a>.<\/p>\n We\u2019ve rounded up the latest crop of changes in more detail below.<\/p>\n Nudity screens<\/strong><\/p>\n Nudity Protection in DMs aims to protect teen Instagram users from cyberflashing by putting nude images behind a safety screen. Users will then be able to choose whether or not to view it.<\/p>\n \u201cWe\u2019ll also show them a message encouraging them not to feel pressure to respond, with an option to block the sender and report the chat,\u201d said Meta.\u00a0<\/span><\/p>\n The nudity safety-screen will be turned on by default for under 18s globally. Older users will see a notification encouraging them to turn it on.<\/p>\n \u201cWhen nudity protection is turned on, people sending images containing nudity will see a message reminding them to be cautious when sending sensitive photos, and that they can unsend these photos if they\u2019ve changed their mind,\u201d it added.<\/p>\n Anyone trying to forward a nude image will see the same warning encouraging them to reconsider.<\/p>\n The feature is powered by on-device machine learning so Meta said it will work within end-to-end encrypted chats because the image analysis is carried out on the user\u2019s own device.<\/p>\n Safety tips<\/strong><\/p>\n In another safeguarding measure, Instagram users sending or receiving nudes will be directed to safety tips \u2014 with information about the potential risks involved \u2014 which Meta said have been developed with guidance from experts.<\/p>\n \u201cThese tips include reminders that people may screenshot or forward images without your knowledge, that your relationship to the person may change in the future, and that you should review profiles carefully in case they\u2019re not who they say they are,\u201d it wrote. \u201cThey also link to a range of resources, including Meta\u2019s Safety Center,<\/a> support helplines<\/a>, StopNCII.org<\/a> for those over 18, and Take It Down<\/a> for those under 18.<\/p>\n It\u2019s also testing pop-up messages for people who may have interacted with an account Meta has removed for sextortion that will also direct them to relevant expert resources.<\/p>\n \u201cWe\u2019re also adding new child safety helplines from around the world into our in-app reporting flows. This means when teens report relevant issues \u2014 such as nudity, threats to share private images or sexual exploitation or solicitation \u2014 we\u2019ll direct them to local child safety helplines where available,\u201d it added.<\/p>\n Tech to spot sextortionists\u00a0\u00a0<\/strong><\/p>\n While Meta says it removes the accounts of sextortionists when it becomes aware of them, it first needs to spot bad actors to shut them down. So Meta is trying to go further: It says it\u2019s \u201cdeveloping technology to help identify where accounts may potentially<\/em> be engaging in sextortion scams, based on a range of signals that could indicate sextortion behavior\u201d.<\/p>\n \u201cWhile these signals aren\u2019t necessarily evidence that an account has broken our rules, we\u2019re taking precautionary steps to help prevent these accounts from finding and interacting with teen accounts,\u201d it goes on, adding: \u201cThis builds on the work we already do<\/a> to prevent other potentially suspicious accounts from finding and interacting with teens.\u201d<\/p>\n It\u2019s not clear exactly what technology Meta is using for this, nor which signals might denote a potential sextortionist (we\u2019ve asked for more) \u2014 but, presumably, it may analyze patterns of communication to try to detect bad actors.<\/p>\n Accounts that get flagged by Meta as potential sextortionists will face restrictions on how they can message or interact with other users.<\/p>\n \u201c[A]ny message requests potential sextortion accounts try to send will go straight to the recipient\u2019s hidden requests folder, meaning they won\u2019t be notified of the message and never have to see it,\u201d it wrote.<\/p>\n Users who are already chatting to potential scam or sextortion accounts, will not have their chats shut down but will be show Safety Notices<\/a> \u201cencouraging them to report any threats to share their private images, and reminding them that they can say no to anything that makes them feel uncomfortable\u201d, per Meta.<\/p>\n Teen users are already protected from receiving DMs from adults they are not connected to on Instagram (and also from other teens in some cases). But Meta is taking a further step of not showing the \u201cMessage\u201d button on a teen\u2019s profile to potential sextortion accounts, i.e. even if they\u2019re connected.<\/p>\n \u201cWe\u2019re also testing hiding teens from these accounts in people\u2019s follower, following and like lists, and making it harder for them to find teen accounts in Search results,\u201d it added.<\/p>\n It\u2019s worth noting the company is under rising scrutiny in Europe over child safety risks on Instagram<\/a>, with enforcers asking questions about its approach since the bloc\u2019s Digital Services Act (DSA) came into force last summer.<\/p>\n Meta has announced measures to combat sextortion before \u2014 most recently in February<\/a> when it expanded access to Take It Down<\/a>.<\/p>\n The third party tool lets people generate a hash of an intimate image locally on their own device and share it with the National Center for Missing and Exploited Children \u2014 creating a repository of non-consensual image hashes that companies can use to search for and remove revenge porn.<\/p>\n Previous approaches by Meta had been criticized<\/a> as they required young people to upload their nudes. In the absence of hard laws regulating how social networks need to protect children Meta was left to self regulate for years \u2014 with patchy results.<\/p>\n However with some requirements landing on platforms in recent years, such as the UK\u2019s Children Code<\/a>, which came into force in 2021 \u2014 and, more recently, the EU\u2019s DSA \u2014 tech giants like Meta are finally having to pay more attention to protecting minors.<\/p>\n For example, in July 2021<\/a> Meta switched to defaulting young people\u2019s Instagram accounts to private just ahead of the UK compliance deadline. Even tighter privacy settings for teens on Instagram and Facebook followed in November 2022<\/a>.<\/p>\n This January<\/a> Meta also announced it would default teens on Facebook and Instagram into stricter message settings still with limits on teens messaging teens they\u2019re not already connected to, shortly before the full compliance deadline for the DSA kicked in in February<\/a>.<\/p>\n Meta\u2019s slow and iterative feature creep when it comes to protective measures for young users raises questions about what took it so long to apply stronger safeguards \u2014 suggesting it\u2019s opted for a cynical minimum in safeguarding in a bid to manage the impact on usage and prioritize engagement over safety. (Which is exactly what Meta whistleblower, Francis Haugen<\/a>, repeatedly denounced her former employer for.)<\/p>\n Asked why it\u2019s not also rolling out the latest protections it\u2019s announced for Instagram users to Facebook, a spokeswomen for Meta told TechCrunch: \u201cWe want to respond to where we see the biggest need and relevance \u2014 which, when it comes to unwanted nudity and educating teens on the risks of sharing sensitive images \u2014 we think is on Instagram DMs, so that\u2019s where we\u2019re focusing first.\u201d<\/p>\n<\/p><\/div>\nA long, slow creep towards safety<\/strong><\/h2>\n