\n<\/p>\n
The panel on stage at the Knight Foundation\u2019s Informed event is Elon Musk\u2019s nightmare blunt rotation<\/a>: Techdirt editor Mike Masnick, Twitter\u2019s former safety lead Yoel Roth, and Bluesky CEO Jay Graber, who have come together to discuss content moderation in the fediverse<\/a>.<\/p>\n It\u2019s been more than a year since Musk showed up at Twitter HQ with <\/span>a literal sink<\/a> in tow, but many social media users are still a bit nomadic, floating among various emerging platforms. And if a user made the choice to leave Twitter in the Musk era, they likely are looking for a platform with <\/span>actual<\/a>\u00a0<\/span>moderation<\/a> policies<\/a>, which means even more pressure for leaders like Graber to strike the fragile balance between tedious over-moderation and a fully hands-off approach.<\/span><\/p>\n \u201cThe whole philosophy has been that this needs to have a good UX and be a good experience,\u201d Graber said about her approach to running Bluesky. \u201cPeople aren\u2019t just in it for the decentralization and abstract ideas. They\u2019re in it for having fun and having a good time here.\u201d<\/p>\n And at the start, users were having a good \u2014 really good<\/a> \u2014 experience.<\/p>\n \u201cWe had a really high ratio of posters to lurkers. On a lot of social platforms, there\u2019s a very small percentage of people who post, and a very large percentage of people who lurk,\u201d Graber said. \u201cIt\u2019s been a very active posting culture, and it continues to be, although the beginning was extremely high, like 90-95% of users were all posting.\u201d<\/p>\n But Bluesky has faced some <\/span>growing pains<\/a> in its beta as it figures out what approach to take to delicate content moderation issues. In one incident, which Roth asked Graber about on the panel, users discovered that Bluesky did not have a list of words banned from appearing in user names. As a result, users started registering account names with <\/span>racial slurs<\/a>.<\/span><\/p>\n \u201cAt the time last summer, we were a really small team, like less than ten engineers. We could all fit around a conference table,\u201d Graber said. When content moderators discovered the issue with slurs in usernames, the team patched the code, which is open source, so users could see the implementation of the word lists happen in real time, which sparked further debate. \u201cWe learned a lot about communication transparency and being really proactive\u2026. One of the reasons we\u2019ve stayed in beta so long is to give ourselves some space to get this right.\u201d<\/p>\n Since then, both Bluesky\u2019s userbase and its team have grown. Bluesky hired more engineers and content moderations, while its total number of users increased from about 50,000 at the end of April 2023, to over 3 million this month. And the platform still isn\u2019t open to the public.<\/p>\n \u201cIt\u2019s fair to say that about half of our technical product work has been related in some way to trust and safety, because moderation is quite core to how this works in an open ecosystem,\u201d Graber said.<\/p>\n For platforms like Bluesky, Mastodon and Threads, content moderation challenges become even more complicated when you add in the variable of the fediverse<\/a>.<\/p>\n Once the AT Protocol is fully up and running, anyone will be able to build their own social network atop Bluesky\u2019s infrastructure \u2014 Bluesky, as a social network, is just one app built on the protocol. But this means that as new networks crop up on the AT Protocol, the company will have to decide how (or if) it should regulate what people do on the platform. For now, this means Bluesky is building what it calls \u201ccomposable moderation.\u201d<\/span><\/p>\n \u201cOur broader vision here is composable moderation, and so that\u2019s essentially saying that on the services we run, like the app, that we set a baseline for moderation,\u201d Graber said. \u201cBut we want to build an ecosystem where anyone can participate [in moderation], and third party is really first party.\u201d<\/p>\n Graber explains the complicated concept further in a blog post<\/a>:<\/p>\n Centralized social platforms delegate all moderation to a central set of admins whose policies are set by one company. This is a bit like resolving all disputes at the level of the Supreme Court. Federated networks delegate moderation decisions to server admins. This is more like resolving disputes at a state government level, which is better because you can move to a new state if you don\u2019t like your state\u2019s decisions \u2014 but moving is usually difficult and expensive in other networks. We\u2019ve improved on this situation by making it easier to switch servers, and by separating moderation out into structurally independent services.<\/p>\n<\/blockquote>\n So, Bluesky can mandate that copyright infringement and spam are not allowed, but an individual app built on the protocol can make its own rules, so long as they don\u2019t contradict Bluesky\u2019s baseline. For example, Bluesky allows users to post adult content, but if someone were to build a more family-friendly server on the AT protocol, they would have the right to ban adult content from their specific server \u2014 and if someone on that server disagreed with that decision, they could easily port over their account to a different server and retain all of their followers.<\/p>\n \u201cOne of the issues that we have right now is that, when you just have what Twitter or Meta gives you, and maybe just a few options or checkboxes, that\u2019s not really algorithmic choice,\u201d Masnick said. \u201cThat\u2019s not really composable moderation. That\u2019s not getting you to the level of really allowing different entities to try different things and to experiment and see what works best.\u201d<\/p>\n Users can also choose to use third-party feeds to view content, instead of just choosing from a \u201crecommended\u201d and \u201cfollowing\u201d tab.<\/p>\n \u201cRather than telling people decentralization has all these benefits in the abstract [\u2026] it\u2019s a lot more powerful to just say, here, there\u2019s 25,000 custom feeds that third party developers have built, and you can just choose from them,\u201d Graber said.<\/p>\n But since it\u2019s such early days for Bluesky, this composable moderation philosophy hasn\u2019t really been tested yet. Meanwhile, companies from Cloudflare<\/a>, to Substack<\/a>, to Mastodon<\/a> have reckoned with what to do when dangerous communities organize on your platform.<\/p>\n \u201cLet\u2019s say somebody takes all this code you\u2019ve been publishing, and the AT protocol, and they build a new network. Let\u2019s call it NaziSky,\u201d Roth told Graber. \u201cWhat do you do?\u201d<\/p>\n Mastodon faced such an issue in 2019, when the far-right, Nazi-friendly social network Gab migrated to its servers after being kicked off of GoDaddy<\/a>. Mastodon\u2019s founder condemned Gab, but said at the time that decentralization prevented him from actually taking action \u2014 so, users had to take matters into their own hands. Individual Mastodon servers blocked Gab\u2019s server en masse, making it impossible for Gab members to interact with others on the website. But still, Mastodon has to reckon with its open source code being used to power what it calls<\/a> a \u201cthinly (if at all) veiled white supremacist platform.\u201d<\/p>\n \u201cThis is one of the trade-offs of open source, which is that there\u2019s a lot of benefits \u2014 stuff is open, anyone can collaborate, anyone can contribute, anyone can use the code,\u201d Graber said. \u201cThat also means people whose values drastically diverge from yours can use the code, grab it and run with it.\u201d<\/p>\n Like what happened on Mastodon, Graber thinks that the user base will ultimately set the tone for what is considered acceptable behavior on the platform.<\/p>\n \u201cIt\u2019s a pluralist ecosystem. There\u2019s lots of parties out there, and when they unanimously decide that something is outside the Overton window of the norms of communication, then that becomes sort of the social consensus,\u201d Graber said. \u201cIf a whole parallel universe emerges, that\u2019s possible with open source software, but those communities don\u2019t necessarily talk if the norms are so drastically divergent.\u201d<\/p>\n Then again, dominant and centralized social platforms like Facebook and X have shown the dangers that can emerge when just a few people are in charge of these moderation decisions, rather than whole communities.<\/p>\n \u201cUnfortunately, you can\u2019t turn a Nazi into not a Nazi. But we can limit the impact of the Nazis,\u201d Masnick said. \u201cLet\u2019s limit their ability to wreak havoc. I think that leads to a better place in the long run.\u201d<\/p>\n<\/p><\/div>\n\n