Tiered Anonymity on Social-Media Platforms as a Countermeasure against Deepfakes and LLM-Driven Mass Misinformation

We argue that governments should mandate a three-tier anonymity framework on social-media platforms as a reactionary measure prompted by the ease-of-production of deepfakes and large-language-model-driven misinformation. The tiers are determined by a given user’s $\textit{reach score}$: Tier 1 permits full pseudonymity for smaller accounts, preserving everyday privacy; Tier 2 requires private legal-identity linkage for accounts with some influence, reinstating real-world accountability at moderate reach; Tier 3 would require per-post, independent, ML-assisted fact-checking, review for accounts that would traditionally be classed as sources-of-mass-information. An analysis of Reddit shows volunteer moderators converge on comparable gates as audience size increases - karma thresholds, approval queues, and identity proofs - demonstrating operational feasibility and social legitimacy. Acknowledging that existing engagement incentives deter voluntary adoption, we outline a regulatory pathway that adapts existing US jurisprudence and recent EU-UK safety statutes to embed reach-proportional identity checks into existing platform tooling, thereby curbing large-scale misinformation while preserving everyday privacy.

💡 Research Summary

The paper tackles the escalating threat of deepfakes and large‑language‑model‑generated misinformation by proposing a legally mandated, three‑tier anonymity framework for social‑media platforms. The authors argue that while pseudonymity is essential for everyday privacy and the protection of vulnerable speakers, it becomes a public‑safety liability when algorithmic amplification grants a single post the reach of a traditional broadcaster. To address this asymmetry, they introduce a “reach score” that aggregates followers, shares, impressions, watch‑time and other engagement metrics into a single quantitative measure of influence. Users are automatically assigned to Tier 1, 2, or 3 based on predefined thresholds.

Tier 1 (low‑reach accounts) retains full pseudonymity; content is governed only by community standards. Tier 2 (moderate‑reach accounts such as niche influencers or local news pages) requires a platform‑held linkage to a verified legal identity, a cooling‑off period for posts, and an immutable audit log, but the real‑world identity remains private. Tier 3 (mass‑reach accounts including national media brands, celebrities, or any content that crosses a high‑reach threshold) must undergo independent, machine‑learning‑assisted fact‑checking before algorithmic amplification. Verified fact‑checks are water‑marked and archived publicly; failure triggers down‑ranking or removal.

The authors frame these requirements as “friction” – deliberate delays or costs that encourage deliberation and reduce the spread of falsehoods. They cite empirical studies showing that prompts such as “read‑before‑retweet” significantly improve content quality and curb harmful interactions.

A central empirical contribution is a longitudinal case study of Reddit, a platform where volunteer moderators already impose proportional gates as communities grow. The study documents that larger subreddits introduce karma minimums, pre‑publication queues, and even private identity verification (e.g., r/IAmA). This organic emergence of tiered governance demonstrates both operational feasibility and social legitimacy for the proposed model.

On the regulatory front, the paper maps the framework onto existing jurisprudence: U.S. First Amendment case law, the EU Digital Services Act (DSA), and the UK Online Safety Act. By leveraging these statutes, the authors outline a “platform‑neutral” pathway that obliges platforms to compute reach scores in real time, trigger tier‑specific verification workflows via APIs, and cooperate with independent fact‑checking bodies. Privacy safeguards are built in by keeping identity data encrypted and non‑public for Tier 2 users, while Tier 3 verification results are transparent to the public.

In conclusion, the paper makes two primary contributions: (1) a formal, reach‑based model that scales identity and verification obligations with influence, supported by real‑world Reddit data; and (2) a cross‑jurisdictional regulatory blueprint that can be embedded into existing safety regimes without abolishing pseudonymity for the majority of users. The authors contend that this proportional‑friction approach preserves free expression for low‑reach participants while curbing the outsized impact of AI‑augmented misinformation from high‑reach actors, thereby safeguarding democratic discourse in the era of synthetic media.