PATCH NOTES · Bungie Outlasted Every Owner It Ever Had... This Time It…· 1W AGO
Player Driven
──── PILLAR GUIDE

Trust & Safety

Moderation, policy, anti-abuse.

23 topics46 pieces of contentBrowse on the map →
──── WHY THIS PILLAR MATTERS

Trust & Safety used to mean a 'mute' button in the chat client. Then players started killing themselves over harassment. Then governments started writing laws (DSA in Europe, KOSA in the US). Then advertisers and platform holders started auditing your moderation. Now T&S is the difference between a game that grows and one that's pulled from app stores.

The discipline covers three things that used to live in three different orgs: real-time moderation (in-game chat, voice, UGC), policy work (terms of service, age gating, behavioral expectations), and crisis response (the discord raid, the doxxing incident, the regulatory letter). The best T&S teams have one strategic owner across all three.

Trust & Safety isn't a cost center. It's the platform that lets everything else stand up.

Recurring theme on Player Driven

If you're targeting under-18s, you don't have a choice — KOSA, COPPA, the UK Age-Appropriate Design Code all carry real teeth now. If you're shipping in voice, the moderation problem is 10× harder and 100× more expensive. Studios that didn't take this seriously two years ago are scrambling now.

──── THE BREAKDOWN

23 topics in Trust & Safety

Each bar is a topic in this pillar. Bar length is content volume — how much we've published about it. Tap any topic to drill in.

──── HOW GAMES USED THIS

Three studios. Three lessons.

Riot · Behavioral systems 2012–present

Riot Games (League + Valorant)

Riot's behavioral team pioneered the Tribunal (player-juried punishment), then ML-driven detection that catches toxic behavior before reports come in. They publish quarterly transparency reports. T&S is treated as a publishable competitive advantage.

Transparency on what you punish — and what you don't — turns moderation from a black box into a trust signal.

Roblox Corp · 2006–present

Roblox

Built one of the largest T&S operations in any tech company, period — thousands of moderators, ML scanning every uploaded asset and chat message. Has had public failures and recoveries; the size of the operation reflects the size of the problem they took on.

If your platform invites user-generated content, the moderation budget is the platform.

VRChat Inc · Voice moderation evolution

VRChat

Voice-only social VR is the hardest moderation problem in gaming. VRChat's path — community moderators, then audio fingerprinting, then ML voice classification — is the case study for what's possible when you can't read what people are saying.

Voice is where T&S goes when text moderation gets easy. Plan budget accordingly.

──── THE OPERATOR'S CHEAT SHEET
↳ WHAT YOU MEASURE
  • ·Reports per 1k DAU
  • ·Time-to-action on policy violations (median, p99)
  • ·False-positive rate on automated moderation
  • ·% of suspended accounts that re-offend after return
  • ·Regulatory compliance rate (DSA, COPPA, etc.)
↳ WHO OWNS THIS

Trust & Safety Lead, ideally reporting to a C-level not buried under marketing. At scale: separate Policy, Operations (moderators), and Engineering (tools + ML) functions.

↳ SIGNALS YOU NEED TO INVEST
  • ·You're shipping voice chat
  • ·You're targeting players under 18
  • ·Your moderator-to-DAU ratio is below industry norms (1:50k is bad, 1:10k is OK)
  • ·You haven't done a policy review in 12+ months
  • ·A regulator (Apple, Google, EU, FTC, ESRB) just sent you a letter
↳ COMMON MISTAKES
  • ·Outsourcing moderation entirely to a vendor and forgetting to read the reports
  • ·Treating T&S as a privacy problem only (it's a safety problem)
  • ·Writing policy in legalese players can't parse
  • ·No appeals process — every false-positive ban is a future review-bomb
  • ·Forgetting that the moderators themselves need wellbeing support; vicarious trauma is real
──── READ + LISTEN

Content in this pillar.

SEE ALL →
DESK

Meet Christina Camilleri, Netflix Games' "Chaos Gremlin" and "Safety By Design" Champion

From a dedicated MapleStory player to an "ethical hacker" to the Head of Trust and Safety at Netflix Games, Camilleri has blazed a unique trail across the digital community support landscape

PODCAST

The Evolution of Moderation: Why AI Won’t Replace Humans… It Will Redefine Them

In this episode of Player Driven, host Greg welcomes back industry veteran Sharon Fisher to discuss the rapidly evolving landscape of content moderation.

PODCAST

How AI Is Rewriting Trust and Safety in Games

Recorded live at Pocket Gamer London, Greg sits down with Hill from Checkstep for a wide ranging conversation on trust and safety, AI powered content detection, parenting in a gaming household, and why moderation is no longer just about rem…

BLOG

How Cheating and Fraud Are Undermining Player Trust and Draining Game Revenue

Every game developer dreams of creating a hit title, a vibrant, thriving community where players log on daily, form friendships, and celebrate their triumphs. But what if a hidden enemy is eroding that community and draining your bottom line without you even knowing it? At a Community Clubhouse panel, Andrew Hogan from Intorqa called cheating one of the most significant threats to building and maintaining a healthy gaming community. While the immediate thought might be "aimbots," the problem goes far deeper, impacting everything from player retention to marketing budgets and brand reputation. The real issue is the "Bot Cost," a term that encompasses not just the lost revenue from cheated in-game economies but the compounding effects of a corrupted player experience.

PODCAST

From Chaos to Control: Christina Camilleri on Building Safer Games by Design

Episode Summary: Christina Camilleri leads trust and safety product strategy at Netflix Games — but her journey started as a shy kid finding refuge in online worlds.

PODCAST

One Account, One Life: Can This Fix Online Gaming

What if you only had one digital life across all games... would you still cheat? In this episode, we dig into the world of online cheating, digital accountability, and the business of fair play with Andrew Wailes from PlaySafe ID.

PODCAST

From Club Penguin to Imagine Island: Building Games That Last a Generation

📖 Episode Summary:This episode of Player Driven, in collaboration with Community Clubhouse, dives into the future of kids' gaming and digital safety.

PODCAST

The Sound of Safety: How Modulate is Cleaning Up Voice Chat & Beyond with Mike Pappas

Mike Pappas discusses Modulate's Toxmod, a sophisticated voice AI that analyzes emotional nuance and behavioral dynamics in online interactions.

PODCAST

How Sonya Haskins' Unique Journey Helped to Redefine Expectations about XR

Episode SummaryIn this powerful and deeply personal episode, Sonya Haskins (Head of Programming at Augmented World Expo) shares her unexpected path into the world of XR—from a homeschool mom and non-gamer to a competitive VR esports athlete…

BLOG

Trust & Safety: The Key to a Thriving Gaming Community

Why Trust & Safety Should Be a Priority As gaming communities grow, the need for robust trust and safety measures increases. Toxicity, cheating, and harassment can quickly erode a game’s reputation, making proactive strategies essential to maintaining a positive player environment.

↳ ACADEMY PATH · TRUST & SAFETY·L01 FOUNDATIONS · L02 OPERATOR · L03 LEAD

Take Trust & Safety in the Academy.

Structured courses, instructor feedback on studio briefs, and a credential scored by working operators. The L01 primer is free with an account.

Climb the Trust & Safety track.

Every piece of content in this pillar you finish earns credits toward your Trust & Safety level. See the full system at /level-up.