Rec Room hosts millions of fun and inventive rooms and creations that we love exploring. This experience is built on the trust that it will be free of harmful content, but we also know that trust is fragile. One bad room or one bad invention - especially if it’s somewhere that lots of players can see it - can fracture that trust.
That’s why we launched AIRS (Automated Invention Review System) in April. It’s not just a moderation tool - it’s a trust-preserving system that helps ensure players see great creations, not harmful surprises.
Impact So Far
Since going live on April 29, AIRS has already:
- Scanned over 5 million inventions;
- Flagged and removed more than 100,000 violating inventions;
- Reduced the prevalence of sexual and discriminatory content in inventions by over 50%
What’s the biggest takeaway?
AIRS reinforces what we’ve always known: the vast majority of creators in Rec Room are building fun, clever, and unique inventions that follow the Creator Code of Conduct. In fact, over 98% of inventions passed to AIRS so far were found to be compliant. Shout out to all of the creators who continue to make joyful, weird, and expressive stuff.
Why does one bad thing matter?
You might ask: Why are we putting so much work into these edge cases? That one bad thing that someone might see? Because even a single negative experience can ruin an entire experience for a player. There’s been a ton of studies into “negativity bias”, with some psychology research suggesting it can take 5-7 positive experiences to counteract the impact of a single bad one. In Rec Room, there’s so much to see and do, but it also means that one inappropriate invention can undo hours of positive experiences. AIRS helps reduce the risk of that happening.
What We’ve Improved Recently
A few weeks ago, we:
- Lowered the threshold for action, allowing us to catch more violating content.
- Added a safeguard: if a flagged invention is widely saved or used, it now triggers manual review before removal. This way, we add an extra layer of oversight for highly impactful actions.
What’s Next
We’ll keep improving AIRS, but we also want to apply the lessons we’ve learnt to other types of content. Watch this space for future updates.
AIRS FAQ:
We’ve compiled a list of common questions we’ve seen since this system went live. If you see players asking the same questions, you can share these answers!
Q: Why does AIRS action private content?
A: Inventions that are labeled “private” can still appear in public spaces if they are spawned in public rooms or shared in private rooms that later become public. That’s why our Creator Code of Conduct applies to both private and public content. AIRS is tuned to catch really harmful content before it can spread, especially sexual or discriminatory content, which has no place in Rec Room, regardless of visibility settings.
Q: Why not have moderators manually review flagged content?
A: With thousands of inventions created every day - and over 100,000 already flagged by AIRS - it’s not feasible for human moderators to keep pace with, and review, every item being made by our millions of creators. Any system we designed for this would create a very long queue of inventions waiting for approval. That isn’t fair, especially when we know that almost all of our creators are publishing great stuff.
That said, our moderation team does regularly audit AIRS’ decisions by reviewing large sample sets to ensure it’s only flagging violating content. So far, AIRS has performed really well in identifying serious violations.
Q: Can players be warned about inventions in their rooms before the room is closed? Why can’t you just close the invention?
A: We understand how frustrating it can be to lose access to your room. We only close rooms where the violating invention is present in the most recent save of the room. When a player adds an invention to a room, they can customize it by adding or removing parts. Sometimes, a creator may take apart the entire invention and build something completely new using its components. This makes it hard for us to automatically remove the violating invention because doing so might also delete important parts of the room that were built on top of it.
In our experience, warning players and asking them to remove content has not been effective, and it has created incentives to hide or spread the content further. Because AIRS is focused on the most severe violations, we have to act quickly to protect the community.
Q: What is the false positive rate?
A: So far, AIRS has reviewed over 4.8 million inventions and flagged over 100,000 for violations. Across all these, we’ve identified just a handful of false positives equal to a tiny fraction of a percent. In those cases, we restored the room and the invention. We continually monitor and audit AIRS to ensure it’s accurate and fair, and we’ll keep refining it as it scales further.
Q: Why is AIRS actioning so much content?
A: AIRS is currently catching up on a backlog of millions of past inventions. And when it detects a violation, it prioritizes scanning inventions that are similar to that one. That’s why you’re seeing a high volume of actions right now.
Once the backlog is reviewed, the daily moderation rate will decrease significantly. Most creators, who follow the rules, will see little to no impact going forward.
We Love Your Feedback
We appreciate all the comments, questions, and suggestions we’ve received about AIRS. Your feedback has helped us improve our systems. We will continue to iterate on our moderation systems to ensure we’re keeping Rec Room as safe as possible for our creators and players.