We want to be clear–moderating voice violations vs inventions is very different. We need to take different approaches to each. We’ve built our own system, AIRS, for moderating inventions, which we’ve tuned and tested ourselves. This is different from the ToxMod solution we use for voice moderation.
We’ve set a very high threshold on the severity scores that AIRS will action. We found no false positives at these scores when our moderators reviewed them. So the likely scenario is rather than inventions being falsely flagged, some bad stuff will still get through because the threshold is set very high. Once the system has been live for a while and we’ve gathered feedback, we will begin lowering that threshold to ensure we’re catching most of the bad stuff.
Why have it automated if it’s not immediate? And if it’s not immediate, how are you supposed to pinpoint what you did wrong, if you did indeed misunderstand or violate the rules.
Let me walk through a scenario as I think it will help!
I have a room, and I spawned a bad invention in it 1 year ago. I realized I shouldn’t have the invention in my room, so I removed it. Here are my room saves:
Save 1 - no bad inventions
Save 2 - contains a bad invention
Save 3 - no bad inventions
Save 4 - no bad inventions
Save 2 would be moved to an inaccessible state. It still exists on our end, but the player cannot access/restore to that save. Hopefully, this clears things up!
Tell me.. what happens if it false bans a user for creating a “Bad Invention” just because its a model of a cat.. is it AIRS fault or the players fault… i feel like this isn’t gonna help at all
Might be a stretch, but what happens if in the very early stages of development of a room, the creator adds a bad invention that stays in the room for years after development
@Gamerr_VR
Basically sounds like access to the room and your creation will be lost. You will only be able to see what it once was in it’s infancy, before you invested much time in creating.
The main concern I have is, what if you had the violating invention saved until today in a room, what happens to any changes made during that time? Can you access them at all?
Imagine not being able to access months of progress because of a singular invention ban. If the room is not published, would it completely lock me out of that save, requiring a rollback to when you didn’t place that invention?
At least right now, the opposite is likely to happen–it’s likely to miss some bad stuff. We’re using a severity score, so anything above the score we’ve set is automatically actioned. Our moderators manually reviewed hundreds of flagged inventions at or above the score threshold, and we found all of them to be bad.
We designed and built this system ourselves. We did not train the system to detect and action cats, so I can confidently say you can safely create cat inventions. I’ve looked through what the system is catching, and I wish I were looking at a bunch of cat photos instead!
