Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
P1ayer-1 
posted an update 1 day ago
Post
60
GameDecider will be fully open source. The alpha is currently private. Email me at noah@holdoutlabs.ai or leave your Discord in the replies for access.
This game is a tech demo to gather validation data.

https://p1ayer-1-gamedecider-playground.hf.space/mean?ref=hfpost

Can you tell when someone doesn't mean it? Mean It? is a 3-minute daily game: 5 short lines (apologies, threats, alibis, sarcasm), you call sincere or faking. Then you get a secret brief and write a line to fool tomorrow's players.

So far players got 100% of the hidden-intent cards but only 50% of the apologies. Fake sorry is hard to spot.

What are the player and card counts behind the 100% and 50%, and is the reference label the secret brief assigned to the writer? That distinction would help readers interpret the result as recovering a scripted intent, rather than detecting whether a real person is sincere.

For the evaluation, I would keep repeated guesses on the same card separate from new cards, and consider recording confidence or “not enough context” alongside the binary choice. A short apology may leave several intentions compatible with the words. I have read the announcement, not tested the private alpha; are you planning to publish those denominators and the labeling rules with the demo results?

·

Fair points, thanks. Honest denominators: the day-1 numbers were one card per type (intent 12/12, apology 7/14), because everyone gets the same five cards a day. As of now it’s 33 players and 10 cards: intent 18/18 over 2 cards, apology 9/19 over 2. So treat them as anecdotes, not results.

And yes, the reference label is the secret brief the writer was assigned. It measures recovering a scripted intent, not detecting real sincerity. The first-day cards were model-written to a brief and kept only if a second model read them blind the same way. Player-written lines started today.

Repeat guesses already only count once per player per card. I like the “can’t tell” idea, especially for apologies, where several intents fit the same words. I’ll add it, and publish the labeling rules plus per-card counts on the game page once there are enough cards to say anything.