Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
wop 
posted an update about 10 hours ago
Post
505
🧪 SlopFinder is here!!

We're building a dataset to study what humans actually consider AI slop.

SlopFinder shows you a random piece of AI-generated text and gives you one simple control: **how slop is it?**
No categories. No complicated forms. Just vote and move on.

Every vote helps build the dataset. 🧩

How does it work?
Samples are pulled from existing datasets, shown anonymously, and collected into our annotation pool. After enough votes, they're exported to Hugging Face for everyone to use.

This is an early MVP, so the dataset is small and the system is still evolving.

Vote here:
https://bench-labs.web.app/slopfinder.html
(refresh page if you want to skip)

Dataset:
bench-labs/slop-classification

@benchlabs

Update: you can now also add custom conversations and score them!
image

It being slop itself is ironic...
Screenshot_20260808_190730

(im joking)

Wonder if someone could build an open-weights GPTZero alternative with this...

·

Oh this is super interesting and a great idea! I voted on some of them! An open-weights GPTZero alternative would be really cool to see.

This is growing pretty fast,I just uploaded another batch, theres now ~115 rows (before 85) 🔥

I will soon make an upgrade for better batching + some big improvements (context & diversity) and maybe some visual upgrade, and maybe auto upload🎉

I wonder what improvements you would like to see (maybe an API?) - tho its suposted not to be automated with AI, but voted by humans🤷🏻

If i take the word slop to effectively mean 'low quality/effort' then that would be the way i'd rate it. I see good text output and bad text output. Personally generated images 1 in 40 are good to use as-is, often bad eyes/hands or other can ruin an image (even if it's stylized like being charcoal/sketch drawing).

Ultimately if content is enjoyable then it has more value/merit, while outright broken or things that don't logically make sense just slowly makes it hurt in your brain.

Slop can also be seen i suppose as 'baby's first FPS' or something. Literally they took source code, assets (asset flip?) or a completed game, threw in hand drawn textures and a weak map and then tried to sell it rather than using it as a stepping stone for something better.

Though i'll probably help if i can with this.