allenai

/

dolma3-fasttext-quality-classifier

like 3

Follow

Ai2 5.75k

Hi AI2/Olmo team,

I wanted to propose this edit to the README.md so that future users are able to immediately know which label points to what. I initially had them flipped around thinking label 1 is high quality, which confused me when processing Dolma with it. My tests on garbled text vs wikipedia showed me the opposite was apparently the case. I believe I also found this verified in the code itself. So this readme change is just to help other users avoid this mistake in the future. The readme's usage was generated with the help of an AI, but the rest is human

Thanks,
Glenn