allenai

/

Olmo-3.1-32B-Instruct

like 35

Follow

Ai2 4.92k

hi, I noticed that in the config, it has "use_cache": false, - is there a reason this is better/needed for this model? It will make inference with transformers abysmally slow, and afaik, goes against standard configuration for text-only decoder models