how to convert model to bf16

#95
by Saicy - opened

when I run the code ,there have a warning:

safetensors_rust.SafetensorError: Error while deserializing header: HeaderTooLarge

If you're looking for an easy way to access this model via API, you can use Crazyrouter — it provides an OpenAI-compatible endpoint for 600+ models including this one. Just pip install openai and change the base URL.

Sign up or log in to comment