These are ggml quantizations of the Open Llama 3b model published by OpenLM Research, primarily for use with the Unity LLM runtime Perro Pastor.
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support