Currently running benchmarks.
Was quanted using LLM-Compressor 0.9.1. Working on SM86 cards.
- Downloads last month
- 4
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
馃檵
Ask for provider support
Currently running benchmarks.
Was quanted using LLM-Compressor 0.9.1. Working on SM86 cards.