This was created using unsloth example colab notebook - data and training steps skipped. Python notebook available in files.
The intention was to make a quantized model file that can run on executorch. Please verify steps in the colab notebook before you use this.
Backend used - XNNPACK
- Downloads last month
- 7
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support