Instructions to use Xenova/tiny-random-Starcoder2ForCausalLM with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use Xenova/tiny-random-Starcoder2ForCausalLM with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'Xenova/tiny-random-Starcoder2ForCausalLM');
Commit History
-
Add/update the quantized ONNX model files and README.md for Transformers.js v3
Verified signature## Applied Quantizations ### ✅ Based on `decoder_model_merged.onnx` *with* slimming **The base model `decoder_model_merged.onnx` has been renamed to `model.onnx`.** ↳ ✅ `fp16`: `model_fp16.onnx` (added) ↳ ✅ `int8`: `model_int8.onnx` (added) ↳ ✅ `uint8`: `model_uint8.onnx` (added) ↳ ✅ `q4`: `model_q4.onnx` (added) ↳ ✅ `q4f16`: `model_q4f16.onnx` (added) ↳ ✅ `bnb4`: `model_bnb4.onnx` (added)2882d62
-
Rename onnx/model_quantized.onnx to onnx/decoder_model_merged_quantized.onnx
Verified signature25ba6d8 -
Rename onnx/model.onnx to onnx/decoder_model_merged.onnx
Verified signatureb354d5e -
Upload folder using huggingface_hub
Verified signature299d667 -
Delete onnx
Verified signature9ab0d56 -
Upload folder using huggingface_hub
Verified signaturedd9ec6f -
Rename onnx/model_quantized.onnx to onnx/decoder_model_merged_quantized.onnx
Verified signature03ee92a -
Rename onnx/model.onnx to onnx/decoder_model_merged.onnx
Verified signature4c0f342 -
Upload folder using huggingface_hub
Verified signature7217998