Instructions to use Xenova/tiny-random-mistral with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use Xenova/tiny-random-mistral with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'Xenova/tiny-random-mistral');
Commit History
-
Add/update the quantized ONNX model files and README.md for Transformers.js v3
Verified signature## Applied Quantizations ### ✅ Based on `decoder_model_merged.onnx` *with* slimming **The base model `decoder_model_merged.onnx` has been renamed to `model.onnx`.** ↳ ✅ `fp16`: `model_fp16.onnx` (added) ↳ ✅ `int8`: `model_int8.onnx` (added) ↳ ✅ `uint8`: `model_uint8.onnx` (added) ↳ ✅ `q4`: `model_q4.onnx` (added) ↳ ✅ `q4f16`: `model_q4f16.onnx` (added) ↳ ✅ `bnb4`: `model_bnb4.onnx` (added)7a3c4c0
-
[Automated] Update base model metadata
Verified signatureSet base model to "echarlaix/tiny-random-mistral"39e5fed
-
Rename onnx/model.onnx to onnx/decoder_model_merged.onnx
9724951 -
Rename onnx/model_quantized.onnx to onnx/decoder_model_merged_quantized.onnx
69fd710 -
Upload folder using huggingface_hub
f05b56a -
Upload README.md with huggingface_hub
c66fcce -
initial commit
5ff3fa0