Instructions to use onnx-community/SmallThinker-3B-Preview-ONNX with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use onnx-community/SmallThinker-3B-Preview-ONNX with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'onnx-community/SmallThinker-3B-Preview-ONNX');
https://huggingface.co/PowerInfer/SmallThinker-3B-Preview with ONNX weights to be compatible with Transformers.js.
Note: Having a separate repo for ONNX weights is intended to be a temporary solution until WebML gains more traction. If you would like to make your models web-ready, we recommend converting to ONNX using 🤗 Optimum and structuring your repo like this one (with ONNX weights located in a subfolder named onnx).
- Downloads last month
- 6
Model tree for onnx-community/SmallThinker-3B-Preview-ONNX
Base model
Qwen/Qwen2.5-3B Finetuned
Qwen/Qwen2.5-3B-Instruct Finetuned
Tiiny/SmallThinker-3B-Preview