cut-point ONNX (q8) + frozen block weights (fp16) for choochoo rung 2 4415eb4 verified
chee rabbits commited on
How to use yaycute/qwen2.5-coder-0.5b-block with Transformers.js:
// npm i @huggingface/transformers
import { pipeline } from '@huggingface/transformers';
// Allocate pipeline
const pipe = await pipeline('text-generation', 'yaycute/qwen2.5-coder-0.5b-block');