LLM
Collection
5 items • Updated
How to use BricksDisplay/stablelm-2-1_6b-q4 with Transformers.js:
// npm i @huggingface/transformers
import { pipeline } from '@huggingface/transformers';
// Allocate pipeline
const pipe = await pipeline('text-generation', 'BricksDisplay/stablelm-2-1_6b-q4');Convert from stabilityai/stablelm-2-1_6b and 4 bits quantized.
Require onnxruntime>=0.17.0
Base model
stabilityai/stablelm-2-1_6b