How to use BricksDisplay/phi-1_5-bnb4 with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'BricksDisplay/phi-1_5-bnb4');
Convert from microsoft/phi-1_5 and BNB 4 bits quantized.
microsoft/phi-1_5
Require onnxruntime>=0.17.0
onnxruntime>=0.17.0
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'BricksDisplay/phi-1_5-bnb4');