Edge RAG LLMs
Collection
Lightweight LLMs specialised in RAG based on t5, bart, bert, roberta with ONNX conversion • 26 items • Updated • 1
How to use tomasmcm/intel-dynamic-tinybert-onnx with Transformers.js:
// npm i @huggingface/transformers
import { pipeline } from '@huggingface/transformers';
// Allocate pipeline
const pipe = await pipeline('question-answering', 'tomasmcm/intel-dynamic-tinybert-onnx');https://huggingface.co/Intel/dynamic_tinybert with ONNX weights to be compatible with Transformers.js.
Base model
Intel/dynamic_tinybert
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('question-answering', 'tomasmcm/intel-dynamic-tinybert-onnx');