Edge RAG LLMs
Collection
Lightweight LLMs specialised in RAG based on t5, bart, bert, roberta with ONNX conversion • 26 items • Updated • 1
How to use tomasmcm/deepset-tinyroberta-squad2-onnx with Transformers.js:
// npm i @huggingface/transformers
import { pipeline } from '@huggingface/transformers';
// Allocate pipeline
const pipe = await pipeline('question-answering', 'tomasmcm/deepset-tinyroberta-squad2-onnx');https://huggingface.co/deepset/tinyroberta-squad2 with ONNX weights to be compatible with Transformers.js.
Base model
deepset/tinyroberta-squad2
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('question-answering', 'tomasmcm/deepset-tinyroberta-squad2-onnx');