Instructions to use onnx-community/MobileLLM-125M with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use onnx-community/MobileLLM-125M with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('text-generation', 'onnx-community/MobileLLM-125M');
How to use this onnx model?
#1
by FengJungle - opened
How to use this model? There are variables, 'batch_size', 'sequence_length', 'past_sequence_length + 1', how to use it?
If I use onnx tool to modify these variables, what values should I fill ?