Instructions to use ryandono/osgrep-colbert-q8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers.js
How to use ryandono/osgrep-colbert-q8 with Transformers.js:
// npm i @huggingface/transformers import { pipeline } from '@huggingface/transformers'; // Allocate pipeline const pipe = await pipeline('feature-extraction', 'ryandono/osgrep-colbert-q8');
osgrep-colbert-q8
This model is a quantized (Int8 / Q8) version of mixedbread-ai/mxbai-edge-colbert-v0-17m exported for use with transformers.js.
It includes the custom projection layers required for the 48-dimension ColBERT architecture.
Original Model License
This model is a derivative work of mixedbread-ai/mxbai-edge-colbert-v0-17m, licensed under the Apache 2.0 License.
Please refer to the original model card for citation and full license details.
- Downloads last month
- 6
Model tree for ryandono/osgrep-colbert-q8
Base model
mixedbread-ai/mxbai-edge-colbert-v0-17m