Instructions to use smarttasks/nomic-embed-text-v1.5-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- llama-cpp-python
How to use smarttasks/nomic-embed-text-v1.5-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="smarttasks/nomic-embed-text-v1.5-GGUF", filename="nomic-embed-text-v1.5-Q4_K_M.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use smarttasks/nomic-embed-text-v1.5-GGUF with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M # Run inference directly in the terminal: llama cli -hf smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M
Use Docker
docker model run hf.co/smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M
- LM Studio
- Jan
- Ollama
How to use smarttasks/nomic-embed-text-v1.5-GGUF with Ollama:
ollama run hf.co/smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M
- Unsloth Studio
How to use smarttasks/nomic-embed-text-v1.5-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for smarttasks/nomic-embed-text-v1.5-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for smarttasks/nomic-embed-text-v1.5-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for smarttasks/nomic-embed-text-v1.5-GGUF to start chatting
- Atomic Chat new
- Docker Model Runner
How to use smarttasks/nomic-embed-text-v1.5-GGUF with Docker Model Runner:
docker model run hf.co/smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M
- Lemonade
How to use smarttasks/nomic-embed-text-v1.5-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull smarttasks/nomic-embed-text-v1.5-GGUF:Q4_K_M
Run and chat with the model
lemonade run user.nomic-embed-text-v1.5-GGUF-Q4_K_M
List all available models
lemonade list
Required usage: task prefixes
nomic-embed-text requires task-instruction prefixes. Without them, retrieval quality collapses.
- Prepend
search_query:to every query. - Prepend
search_document:to every document you index.
Other supported prefixes: classification: , clustering: . The MTEB score below (SciFact 0.7056 nDCG@10) was measured with these prefixes.
Long context (8192 tokens): the GGUF defaults to 2048. For the full window, serve with --rope-scaling yarn --rope-freq-scale 0.75 -c 8192.
nomic-embed-text-v1.5 β Embedding GGUF (quantization-verified)
Quantized embedding model in GGUF, served in --embedding mode via llama.cpp. This is an encoder β it outputs vectors, not text. It is validated for retrieval quality and quantization fidelity, not chat behavior.
Files
nomic-embed-text-v1.5-Q4_K_M.gguf(90.1 MB)nomic-embed-text-v1.5-Q5_K_M.gguf(101.2 MB)nomic-embed-text-v1.5-Q8_0.gguf(146.0 MB)
Quantization drift
Run embedding_quant_drift.py to populate.
Retrieval sanity (lightweight)
Built-in 12-query retrieval check (no external corpus): top-1 accuracy 1.0, MRR 1.0. healthy (top-1 >= 0.9)
Retrieval (MTEB)
Standardized MTEB retrieval scores (main metric, usually nDCG@10 β higher is better). These are comparable across models on the MTEB leaderboard.
| Task | Score |
|---|---|
| SciFact | 0.7056 |
Metric: main_score (retrieval tasks: nDCG@10). Measured on the Q8_0 quant served via llama.cpp.
Dense-retrieval mode. These scores are for standard single-vector dense retrieval (what llama.cpp serves). Models like BGE-M3 that also support sparse/multi-vector (ColBERT) modes score higher in hybrid setups β that capability isn't exercised here, so compare this number against other models' dense scores, not hybrid ones.
What this is NOT
This card carries no safety, red-team, or viewpoint scores: those do not apply to an embedding model. For chat-model governance cards, see the SmartTasks text-LLM line.
- Downloads last month
- -
4-bit
5-bit
8-bit
Model tree for smarttasks/nomic-embed-text-v1.5-GGUF
Base model
nomic-ai/nomic-embed-text-v1.5