How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("feature-extraction", model="zenlm/zen-embedding-4B")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("zenlm/zen-embedding-4B")
model = AutoModelForCausalLM.from_pretrained("zenlm/zen-embedding-4B")
Quick Links

Zen Embedding 4B

4B-parameter sentence-embedding model for retrieval-augmented generation, semantic search, and dense retrieval. Part of the Zen embedding family.

Hosted via Hanzo gateway

Served at api.hanzo.ai as zen-embedding-4b.

Files

Native HuggingFace safetensors weights, loadable directly with transformers:

from transformers import AutoModel, AutoTokenizer
m = AutoModel.from_pretrained("zenlm/zen-embedding-4B")
t = AutoTokenizer.from_pretrained("zenlm/zen-embedding-4B")

For GGUF / Ollama deployment, see zenlm/zen-embedding-4B-GGUF.

Downloads last month
46
Safetensors
Model size
4B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support