Feature Extraction
sentence-transformers
Safetensors
Transformers
sentence-similarity
text-embeddings-inference
Instructions to use Qwen/Qwen3-Embedding-8B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use Qwen/Qwen3-Embedding-8B with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("Qwen/Qwen3-Embedding-8B") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Transformers
How to use Qwen/Qwen3-Embedding-8B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="Qwen/Qwen3-Embedding-8B")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Qwen/Qwen3-Embedding-8B", dtype="auto") - Inference
- Notebooks
- Google Colab
- Kaggle
NaN outputs when running in torch.float16 with text containing specific tokens (e.g., "import")
#27 opened 4 months ago
by
Hank-Pan
how to use multi-gpu for inference?
#26 opened 7 months ago
by
hh1212
如果想给embedding模型添加lm_heads该怎么做?
#25 opened 7 months ago
by
linln1
Update README.md
#24 opened 8 months ago
by
RealWorga
Update README.md
#23 opened 10 months ago
by
aari1995
How to make the model generate a 32-dimensional vector
#22 opened 10 months ago
by
talenm01
Issue with Token 474 Causing NaN Embeddings in 8B Model
➕ 2
8
#21 opened 10 months ago
by
Sernaryon
dimensions not working it always generates 4096
#20 opened 11 months ago
by
khanakia
Training for classification task
1
#19 opened 11 months ago
by
nastyafairypro
Update `README.md` to use TEI v1.7 instead
1
#18 opened 11 months ago
by
alvarobartt
Is `tie_word_embeddings: false` correct for this model?
1
#17 opened 11 months ago
by
depasquale
sentence-transformers with 8B
2
#15 opened 12 months ago
by
almugabo
MRL Performance loss
👀 6
#14 opened 12 months ago
by
psych0v0yager
ONNX Conversion
#13 opened 12 months ago
by
shuttie
Downloading issue
#12 opened 12 months ago
by
Elijahhhhh
The invoke results seems quite bad, did I code something wrong?
1
#11 opened 12 months ago
by
ShuyangShi
The result is completely different from the example.
#10 opened 12 months ago
by
lightingfish
Add missing `torch_dtype` in commented snippet in `README.md`
🔥 1
4
#9 opened 12 months ago
by
alvarobartt
Training supported
#7 opened 12 months ago
by
tastelikefeet
как уменьшить размер journalctl linux
#6 opened 12 months ago
by
woldemarus
希望为TEI推理添加支持
#4 opened 12 months ago
by
forseason
不知道能否支持少数民族语言
#3 opened 12 months ago
by
dojeee
Add last token pooling
❤️ 1
1
#2 opened 12 months ago
by
michaelfeil