Feature Extraction
Transformers
Safetensors
qwen3
fp8
compressed-tensors
llm-compressor
vllm
embedding
text-embeddings-inference
Instructions to use DCC-BS/Qwen3-Embedding-4B-FP8-Dynamic with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use DCC-BS/Qwen3-Embedding-4B-FP8-Dynamic with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="DCC-BS/Qwen3-Embedding-4B-FP8-Dynamic")# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("DCC-BS/Qwen3-Embedding-4B-FP8-Dynamic") model = AutoModel.from_pretrained("DCC-BS/Qwen3-Embedding-4B-FP8-Dynamic", device_map="auto") - Notebooks
- Google Colab
- Kaggle
| { | |
| "word_embedding_dimension": 2560, | |
| "pooling_mode_cls_token": false, | |
| "pooling_mode_mean_tokens": false, | |
| "pooling_mode_max_tokens": false, | |
| "pooling_mode_mean_sqrt_len_tokens": false, | |
| "pooling_mode_weightedmean_tokens": false, | |
| "pooling_mode_lasttoken": true, | |
| "include_prompt": true | |
| } |