Instructions to use Impulse2000/multilingual-e5-large-instruct-GGUF with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- sentence-transformers
How to use Impulse2000/multilingual-e5-large-instruct-GGUF with sentence-transformers:
from sentence_transformers import SentenceTransformer model = SentenceTransformer("Impulse2000/multilingual-e5-large-instruct-GGUF") sentences = [ "The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium." ] embeddings = model.encode(sentences) similarities = model.similarity(embeddings, embeddings) print(similarities.shape) # [3, 3] - Transformers
How to use Impulse2000/multilingual-e5-large-instruct-GGUF with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="Impulse2000/multilingual-e5-large-instruct-GGUF")# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("Impulse2000/multilingual-e5-large-instruct-GGUF", dtype="auto") - llama-cpp-python
How to use Impulse2000/multilingual-e5-large-instruct-GGUF with llama-cpp-python:
# !pip install llama-cpp-python from llama_cpp import Llama llm = Llama.from_pretrained( repo_id="Impulse2000/multilingual-e5-large-instruct-GGUF", filename="multilingual-e5-large-instruct-f16.gguf", )
output = llm( "Once upon a time,", max_tokens=512, echo=True ) print(output)
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Impulse2000/multilingual-e5-large-instruct-GGUF with llama.cpp:
Install from brew
brew install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Impulse2000/multilingual-e5-large-instruct-GGUF:F16 # Run inference directly in the terminal: llama-cli -hf Impulse2000/multilingual-e5-large-instruct-GGUF:F16
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama-server -hf Impulse2000/multilingual-e5-large-instruct-GGUF:F16 # Run inference directly in the terminal: llama-cli -hf Impulse2000/multilingual-e5-large-instruct-GGUF:F16
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Impulse2000/multilingual-e5-large-instruct-GGUF:F16 # Run inference directly in the terminal: ./llama-cli -hf Impulse2000/multilingual-e5-large-instruct-GGUF:F16
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Impulse2000/multilingual-e5-large-instruct-GGUF:F16 # Run inference directly in the terminal: ./build/bin/llama-cli -hf Impulse2000/multilingual-e5-large-instruct-GGUF:F16
Use Docker
docker model run hf.co/Impulse2000/multilingual-e5-large-instruct-GGUF:F16
- LM Studio
- Jan
- Ollama
How to use Impulse2000/multilingual-e5-large-instruct-GGUF with Ollama:
ollama run hf.co/Impulse2000/multilingual-e5-large-instruct-GGUF:F16
- Unsloth Studio
How to use Impulse2000/multilingual-e5-large-instruct-GGUF with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Impulse2000/multilingual-e5-large-instruct-GGUF to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Impulse2000/multilingual-e5-large-instruct-GGUF to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Impulse2000/multilingual-e5-large-instruct-GGUF to start chatting
- Docker Model Runner
How to use Impulse2000/multilingual-e5-large-instruct-GGUF with Docker Model Runner:
docker model run hf.co/Impulse2000/multilingual-e5-large-instruct-GGUF:F16
- Lemonade
How to use Impulse2000/multilingual-e5-large-instruct-GGUF with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Impulse2000/multilingual-e5-large-instruct-GGUF:F16
Run and chat with the model
lemonade run user.multilingual-e5-large-instruct-GGUF-F16
List all available models
lemonade list
Update README.md
Browse files
README.md
CHANGED
|
@@ -671,7 +671,7 @@ model-index:
|
|
| 671 |
- type: precision_at_1
|
| 672 |
value: 62.5
|
| 673 |
- type: precision_at_10
|
| 674 |
-
value: 30
|
| 675 |
- type: precision_at_100
|
| 676 |
value: 10.038
|
| 677 |
- type: precision_at_1000
|
|
@@ -3211,7 +3211,7 @@ model-index:
|
|
| 3211 |
- type: map_at_5
|
| 3212 |
value: 1.097
|
| 3213 |
- type: mrr_at_1
|
| 3214 |
-
value: 90
|
| 3215 |
- type: mrr_at_10
|
| 3216 |
value: 94.667
|
| 3217 |
- type: mrr_at_100
|
|
@@ -3223,9 +3223,9 @@ model-index:
|
|
| 3223 |
- type: mrr_at_5
|
| 3224 |
value: 94.667
|
| 3225 |
- type: ndcg_at_1
|
| 3226 |
-
value: 86
|
| 3227 |
- type: ndcg_at_10
|
| 3228 |
-
value: 82
|
| 3229 |
- type: ndcg_at_100
|
| 3230 |
value: 64.307
|
| 3231 |
- type: ndcg_at_1000
|
|
@@ -3235,7 +3235,7 @@ model-index:
|
|
| 3235 |
- type: ndcg_at_5
|
| 3236 |
value: 84.904
|
| 3237 |
- type: precision_at_1
|
| 3238 |
-
value: 90
|
| 3239 |
- type: precision_at_10
|
| 3240 |
value: 85.8
|
| 3241 |
- type: precision_at_100
|
|
@@ -3243,7 +3243,7 @@ model-index:
|
|
| 3243 |
- type: precision_at_1000
|
| 3244 |
value: 25.202
|
| 3245 |
- type: precision_at_3
|
| 3246 |
-
value: 90
|
| 3247 |
- type: precision_at_5
|
| 3248 |
value: 89.2
|
| 3249 |
- type: recall_at_1
|
|
@@ -3440,7 +3440,7 @@ model-index:
|
|
| 3440 |
- type: accuracy
|
| 3441 |
value: 96.1
|
| 3442 |
- type: f1
|
| 3443 |
-
value: 95
|
| 3444 |
- type: precision
|
| 3445 |
value: 94.46666666666668
|
| 3446 |
- type: recall
|
|
@@ -3663,7 +3663,7 @@ model-index:
|
|
| 3663 |
- type: f1
|
| 3664 |
value: 98.2
|
| 3665 |
- type: precision
|
| 3666 |
-
value: 98
|
| 3667 |
- type: recall
|
| 3668 |
value: 98.6
|
| 3669 |
- task:
|
|
@@ -3931,13 +3931,13 @@ model-index:
|
|
| 3931 |
revision: 9080400076fbadbb4c4dcb136ff4eddc40b42553
|
| 3932 |
metrics:
|
| 3933 |
- type: accuracy
|
| 3934 |
-
value: 96
|
| 3935 |
- type: f1
|
| 3936 |
value: 94.78333333333333
|
| 3937 |
- type: precision
|
| 3938 |
value: 94.18333333333334
|
| 3939 |
- type: recall
|
| 3940 |
-
value: 96
|
| 3941 |
- task:
|
| 3942 |
type: BitextMining
|
| 3943 |
dataset:
|
|
@@ -4084,13 +4084,13 @@ model-index:
|
|
| 4084 |
revision: 9080400076fbadbb4c4dcb136ff4eddc40b42553
|
| 4085 |
metrics:
|
| 4086 |
- type: accuracy
|
| 4087 |
-
value: 97
|
| 4088 |
- type: f1
|
| 4089 |
value: 96.22333333333334
|
| 4090 |
- type: precision
|
| 4091 |
value: 95.875
|
| 4092 |
- type: recall
|
| 4093 |
-
value: 97
|
| 4094 |
- task:
|
| 4095 |
type: BitextMining
|
| 4096 |
dataset:
|
|
@@ -4577,13 +4577,13 @@ model-index:
|
|
| 4577 |
revision: 9080400076fbadbb4c4dcb136ff4eddc40b42553
|
| 4578 |
metrics:
|
| 4579 |
- type: accuracy
|
| 4580 |
-
value: 92
|
| 4581 |
- type: f1
|
| 4582 |
value: 89.77999999999999
|
| 4583 |
- type: precision
|
| 4584 |
value: 88.78333333333333
|
| 4585 |
- type: recall
|
| 4586 |
-
value: 92
|
| 4587 |
- task:
|
| 4588 |
type: BitextMining
|
| 4589 |
dataset:
|
|
@@ -4730,13 +4730,13 @@ model-index:
|
|
| 4730 |
revision: 9080400076fbadbb4c4dcb136ff4eddc40b42553
|
| 4731 |
metrics:
|
| 4732 |
- type: accuracy
|
| 4733 |
-
value: 97
|
| 4734 |
- type: f1
|
| 4735 |
value: 96.11666666666666
|
| 4736 |
- type: precision
|
| 4737 |
value: 95.68333333333334
|
| 4738 |
- type: recall
|
| 4739 |
-
value: 97
|
| 4740 |
- task:
|
| 4741 |
type: BitextMining
|
| 4742 |
dataset:
|
|
@@ -5380,8 +5380,9 @@ model-index:
|
|
| 5380 |
value: 87.11747055081017
|
| 5381 |
- type: max_f1
|
| 5382 |
value: 80.13002540726349
|
|
|
|
| 5383 |
---
|
| 5384 |
|
| 5385 |
# Impulse2000/multilingual-e5-large-instruct-GGUF
|
| 5386 |
This model was converted to GGUF format from [`intfloat/multilingual-e5-large-instruct`](https://huggingface.co/intfloat/multilingual-e5-large-instruct) using llama.cpp via its 'convert_hf_to_gguf.py' script.
|
| 5387 |
-
Refer to the [original model card](https://huggingface.co/intfloat/multilingual-e5-large-instruct) for more details on the model.
|
|
|
|
| 671 |
- type: precision_at_1
|
| 672 |
value: 62.5
|
| 673 |
- type: precision_at_10
|
| 674 |
+
value: 30
|
| 675 |
- type: precision_at_100
|
| 676 |
value: 10.038
|
| 677 |
- type: precision_at_1000
|
|
|
|
| 3211 |
- type: map_at_5
|
| 3212 |
value: 1.097
|
| 3213 |
- type: mrr_at_1
|
| 3214 |
+
value: 90
|
| 3215 |
- type: mrr_at_10
|
| 3216 |
value: 94.667
|
| 3217 |
- type: mrr_at_100
|
|
|
|
| 3223 |
- type: mrr_at_5
|
| 3224 |
value: 94.667
|
| 3225 |
- type: ndcg_at_1
|
| 3226 |
+
value: 86
|
| 3227 |
- type: ndcg_at_10
|
| 3228 |
+
value: 82
|
| 3229 |
- type: ndcg_at_100
|
| 3230 |
value: 64.307
|
| 3231 |
- type: ndcg_at_1000
|
|
|
|
| 3235 |
- type: ndcg_at_5
|
| 3236 |
value: 84.904
|
| 3237 |
- type: precision_at_1
|
| 3238 |
+
value: 90
|
| 3239 |
- type: precision_at_10
|
| 3240 |
value: 85.8
|
| 3241 |
- type: precision_at_100
|
|
|
|
| 3243 |
- type: precision_at_1000
|
| 3244 |
value: 25.202
|
| 3245 |
- type: precision_at_3
|
| 3246 |
+
value: 90
|
| 3247 |
- type: precision_at_5
|
| 3248 |
value: 89.2
|
| 3249 |
- type: recall_at_1
|
|
|
|
| 3440 |
- type: accuracy
|
| 3441 |
value: 96.1
|
| 3442 |
- type: f1
|
| 3443 |
+
value: 95
|
| 3444 |
- type: precision
|
| 3445 |
value: 94.46666666666668
|
| 3446 |
- type: recall
|
|
|
|
| 3663 |
- type: f1
|
| 3664 |
value: 98.2
|
| 3665 |
- type: precision
|
| 3666 |
+
value: 98
|
| 3667 |
- type: recall
|
| 3668 |
value: 98.6
|
| 3669 |
- task:
|
|
|
|
| 3931 |
revision: 9080400076fbadbb4c4dcb136ff4eddc40b42553
|
| 3932 |
metrics:
|
| 3933 |
- type: accuracy
|
| 3934 |
+
value: 96
|
| 3935 |
- type: f1
|
| 3936 |
value: 94.78333333333333
|
| 3937 |
- type: precision
|
| 3938 |
value: 94.18333333333334
|
| 3939 |
- type: recall
|
| 3940 |
+
value: 96
|
| 3941 |
- task:
|
| 3942 |
type: BitextMining
|
| 3943 |
dataset:
|
|
|
|
| 4084 |
revision: 9080400076fbadbb4c4dcb136ff4eddc40b42553
|
| 4085 |
metrics:
|
| 4086 |
- type: accuracy
|
| 4087 |
+
value: 97
|
| 4088 |
- type: f1
|
| 4089 |
value: 96.22333333333334
|
| 4090 |
- type: precision
|
| 4091 |
value: 95.875
|
| 4092 |
- type: recall
|
| 4093 |
+
value: 97
|
| 4094 |
- task:
|
| 4095 |
type: BitextMining
|
| 4096 |
dataset:
|
|
|
|
| 4577 |
revision: 9080400076fbadbb4c4dcb136ff4eddc40b42553
|
| 4578 |
metrics:
|
| 4579 |
- type: accuracy
|
| 4580 |
+
value: 92
|
| 4581 |
- type: f1
|
| 4582 |
value: 89.77999999999999
|
| 4583 |
- type: precision
|
| 4584 |
value: 88.78333333333333
|
| 4585 |
- type: recall
|
| 4586 |
+
value: 92
|
| 4587 |
- task:
|
| 4588 |
type: BitextMining
|
| 4589 |
dataset:
|
|
|
|
| 4730 |
revision: 9080400076fbadbb4c4dcb136ff4eddc40b42553
|
| 4731 |
metrics:
|
| 4732 |
- type: accuracy
|
| 4733 |
+
value: 97
|
| 4734 |
- type: f1
|
| 4735 |
value: 96.11666666666666
|
| 4736 |
- type: precision
|
| 4737 |
value: 95.68333333333334
|
| 4738 |
- type: recall
|
| 4739 |
+
value: 97
|
| 4740 |
- task:
|
| 4741 |
type: BitextMining
|
| 4742 |
dataset:
|
|
|
|
| 5380 |
value: 87.11747055081017
|
| 5381 |
- type: max_f1
|
| 5382 |
value: 80.13002540726349
|
| 5383 |
+
pipeline_tag: feature-extraction
|
| 5384 |
---
|
| 5385 |
|
| 5386 |
# Impulse2000/multilingual-e5-large-instruct-GGUF
|
| 5387 |
This model was converted to GGUF format from [`intfloat/multilingual-e5-large-instruct`](https://huggingface.co/intfloat/multilingual-e5-large-instruct) using llama.cpp via its 'convert_hf_to_gguf.py' script.
|
| 5388 |
+
Refer to the [original model card](https://huggingface.co/intfloat/multilingual-e5-large-instruct) for more details on the model.
|