Instructions to use SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct")
model = AutoModelForCausalLM.from_pretrained("SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct

SGLang

How to use SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Docker Model Runner
How to use SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct with Docker Model Runner:
```
docker model run hf.co/SemanticAlignment/Mistral-v0.1-Italian-SAVA-instruct
```

iperbole commited on May 20

Commit

24585c2

verified ·

1 Parent(s): 9292067

Upload folder using huggingface_hub

Browse files

Files changed (11) hide show

added_tokens.json +4 -4
config.json +4 -3
generation_config.json +1 -1
model-00001-of-00003.safetensors +2 -2
model-00002-of-00003.safetensors +1 -1
model-00003-of-00003.safetensors +2 -2
model.safetensors.index.json +1 -2
special_tokens_map.json +8 -8
tokenizer.json +0 -0
tokenizer.model +2 -2
tokenizer_config.json +6 -6

added_tokens.json CHANGED Viewed

@@ -1,6 +1,6 @@
 {
-  "<|end_header_id|>": 32001,
-  "<|eom_id|>": 32003,
-  "<|eot_id|>": 32002,
-  "<|start_header_id|>": 32000
 }

 {
+  "<|end_header_id|>": 32769,
+  "<|eom_id|>": 32771,
+  "<|eot_id|>": 32770,
+  "<|start_header_id|>": 32768
 }

config.json CHANGED Viewed

@@ -4,7 +4,6 @@
   ],
   "attention_dropout": 0.0,
   "bos_token_id": 1,
-  "dtype": "bfloat16",
   "eos_token_id": 2,
   "head_dim": null,
   "hidden_act": "silu",
@@ -20,7 +19,9 @@
   "rope_theta": 10000.0,
   "sliding_window": 4096,
   "tie_word_embeddings": false,
-  "transformers_version": "4.57.3",
   "use_cache": false,
-  "vocab_size": 32064
 }

   ],
   "attention_dropout": 0.0,
   "bos_token_id": 1,
   "eos_token_id": 2,
   "head_dim": null,
   "hidden_act": "silu",
   "rope_theta": 10000.0,
   "sliding_window": 4096,
   "tie_word_embeddings": false,
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.52.0.dev0",
+  "unk_token_id": 0,
   "use_cache": false,
+  "vocab_size": 32832
 }

generation_config.json CHANGED Viewed

@@ -2,5 +2,5 @@
   "_from_model_config": true,
   "bos_token_id": 1,
   "eos_token_id": 2,
-  "transformers_version": "4.57.3"
 }

   "_from_model_config": true,
   "bos_token_id": 1,
   "eos_token_id": 2,
+  "transformers_version": "4.52.0.dev0"
 }

model-00001-of-00003.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a0b933394db60ddca8fdb82f9d8bb36421626f96e97d279945e2c9b1bf4cf07d
-size 4943686624

 version https://git-lfs.github.com/spec/v1
+oid sha256:19e44acec21cbc7be9f6081c4c4cbf738a7ea8c384a04158375cd76551dcc45e
+size 4949978080

model-00002-of-00003.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9f1d10d1b1446937d76896bbdafa3d35d1fc8306798aeded6fa58cbcf6f64d93
 size 4999819336

 version https://git-lfs.github.com/spec/v1
+oid sha256:c3eeb535d837b3ecf67ffaeb9348ed47aed28a3c225cc180127196a0acfa68f2
 size 4999819336

model-00003-of-00003.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a9dde18c5778701bea9674f80f7c47a700f301da728fdc6bbacb61fed6488306
-size 4541040632

 version https://git-lfs.github.com/spec/v1
+oid sha256:cf58c542f35dbf21b368773760433e5ad2b0b4cf7022b13ed42df3556d8708d0
+size 4547332088

model.safetensors.index.json CHANGED Viewed

@@ -1,7 +1,6 @@
 {
   "metadata": {
-    "total_parameters": 7242256384,
-    "total_size": 14484512768
   },
   "weight_map": {
     "lm_head.weight": "model-00003-of-00003.safetensors",

 {
   "metadata": {
+    "total_size": 14497095680
   },
   "weight_map": {
     "lm_head.weight": "model-00003-of-00003.safetensors",

special_tokens_map.json CHANGED Viewed

@@ -1,6 +1,12 @@
 {
   "additional_special_tokens": [
-    "<|eom_id|>"
   ],
   "bos_token": {
     "content": "<s>",
@@ -16,13 +22,7 @@
     "rstrip": false,
     "single_word": false
   },
-  "pad_token": {
-    "content": "<|eot_id|>",
-    "lstrip": false,
-    "normalized": false,
-    "rstrip": false,
-    "single_word": false
-  },
   "unk_token": {
     "content": "<unk>",
     "lstrip": false,

 {
   "additional_special_tokens": [
+    {
+      "content": "<|eom_id|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false
+    }
   ],
   "bos_token": {
     "content": "<s>",
     "rstrip": false,
     "single_word": false
   },
+  "pad_token": "<|eot_id|>",
   "unk_token": {
     "content": "<unk>",
     "lstrip": false,

tokenizer.json CHANGED Viewed

The diff for this file is too large to render. See raw diff

tokenizer.model CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dadfd56d766715c61d2ef780a525ab43b8e6da4de6865bda3d95fdef5e134055
-size 493443

 version https://git-lfs.github.com/spec/v1
+oid sha256:bb411d9f702041597b9c84f0c99ee6601f02631467e2a76722db3ca1a2a77bf5
+size 795167

tokenizer_config.json CHANGED Viewed

@@ -1,7 +1,7 @@
 {
   "add_bos_token": true,
   "add_eos_token": false,
-  "add_prefix_space": null,
   "added_tokens_decoder": {
     "0": {
       "content": "<unk>",
@@ -27,7 +27,7 @@
       "single_word": false,
       "special": true
     },
-    "32000": {
       "content": "<|start_header_id|>",
       "lstrip": false,
       "normalized": false,
@@ -35,7 +35,7 @@
       "single_word": false,
       "special": true
     },
-    "32001": {
       "content": "<|end_header_id|>",
       "lstrip": false,
       "normalized": false,
@@ -43,7 +43,7 @@
       "single_word": false,
       "special": true
     },
-    "32002": {
       "content": "<|eot_id|>",
       "lstrip": false,
       "normalized": false,
@@ -51,7 +51,7 @@
       "single_word": false,
       "special": true
     },
-    "32003": {
       "content": "<|eom_id|>",
       "lstrip": false,
       "normalized": false,
@@ -76,5 +76,5 @@
   "split_special_tokens": false,
   "tokenizer_class": "LlamaTokenizer",
   "unk_token": "<unk>",
-  "use_default_system_prompt": false
 }

 {
   "add_bos_token": true,
   "add_eos_token": false,
+  "add_prefix_space": true,
   "added_tokens_decoder": {
     "0": {
       "content": "<unk>",
       "single_word": false,
       "special": true
     },
+    "32768": {
       "content": "<|start_header_id|>",
       "lstrip": false,
       "normalized": false,
       "single_word": false,
       "special": true
     },
+    "32769": {
       "content": "<|end_header_id|>",
       "lstrip": false,
       "normalized": false,
       "single_word": false,
       "special": true
     },
+    "32770": {
       "content": "<|eot_id|>",
       "lstrip": false,
       "normalized": false,
       "single_word": false,
       "special": true
     },
+    "32771": {
       "content": "<|eom_id|>",
       "lstrip": false,
       "normalized": false,
   "split_special_tokens": false,
   "tokenizer_class": "LlamaTokenizer",
   "unk_token": "<unk>",
+  "use_default_system_prompt": true
 }