Safetensors
gemma3_text
peshevskidimitar commited on
Commit
40ca45e
·
verified ·
1 Parent(s): b46905f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -0
README.md CHANGED
@@ -19,3 +19,21 @@ We present the evaluation results viusally in Figure 1.
19
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/67b080b373329eb145daa150/Cl0S2V51aucdo0IMDTCSy.png)
20
 
21
  **Figure 1: Model Performance Comparison Across Evaluation Bencmarks**
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
19
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/67b080b373329eb145daa150/Cl0S2V51aucdo0IMDTCSy.png)
20
 
21
  **Figure 1: Model Performance Comparison Across Evaluation Bencmarks**
22
+
23
+ You can run inference with VezilkaLLM using the Hugging Face Transformers library as shown below:
24
+
25
+ ```{python}
26
+ from transformers import AutoTokenizer, AutoModelForCausalLM, pipeline
27
+
28
+ model_id = "finki-ukim/VezilkaLLM"
29
+
30
+ tokenizer = AutoTokenizer.from_pretrained(model_id)
31
+ model = AutoModelForCausalLM.from_pretrained(model_id)
32
+
33
+ generator = pipeline("text-generation", model=model, tokenizer=tokenizer)
34
+
35
+ prompt = "Зборот „пријателство“ значи "
36
+ outputs = generator(prompt, max_new_tokens=128, do_sample=True, temperature=0.7)
37
+
38
+ print(outputs[0]["generated_text"])
39
+ ```