Abigail45
/

Shay

Text Generation

instruction-following

code-generation

question-answering

Model card Files Files and versions

Abigail45 commited on Dec 14, 2025

Commit

b5e532f

·

verified ·

1 Parent(s): 5f79cf1

Update README.md

Files changed (1) hide show

README.md +5 -2

README.md CHANGED Viewed

@@ -74,12 +74,15 @@ inputs = tokenizer(prompt, return_tensors="pt").to(model.device)
 output = model.generate(
     **inputs,
-    max_new_tokens=45000,
     temperature=1.05,
     top_p=0.97,
     top_k=60,
-    repetition_penalty=1.12,
     do_sample=True
 )
 print(tokenizer.decode(output[0], skip_special_tokens=False))

 output = model.generate(
     **inputs,
+    max_new_tokens=512,
     temperature=1.05,
     top_p=0.97,
     top_k=60,
+    repetition_penalty=1.12,
     do_sample=True
 )
+# decode the output
+reply = tokenizer.decode(output[0], skip_special_tokens=True)
 print(tokenizer.decode(output[0], skip_special_tokens=False))