Salesforce
/

xgen-small-4B-instruct-r

Text Generation

text-generation-inference

Model card Files Files and versions

enijkamp commited on May 9, 2025

Commit

8d8c326

·

verified ·

1 Parent(s): 94356b8

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -46,7 +46,7 @@ inputs = tokenizer.apply_chat_template(
     return_tensors="pt"
 ).to(model.device)
-generated = model.generate(inputs, max_new_tokens=32)
 output = tokenizer.decode(
     generated[0],
     skip_special_tokens=True,

     return_tensors="pt"
 ).to(model.device)
+generated = model.generate(inputs, max_new_tokens=128)
 output = tokenizer.decode(
     generated[0],
     skip_special_tokens=True,