broadfield-dev
/

gemma-3-270m-context-qa

Generated from Trainer

Model card Files Files and versions

broadfield-dev commited on Jan 5

Commit

f2780ff

·

verified ·

1 Parent(s): 8861934

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -34,6 +34,6 @@ messages = [
 ]
 inputs = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True).to(model.device)
-outputs = model.generate(inputs, max_new_tokens=100)
 print(tokenizer.decode(outputs[0], skip_special_tokens=True))
 ```

 ]
 inputs = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True).to(model.device)
+outputs = model.generate(inputs, max_new_tokens=256)
 print(tokenizer.decode(outputs[0], skip_special_tokens=True))
 ```