scb10x
/

llama3.2-typhoon2-1b-instruct

Text Generation

Model card Files Files and versions

kunato commited on Dec 20, 2024

Commit

0f52bb2

·

verified ·

1 Parent(s): 836a4eb

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -66,7 +66,7 @@ terminators = [
     tokenizer.eos_token_id,
     tokenizer.convert_tokens_to_ids("<|eot_id|>")
 ]
 outputs = model.generate(
     input_ids,
     max_new_tokens=512,

     tokenizer.eos_token_id,
     tokenizer.convert_tokens_to_ids("<|eot_id|>")
 ]
+## Typhoon 1b need low temperature to inference.
 outputs = model.generate(
     input_ids,
     max_new_tokens=512,