katanemo
/

Arch-Function-1.5B

Text Generation

text-generation-inference

Model card Files Files and versions

nehcgs commited on Oct 7, 2024

Commit

2d09e18

·

verified ·

1 Parent(s): 55e7a8f

Update README.md

Files changed (1) hide show

README.md +0 -1

README.md CHANGED Viewed

@@ -276,7 +276,6 @@ inputs = tokenizer.apply_chat_template(
     messages, add_generation_prompt=True, return_tensors="pt"
 ).to(model.device)
-# tokenizer.eos_token_id is the id of <|EOT|> token
 outputs = model.generate(
     inputs,
     max_new_tokens=512,

     messages, add_generation_prompt=True, return_tensors="pt"
 ).to(model.device)
 outputs = model.generate(
     inputs,
     max_new_tokens=512,