ByteDance-Seed
/

Seed-Coder-8B-Reasoning

Text Generation

text-generation-inference

Model card Files Files and versions

yuyuzhang commited on Apr 30

Commit

2b6ecaa

·

verified ·

1 Parent(s): 13911cf

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -56,7 +56,7 @@ input_ids = tokenizer.apply_chat_template(
     add_generation_prompt=True,
 ).to(model.device)
-outputs = model.generate(input_ids, max_new_tokens=32768)
 response = tokenizer.decode(outputs[0][input_ids.shape[-1]:], skip_special_tokens=True)
 print(response)
 ```

     add_generation_prompt=True,
 ).to(model.device)
+outputs = model.generate(input_ids, max_new_tokens=16384)
 response = tokenizer.decode(outputs[0][input_ids.shape[-1]:], skip_special_tokens=True)
 print(response)
 ```