generation_args in the example
#10
by Ray2333 - opened
Awesome work! Congratulations! I noticed that the definition of generation_args is missing in the example.
with torch.inference_mode():
generate_ids = model.generate(**inputs, **generation_args)
Ray2333 changed discussion status to closed