TypeError: arange() received an invalid combination of arguments
TypeError: arange() received an invalid combination of arguments - got (NoneType, int, device=torch.device), but expected one of:
- (Number end, *, Tensor out, torch.dtype dtype, torch.layout layout, torch.device device, bool pin_memory, bool requires_grad)
- (Number start, Number end, *, torch.dtype dtype, torch.layout layout, torch.device device, bool pin_memory, bool requires_grad)
- (Number start, Number end, Number step, *, Tensor out, torch.dtype dtype, torch.layout layout, torch.device device, bool pin_memory, bool requires_grad)
I got this error when I was running the code "outputs = model.generate(**input_ids)"
I ran into the same problem before. The error message was misleading, and it turned out to be related to a dependent library of transformers.
You can try with these lib dependencies (https://github.com/huggingface/alignment-handbook/blob/main/setup.py) along with the latest transformers in the repo.
Hey @darrenbudiman , @tanliboy , sorry you ran in this issue!
@tanliboy do you mind sharing what was the issue with a dependent library? We should try to solve this.
@lysandre I took a closer look at the issue, and here's what I found. I initially thought it was a dependency problem. However, I found it was related to a bug in transformers (see issue #31664). This bug has already been fixed in PR #31661.
It is worth noting that the Gemma 2 PR #31659 landed a few hours before this PR. If anyone pulled the master version between them, they might encounter this problem.
Hi @darrenbudiman , @tanliboy , I hope the issue has been resolved. Please let us know if any further assistance is needed. Thanks!