Commit History
-
[bugfix] Initialize attention bias on the same device as Query/Key/Value
Verified signatureThe attention bias in xformers is currently initialized on the default device, rather than the device of the Q/K/V tensors. Thus, in a multi-GPU environment, the following error occurs: ```log Error: Attention bias and Query/Key/Value should be on the same device query.device: cuda:6 attn_bias : cuda:0 ``` This PR resolved the above error. Note: The same error occurred in vllm and was resolved by the following PR. https://github.com/vllm-project/vllm/pull/134688bdecf3
-
Update README.md
Verified signature8d158c9
-
Update README.md
Verified signature6c3ac78 -
Update README.md
Verified signature38c6c6d
-
Update README.md
Verified signature2a309ab
-
Update README.md
Verified signature68d4926 -
Update README.md
Verified signature6f15a91 -
Update README.md
Verified signatureb74903d
-
Upload tokenizer
Verified signature62b1206 -
Upload NewForSequenceClassification
Verified signature0599e88 -
initial commit
Verified signature0c90aa0