fuzhenxin

fuzhenxin's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in unsloth/DeepSeek-R1-GGUF 11 months ago

DeepSeek-R1-UD-Q2_K_XL model inference by llama.cpp can't use flash-attention with n_embd_head_k!=n_embd_head_v

2

#43 opened 11 months ago by

fuzhenxin

DeepSeek-R1-UD-Q2_K_XL model inference by llama.cpp can't use flash-attention with n_embd_head_k!=n_embd_head_v

2

#43 opened 11 months ago by

fuzhenxin