Road To AGI
roadtoagi
AI & ML interests
None yet
Organizations
Does this work with vllm?
7
#1 opened 7 months ago
by
Ainonake
It seems like model have serious repetition issues (both gguf and on openrouter)
6
#8 opened 11 months ago
by
roadtoagi
[Qwen3-235B-A22B-UD-Q4_K_XL.gguf] UD Quant seems to be invalid.
2
#7 opened 11 months ago
by
XelotX
Ud quants please🥺
2
#5 opened 11 months ago
by
Ainonake
Test on 3090 + Tesla P40 (48gb vram total) + 64gb ram (Q2K)
1
#6 opened 11 months ago
by
roadtoagi
nan or 0.0 loss when training with flash attention
16
#59 opened about 1 year ago
by
roadtoagi
nan or 0.0 loss when training with flash attention
16
#59 opened about 1 year ago
by
roadtoagi
nan or 0.0 loss when training with flash attention
16
#59 opened about 1 year ago
by
roadtoagi