Costa Tsaousis
ktsaou
AI & ML interests
Founder and CEO of Netdata.
Organizations
nvfp4
βπ 2
1
#1 opened 6 months ago
by
ktsaou
accuracy
26
#4 opened 6 months ago
by
ktsaou
"w1_weight_scale_2 must match w3_weight_scale_2. Accuracy may be affected."
π 1
21
#2 opened 6 months ago
by
zenmagnets
4bit quant
#1 opened 6 months ago
by
ktsaou
extremely slow on vllm
#1 opened 6 months ago
by
ktsaou
This is perfect! Thank you!
π₯ 1
14
#1 opened 8 months ago
by
ktsaou
MinimaxM2.1
3
#5 opened 8 months ago
by
reneho
It works!
1
#1 opened 8 months ago
by
ktsaou
Gave it a try, here are my findings
#2 opened 8 months ago
by
ktsaou
Works with vllm? Any recommendations or howtos?
7
#1 opened 10 months ago
by
DrRos
you know which nightly it worked with? because it does not with current one
31
#1 opened 9 months ago
by
willfalco
NVFP4 version
π 1
1
#2 opened 8 months ago
by
ktsaou
thinking disables tools
5
#6 opened 9 months ago
by
ktsaou
thinking disables tools
5
#6 opened 9 months ago
by
ktsaou
thinking disables tools
5
#6 opened 9 months ago
by
ktsaou