Quantization of the Model
1
#9 opened 3 months ago
by
shiva2022
the docker image is error
1
#6 opened 3 months ago
by
LIYHuFace
RuntimeError: The size of tensor a (3072) must match the size of tensor b (6144) at non-singleton dimension 1
3
#5 opened 3 months ago
by
lianyouzao
Vllm command?
1
#3 opened 3 months ago
by
tkg61
Hopper GPU?
1
#2 opened 3 months ago
by
AndrewMatienko
very nice thx!!
➕ 2
#1 opened 3 months ago
by
eddy1111111