INCModel
/

NextStep-1.1-W4A16-AutoRound

4-bit precision

Model card Files Files and versions

xinhe commited on Apr 10

Commit

9ce1d43

·

verified ·

1 Parent(s): e05be58

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -15,7 +15,8 @@ This model is an W4A16 model with group_size 128 of [stepfun-ai/NextStep-1.1](ht
 hf download INCModel/NextStep-1.1-W4A16-AutoRound  /workspace/models/stepfun-ai/NextStep-1.1-W4A16/
 export PYTHONPATH=/workspace/models/stepfun-ai/NextStep-1.1-W4A16/
 cd /workspace/models/stepfun-ai/NextStep-1.1-W4A16/
-pip install transformers==4.57.6
 python run_generation.py
 ~~~

 hf download INCModel/NextStep-1.1-W4A16-AutoRound  /workspace/models/stepfun-ai/NextStep-1.1-W4A16/
 export PYTHONPATH=/workspace/models/stepfun-ai/NextStep-1.1-W4A16/
 cd /workspace/models/stepfun-ai/NextStep-1.1-W4A16/
+uv pip install transformers==4.57.6
+uv pip install gptqmodel==6.0.3 --no-build-isolation
 python run_generation.py
 ~~~