kgrabko commited on
Commit
b73e0c2
·
verified ·
1 Parent(s): 6e73280

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -91,7 +91,7 @@ It is more heavy then JiRack Coder 7B INT8
91
 
92
  ### Important Memory Notes
93
 
94
- Even though the 7B INT8 model itself takes approximately **89 GB**, we recommend **at least 24GB VRAM** for the following reasons:
95
 
96
  - KV-cache consumption during generation (especially with long context)
97
  - ONNX Runtime overhead and temporary buffers
 
91
 
92
  ### Important Memory Notes
93
 
94
+ Even though the 8B INT4 model itself takes approximately **56 GB**, we recommend **at least 24GB VRAM** for the following reasons:
95
 
96
  - KV-cache consumption during generation (especially with long context)
97
  - ONNX Runtime overhead and temporary buffers