Update README.md
Browse files
README.md
CHANGED
|
@@ -2,6 +2,8 @@
|
|
| 2 |
|
| 3 |
Quantized starcoderbase-3b model to GPTQ format (4-bit precision).
|
| 4 |
|
|
|
|
|
|
|
| 5 |
## Benchmark
|
| 6 |
|
| 7 |
[Benchmarking script](https://github.com/cosmo3769/Quantized-LLMs/blob/main/notebooks/llmbenchmark-starcodebase-3b-lm-eval-harness.ipynb)
|
|
|
|
| 2 |
|
| 3 |
Quantized starcoderbase-3b model to GPTQ format (4-bit precision).
|
| 4 |
|
| 5 |
+
[Quantization script](https://github.com/cosmo3769/Quantized-LLMs/blob/main/notebooks/quantize-starcodebase-3b-gptq.ipynb)
|
| 6 |
+
|
| 7 |
## Benchmark
|
| 8 |
|
| 9 |
[Benchmarking script](https://github.com/cosmo3769/Quantized-LLMs/blob/main/notebooks/llmbenchmark-starcodebase-3b-lm-eval-harness.ipynb)
|