Commit
·
3bb5aae
1
Parent(s):
2ef3177
Update README.md
Browse files
README.md
CHANGED
|
@@ -124,7 +124,7 @@ model = KeyValueCacheInjector(model_path=os.path.dirname(input_file)).apply(mode
|
|
| 124 |
onnx.save(model, output_file)
|
| 125 |
print(f"Modified model saved to: {output_file}")
|
| 126 |
```
|
| 127 |
-
Follow the instructions on our [One Shot With SparseML](https://github.com/neuralmagic/sparseml/tree/main/src/sparseml/transformers/sparsification/obcq)
|
| 128 |
## Slack
|
| 129 |
|
| 130 |
For further support, and discussions on these models and AI in general, join [Neural Magic's Slack Community](https://join.slack.com/t/discuss-neuralmagic/shared_invite/zt-q1a1cnvo-YBoICSIw3L1dmQpjBeDurQ)
|
|
|
|
| 124 |
onnx.save(model, output_file)
|
| 125 |
print(f"Modified model saved to: {output_file}")
|
| 126 |
```
|
| 127 |
+
Follow the instructions on our [One Shot With SparseML](https://github.com/neuralmagic/sparseml/tree/main/src/sparseml/transformers/sparsification/obcq) page for a step-by-step guide for performing one-shot quantization of large language models.
|
| 128 |
## Slack
|
| 129 |
|
| 130 |
For further support, and discussions on these models and AI in general, join [Neural Magic's Slack Community](https://join.slack.com/t/discuss-neuralmagic/shared_invite/zt-q1a1cnvo-YBoICSIw3L1dmQpjBeDurQ)
|