Leon commited on
Update README.md
Browse files
README.md
CHANGED
|
@@ -10,7 +10,7 @@ FP8-Dynamic quant from rhymes-ai Aria made with llm-compressor.
|
|
| 10 |
|
| 11 |
Generated with the following code:
|
| 12 |
|
| 13 |
-
```
|
| 14 |
from transformers import AutoProcessor, AutoModelForCausalLM
|
| 15 |
from llmcompressor.modifiers.quantization import QuantizationModifier
|
| 16 |
from llmcompressor.transformers import SparseAutoModelForCausalLM, oneshot
|
|
|
|
| 10 |
|
| 11 |
Generated with the following code:
|
| 12 |
|
| 13 |
+
```python
|
| 14 |
from transformers import AutoProcessor, AutoModelForCausalLM
|
| 15 |
from llmcompressor.modifiers.quantization import QuantizationModifier
|
| 16 |
from llmcompressor.transformers import SparseAutoModelForCausalLM, oneshot
|