RedHatAI
/

Llama-3.2-3B-Instruct-quantized.w8a8

dsikka commited on Jul 10

Commit

505dad2

verified ·

1 Parent(s): fb5da44

Update config.json with the correct state (#1)

- Update config.json with the correct state (ffdab28913dddbee0e385adb20f65f3913996059)

Co-authored-by: Dipika <dsikka@users.noreply.huggingface.co>

Files changed (1) hide show

config.json CHANGED Viewed

@@ -75,6 +75,6 @@
     ],
     "kv_cache_scheme": null,
     "quant_method": "compressed-tensors",
-    "quantization_status": "frozen"
   }
 }

     ],
     "kv_cache_scheme": null,
     "quant_method": "compressed-tensors",
+    "quantization_status": "compressed"
   }
 }