RedHatAI
/

gemma-2-2b-it-FP8

compressed-tensors

Model card Files Files and versions

Lin-K76 commited on Aug 7, 2024

Commit

7cc3350

·

verified ·

1 Parent(s): 9cc89ac

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -101,7 +101,7 @@ quant_stage:
                     targets: ["Linear"]
 """
-model_stub = "neuralmagic/gemma-2-2b-it-FP8"
 model_name = model_stub.split("/")[-1]
 device_map = calculate_offload_device_map(

                     targets: ["Linear"]
 """
+model_stub = "google/gemma-2-2b-it-FP8"
 model_name = model_stub.split("/")[-1]
 device_map = calculate_offload_device_map(