inference-optimization
/

GLM-4.6-quantized.w4a16

compressed-tensors

Model card Files Files and versions

nm-research commited on 20 days ago

Commit

a9ee80e

·

verified ·

1 Parent(s): 624e9ce

Update config.json

Files changed (1) hide show

config.json +1 -3

config.json CHANGED Viewed

@@ -47,11 +47,9 @@
           "num_bits": 4,
           "observer": "minmax",
           "observer_kwargs": {},
-          "scale_dtype": null,
           "strategy": "group",
           "symmetric": true,
-          "type": "int",
-          "zp_dtype": null
         }
       }
     },

           "num_bits": 4,
           "observer": "minmax",
           "observer_kwargs": {},
           "strategy": "group",
           "symmetric": true,
+          "type": "int"
         }
       }
     },