How to use ApacheOne/expimodel with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("ApacheOne/expimodel", dtype="auto")
405f3cc
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
{ "producer": { "name": "modelopt", "version": "0.43.0" }, "quantization": { "quant_algo": "NVFP4", "kv_cache_quant_algo": null, "group_size": 16, "exclude_modules": [ "lm_head", "model.visual*" ] } }