Hugging Face's logo

torchao-testing
/
opt-125m-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev

Text Generation
Transformers
PyTorch
opt
text-generation-inference
torchao
Model card Files
xet
Community
TorchAO Testing commited on
Commit
f0877b6
·
verified ·
1 Parent(s): 1dc1fef

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -26,7 +26,7 @@ tokenizer = AutoTokenizer.from_pretrained(model_id)
26
  # Push to hub
27
  USER_ID = "torchao-testing"
28
  MODEL_NAME = model_id.split("/")[-1]
29
- save_to = f"{USER_ID}/{MODEL_NAME}-Float8DynamicActivationFloat8WeightConfig-v1-0.13-dev"
30
  quantized_model.push_to_hub(save_to, safe_serialization=False)
31
  tokenizer.push_to_hub(save_to)
32
 
 
26
  # Push to hub
27
  USER_ID = "torchao-testing"
28
  MODEL_NAME = model_id.split("/")[-1]
29
+ save_to = f"{USER_ID}/{MODEL_NAME}-Float8DynamicActivationFloat8WeightConfig-v1-0.13.dev"
30
  quantized_model.push_to_hub(save_to, safe_serialization=False)
31
  tokenizer.push_to_hub(save_to)
32