How to use c2p-cmd/Bart-Large-CNN-int8 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="c2p-cmd/Bart-Large-CNN-int8")
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("c2p-cmd/Bart-Large-CNN-int8") model = AutoModelForSeq2SeqLM.from_pretrained("c2p-cmd/Bart-Large-CNN-int8")
int8 bit quantized version of bart-large-cnn
Files info
Base model
