Transformers How to use optimum-internal-testing/tiny-random-encoder-decoder-gpt2-bert with Transformers:
# Load model directly
from transformers import AutoTokenizer, AutoModelForSeq2SeqLM
tokenizer = AutoTokenizer.from_pretrained("optimum-internal-testing/tiny-random-encoder-decoder-gpt2-bert")
model = AutoModelForSeq2SeqLM.from_pretrained("optimum-internal-testing/tiny-random-encoder-decoder-gpt2-bert") 
