How to use CohereLabs/aya-101 with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("CohereLabs/aya-101") model = AutoModelForSeq2SeqLM.from_pretrained("CohereLabs/aya-101")
I notice that with the same prompt the model responses will always be the same, even with very high temperature. What is the reason for this?
· Sign up or log in to comment