How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="GAIR/autoj-13b")
# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("GAIR/autoj-13b")
model = AutoModelForCausalLM.from_pretrained("GAIR/autoj-13b", device_map="auto")
Quick Links

Please refer to our github repo for more datails.

Downloads last month
33
Inference Providers NEW