How to use the model section in model card.

#4
by sudhir2016 - opened

This looks incorrect. There is no option to load meta-llama/Llama-2-7b-hf in 4bits. Please suggest.

model = AutoModelForCausalLM.from_pretrained("meta-llama/Llama-2-7b-hf", load_in_4bit=True)

Hey, I came across your CodeAlpaca QLoRA model for code generation and found the use case interesting.

I’m exploring how developers are adapting LLMs for specific tasks. Are you happy with the results so far, or are you planning to improve the model further?

Sign up or log in to comment