How to use NoNameFactory/llama-3-70b-it-4bit-LINA_QA with Transformers:
# Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("NoNameFactory/llama-3-70b-it-4bit-LINA_QA", device_map="auto")
