EpistemeAI
/

Fireball-R1.1-Llama-3.1-8B

Text Generation

text-generation-inference

Model card Files Files and versions

legolasyiu commited on Mar 1, 2025

Commit

863882f

·

verified ·

1 Parent(s): 6caf9ab

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -75,7 +75,7 @@ tokenizer = AutoTokenizer.from_pretrained("EpistemeAI/Fireball-R1.1-Llama-3.1-8B
 # Load the model in 8-bit precision using bitsandbytes (requires a CUDA GPU)
 model = AutoModelForCausalLM.from_pretrained(
-    "EpistemeAI/Fireball-R1-Llama-3.1-8B",
     load_in_8bit=True,      # Enable 8-bit loading to reduce memory usage
     device_map="auto"       # Automatically map model layers to the available device(s)
 )

 # Load the model in 8-bit precision using bitsandbytes (requires a CUDA GPU)
 model = AutoModelForCausalLM.from_pretrained(
+    "EpistemeAI/Fireball-R1.1-Llama-3.1-8B",
     load_in_8bit=True,      # Enable 8-bit loading to reduce memory usage
     device_map="auto"       # Automatically map model layers to the available device(s)
 )