Hugging Face's logo

Spaces:
farouk1
/
Memory-Weaver-AI
Build error

App Files Community
farouk1 commited on
Commit
00137dc
·
verified ·
1 Parent(s): d8613d2

Create requirements.txt

Browse files
Files changed (1) hide show
  1. requirements.txt +4 -0
requirements.txt ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ # For 8-bit loading (requires bitsandbytes and accelerate)
2
+ model = AutoModelForSeq2SeqLM.from_pretrained(MODEL_NAME, load_in_8bit=True, device_map="auto")
3
+ # For 4-bit loading
4
+ # model = AutoModelForSeq2SeqLM.from_pretrained(MODEL_NAME, load_in_4bit=True, device_map="auto")