Hugging Face's logo

Spaces:
farouk1
/
Memory-Weaver-AI
Build error

App Files Community
farouk1 commited on
Commit
069c64f
·
verified ·
1 Parent(s): d4d58c1

Update requirements.txt

Browse files
Files changed (1) hide show
  1. requirements.txt +4 -3
requirements.txt CHANGED
@@ -1,3 +1,4 @@
1
- gradio
2
- transformers
3
- torch
 
 
1
+ # For 8-bit loading (requires bitsandbytes and accelerate)
2
+ model = AutoModelForSeq2SeqLM.from_pretrained(MODEL_NAME, load_in_8bit=True, device_map="auto")
3
+ # For 4-bit loading
4
+ # model = AutoModelForSeq2SeqLM.from_pretrained(MODEL_NAME, load_in_4bit=True, device_map="auto")