Hugging Face's logo

Spaces:
Mudditha
/
phi3-my-test
Paused

App Files Community
Mudditha commited on
Commit
b7deda8
·
verified ·
1 Parent(s): 987a539

Update app.py

Browse files
Files changed (1) hide show
  1. app.py +1 -1
app.py CHANGED
@@ -3,7 +3,7 @@ from unsloth import FastLanguageModel
3
  import torch
4
  max_seq_length = 2048 # Choose any! We auto support RoPE Scaling internally!
5
  dtype = None # None for auto detection. Float16 for Tesla T4, V100, Bfloat16 for Ampere+
6
- load_in_4bit = False
7
 
8
 
9
 
 
3
  import torch
4
  max_seq_length = 2048 # Choose any! We auto support RoPE Scaling internally!
5
  dtype = None # None for auto detection. Float16 for Tesla T4, V100, Bfloat16 for Ampere+
6
+ load_in_4bit = True
7
 
8
 
9