Spaces:

SFM2001
/

SimpleAES

Paused

SFM2001 commited on Jun 16, 2025

Commit

ed8bf25

1 Parent(s): b0f940f

..,

Files changed (4) hide show

__pycache__/create_app.cpython-312.pyc CHANGED Viewed

Binary files a/__pycache__/create_app.cpython-312.pyc and b/__pycache__/create_app.cpython-312.pyc differ

create_app.py CHANGED Viewed

@@ -31,7 +31,7 @@ def load_models():
         model_name = 'Qwen/Qwen3-1.7B'
         QWEN_TOKENIZER = AutoTokenizer.from_pretrained(model_name, device='auto')
         QWEN_TOKENIZER.pad_token_id = QWEN_TOKENIZER.eos_token_id
-        QWEN_MODEL = AutoModelForCausalLM.from_pretrained(model_name, trust_remote_code=True, device_map="auto", load_in_8bit=True, torch_dtype=torch.float16).half()
         QWEN_MODEL = QWEN_MODEL.to(device)
         MODELS_LOADED = True

         model_name = 'Qwen/Qwen3-1.7B'
         QWEN_TOKENIZER = AutoTokenizer.from_pretrained(model_name, device='auto')
         QWEN_TOKENIZER.pad_token_id = QWEN_TOKENIZER.eos_token_id
+        QWEN_MODEL = AutoModelForCausalLM.from_pretrained(model_name, trust_remote_code=True, device_map="auto", torch_dtype=torch.float16).half()
         QWEN_MODEL = QWEN_MODEL.to(device)
         MODELS_LOADED = True

inference/__pycache__/infer_single.cpython-312.pyc CHANGED Viewed

Binary files a/inference/__pycache__/infer_single.cpython-312.pyc and b/inference/__pycache__/infer_single.cpython-312.pyc differ

requirements.txt CHANGED Viewed

@@ -10,5 +10,4 @@ flask==3.1.1
 flask_login==0.6.3
 werkzeug==3.1.3
 flask_sqlalchemy==3.1.1
-gunicorn
-bitsandbytes-0.46.0

 flask_login==0.6.3
 werkzeug==3.1.3
 flask_sqlalchemy==3.1.1
+gunicorn