Trying Qwen/Qwen2.5-14B-Instruct model to test performance
Browse files
config.py
CHANGED
|
@@ -1,8 +1,7 @@
|
|
| 1 |
-
# ββ LLM Backend ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 2 |
-
# ββ LLM Backend ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 3 |
-
#βββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 4 |
# Set to a globally maintained, high-throughput serverless instruction model
|
| 5 |
-
|
|
|
|
|
|
|
| 6 |
|
| 7 |
# ββ Persistence ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 8 |
# Session is runtime-only. History JSON is written per-session and read for PDF.
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# Set to a globally maintained, high-throughput serverless instruction model
|
| 2 |
+
# ββ LLM Backend ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 3 |
+
# Set to the high-availability 14B Qwen cluster for context-aware grading
|
| 4 |
+
HF_MODEL = "Qwen/Qwen2.5-14B-Instruct"
|
| 5 |
|
| 6 |
# ββ Persistence ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
|
| 7 |
# Session is runtime-only. History JSON is written per-session and read for PDF.
|