Spaces:
Running
Running
fix: Remove ERNIE 21B Q3 variant, keep only TQ1_0
Browse files- Removed ernie_21b_thinking_q2 (IQ3_XXS from mradermacher)
- Keeping only ernie_21b_thinking_q1 (TQ1_0 from unsloth)
- Model issue confirmed - Q3 variant had same problems as Q2
app.py
CHANGED
|
@@ -218,20 +218,6 @@ AVAILABLE_MODELS = {
|
|
| 218 |
"repeat_penalty": 1.1,
|
| 219 |
},
|
| 220 |
},
|
| 221 |
-
"ernie_21b_thinking_q2": {
|
| 222 |
-
"name": "ERNIE-4.5 21B Thinking Q3 (128K Context)",
|
| 223 |
-
"repo_id": "mradermacher/ERNIE-4.5-21B-A3B-Thinking-i1-GGUF",
|
| 224 |
-
"filename": "*IQ3_XXS.gguf",
|
| 225 |
-
"max_context": 131072,
|
| 226 |
-
"default_temperature": 0.8,
|
| 227 |
-
"supports_toggle": False,
|
| 228 |
-
"inference_settings": {
|
| 229 |
-
"temperature": 0.8,
|
| 230 |
-
"top_p": 0.95,
|
| 231 |
-
"top_k": 40,
|
| 232 |
-
"repeat_penalty": 1.1,
|
| 233 |
-
},
|
| 234 |
-
},
|
| 235 |
}
|
| 236 |
|
| 237 |
DEFAULT_MODEL_KEY = "qwen3_600m_q4"
|
|
|
|
| 218 |
"repeat_penalty": 1.1,
|
| 219 |
},
|
| 220 |
},
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 221 |
}
|
| 222 |
|
| 223 |
DEFAULT_MODEL_KEY = "qwen3_600m_q4"
|