KlondikeDev commited on
Commit
930bb1d
·
verified ·
1 Parent(s): 6ac5604

Add Boris-2-Preview-1 to the base-model arena

Browse files

Adds opencerebral/Boris-2-Preview-1 to the base-model arena.

Boris-2-Preview-1 is a 143.7M-parameter base model pretrained from scratch by OpenCerebral (52.5B tokens on one V100). It is currently #2 on the Open SLM Leaderboard (Index 27.91). Model card: https://huggingface.co/opencerebral/Boris-2-Preview-1

Changes, all in app.py and mirroring the existing Boris-1.3 base entries:
- BASE_MODEL_IDS / BASE_MODEL_DISPLAY: the new model
- MODEL_PARAMS: 143.7e6
- GEN_DEFAULTS: same sampling settings as Boris-1.3-125M (64 new tokens, temperature 0.8, top_p 0.95, repetition_penalty 1.1)
- MODEL_CONTEXT: 2048

Tested with the arena's own load and generate path (AutoTokenizer/AutoModelForCausalLM with trust_remote_code=True, float32, use_cache=False, plain-text prompt since the model has no chat template) on transformers 5.15. The custom code is plain PyTorch with no extra dependencies and generates without a KV cache, which matches the arena's use_cache=False.

Action Automated by Claude Code

Files changed (1) hide show
  1. app.py +5 -0
app.py CHANGED
@@ -64,6 +64,7 @@ BASE_MODEL_IDS: List[str] = [
64
  "HuggingFaceTB/SmolLM2-135M",
65
  "OpenCerebral/Boris-1.3-125M",
66
  "OpenCerebral/Boris-1.3-75M",
 
67
  "CodeSoft/sorbet-v2-25m",
68
  "fromziro/Er-Large-30M",
69
  "fromziro/Negative-v1.0",
@@ -82,6 +83,7 @@ BASE_MODEL_DISPLAY: Dict[str, str] = {
82
  "HuggingFaceTB/SmolLM2-135M": "SmolLM2-135M",
83
  "OpenCerebral/Boris-1.3-125M": "Boris-1.3-125M",
84
  "OpenCerebral/Boris-1.3-75M": "Boris-1.3-75M",
 
85
  "CodeSoft/sorbet-v2-25m": "sorbet-v2-25m",
86
  "fromziro/Er-Large-30M": "Er-Large-30M",
87
  "fromziro/Negative-v1.0": "Negative-v1.0",
@@ -108,6 +110,7 @@ MODEL_PARAMS: Dict[str, float] = {
108
  "HuggingFaceTB/SmolLM2-135M": 135.0e6,
109
  "OpenCerebral/Boris-1.3-125M": 125.0e6,
110
  "OpenCerebral/Boris-1.3-75M": 75.0e6,
 
111
  "CodeSoft/sorbet-v2-25m": 25.2e6,
112
  "fromziro/Er-Large-30M": 31.9e6,
113
  "fromziro/Negative-v1.0": 67.7e3,
@@ -205,6 +208,7 @@ GEN_DEFAULTS: Dict[str, dict] = {
205
  "OpenCerebral/Boris-1.3-75M-Instruct": {"max_new_tokens": 64, "temperature": 0.7, "top_p": 0.9, "repetition_penalty": 1.1, "do_sample": True},
206
  "OpenCerebral/Boris-1.3-125M": {"max_new_tokens": 64, "temperature": 0.8, "top_p": 0.95, "repetition_penalty": 1.1, "do_sample": True},
207
  "OpenCerebral/Boris-1.3-75M": {"max_new_tokens": 64, "temperature": 0.8, "top_p": 0.95, "repetition_penalty": 1.1, "do_sample": True},
 
208
  "CodeSoft/sorbet-v2-25m": {"max_new_tokens": 64, "temperature": 0.8, "top_p": 0.95, "repetition_penalty": 1.1, "do_sample": True},
209
  "fromziro/Er-Large-30M": {"max_new_tokens": 64, "temperature": 0.8, "top_p": 0.95, "repetition_penalty": 1.1, "do_sample": True},
210
  "fromziro/Negative-v1.0": {"max_new_tokens": 48, "temperature": 0.9, "top_p": 0.95, "repetition_penalty": 1.1, "do_sample": True},
@@ -236,6 +240,7 @@ MODEL_CONTEXT: Dict[str, int] = {
236
  "OpenCerebral/Boris-1.3-75M-Instruct": 2048,
237
  "OpenCerebral/Boris-1.3-125M": 2048,
238
  "OpenCerebral/Boris-1.3-75M": 2048,
 
239
  "CodeSoft/sorbet-v2-25m": 4096,
240
  "fromziro/Er-Large-30M": 2048,
241
  "fromziro/Negative-v1.0": 96,
 
64
  "HuggingFaceTB/SmolLM2-135M",
65
  "OpenCerebral/Boris-1.3-125M",
66
  "OpenCerebral/Boris-1.3-75M",
67
+ "opencerebral/Boris-2-Preview-1",
68
  "CodeSoft/sorbet-v2-25m",
69
  "fromziro/Er-Large-30M",
70
  "fromziro/Negative-v1.0",
 
83
  "HuggingFaceTB/SmolLM2-135M": "SmolLM2-135M",
84
  "OpenCerebral/Boris-1.3-125M": "Boris-1.3-125M",
85
  "OpenCerebral/Boris-1.3-75M": "Boris-1.3-75M",
86
+ "opencerebral/Boris-2-Preview-1": "Boris-2-Preview-1",
87
  "CodeSoft/sorbet-v2-25m": "sorbet-v2-25m",
88
  "fromziro/Er-Large-30M": "Er-Large-30M",
89
  "fromziro/Negative-v1.0": "Negative-v1.0",
 
110
  "HuggingFaceTB/SmolLM2-135M": 135.0e6,
111
  "OpenCerebral/Boris-1.3-125M": 125.0e6,
112
  "OpenCerebral/Boris-1.3-75M": 75.0e6,
113
+ "opencerebral/Boris-2-Preview-1": 143.7e6,
114
  "CodeSoft/sorbet-v2-25m": 25.2e6,
115
  "fromziro/Er-Large-30M": 31.9e6,
116
  "fromziro/Negative-v1.0": 67.7e3,
 
208
  "OpenCerebral/Boris-1.3-75M-Instruct": {"max_new_tokens": 64, "temperature": 0.7, "top_p": 0.9, "repetition_penalty": 1.1, "do_sample": True},
209
  "OpenCerebral/Boris-1.3-125M": {"max_new_tokens": 64, "temperature": 0.8, "top_p": 0.95, "repetition_penalty": 1.1, "do_sample": True},
210
  "OpenCerebral/Boris-1.3-75M": {"max_new_tokens": 64, "temperature": 0.8, "top_p": 0.95, "repetition_penalty": 1.1, "do_sample": True},
211
+ "opencerebral/Boris-2-Preview-1": {"max_new_tokens": 64, "temperature": 0.8, "top_p": 0.95, "repetition_penalty": 1.1, "do_sample": True},
212
  "CodeSoft/sorbet-v2-25m": {"max_new_tokens": 64, "temperature": 0.8, "top_p": 0.95, "repetition_penalty": 1.1, "do_sample": True},
213
  "fromziro/Er-Large-30M": {"max_new_tokens": 64, "temperature": 0.8, "top_p": 0.95, "repetition_penalty": 1.1, "do_sample": True},
214
  "fromziro/Negative-v1.0": {"max_new_tokens": 48, "temperature": 0.9, "top_p": 0.95, "repetition_penalty": 1.1, "do_sample": True},
 
240
  "OpenCerebral/Boris-1.3-75M-Instruct": 2048,
241
  "OpenCerebral/Boris-1.3-125M": 2048,
242
  "OpenCerebral/Boris-1.3-75M": 2048,
243
+ "opencerebral/Boris-2-Preview-1": 2048,
244
  "CodeSoft/sorbet-v2-25m": 4096,
245
  "fromziro/Er-Large-30M": 2048,
246
  "fromziro/Negative-v1.0": 96,