Hugging Face's logo

Spaces:
OrisTeam
/
ORIS-Project
Running

App Files Community
Aleksander commited on
Commit
4ded413
·
verified ·
1 Parent(s): 483f0a3

Update index.html

Browse files
Files changed (1) hide show
  1. index.html +982 -3081
index.html CHANGED
@@ -1,3090 +1,991 @@
1
  <!doctype html>
2
  <html lang="en">
3
  <head>
4
- <meta charset="utf-8" />
5
- <meta
6
- name="viewport"
7
- content="width=device-width, initial-scale=1"
8
- />
9
-
10
- <meta
11
- name="description"
12
- content="ORIS LLM — Polish language model research project focused on architecture compression, recovery pretraining, data engineering and evaluation."
13
- />
14
-
15
- <title>ORIS LLM — Polish Language Model Research</title>
16
-
17
- <link
18
- rel="stylesheet"
19
- href="style.css"
20
- />
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
  </head>
22
 
23
  <body>
24
 
25
- <div class="background-grid"></div>
26
- <div class="background-glow glow-one"></div>
27
- <div class="background-glow glow-two"></div>
28
-
29
- <header class="topbar">
30
- <div class="container nav-inner">
31
-
32
- <a
33
- class="brand"
34
- href="#top"
35
- >
36
- <span class="brand-mark">O</span>
37
-
38
- <span class="brand-text">
39
- ORIS
40
- <small>LLM RESEARCH</small>
41
- </span>
42
- </a>
43
-
44
- <nav class="nav-links">
45
- <a href="#mission">Mission</a>
46
- <a href="#architecture">Architecture</a>
47
- <a href="#training">Training</a>
48
- <a href="#evaluation">Evaluation</a>
49
- <a href="#generations">Generations</a>
50
- <a href="#data">Data</a>
51
- <a href="#status">Status</a>
52
- </nav>
53
-
54
- </div>
55
- </header>
56
-
57
-
58
- <main id="top">
59
-
60
- <!-- =====================================================
61
- HERO
62
- ====================================================== -->
63
-
64
- <section class="hero">
65
- <div class="container hero-grid">
66
-
67
- <div class="hero-main">
68
-
69
- <div class="eyebrow">
70
- POLISH LANGUAGE MODEL RESEARCH
71
- </div>
72
-
73
- <h1>
74
- ORIS
75
- <span>660M</span>
76
- </h1>
77
-
78
- <p class="hero-lead">
79
- An experimental Polish language model
80
- developed as part of the ORIS family.
81
- The project explores non-standard trade-offs
82
- between architecture, data quality,
83
- compute efficiency and practical language
84
- model behavior.
85
- </p>
86
-
87
- <div class="hero-actions">
88
- <a
89
- class="button button-primary"
90
- href="#current-results"
91
- >
92
- Current results
93
- </a>
94
-
95
- <a
96
- class="button button-secondary"
97
- href="#status"
98
- >
99
- Project status
100
- </a>
101
- </div>
102
-
103
- <p class="hero-note">
104
- Research project · Work in progress ·
105
- Weights not released
106
- </p>
107
-
108
- </div>
109
-
110
-
111
- <div class="hero-panel">
112
-
113
- <div class="panel-label">
114
- CURRENT MODEL
115
- </div>
116
-
117
- <div class="big-stat">
118
- 660.13M
119
- <small>parameters</small>
120
- </div>
121
-
122
- <div class="stat-grid">
123
-
124
- <div>
125
- <strong>12</strong>
126
- <span>layers</span>
127
- </div>
128
-
129
- <div>
130
- <strong>1536</strong>
131
- <span>hidden size</span>
132
- </div>
133
-
134
- <div>
135
- <strong>8960</strong>
136
- <span>FFN size</span>
137
- </div>
138
-
139
- <div>
140
- <strong>12 / 2</strong>
141
- <span>Q / KV heads</span>
142
- </div>
143
-
144
- </div>
145
-
146
- <div class="hero-lineage">
147
- <span>Qwen 2.5</span>
148
- <b>→</b>
149
- <span>Bielik v3</span>
150
- <b>→</b>
151
- <span class="accent">ORIS 660M</span>
152
- </div>
153
-
154
- </div>
155
-
156
- </div>
157
- </section>
158
-
159
-
160
- <!-- =====================================================
161
- QUICK FACTS
162
- ====================================================== -->
163
-
164
- <section class="section compact-section">
165
- <div class="container">
166
-
167
- <div class="quick-grid">
168
-
169
- <article class="metric-card">
170
- <span class="metric-label">
171
- Project started
172
- </span>
173
-
174
- <strong>
175
- 07.08.2026
176
- </strong>
177
- </article>
178
-
179
-
180
- <article class="metric-card">
181
- <span class="metric-label">
182
- Teacher model
183
- </span>
184
-
185
- <strong>
186
- Bielik-1.5B-v3
187
- </strong>
188
- </article>
189
-
190
-
191
- <article class="metric-card">
192
- <span class="metric-label">
193
- Depth reduction
194
- </span>
195
-
196
- <strong>
197
- 32L → 12L
198
- </strong>
199
- </article>
200
-
201
-
202
- <article class="metric-card">
203
- <span class="metric-label">
204
- Recovery observed
205
- </span>
206
-
207
- <strong>
208
- 170.23M
209
- </strong>
210
-
211
- <small>
212
- label tokens
213
- </small>
214
- </article>
215
-
216
- </div>
217
-
218
- </div>
219
- </section>
220
-
221
-
222
- <!-- =====================================================
223
- MISSION
224
- ====================================================== -->
225
-
226
- <section
227
- id="mission"
228
- class="section"
229
- >
230
- <div class="container narrow">
231
-
232
- <div class="section-heading">
233
- <span>01 / MISSION</span>
234
-
235
- <h2>
236
- ORIS was not created simply
237
- to be a “better model”.
238
- </h2>
239
- </div>
240
-
241
- <div class="prose">
242
-
243
- <p class="lead-paragraph">
244
- The purpose of the ORIS family is to explore
245
- unusual gaps in the Polish language model
246
- ecosystem and establish new reference points
247
- where the usual “bigger is better” comparison
248
- is not enough.
249
- </p>
250
-
251
- <p>
252
- ORIS treats the model itself as a research object.
253
- The project is interested not only in final scores,
254
- but also in the process: which parts of an
255
- architecture can be removed, which representations
256
- survive pruning, how a model recovers language
257
- behavior after aggressive compression, how little
258
- recovery compute can still produce meaningful
259
- results, and how strongly data quality affects
260
- a relatively small model.
261
- </p>
262
-
263
- <p>
264
- The goal is not to claim superiority over other
265
- Polish models. Instead, ORIS aims to share
266
- measurements, failed experiments, architectural
267
- decisions, limitations and practical observations
268
- that may be useful when building future models.
269
- </p>
270
-
271
- <blockquote>
272
- ORIS is intended to be both a model family
273
- and a record of what worked, what failed,
274
- and why.
275
- </blockquote>
276
-
277
- </div>
278
-
279
- </div>
280
- </section>
281
-
282
-
283
- <!-- =====================================================
284
- LINEAGE
285
- ====================================================== -->
286
-
287
- <section class="section dark-section">
288
- <div class="container">
289
-
290
- <div class="section-heading">
291
- <span>02 / LINEAGE</span>
292
-
293
- <h2>
294
- Qwen 2.5 → Bielik v3 → ORIS 660M
295
- </h2>
296
- </div>
297
-
298
- <div class="lineage">
299
-
300
- <div class="lineage-node">
301
- <small>FOUNDATION</small>
302
- <strong>Qwen 2.5</strong>
303
- </div>
304
-
305
- <div class="lineage-arrow">
306
- →
307
- </div>
308
-
309
- <div class="lineage-node">
310
- <small>POLISH BASE</small>
311
- <strong>Bielik-1.5B-v3</strong>
312
- </div>
313
-
314
- <div class="lineage-arrow">
315
- →
316
- </div>
317
-
318
- <div class="lineage-node active">
319
- <small>ORIS BRANCH</small>
320
- <strong>ORIS 660M</strong>
321
- </div>
322
-
323
- </div>
324
-
325
- <div class="prose wide-prose">
326
-
327
- <p>
328
- ORIS 660M was created by aggressively reducing
329
- the depth of Bielik-1.5B-v3 while preserving
330
- the original width of the representation,
331
- attention geometry, embeddings, tokenizer
332
- and language-model head.
333
- </p>
334
-
335
- <p>
336
- The resulting model is not a conventionally
337
- narrow 660M transformer. It preserves the
338
- internal width of the much larger teacher,
339
- but performs the transformation through
340
- only twelve decoder blocks instead of thirty-two.
341
- </p>
342
-
343
- </div>
344
-
345
- </div>
346
- </section>
347
-
348
-
349
- <!-- =====================================================
350
- ARCHITECTURE
351
- ====================================================== -->
352
-
353
- <section
354
- id="architecture"
355
- class="section"
356
- >
357
- <div class="container">
358
-
359
- <div class="section-heading">
360
- <span>03 / ARCHITECTURE</span>
361
-
362
- <h2>
363
- A wide 660M model created primarily
364
- through depth pruning.
365
- </h2>
366
- </div>
367
-
368
- <div class="architecture-grid">
369
-
370
- <div class="architecture-card">
371
- <span>Total parameters</span>
372
- <strong>660,131,328</strong>
373
- </div>
374
-
375
- <div class="architecture-card">
376
- <span>Decoder layers</span>
377
- <strong>12</strong>
378
- </div>
379
-
380
- <div class="architecture-card">
381
- <span>Hidden size</span>
382
- <strong>1536</strong>
383
- </div>
384
-
385
- <div class="architecture-card">
386
- <span>Intermediate size</span>
387
- <strong>8960</strong>
388
- </div>
389
-
390
- <div class="architecture-card">
391
- <span>Attention heads</span>
392
- <strong>12</strong>
393
- </div>
394
-
395
- <div class="architecture-card">
396
- <span>KV heads</span>
397
- <strong>2</strong>
398
- </div>
399
-
400
- <div class="architecture-card">
401
- <span>Head dimension</span>
402
- <strong>128</strong>
403
- </div>
404
-
405
- <div class="architecture-card">
406
- <span>Vocabulary</span>
407
- <strong>32,000</strong>
408
- </div>
409
-
410
- </div>
411
-
412
-
413
- <div class="split-panel">
414
-
415
- <div>
416
- <div class="panel-label">
417
- RETAINED TEACHER BLOCKS
418
- </div>
419
-
420
- <div class="layer-list">
421
- <span>0</span>
422
- <span>1</span>
423
- <span>2</span>
424
- <span>3</span>
425
- <span>4</span>
426
- <span>21</span>
427
- <span>23</span>
428
- <span>24</span>
429
- <span>25</span>
430
- <span>29</span>
431
- <span>30</span>
432
- <span>31</span>
433
- </div>
434
- </div>
435
-
436
-
437
- <div class="prose">
438
-
439
- <p>
440
- The model does not simply keep the first
441
- twelve layers of the teacher. The retained
442
- path spans early, middle-late and final
443
- regions of the original network.
444
- </p>
445
-
446
- <p>
447
- Width, FFN size, attention geometry,
448
- embeddings and LM head were preserved.
449
- The main architectural intervention
450
- was the reduction:
451
- </p>
452
-
453
- <div class="big-arrow">
454
- 32 layers
455
- <span>→</span>
456
- 12 layers
457
- </div>
458
-
459
- </div>
460
-
461
- </div>
462
-
463
-
464
- <div class="compute-panel">
465
-
466
- <div class="panel-label">
467
- PARAMETER DISTRIBUTION
468
- </div>
469
-
470
- <div class="compute-grid">
471
-
472
- <div>
473
- <strong>~46.82M</strong>
474
- <span>parameters / block</span>
475
- </div>
476
-
477
- <div>
478
- <strong>~41.31M</strong>
479
- <span>MLP / block</span>
480
- </div>
481
-
482
- <div>
483
- <strong>~5.51M</strong>
484
- <span>attention / block</span>
485
- </div>
486
-
487
- <div>
488
- <strong>~88%</strong>
489
- <span>block parameters in MLP</span>
490
- </div>
491
-
492
- </div>
493
-
494
- </div>
495
-
496
- </div>
497
- </section>
498
-
499
-
500
- <!-- =====================================================
501
- INITIAL DAMAGE
502
- ====================================================== -->
503
-
504
- <section class="section dark-section">
505
- <div class="container narrow">
506
-
507
- <div class="section-heading">
508
- <span>04 / STEP ZERO</span>
509
-
510
- <h2>
511
- Pruning preserved structure,
512
- but heavily damaged language modeling.
513
- </h2>
514
- </div>
515
-
516
- <div class="prose">
517
-
518
- <p>
519
- The initial 660M student was not expected
520
- to behave like a ready language model.
521
- Removing twenty transformer blocks severely
522
- disrupted the sequence of transformations
523
- learned by the teacher.
524
- </p>
525
-
526
- </div>
527
-
528
-
529
- <div class="comparison-table">
530
-
531
- <div class="comparison-row comparison-header">
532
- <span>Model</span>
533
- <span>Loss</span>
534
- <span>Perplexity</span>
535
- <span>Throughput</span>
536
- <span>Peak VRAM</span>
537
- </div>
538
-
539
- <div class="comparison-row">
540
- <strong>ORIS 660M step0</strong>
541
- <span>7.1613</span>
542
- <span>1288.58</span>
543
- <span>17.29k tok/s</span>
544
- <span>1.54 GiB</span>
545
- </div>
546
-
547
- <div class="comparison-row">
548
- <strong>Bielik-1.5B</strong>
549
- <span>2.2692</span>
550
- <span>9.67</span>
551
- <span>6.69k tok/s</span>
552
- <span>3.29 GiB</span>
553
- </div>
554
-
555
- </div>
556
-
557
- <p class="caption">
558
- Fixed 128 × 1024 evaluation sequences.
559
- These measurements describe the initial
560
- post-pruning state and its teacher reference.
561
- </p>
562
-
563
- </div>
564
- </section>
565
-
566
-
567
- <!-- =====================================================
568
- RECOVERY
569
- ====================================================== -->
570
-
571
- <section
572
- id="training"
573
- class="section"
574
- >
575
- <div class="container">
576
-
577
- <div class="section-heading">
578
- <span>05 / RECOVERY TRAINING</span>
579
-
580
- <h2>
581
- The first objective was recovery,
582
- not scaling.
583
- </h2>
584
- </div>
585
-
586
-
587
- <div class="training-grid">
588
-
589
- <article class="training-card">
590
-
591
- <span class="training-label">
592
- Sequence length
593
- </span>
594
-
595
- <strong>1024</strong>
596
-
597
- </article>
598
-
599
-
600
- <article class="training-card">
601
-
602
- <span class="training-label">
603
- Micro batch
604
- </span>
605
-
606
- <strong>2</strong>
607
-
608
- </article>
609
-
610
-
611
- <article class="training-card">
612
-
613
- <span class="training-label">
614
- Gradient accumulation
615
- </span>
616
-
617
- <strong>256</strong>
618
-
619
- </article>
620
-
621
-
622
- <article class="training-card">
623
-
624
- <span class="training-label">
625
- Label tokens / update
626
- </span>
627
-
628
- <strong>523,776</strong>
629
-
630
- </article>
631
-
632
-
633
- <article class="training-card">
634
-
635
- <span class="training-label">
636
- Precision
637
- </span>
638
-
639
- <strong>BF16</strong>
640
-
641
- </article>
642
-
643
-
644
- <article class="training-card">
645
-
646
- <span class="training-label">
647
- Optimizer
648
- </span>
649
-
650
- <strong>Fused AdamW</strong>
651
-
652
- </article>
653
-
654
-
655
- <article class="training-card">
656
-
657
- <span class="training-label">
658
- Max learning rate
659
- </span>
660
-
661
- <strong>2e-5</strong>
662
-
663
- </article>
664
-
665
-
666
- <article class="training-card">
667
-
668
- <span class="training-label">
669
- Training throughput
670
- </span>
671
-
672
- <strong>~9.1k tok/s</strong>
673
-
674
- </article>
675
-
676
- </div>
677
-
678
-
679
- <div
680
- id="current-results"
681
- class="milestone"
682
- >
683
-
684
- <div>
685
- <span class="panel-label">
686
- LATEST PRESERVED MILESTONE
687
- </span>
688
-
689
- <h3>
690
- Checkpoint 325
691
- </h3>
692
- </div>
693
-
694
- <div class="milestone-stats">
695
-
696
- <div>
697
- <strong>170,227,200</strong>
698
- <span>label tokens consumed</span>
699
- </div>
700
-
701
- <div>
702
- <strong>190,720</strong>
703
- <span>documents read</span>
704
- </div>
705
-
706
- <div>
707
- <strong>190,720</strong>
708
- <span>EOS tokens added</span>
709
- </div>
710
-
711
- <div>
712
- <strong>3.7726</strong>
713
- <span>last training-loss window</span>
714
- </div>
715
-
716
- </div>
717
-
718
- </div>
719
-
720
-
721
- <div class="warning-box">
722
- <strong>
723
- Important:
724
- </strong>
725
-
726
- <p>
727
- The 3.7726 value is a training-window loss
728
- on the clean continuation corpus.
729
- It must not be directly compared with the
730
- historical step0 fixed-evaluation loss of 7.1613.
731
- </p>
732
- </div>
733
-
734
- </div>
735
- </section>
736
-
737
-
738
- <!-- =====================================================
739
- DATA PROBLEM
740
- ====================================================== -->
741
-
742
- <section
743
- id="data"
744
- class="section dark-section"
745
- >
746
- <div class="container">
747
-
748
- <div class="section-heading">
749
- <span>06 / DATA</span>
750
-
751
- <h2>
752
- The bottleneck moved from model training
753
- to data infrastructure.
754
- </h2>
755
- </div>
756
-
757
- <div class="prose wide-prose">
758
-
759
- <p class="lead-paragraph">
760
- ORIS 660M exposed a problem that is easy
761
- to underestimate when experiments begin
762
- at small scale: training hundreds of millions
763
- of tokens is straightforward compared with
764
- reliably managing tens or hundreds of billions
765
- of tokens.
766
- </p>
767
-
768
- <p>
769
- Early recovery data still contained many
770
- structures inherited from web crawls:
771
- boilerplate, duplicated fragments, listing pages,
772
- SEO text, navigation elements, disconnected
773
- topics, encoding damage, forum residue,
774
- article metadata and repeated templates.
775
- </p>
776
-
777
- <p>
778
- Continuing to scale training without addressing
779
- those representations would simply make the
780
- model better at reproducing the same defects.
781
- The project therefore changed direction
782
- temporarily from model compute to data compute.
783
- </p>
784
-
785
- </div>
786
-
787
-
788
- <div class="data-pipeline">
789
-
790
- <div class="data-stage keep">
791
- <strong>KEEP</strong>
792
- <span>
793
- usable coherent documents
794
- </span>
795
- </div>
796
-
797
- <div class="data-stage clean">
798
- <strong>CLEAN</strong>
799
- <span>
800
- recoverable core + removable noise
801
- </span>
802
- </div>
803
-
804
- <div class="data-stage split">
805
- <strong>SPLIT</strong>
806
- <span>
807
- multiple recoverable document regions
808
- </span>
809
- </div>
810
-
811
- <div class="data-stage drop">
812
- <strong>DROP</strong>
813
- <span>
814
- no sufficiently useful core
815
- </span>
816
- </div>
817
-
818
- </div>
819
-
820
-
821
- <div class="prose wide-prose">
822
-
823
- <p>
824
- The V2 data pipeline combines deterministic
825
- structural signals with semantic analysis.
826
- It measures repetition, fragmentation,
827
- cross-document templates, paragraph coherence,
828
- boundary candidates, corrupted characters
829
- and learned mmBERT signals.
830
- </p>
831
-
832
- <p>
833
- The goal is not to reduce the corpus as much
834
- as possible. The goal is to preserve useful
835
- Polish text while separating raw source material
836
- from training-ready units.
837
- </p>
838
-
839
- </div>
840
-
841
-
842
- <div class="data-number-grid">
843
-
844
- <div>
845
- <strong>1.39M+</strong>
846
- <span>
847
- documents observed in one V2 shard run
848
- </span>
849
- </div>
850
-
851
- <div>
852
- <strong>1.55B+</strong>
853
- <span>
854
- approximate raw tokens in that run
855
- </span>
856
- </div>
857
-
858
- <div>
859
- <strong>~17.2</strong>
860
- <span>
861
- documents / second
862
- </span>
863
- </div>
864
-
865
- <div>
866
- <strong>99.77%</strong>
867
- <span>
868
- token retention in conservative KEEP hygiene
869
- </span>
870
- </div>
871
-
872
- </div>
873
-
874
- </div>
875
- </section>
876
-
877
-
878
- <!-- =====================================================
879
- EVALUATION
880
- ====================================================== -->
881
-
882
- <section
883
- id="evaluation"
884
- class="section"
885
- >
886
- <div class="container">
887
-
888
- <div class="section-heading">
889
- <span>07 / EVALUATION</span>
890
-
891
- <h2>
892
- Diagnostic results, not leaderboard claims.
893
- </h2>
894
- </div>
895
-
896
- <div class="prose wide-prose">
897
-
898
- <p>
899
- ORIS 660M has not completed a full pretraining
900
- schedule and is not presented as a finished model.
901
- Current evaluations are intended to understand
902
- recovery behavior rather than establish a final rank.
903
- </p>
904
-
905
- <p>
906
- The current checkpoint was compared against
907
- larger Polish base models on small controlled
908
- probes and on a limited subset of the
909
- Open PL LLM Leaderboard multiple-choice suite.
910
- </p>
911
-
912
- </div>
913
-
914
-
915
- <div class="benchmark-title">
916
- Custom diagnostic benchmark
917
- </div>
918
-
919
- <div class="comparison-table">
920
-
921
- <div class="comparison-row comparison-header">
922
- <span>Model</span>
923
- <span>Parameters</span>
924
- <span>Raw MC acc.</span>
925
- <span>Normalized acc.</span>
926
- <span>Continuation NLL</span>
927
- </div>
928
-
929
- <div class="comparison-row highlighted">
930
- <strong>ORIS 660M step325</strong>
931
- <span>660.13M</span>
932
- <span>0.750</span>
933
- <span>0.500</span>
934
- <span>3.3525</span>
935
- </div>
936
-
937
- <div class="comparison-row">
938
- <strong>Qra-1b</strong>
939
- <span>~1.10B</span>
940
- <span>0.917</span>
941
- <span>0.583</span>
942
- <span>1.5715</span>
943
- </div>
944
-
945
- </div>
946
-
947
-
948
- <p class="caption">
949
- Project-specific lightweight probe.
950
- Not an official benchmark suite.
951
- </p>
952
-
953
-
954
- <div class="benchmark-title">
955
- Open PL LLM Leaderboard task subset
956
- </div>
957
-
958
- <div class="comparison-table">
959
-
960
- <div class="comparison-row comparison-header">
961
- <span>Model</span>
962
- <span>Parameters</span>
963
- <span>Accuracy</span>
964
- <span>Acc. norm</span>
965
- <span>F1</span>
966
- </div>
967
-
968
- <div class="comparison-row highlighted">
969
- <strong>ORIS 660M step325</strong>
970
- <span>660.13M</span>
971
- <span>0.399</span>
972
- <span>0.386</span>
973
- <span>0.0116</span>
974
- </div>
975
-
976
- <div class="comparison-row">
977
- <strong>APT3-1B-Base</strong>
978
- <span>~1B</span>
979
- <span>0.330</span>
980
- <span>0.300</span>
981
- <span>0.3215</span>
982
- </div>
983
-
984
- </div>
985
-
986
- <p class="caption">
987
- `polish_mc`, 0-shot, limited to 100 examples
988
- per task. These are diagnostic subset results,
989
- not official leaderboard scores.
990
- </p>
991
-
992
-
993
- <div class="warning-box benchmark-warning">
994
-
995
- <strong>
996
- Aggregate accuracy is not the whole story.
997
- </strong>
998
-
999
- <p>
1000
- ORIS showed severe class bias on some binary
1001
- tasks. For example, high raw accuracy could
1002
- coexist with near-zero F1. The model therefore
1003
- cannot be described as generally outperforming
1004
- APT3 based on this diagnostic run.
1005
- </p>
1006
-
1007
- </div>
1008
-
1009
-
1010
- <div class="task-grid">
1011
-
1012
- <div>
1013
- <span>PoLeMo2 in</span>
1014
- <strong>0.43</strong>
1015
- </div>
1016
-
1017
- <div>
1018
- <span>PoLeMo2 out</span>
1019
- <strong>0.33</strong>
1020
- </div>
1021
-
1022
- <div>
1023
- <span>Belebele MC</span>
1024
- <strong>0.23</strong>
1025
- </div>
1026
-
1027
- <div>
1028
- <span>PolQA reranking</span>
1029
- <strong>0.62</strong>
1030
- </div>
1031
-
1032
- <div>
1033
- <span>PPC</span>
1034
- <strong>0.44</strong>
1035
- </div>
1036
-
1037
- <div>
1038
- <span>PSC</span>
1039
- <strong>0.68</strong>
1040
- </div>
1041
-
1042
- </div>
1043
-
1044
- </div>
1045
- </section>
1046
-
1047
-
1048
- <!-- =====================================================
1049
- GENERATIONS
1050
- ====================================================== -->
1051
-
1052
- <section
1053
- id="generations"
1054
- class="section dark-section"
1055
- >
1056
- <div class="container">
1057
-
1058
- <div class="section-heading">
1059
- <span>08 / GENERATION BEHAVIOR</span>
1060
-
1061
- <h2>
1062
- Language ability returned faster
1063
- than generation stability.
1064
- </h2>
1065
- </div>
1066
-
1067
- <div class="prose wide-prose">
1068
-
1069
- <p>
1070
- The current model can produce fluent Polish
1071
- locally and sampling can yield surprisingly
1072
- coherent paragraphs. However, greedy decoding
1073
- still exposes strong autoregressive instability.
1074
- </p>
1075
-
1076
- <p>
1077
- Repetition loops, semantic drift and remnants
1078
- of web-style representations remain clearly visible.
1079
- </p>
1080
-
1081
- </div>
1082
-
1083
-
1084
- <div class="generation-card">
1085
-
1086
- <div class="generation-header">
1087
- <span>PROMPT</span>
1088
-
1089
- <strong>
1090
- Inflacja oznacza wzrost
1091
- </strong>
1092
- </div>
1093
-
1094
- <div class="generation-body">
1095
-
1096
- <span class="generation-mode">
1097
- GREEDY
1098
- </span>
1099
-
1100
- <p>
1101
- o 1,5 proc. W 2013 r. w Polsce...
1102
- w porównaniu do 1,5 proc...
1103
- w porównaniu do 1,5 proc...
1104
- </p>
1105
-
1106
- </div>
1107
-
1108
- <div class="generation-comment">
1109
- Repetition collapse remains clearly visible.
1110
- </div>
1111
-
1112
- </div>
1113
-
1114
-
1115
- <div class="generation-card">
1116
-
1117
- <div class="generation-header">
1118
- <span>PROMPT</span>
1119
-
1120
- <strong>
1121
- Kiedy rano otworzył okno, zobaczył
1122
- </strong>
1123
- </div>
1124
-
1125
- <div class="generation-body">
1126
-
1127
- <span class="generation-mode sampled-mode">
1128
- SAMPLED
1129
- </span>
1130
-
1131
- <p>
1132
- ...someone lying on the floor.
1133
- She became frightened and ran to the window...
1134
- </p>
1135
-
1136
- </div>
1137
-
1138
- <div class="generation-comment">
1139
- Sampling can recover a recognizable narrative
1140
- structure, but the model still drifts and mixes
1141
- unrelated representations.
1142
- </div>
1143
-
1144
- </div>
1145
-
1146
-
1147
- <div class="generation-card">
1148
-
1149
- <div class="generation-header">
1150
- <span>PROMPT</span>
1151
-
1152
- <strong>
1153
- Model językowy przewiduje kolejne tokeny
1154
- na podstawie
1155
- </strong>
1156
- </div>
1157
-
1158
- <div class="generation-body">
1159
-
1160
- <span class="generation-mode">
1161
- GREEDY
1162
- </span>
1163
-
1164
- <p>
1165
- ...tokens. Tokens are also available
1166
- as QR codes. Tokens are also available...
1167
- </p>
1168
-
1169
- </div>
1170
-
1171
- <div class="generation-comment">
1172
- Local syntax is functional, while global semantics
1173
- and repetition control are still incomplete.
1174
- </div>
1175
-
1176
- </div>
1177
-
1178
-
1179
- <div class="behavior-grid">
1180
-
1181
- <div class="positive">
1182
- <strong>Recovered</strong>
1183
-
1184
- <ul>
1185
- <li>Polish syntax</li>
1186
- <li>local sentence fluency</li>
1187
- <li>basic factual associations</li>
1188
- <li>usable sampled continuations</li>
1189
- </ul>
1190
- </div>
1191
-
1192
-
1193
- <div class="negative">
1194
- <strong>Still unstable</strong>
1195
-
1196
- <ul>
1197
- <li>greedy repetition</li>
1198
- <li>topic drift</li>
1199
- <li>long-range coherence</li>
1200
- <li>binary class calibration</li>
1201
- <li>web-pattern residue</li>
1202
- </ul>
1203
- </div>
1204
-
1205
- </div>
1206
-
1207
- </div>
1208
- </section>
1209
-
1210
-
1211
- <!-- =====================================================
1212
- WHY PAUSED
1213
- ====================================================== -->
1214
-
1215
- <section
1216
- id="status"
1217
- class="section"
1218
- >
1219
- <div class="container narrow">
1220
-
1221
- <div class="section-heading">
1222
- <span>09 / CURRENT STATUS</span>
1223
-
1224
- <h2>
1225
- ORIS 660M is currently paused,
1226
- not finished.
1227
- </h2>
1228
- </div>
1229
-
1230
- <div class="status-box">
1231
-
1232
- <div class="status-indicator">
1233
- <span></span>
1234
- PAUSED / RESEARCH ACTIVE
1235
- </div>
1236
-
1237
- <p>
1238
- ORIS 660M reached a useful recovery milestone,
1239
- but continuing the same training immediately
1240
- would not answer the most important remaining
1241
- questions.
1242
- </p>
1243
-
1244
- <p>
1245
- The current limitation is not simply GPU training
1246
- throughput. The project now requires a reliable
1247
- strategy for selecting, cleaning, reconstructing,
1248
- deduplicating and independently evaluating
1249
- datasets at a scale approaching or exceeding
1250
- <strong>100B tokens</strong>.
1251
- </p>
1252
-
1253
- <p>
1254
- Several components of that strategy have already
1255
- been prototyped, including semantic document
1256
- classification, structural reconstruction,
1257
- conservative cleaning and persistent metadata.
1258
- The complete large-scale pipeline has not yet
1259
- been fully deployed.
1260
- </p>
1261
-
1262
- <p>
1263
- Additional compute infrastructure is also planned.
1264
- Until both data throughput and evaluation
1265
- throughput are adequate, pushing ORIS 660M
1266
- through a much larger training run would provide
1267
- weaker evidence than improving the experimental
1268
- foundation first.
1269
- </p>
1270
-
1271
- </div>
1272
-
1273
- </div>
1274
- </section>
1275
-
1276
-
1277
- <!-- =====================================================
1278
- ROADMAP
1279
- ====================================================== -->
1280
-
1281
- <section class="section dark-section">
1282
- <div class="container">
1283
-
1284
- <div class="section-heading">
1285
- <span>10 / ROADMAP</span>
1286
-
1287
- <h2>
1288
- What comes next.
1289
- </h2>
1290
- </div>
1291
-
1292
- <div class="roadmap">
1293
-
1294
- <div class="roadmap-item done">
1295
- <span>01</span>
1296
-
1297
- <div>
1298
- <strong>
1299
- 660M architecture
1300
- </strong>
1301
-
1302
- <p>
1303
- Depth-pruned ORIS branch established.
1304
- </p>
1305
- </div>
1306
- </div>
1307
-
1308
-
1309
- <div class="roadmap-item done">
1310
- <span>02</span>
1311
-
1312
- <div>
1313
- <strong>
1314
- Recovery training
1315
- </strong>
1316
-
1317
- <p>
1318
- Initial language recovery demonstrated.
1319
- </p>
1320
- </div>
1321
- </div>
1322
-
1323
-
1324
- <div class="roadmap-item active">
1325
- <span>03</span>
1326
-
1327
- <div>
1328
- <strong>
1329
- Data infrastructure
1330
- </strong>
1331
-
1332
- <p>
1333
- Build scalable Polish corpus selection,
1334
- cleaning and reconstruction.
1335
- </p>
1336
- </div>
1337
- </div>
1338
-
1339
-
1340
- <div class="roadmap-item">
1341
- <span>04</span>
1342
-
1343
- <div>
1344
- <strong>
1345
- Deduplication and curriculum
1346
- </strong>
1347
-
1348
- <p>
1349
- Finalize training-ready corpus policies.
1350
- </p>
1351
- </div>
1352
- </div>
1353
-
1354
-
1355
- <div class="roadmap-item">
1356
- <span>05</span>
1357
-
1358
- <div>
1359
- <strong>
1360
- Large-scale continuation
1361
- </strong>
1362
-
1363
- <p>
1364
- Resume ORIS training with a significantly
1365
- larger controlled dataset.
1366
- </p>
1367
- </div>
1368
- </div>
1369
-
1370
-
1371
- <div class="roadmap-item">
1372
- <span>06</span>
1373
-
1374
- <div>
1375
- <strong>
1376
- Full evaluation
1377
- </strong>
1378
-
1379
- <p>
1380
- Polish benchmarks, held-out language
1381
- modeling, repetition, calibration
1382
- and generation stability.
1383
- </p>
1384
- </div>
1385
- </div>
1386
-
1387
- </div>
1388
-
1389
- </div>
1390
- </section>
1391
-
1392
-
1393
- <!-- =====================================================
1394
- FINAL
1395
- ====================================================== -->
1396
-
1397
- <section class="section final-section">
1398
- <div class="container narrow">
1399
-
1400
- <div class="final-mark">
1401
- ORIS
1402
- </div>
1403
-
1404
- <h2>
1405
- What remains when a large model
1406
- loses most of its depth?
1407
- </h2>
1408
-
1409
- <p>
1410
- ORIS 660M is the first measurable answer
1411
- produced by this project.
1412
- </p>
1413
-
1414
- <p>
1415
- It is not a final model.
1416
- It is a research checkpoint.
1417
- </p>
1418
-
1419
- <div class="final-meta">
1420
- <span>Started 07.08.2026</span>
1421
- <span>Polish LLM research</span>
1422
- <span>Work in progress</span>
1423
- </div>
1424
-
1425
- </div>
1426
- </section>
1427
-
1428
- </main>
1429
-
1430
-
1431
- <footer>
1432
- <div class="container footer-inner">
1433
-
1434
- <span>
1435
- ORIS LLM
1436
- </span>
1437
-
1438
- <span>
1439
- Architecture compression · Recovery ·
1440
- Data engineering · Evaluation
1441
- </span>
1442
-
1443
- </div>
1444
- </footer>
1445
 
1446
  </body>
1447
- </html>
1448
-
1449
- :root {
1450
- --bg: #050506;
1451
- --bg-soft: #0a0a0d;
1452
- --panel: #0d0d11;
1453
- --panel-2: #121216;
1454
-
1455
- --text: #f4f4f5;
1456
- --muted: #96969f;
1457
- --muted-2: #66666f;
1458
-
1459
- --red: #e10618;
1460
- --red-bright: #ff2238;
1461
- --red-dark: #78000c;
1462
-
1463
- --border: rgba(255, 255, 255, 0.08);
1464
- --border-red: rgba(225, 6, 24, 0.38);
1465
-
1466
- --max-width: 1220px;
1467
- }
1468
-
1469
-
1470
- /* ============================================================
1471
- RESET
1472
- ============================================================ */
1473
-
1474
- * {
1475
- box-sizing: border-box;
1476
- }
1477
-
1478
- html {
1479
- scroll-behavior: smooth;
1480
- }
1481
-
1482
- body {
1483
- margin: 0;
1484
-
1485
- background:
1486
- radial-gradient(
1487
- circle at 50% -20%,
1488
- #200008 0%,
1489
- #080809 34%,
1490
- #050506 64%
1491
- );
1492
-
1493
- color: var(--text);
1494
-
1495
- font-family:
1496
- Inter,
1497
- ui-sans-serif,
1498
- system-ui,
1499
- -apple-system,
1500
- BlinkMacSystemFont,
1501
- "Segoe UI",
1502
- sans-serif;
1503
-
1504
- line-height: 1.65;
1505
-
1506
- overflow-x: hidden;
1507
- }
1508
-
1509
- a {
1510
- color: inherit;
1511
- text-decoration: none;
1512
- }
1513
-
1514
- strong {
1515
- font-weight: 700;
1516
- }
1517
-
1518
-
1519
- /* ============================================================
1520
- BACKGROUND
1521
- ============================================================ */
1522
-
1523
- .background-grid {
1524
- position: fixed;
1525
- inset: 0;
1526
-
1527
- pointer-events: none;
1528
-
1529
- opacity: 0.16;
1530
-
1531
- background-image:
1532
- linear-gradient(
1533
- rgba(255,255,255,0.035) 1px,
1534
- transparent 1px
1535
- ),
1536
- linear-gradient(
1537
- 90deg,
1538
- rgba(255,255,255,0.035) 1px,
1539
- transparent 1px
1540
- );
1541
-
1542
- background-size:
1543
- 42px 42px;
1544
-
1545
- mask-image:
1546
- linear-gradient(
1547
- to bottom,
1548
- black,
1549
- transparent 80%
1550
- );
1551
-
1552
- z-index: -3;
1553
- }
1554
-
1555
- .background-glow {
1556
- position: fixed;
1557
-
1558
- width: 600px;
1559
- height: 600px;
1560
-
1561
- border-radius: 50%;
1562
-
1563
- filter: blur(150px);
1564
-
1565
- opacity: 0.08;
1566
-
1567
- pointer-events: none;
1568
-
1569
- z-index: -2;
1570
-
1571
- background: var(--red);
1572
- }
1573
-
1574
- .glow-one {
1575
- left: -260px;
1576
- top: 250px;
1577
- }
1578
-
1579
- .glow-two {
1580
- right: -350px;
1581
- top: 1050px;
1582
- }
1583
-
1584
-
1585
- /* ============================================================
1586
- LAYOUT
1587
- ============================================================ */
1588
-
1589
- .container {
1590
- width: min(
1591
- calc(100% - 44px),
1592
- var(--max-width)
1593
- );
1594
-
1595
- margin:
1596
- 0 auto;
1597
- }
1598
-
1599
- .narrow {
1600
- max-width: 900px;
1601
- }
1602
-
1603
- .section {
1604
- position: relative;
1605
-
1606
- padding:
1607
- 110px 0;
1608
- }
1609
-
1610
- .compact-section {
1611
- padding-top: 35px;
1612
- padding-bottom: 60px;
1613
- }
1614
-
1615
- .dark-section {
1616
- background:
1617
- linear-gradient(
1618
- 180deg,
1619
- rgba(255,255,255,0.015),
1620
- rgba(255,255,255,0.006)
1621
- );
1622
-
1623
- border-top:
1624
- 1px solid var(--border);
1625
-
1626
- border-bottom:
1627
- 1px solid var(--border);
1628
- }
1629
-
1630
-
1631
- /* ============================================================
1632
- NAV
1633
- ============================================================ */
1634
-
1635
- .topbar {
1636
- position: sticky;
1637
-
1638
- top: 0;
1639
-
1640
- z-index: 20;
1641
-
1642
- backdrop-filter:
1643
- blur(20px);
1644
-
1645
- background:
1646
- rgba(5, 5, 6, 0.78);
1647
-
1648
- border-bottom:
1649
- 1px solid var(--border);
1650
- }
1651
-
1652
- .nav-inner {
1653
- min-height: 72px;
1654
-
1655
- display: flex;
1656
-
1657
- align-items: center;
1658
-
1659
- justify-content: space-between;
1660
-
1661
- gap: 32px;
1662
- }
1663
-
1664
- .brand {
1665
- display: flex;
1666
-
1667
- align-items: center;
1668
-
1669
- gap: 12px;
1670
- }
1671
-
1672
- .brand-mark {
1673
- width: 38px;
1674
- height: 38px;
1675
-
1676
- border:
1677
- 1px solid var(--red);
1678
-
1679
- display: grid;
1680
-
1681
- place-items: center;
1682
-
1683
- font-weight: 900;
1684
-
1685
- font-size: 20px;
1686
-
1687
- color: white;
1688
-
1689
- background:
1690
- linear-gradient(
1691
- 145deg,
1692
- #180006,
1693
- #070708
1694
- );
1695
-
1696
- box-shadow:
1697
- 0 0 25px
1698
- rgba(225, 6, 24, 0.22);
1699
- }
1700
-
1701
- .brand-text {
1702
- display: flex;
1703
-
1704
- flex-direction: column;
1705
-
1706
- font-size: 15px;
1707
-
1708
- font-weight: 800;
1709
-
1710
- letter-spacing: 0.14em;
1711
- }
1712
-
1713
- .brand-text small {
1714
- color: var(--muted);
1715
-
1716
- font-size: 8px;
1717
-
1718
- font-weight: 600;
1719
-
1720
- letter-spacing: 0.24em;
1721
- }
1722
-
1723
- .nav-links {
1724
- display: flex;
1725
-
1726
- gap: 24px;
1727
-
1728
- font-size: 13px;
1729
-
1730
- color: var(--muted);
1731
- }
1732
-
1733
- .nav-links a {
1734
- transition:
1735
- color 0.2s ease;
1736
- }
1737
-
1738
- .nav-links a:hover {
1739
- color: white;
1740
- }
1741
-
1742
-
1743
- /* ============================================================
1744
- HERO
1745
- ============================================================ */
1746
-
1747
- .hero {
1748
- padding:
1749
- 120px 0 75px;
1750
- }
1751
-
1752
- .hero-grid {
1753
- display: grid;
1754
-
1755
- grid-template-columns:
1756
- 1.25fr 0.75fr;
1757
-
1758
- gap: 80px;
1759
-
1760
- align-items: center;
1761
- }
1762
-
1763
- .eyebrow,
1764
- .panel-label,
1765
- .section-heading > span {
1766
- color: var(--red-bright);
1767
-
1768
- font-size: 11px;
1769
-
1770
- font-weight: 800;
1771
-
1772
- letter-spacing: 0.22em;
1773
-
1774
- text-transform: uppercase;
1775
- }
1776
-
1777
- .hero h1 {
1778
- margin:
1779
- 20px 0 20px;
1780
-
1781
- font-size:
1782
- clamp(80px, 12vw, 160px);
1783
-
1784
- line-height: 0.85;
1785
-
1786
- letter-spacing: -0.07em;
1787
-
1788
- font-weight: 950;
1789
- }
1790
-
1791
- .hero h1 span {
1792
- color: var(--red);
1793
- }
1794
-
1795
- .hero-lead {
1796
- max-width: 720px;
1797
-
1798
- color: #c6c6cc;
1799
-
1800
- font-size: 20px;
1801
-
1802
- line-height: 1.6;
1803
- }
1804
-
1805
- .hero-actions {
1806
- display: flex;
1807
-
1808
- gap: 13px;
1809
-
1810
- margin-top: 34px;
1811
- }
1812
-
1813
- .button {
1814
- min-height: 48px;
1815
-
1816
- padding:
1817
- 0 22px;
1818
-
1819
- display: inline-flex;
1820
-
1821
- align-items: center;
1822
-
1823
- justify-content: center;
1824
-
1825
- border:
1826
- 1px solid var(--border);
1827
-
1828
- font-size: 13px;
1829
-
1830
- font-weight: 700;
1831
-
1832
- transition:
1833
- 0.2s ease;
1834
- }
1835
-
1836
- .button-primary {
1837
- border-color:
1838
- var(--red);
1839
-
1840
- background:
1841
- var(--red);
1842
-
1843
- color: white;
1844
- }
1845
-
1846
- .button-primary:hover {
1847
- background:
1848
- var(--red-bright);
1849
- }
1850
-
1851
- .button-secondary {
1852
- background:
1853
- rgba(255,255,255,0.02);
1854
- }
1855
-
1856
- .button-secondary:hover {
1857
- border-color:
1858
- rgba(255,255,255,0.2);
1859
-
1860
- background:
1861
- rgba(255,255,255,0.05);
1862
- }
1863
-
1864
- .hero-note {
1865
- margin-top: 20px;
1866
-
1867
- color: var(--muted-2);
1868
-
1869
- font-size: 12px;
1870
- }
1871
-
1872
- .hero-panel {
1873
- padding: 30px;
1874
-
1875
- border:
1876
- 1px solid var(--border-red);
1877
-
1878
- background:
1879
- linear-gradient(
1880
- 145deg,
1881
- rgba(225,6,24,0.07),
1882
- rgba(255,255,255,0.018)
1883
- );
1884
-
1885
- box-shadow:
1886
- 0 30px 100px
1887
- rgba(0,0,0,0.35);
1888
- }
1889
-
1890
- .big-stat {
1891
- margin:
1892
- 12px 0 26px;
1893
-
1894
- font-size: 54px;
1895
-
1896
- font-weight: 900;
1897
-
1898
- letter-spacing: -0.05em;
1899
- }
1900
-
1901
- .big-stat small {
1902
- display: block;
1903
-
1904
- margin-top: -4px;
1905
-
1906
- color: var(--muted);
1907
-
1908
- font-size: 12px;
1909
-
1910
- letter-spacing: 0.08em;
1911
-
1912
- font-weight: 600;
1913
- }
1914
-
1915
- .stat-grid {
1916
- display: grid;
1917
-
1918
- grid-template-columns:
1919
- repeat(2, 1fr);
1920
-
1921
- gap: 1px;
1922
-
1923
- background:
1924
- var(--border);
1925
- }
1926
-
1927
- .stat-grid div {
1928
- padding:
1929
- 18px;
1930
-
1931
- background:
1932
- var(--bg-soft);
1933
- }
1934
-
1935
- .stat-grid strong,
1936
- .stat-grid span {
1937
- display: block;
1938
- }
1939
-
1940
- .stat-grid strong {
1941
- font-size: 21px;
1942
- }
1943
-
1944
- .stat-grid span {
1945
- margin-top: 3px;
1946
-
1947
- color: var(--muted);
1948
-
1949
- font-size: 11px;
1950
- }
1951
-
1952
- .hero-lineage {
1953
- display: flex;
1954
-
1955
- flex-wrap: wrap;
1956
-
1957
- gap: 8px;
1958
-
1959
- margin-top: 25px;
1960
-
1961
- color: var(--muted);
1962
-
1963
- font-size: 12px;
1964
- }
1965
-
1966
- .hero-lineage b {
1967
- color: var(--muted-2);
1968
- }
1969
-
1970
- .hero-lineage .accent {
1971
- color: white;
1972
-
1973
- font-weight: 800;
1974
- }
1975
-
1976
-
1977
- /* ============================================================
1978
- QUICK METRICS
1979
- ============================================================ */
1980
-
1981
- .quick-grid {
1982
- display: grid;
1983
-
1984
- grid-template-columns:
1985
- repeat(4, 1fr);
1986
-
1987
- gap: 12px;
1988
- }
1989
-
1990
- .metric-card {
1991
- min-height: 130px;
1992
-
1993
- padding:
1994
- 22px;
1995
-
1996
- display: flex;
1997
-
1998
- flex-direction: column;
1999
-
2000
- justify-content: flex-end;
2001
-
2002
- border:
2003
- 1px solid var(--border);
2004
-
2005
- background:
2006
- rgba(255,255,255,0.012);
2007
- }
2008
-
2009
- .metric-label {
2010
- color: var(--muted);
2011
-
2012
- font-size: 11px;
2013
-
2014
- margin-bottom: auto;
2015
- }
2016
-
2017
- .metric-card strong {
2018
- font-size: 22px;
2019
- }
2020
-
2021
- .metric-card small {
2022
- color: var(--muted);
2023
-
2024
- font-size: 10px;
2025
- }
2026
-
2027
-
2028
- /* ============================================================
2029
- HEADINGS / PROSE
2030
- ============================================================ */
2031
-
2032
- .section-heading {
2033
- margin-bottom: 50px;
2034
- }
2035
-
2036
- .section-heading h2 {
2037
- max-width: 900px;
2038
-
2039
- margin:
2040
- 10px 0 0;
2041
-
2042
- font-size:
2043
- clamp(36px, 5vw, 62px);
2044
-
2045
- line-height: 1.05;
2046
-
2047
- letter-spacing: -0.045em;
2048
- }
2049
-
2050
- .prose {
2051
- color: #b7b7be;
2052
-
2053
- font-size: 16px;
2054
- }
2055
-
2056
- .wide-prose {
2057
- max-width: 940px;
2058
- }
2059
-
2060
- .prose p {
2061
- margin:
2062
- 0 0 22px;
2063
- }
2064
-
2065
- .lead-paragraph {
2066
- color: #eeeeef;
2067
-
2068
- font-size: 21px;
2069
-
2070
- line-height: 1.6;
2071
- }
2072
-
2073
- blockquote {
2074
- margin:
2075
- 40px 0 0;
2076
-
2077
- padding:
2078
- 24px 28px;
2079
-
2080
- border-left:
2081
- 3px solid var(--red);
2082
-
2083
- background:
2084
- rgba(225,6,24,0.045);
2085
-
2086
- color: white;
2087
-
2088
- font-size: 20px;
2089
-
2090
- font-weight: 650;
2091
- }
2092
-
2093
-
2094
- /* ============================================================
2095
- LINEAGE
2096
- ============================================================ */
2097
-
2098
- .lineage {
2099
- display: grid;
2100
-
2101
- grid-template-columns:
2102
- 1fr auto 1fr auto 1fr;
2103
-
2104
- gap: 18px;
2105
-
2106
- align-items: center;
2107
-
2108
- margin-bottom: 45px;
2109
- }
2110
-
2111
- .lineage-node {
2112
- padding:
2113
- 26px;
2114
-
2115
- border:
2116
- 1px solid var(--border);
2117
-
2118
- background:
2119
- var(--panel);
2120
- }
2121
-
2122
- .lineage-node.active {
2123
- border-color:
2124
- var(--red);
2125
-
2126
- background:
2127
- linear-gradient(
2128
- 140deg,
2129
- rgba(225,6,24,0.12),
2130
- var(--panel)
2131
- );
2132
- }
2133
-
2134
- .lineage-node small {
2135
- display: block;
2136
-
2137
- color: var(--muted);
2138
-
2139
- font-size: 9px;
2140
-
2141
- letter-spacing: 0.15em;
2142
- }
2143
-
2144
- .lineage-node strong {
2145
- display: block;
2146
-
2147
- margin-top: 7px;
2148
-
2149
- font-size: 18px;
2150
- }
2151
-
2152
- .lineage-arrow {
2153
- color: var(--red);
2154
-
2155
- font-size: 24px;
2156
- }
2157
-
2158
-
2159
- /* ============================================================
2160
- ARCHITECTURE
2161
- ============================================================ */
2162
-
2163
- .architecture-grid {
2164
- display: grid;
2165
-
2166
- grid-template-columns:
2167
- repeat(4, 1fr);
2168
-
2169
- gap: 12px;
2170
- }
2171
-
2172
- .architecture-card {
2173
- min-height: 140px;
2174
-
2175
- padding: 22px;
2176
-
2177
- border:
2178
- 1px solid var(--border);
2179
-
2180
- background:
2181
- var(--panel);
2182
- }
2183
-
2184
- .architecture-card span {
2185
- display: block;
2186
-
2187
- color: var(--muted);
2188
-
2189
- font-size: 11px;
2190
- }
2191
-
2192
- .architecture-card strong {
2193
- display: block;
2194
-
2195
- margin-top: 30px;
2196
-
2197
- font-size: 27px;
2198
- }
2199
-
2200
- .split-panel {
2201
- display: grid;
2202
-
2203
- grid-template-columns:
2204
- 1fr 1fr;
2205
-
2206
- gap: 60px;
2207
-
2208
- margin-top: 60px;
2209
-
2210
- padding:
2211
- 35px;
2212
-
2213
- border:
2214
- 1px solid var(--border);
2215
-
2216
- background:
2217
- rgba(255,255,255,0.012);
2218
- }
2219
-
2220
- .layer-list {
2221
- display: flex;
2222
-
2223
- flex-wrap: wrap;
2224
-
2225
- gap: 8px;
2226
-
2227
- margin-top: 24px;
2228
- }
2229
-
2230
- .layer-list span {
2231
- width: 48px;
2232
- height: 48px;
2233
-
2234
- display: grid;
2235
-
2236
- place-items: center;
2237
-
2238
- border:
2239
- 1px solid var(--border-red);
2240
-
2241
- background:
2242
- rgba(225,6,24,0.04);
2243
-
2244
- font-family:
2245
- ui-monospace,
2246
- SFMono-Regular,
2247
- Menlo,
2248
- monospace;
2249
- }
2250
-
2251
- .big-arrow {
2252
- margin-top: 35px;
2253
-
2254
- font-size: 24px;
2255
-
2256
- font-weight: 800;
2257
- }
2258
-
2259
- .big-arrow span {
2260
- padding:
2261
- 0 15px;
2262
-
2263
- color: var(--red);
2264
- }
2265
-
2266
- .compute-panel {
2267
- margin-top: 20px;
2268
-
2269
- padding: 30px;
2270
-
2271
- border:
2272
- 1px solid var(--border-red);
2273
-
2274
- background:
2275
- rgba(225,6,24,0.035);
2276
- }
2277
-
2278
- .compute-grid {
2279
- display: grid;
2280
-
2281
- grid-template-columns:
2282
- repeat(4, 1fr);
2283
-
2284
- gap: 30px;
2285
-
2286
- margin-top: 23px;
2287
- }
2288
-
2289
- .compute-grid strong,
2290
- .compute-grid span {
2291
- display: block;
2292
- }
2293
-
2294
- .compute-grid strong {
2295
- font-size: 25px;
2296
- }
2297
-
2298
- .compute-grid span {
2299
- color: var(--muted);
2300
-
2301
- font-size: 11px;
2302
- }
2303
-
2304
-
2305
- /* ============================================================
2306
- TABLES
2307
- ============================================================ */
2308
-
2309
- .comparison-table {
2310
- margin-top: 36px;
2311
-
2312
- border:
2313
- 1px solid var(--border);
2314
-
2315
- overflow: hidden;
2316
- }
2317
-
2318
- .comparison-row {
2319
- display: grid;
2320
-
2321
- grid-template-columns:
2322
- 2fr repeat(4, 1fr);
2323
-
2324
- border-top:
2325
- 1px solid var(--border);
2326
- }
2327
-
2328
- .comparison-row:first-child {
2329
- border-top: none;
2330
- }
2331
-
2332
- .comparison-row > * {
2333
- padding:
2334
- 15px 17px;
2335
- }
2336
-
2337
- .comparison-row span {
2338
- color: #b5b5bb;
2339
-
2340
- font-family:
2341
- ui-monospace,
2342
- SFMono-Regular,
2343
- Menlo,
2344
- monospace;
2345
-
2346
- font-size: 12px;
2347
- }
2348
-
2349
- .comparison-header {
2350
- background:
2351
- rgba(255,255,255,0.025);
2352
-
2353
- color: var(--muted);
2354
-
2355
- text-transform: uppercase;
2356
-
2357
- letter-spacing: 0.08em;
2358
-
2359
- font-size: 10px;
2360
- }
2361
-
2362
- .comparison-header span {
2363
- font-family: inherit;
2364
-
2365
- font-size: 10px;
2366
- }
2367
-
2368
- .comparison-row.highlighted {
2369
- background:
2370
- rgba(225,6,24,0.045);
2371
- }
2372
-
2373
- .caption {
2374
- color: var(--muted-2);
2375
-
2376
- font-size: 11px;
2377
-
2378
- margin-top: 13px;
2379
- }
2380
-
2381
-
2382
- /* ============================================================
2383
- TRAINING
2384
- ============================================================ */
2385
-
2386
- .training-grid {
2387
- display: grid;
2388
-
2389
- grid-template-columns:
2390
- repeat(4, 1fr);
2391
-
2392
- gap: 12px;
2393
- }
2394
-
2395
- .training-card {
2396
- padding: 23px;
2397
-
2398
- border:
2399
- 1px solid var(--border);
2400
-
2401
- background:
2402
- var(--panel);
2403
- }
2404
-
2405
- .training-label {
2406
- display: block;
2407
-
2408
- color: var(--muted);
2409
-
2410
- font-size: 10px;
2411
- }
2412
-
2413
- .training-card strong {
2414
- display: block;
2415
-
2416
- margin-top: 18px;
2417
-
2418
- font-size: 21px;
2419
- }
2420
-
2421
- .milestone {
2422
- margin-top: 60px;
2423
-
2424
- padding: 35px;
2425
-
2426
- display: grid;
2427
-
2428
- grid-template-columns:
2429
- 0.6fr 1.4fr;
2430
-
2431
- gap: 40px;
2432
-
2433
- border:
2434
- 1px solid var(--red);
2435
-
2436
- background:
2437
- linear-gradient(
2438
- 135deg,
2439
- rgba(225,6,24,0.1),
2440
- rgba(255,255,255,0.015)
2441
- );
2442
- }
2443
-
2444
- .milestone h3 {
2445
- margin:
2446
- 8px 0 0;
2447
-
2448
- font-size: 36px;
2449
- }
2450
-
2451
- .milestone-stats {
2452
- display: grid;
2453
-
2454
- grid-template-columns:
2455
- repeat(2, 1fr);
2456
-
2457
- gap: 25px;
2458
- }
2459
-
2460
- .milestone-stats strong,
2461
- .milestone-stats span {
2462
- display: block;
2463
- }
2464
-
2465
- .milestone-stats strong {
2466
- font-size: 23px;
2467
- }
2468
-
2469
- .milestone-stats span {
2470
- color: var(--muted);
2471
-
2472
- font-size: 10px;
2473
- }
2474
-
2475
- .warning-box {
2476
- margin-top: 20px;
2477
-
2478
- padding: 22px 25px;
2479
-
2480
- border:
2481
- 1px solid rgba(255,255,255,0.11);
2482
-
2483
- background:
2484
- rgba(255,255,255,0.02);
2485
-
2486
- color: #aaaab1;
2487
-
2488
- font-size: 13px;
2489
- }
2490
-
2491
- .warning-box strong {
2492
- color: white;
2493
- }
2494
-
2495
- .warning-box p {
2496
- margin:
2497
- 5px 0 0;
2498
- }
2499
-
2500
-
2501
- /* ============================================================
2502
- DATA
2503
- ============================================================ */
2504
-
2505
- .data-pipeline {
2506
- display: grid;
2507
-
2508
- grid-template-columns:
2509
- repeat(4, 1fr);
2510
-
2511
- gap: 12px;
2512
-
2513
- margin:
2514
- 45px 0;
2515
- }
2516
-
2517
- .data-stage {
2518
- min-height: 155px;
2519
-
2520
- padding: 24px;
2521
-
2522
- border:
2523
- 1px solid var(--border);
2524
-
2525
- display: flex;
2526
-
2527
- flex-direction: column;
2528
-
2529
- justify-content: space-between;
2530
-
2531
- background:
2532
- var(--panel);
2533
- }
2534
-
2535
- .data-stage strong {
2536
- font-size: 22px;
2537
- }
2538
-
2539
- .data-stage span {
2540
- color: var(--muted);
2541
-
2542
- font-size: 11px;
2543
- }
2544
-
2545
- .data-stage.keep {
2546
- border-top:
2547
- 2px solid #5dff94;
2548
- }
2549
-
2550
- .data-stage.clean {
2551
- border-top:
2552
- 2px solid #ffc65d;
2553
- }
2554
-
2555
- .data-stage.split {
2556
- border-top:
2557
- 2px solid #6e8cff;
2558
- }
2559
-
2560
- .data-stage.drop {
2561
- border-top:
2562
- 2px solid var(--red);
2563
- }
2564
-
2565
- .data-number-grid {
2566
- display: grid;
2567
-
2568
- grid-template-columns:
2569
- repeat(4, 1fr);
2570
-
2571
- gap: 12px;
2572
-
2573
- margin-top: 50px;
2574
- }
2575
-
2576
- .data-number-grid div {
2577
- padding: 22px;
2578
-
2579
- border:
2580
- 1px solid var(--border);
2581
- }
2582
-
2583
- .data-number-grid strong,
2584
- .data-number-grid span {
2585
- display: block;
2586
- }
2587
-
2588
- .data-number-grid strong {
2589
- font-size: 25px;
2590
- }
2591
-
2592
- .data-number-grid span {
2593
- margin-top: 5px;
2594
-
2595
- color: var(--muted);
2596
-
2597
- font-size: 10px;
2598
- }
2599
-
2600
-
2601
- /* ============================================================
2602
- BENCHMARK
2603
- ============================================================ */
2604
-
2605
- .benchmark-title {
2606
- margin-top: 55px;
2607
-
2608
- margin-bottom: 18px;
2609
-
2610
- color: white;
2611
-
2612
- font-size: 15px;
2613
-
2614
- font-weight: 750;
2615
- }
2616
-
2617
- .benchmark-warning {
2618
- border-color:
2619
- rgba(225,6,24,0.28);
2620
-
2621
- background:
2622
- rgba(225,6,24,0.025);
2623
- }
2624
-
2625
- .task-grid {
2626
- display: grid;
2627
-
2628
- grid-template-columns:
2629
- repeat(3, 1fr);
2630
-
2631
- gap: 10px;
2632
-
2633
- margin-top: 30px;
2634
- }
2635
-
2636
- .task-grid div {
2637
- padding: 18px;
2638
-
2639
- display: flex;
2640
-
2641
- justify-content: space-between;
2642
-
2643
- border:
2644
- 1px solid var(--border);
2645
-
2646
- background:
2647
- var(--panel);
2648
- }
2649
-
2650
- .task-grid span {
2651
- color: var(--muted);
2652
-
2653
- font-size: 11px;
2654
- }
2655
-
2656
-
2657
- /* ============================================================
2658
- GENERATIONS
2659
- ============================================================ */
2660
-
2661
- .generation-card {
2662
- margin-top: 20px;
2663
-
2664
- border:
2665
- 1px solid var(--border);
2666
-
2667
- background:
2668
- #09090b;
2669
- }
2670
-
2671
- .generation-header {
2672
- padding:
2673
- 16px 20px;
2674
-
2675
- border-bottom:
2676
- 1px solid var(--border);
2677
- }
2678
-
2679
- .generation-header span {
2680
- display: block;
2681
-
2682
- color: var(--red-bright);
2683
-
2684
- font-size: 9px;
2685
-
2686
- letter-spacing: 0.15em;
2687
-
2688
- margin-bottom: 5px;
2689
- }
2690
-
2691
- .generation-header strong {
2692
- font-family:
2693
- ui-monospace,
2694
- SFMono-Regular,
2695
- Menlo,
2696
- monospace;
2697
-
2698
- font-size: 13px;
2699
- }
2700
-
2701
- .generation-body {
2702
- padding:
2703
- 22px;
2704
-
2705
- color: #d0d0d4;
2706
-
2707
- font-family:
2708
- ui-monospace,
2709
- SFMono-Regular,
2710
- Menlo,
2711
- monospace;
2712
-
2713
- font-size: 12px;
2714
- }
2715
-
2716
- .generation-body p {
2717
- margin:
2718
- 10px 0 0;
2719
- }
2720
-
2721
- .generation-mode {
2722
- color: var(--red-bright);
2723
-
2724
- font-size: 9px;
2725
-
2726
- font-weight: 800;
2727
-
2728
- letter-spacing: 0.15em;
2729
- }
2730
-
2731
- .sampled-mode {
2732
- color: #f0f0f0;
2733
- }
2734
-
2735
- .generation-comment {
2736
- padding:
2737
- 14px 20px;
2738
-
2739
- border-top:
2740
- 1px solid var(--border);
2741
-
2742
- color: var(--muted);
2743
-
2744
- font-size: 11px;
2745
- }
2746
-
2747
- .behavior-grid {
2748
- display: grid;
2749
-
2750
- grid-template-columns:
2751
- 1fr 1fr;
2752
-
2753
- gap: 20px;
2754
-
2755
- margin-top: 40px;
2756
- }
2757
-
2758
- .behavior-grid > div {
2759
- padding: 28px;
2760
-
2761
- border:
2762
- 1px solid var(--border);
2763
-
2764
- background:
2765
- var(--panel);
2766
- }
2767
-
2768
- .behavior-grid strong {
2769
- font-size: 18px;
2770
- }
2771
-
2772
- .behavior-grid ul {
2773
- margin:
2774
- 18px 0 0;
2775
-
2776
- padding-left: 20px;
2777
-
2778
- color: var(--muted);
2779
- }
2780
-
2781
- .positive {
2782
- border-top-color:
2783
- #48c878 !important;
2784
- }
2785
-
2786
- .negative {
2787
- border-top-color:
2788
- var(--red) !important;
2789
- }
2790
-
2791
-
2792
- /* ============================================================
2793
- STATUS
2794
- ============================================================ */
2795
-
2796
- .status-box {
2797
- padding: 35px;
2798
-
2799
- border:
2800
- 1px solid var(--border-red);
2801
-
2802
- background:
2803
- linear-gradient(
2804
- 140deg,
2805
- rgba(225,6,24,0.07),
2806
- rgba(255,255,255,0.01)
2807
- );
2808
- }
2809
-
2810
- .status-box p {
2811
- color: #b9b9bf;
2812
- }
2813
-
2814
- .status-indicator {
2815
- display: flex;
2816
-
2817
- align-items: center;
2818
-
2819
- gap: 10px;
2820
-
2821
- margin-bottom: 27px;
2822
-
2823
- color: white;
2824
-
2825
- font-size: 11px;
2826
-
2827
- font-weight: 800;
2828
-
2829
- letter-spacing: 0.13em;
2830
- }
2831
-
2832
- .status-indicator span {
2833
- width: 10px;
2834
- height: 10px;
2835
-
2836
- border-radius: 50%;
2837
-
2838
- background:
2839
- var(--red);
2840
-
2841
- box-shadow:
2842
- 0 0 15px
2843
- var(--red);
2844
- }
2845
-
2846
-
2847
- /* ============================================================
2848
- ROADMAP
2849
- ============================================================ */
2850
-
2851
- .roadmap {
2852
- border-top:
2853
- 1px solid var(--border);
2854
- }
2855
-
2856
- .roadmap-item {
2857
- display: grid;
2858
-
2859
- grid-template-columns:
2860
- 70px 1fr;
2861
-
2862
- gap: 20px;
2863
-
2864
- padding:
2865
- 28px 0;
2866
-
2867
- border-bottom:
2868
- 1px solid var(--border);
2869
- }
2870
-
2871
- .roadmap-item > span {
2872
- color: var(--muted-2);
2873
-
2874
- font-family:
2875
- ui-monospace,
2876
- SFMono-Regular,
2877
- Menlo,
2878
- monospace;
2879
- }
2880
-
2881
- .roadmap-item strong {
2882
- font-size: 17px;
2883
- }
2884
-
2885
- .roadmap-item p {
2886
- margin:
2887
- 5px 0 0;
2888
-
2889
- color: var(--muted);
2890
-
2891
- font-size: 13px;
2892
- }
2893
-
2894
- .roadmap-item.done > span {
2895
- color: #5dff94;
2896
- }
2897
-
2898
- .roadmap-item.active > span {
2899
- color: var(--red-bright);
2900
- }
2901
-
2902
-
2903
- /* ============================================================
2904
- FINAL
2905
- ============================================================ */
2906
-
2907
- .final-section {
2908
- padding:
2909
- 150px 0;
2910
- }
2911
-
2912
- .final-mark {
2913
- color: var(--red);
2914
-
2915
- font-size: 12px;
2916
-
2917
- font-weight: 900;
2918
-
2919
- letter-spacing: 0.4em;
2920
- }
2921
-
2922
- .final-section h2 {
2923
- margin:
2924
- 20px 0;
2925
-
2926
- font-size:
2927
- clamp(40px, 6vw, 72px);
2928
-
2929
- line-height: 1;
2930
-
2931
- letter-spacing: -0.05em;
2932
- }
2933
-
2934
- .final-section p {
2935
- color: var(--muted);
2936
-
2937
- font-size: 17px;
2938
- }
2939
-
2940
- .final-meta {
2941
- display: flex;
2942
-
2943
- flex-wrap: wrap;
2944
-
2945
- gap: 18px;
2946
-
2947
- margin-top: 45px;
2948
-
2949
- color: var(--muted-2);
2950
-
2951
- font-size: 10px;
2952
-
2953
- text-transform: uppercase;
2954
-
2955
- letter-spacing: 0.1em;
2956
- }
2957
-
2958
-
2959
- /* ============================================================
2960
- FOOTER
2961
- ============================================================ */
2962
-
2963
- footer {
2964
- border-top:
2965
- 1px solid var(--border);
2966
-
2967
- background:
2968
- #030304;
2969
- }
2970
-
2971
- .footer-inner {
2972
- min-height: 90px;
2973
-
2974
- display: flex;
2975
-
2976
- align-items: center;
2977
-
2978
- justify-content: space-between;
2979
-
2980
- gap: 30px;
2981
-
2982
- color: var(--muted-2);
2983
-
2984
- font-size: 10px;
2985
- }
2986
-
2987
-
2988
- /* ============================================================
2989
- RESPONSIVE
2990
- ============================================================ */
2991
-
2992
- @media (
2993
- max-width: 980px
2994
- ) {
2995
- .hero-grid,
2996
- .split-panel,
2997
- .milestone {
2998
- grid-template-columns:
2999
- 1fr;
3000
- }
3001
-
3002
- .quick-grid,
3003
- .architecture-grid,
3004
- .training-grid,
3005
- .data-pipeline,
3006
- .data-number-grid,
3007
- .compute-grid {
3008
- grid-template-columns:
3009
- repeat(2, 1fr);
3010
- }
3011
-
3012
- .nav-links {
3013
- display: none;
3014
- }
3015
-
3016
- .lineage {
3017
- grid-template-columns:
3018
- 1fr;
3019
-
3020
- text-align: center;
3021
- }
3022
-
3023
- .lineage-arrow {
3024
- transform:
3025
- rotate(90deg);
3026
- }
3027
-
3028
- .comparison-table {
3029
- overflow-x: auto;
3030
- }
3031
-
3032
- .comparison-row {
3033
- min-width: 780px;
3034
- }
3035
- }
3036
-
3037
-
3038
- @media (
3039
- max-width: 640px
3040
- ) {
3041
- .section {
3042
- padding:
3043
- 78px 0;
3044
- }
3045
-
3046
- .hero {
3047
- padding-top: 85px;
3048
- }
3049
-
3050
- .hero h1 {
3051
- font-size:
3052
- clamp(70px, 25vw, 110px);
3053
- }
3054
-
3055
- .hero-lead {
3056
- font-size: 17px;
3057
- }
3058
-
3059
- .quick-grid,
3060
- .architecture-grid,
3061
- .training-grid,
3062
- .data-pipeline,
3063
- .data-number-grid,
3064
- .compute-grid,
3065
- .task-grid,
3066
- .behavior-grid,
3067
- .milestone-stats {
3068
- grid-template-columns:
3069
- 1fr;
3070
- }
3071
-
3072
- .hero-actions {
3073
- flex-direction: column;
3074
-
3075
- align-items: stretch;
3076
- }
3077
-
3078
- .button {
3079
- width: 100%;
3080
- }
3081
-
3082
- .footer-inner {
3083
- padding:
3084
- 25px 0;
3085
-
3086
- align-items: flex-start;
3087
-
3088
- flex-direction: column;
3089
- }
3090
- }
 
1
  <!doctype html>
2
  <html lang="en">
3
  <head>
4
+ <meta charset="utf-8" />
5
+ <meta name="viewport" content="width=device-width, initial-scale=1" />
6
+ <title>ORIS LLM</title>
7
+
8
+ <style>
9
+ :root {
10
+ --bg: #070708;
11
+ --panel: #0d0d0f;
12
+ --panel-2: #111114;
13
+ --text: #f2f2f3;
14
+ --muted: #9a9aa3;
15
+ --red: #d80f20;
16
+ --red-soft: rgba(216, 15, 32, 0.12);
17
+ --border: rgba(255, 255, 255, 0.08);
18
+ --max: 1080px;
19
+ }
20
+
21
+ * {
22
+ box-sizing: border-box;
23
+ }
24
+
25
+ html {
26
+ scroll-behavior: smooth;
27
+ }
28
+
29
+ body {
30
+ margin: 0;
31
+ background: var(--bg);
32
+ color: var(--text);
33
+ font-family:
34
+ Inter,
35
+ Arial,
36
+ sans-serif;
37
+ line-height: 1.65;
38
+ }
39
+
40
+ a {
41
+ color: inherit;
42
+ text-decoration: none;
43
+ }
44
+
45
+ .container {
46
+ width: min(calc(100% - 40px), var(--max));
47
+ margin: 0 auto;
48
+ }
49
+
50
+ header {
51
+ border-bottom: 1px solid var(--border);
52
+ background: #09090a;
53
+ position: sticky;
54
+ top: 0;
55
+ z-index: 10;
56
+ }
57
+
58
+ nav {
59
+ min-height: 64px;
60
+ display: flex;
61
+ align-items: center;
62
+ justify-content: space-between;
63
+ gap: 24px;
64
+ }
65
+
66
+ .brand {
67
+ font-weight: 900;
68
+ letter-spacing: 0.18em;
69
+ }
70
+
71
+ .brand span {
72
+ color: var(--red);
73
+ }
74
+
75
+ .links {
76
+ display: flex;
77
+ gap: 20px;
78
+ font-size: 13px;
79
+ color: var(--muted);
80
+ }
81
+
82
+ .links a:hover {
83
+ color: white;
84
+ }
85
+
86
+ .hero {
87
+ padding: 110px 0 90px;
88
+ }
89
+
90
+ .hero-grid {
91
+ display: grid;
92
+ grid-template-columns: 1.4fr 0.6fr;
93
+ gap: 60px;
94
+ align-items: end;
95
+ }
96
+
97
+ .label {
98
+ color: var(--red);
99
+ font-size: 11px;
100
+ font-weight: 800;
101
+ letter-spacing: 0.18em;
102
+ text-transform: uppercase;
103
+ }
104
+
105
+ h1 {
106
+ margin: 12px 0 20px;
107
+ font-size: clamp(72px, 12vw, 140px);
108
+ line-height: 0.88;
109
+ letter-spacing: -0.06em;
110
+ }
111
+
112
+ h1 span {
113
+ color: var(--red);
114
+ }
115
+
116
+ .hero p {
117
+ max-width: 760px;
118
+ color: #c2c2c8;
119
+ font-size: 19px;
120
+ }
121
+
122
+ .hero-card {
123
+ border: 1px solid var(--border);
124
+ border-top: 2px solid var(--red);
125
+ background: var(--panel);
126
+ padding: 26px;
127
+ }
128
+
129
+ .hero-card strong {
130
+ display: block;
131
+ font-size: 42px;
132
+ line-height: 1;
133
+ margin: 10px 0 18px;
134
+ }
135
+
136
+ .hero-card div {
137
+ display: flex;
138
+ justify-content: space-between;
139
+ gap: 20px;
140
+ padding: 8px 0;
141
+ border-top: 1px solid var(--border);
142
+ font-size: 12px;
143
+ }
144
+
145
+ .hero-card span {
146
+ color: var(--muted);
147
+ }
148
+
149
+ section {
150
+ padding: 90px 0;
151
+ border-top: 1px solid var(--border);
152
+ }
153
+
154
+ h2 {
155
+ margin: 10px 0 30px;
156
+ font-size: clamp(34px, 5vw, 56px);
157
+ line-height: 1.05;
158
+ letter-spacing: -0.04em;
159
+ }
160
+
161
+ .prose {
162
+ max-width: 880px;
163
+ color: #b7b7be;
164
+ font-size: 16px;
165
+ }
166
+
167
+ .prose p {
168
+ margin: 0 0 20px;
169
+ }
170
+
171
+ .lead {
172
+ color: white;
173
+ font-size: 21px;
174
+ }
175
+
176
+ .lineage {
177
+ margin-top: 35px;
178
+ display: flex;
179
+ align-items: center;
180
+ flex-wrap: wrap;
181
+ gap: 12px;
182
+ font-family: monospace;
183
+ }
184
+
185
+ .lineage span {
186
+ border: 1px solid var(--border);
187
+ background: var(--panel);
188
+ padding: 12px 16px;
189
+ }
190
+
191
+ .lineage b {
192
+ color: var(--red);
193
+ }
194
+
195
+ .grid {
196
+ display: grid;
197
+ grid-template-columns: repeat(4, 1fr);
198
+ gap: 12px;
199
+ margin-top: 35px;
200
+ }
201
+
202
+ .box {
203
+ border: 1px solid var(--border);
204
+ background: var(--panel);
205
+ padding: 20px;
206
+ }
207
+
208
+ .box small {
209
+ display: block;
210
+ color: var(--muted);
211
+ margin-bottom: 16px;
212
+ }
213
+
214
+ .box strong {
215
+ font-size: 23px;
216
+ }
217
+
218
+ .layers {
219
+ display: flex;
220
+ flex-wrap: wrap;
221
+ gap: 8px;
222
+ margin-top: 25px;
223
+ }
224
+
225
+ .layers span {
226
+ width: 44px;
227
+ height: 44px;
228
+ display: grid;
229
+ place-items: center;
230
+ border: 1px solid rgba(216, 15, 32, 0.4);
231
+ background: var(--red-soft);
232
+ font-family: monospace;
233
+ }
234
+
235
+ .table-wrap {
236
+ overflow-x: auto;
237
+ margin-top: 30px;
238
+ }
239
+
240
+ table {
241
+ width: 100%;
242
+ border-collapse: collapse;
243
+ background: var(--panel);
244
+ font-size: 13px;
245
+ }
246
+
247
+ th,
248
+ td {
249
+ padding: 14px 16px;
250
+ text-align: left;
251
+ border: 1px solid var(--border);
252
+ }
253
+
254
+ th {
255
+ color: var(--muted);
256
+ font-size: 11px;
257
+ font-weight: 600;
258
+ }
259
+
260
+ tr.highlight {
261
+ background: var(--red-soft);
262
+ }
263
+
264
+ .note {
265
+ margin-top: 14px;
266
+ color: var(--muted);
267
+ font-size: 12px;
268
+ }
269
+
270
+ .status {
271
+ border-left: 3px solid var(--red);
272
+ background: var(--red-soft);
273
+ padding: 24px 26px;
274
+ margin-top: 30px;
275
+ }
276
+
277
+ .status strong {
278
+ color: white;
279
+ }
280
+
281
+ .code {
282
+ background: #050506;
283
+ border: 1px solid var(--border);
284
+ padding: 18px;
285
+ font-family: monospace;
286
+ font-size: 12px;
287
+ white-space: pre-wrap;
288
+ overflow-wrap: anywhere;
289
+ margin-top: 16px;
290
+ }
291
+
292
+ .good-bad {
293
+ display: grid;
294
+ grid-template-columns: 1fr 1fr;
295
+ gap: 14px;
296
+ margin-top: 30px;
297
+ }
298
+
299
+ .good-bad div {
300
+ border: 1px solid var(--border);
301
+ background: var(--panel);
302
+ padding: 22px;
303
+ }
304
+
305
+ .good-bad ul {
306
+ margin-bottom: 0;
307
+ color: var(--muted);
308
+ }
309
+
310
+ footer {
311
+ border-top: 1px solid var(--border);
312
+ padding: 40px 0;
313
+ color: var(--muted);
314
+ font-size: 12px;
315
+ }
316
+
317
+ @media (max-width: 800px) {
318
+ .hero-grid {
319
+ grid-template-columns: 1fr;
320
+ }
321
+
322
+ .grid {
323
+ grid-template-columns: repeat(2, 1fr);
324
+ }
325
+
326
+ .good-bad {
327
+ grid-template-columns: 1fr;
328
+ }
329
+
330
+ .links {
331
+ display: none;
332
+ }
333
+ }
334
+
335
+ @media (max-width: 520px) {
336
+ .grid {
337
+ grid-template-columns: 1fr;
338
+ }
339
+
340
+ .hero {
341
+ padding-top: 80px;
342
+ }
343
+ }
344
+ </style>
345
  </head>
346
 
347
  <body>
348
 
349
+ <header>
350
+ <div class="container">
351
+ <nav>
352
+ <a class="brand" href="#">
353
+ ORIS<span>.</span>
354
+ </a>
355
+
356
+ <div class="links">
357
+ <a href="#mission">Mission</a>
358
+ <a href="#architecture">Architecture</a>
359
+ <a href="#training">Training</a>
360
+ <a href="#evaluation">Evaluation</a>
361
+ <a href="#data">Data</a>
362
+ <a href="#status">Status</a>
363
+ </div>
364
+ </nav>
365
+ </div>
366
+ </header>
367
+
368
+ <main>
369
+
370
+ <div class="hero">
371
+ <div class="container hero-grid">
372
+
373
+ <div>
374
+ <div class="label">
375
+ Polish language model research
376
+ </div>
377
+
378
+ <h1>
379
+ ORIS <span>660M</span>
380
+ </h1>
381
+
382
+ <p>
383
+ ORIS is an experimental Polish language model family
384
+ focused on unusual architectural and data trade-offs.
385
+ The goal is not necessarily to outperform every existing
386
+ model, but to explore gaps in the Polish LLM ecosystem,
387
+ establish useful reference points, and openly share
388
+ results, failures and engineering observations.
389
+ </p>
390
+ </div>
391
+
392
+ <div class="hero-card">
393
+ <div class="label">
394
+ Current branch
395
+ </div>
396
+
397
+ <strong>
398
+ 660.13M
399
+ </strong>
400
+
401
+ <div>
402
+ <span>Layers</span>
403
+ <b>12</b>
404
+ </div>
405
+
406
+ <div>
407
+ <span>Hidden</span>
408
+ <b>1536</b>
409
+ </div>
410
+
411
+ <div>
412
+ <span>FFN</span>
413
+ <b>8960</b>
414
+ </div>
415
+
416
+ <div>
417
+ <span>Status</span>
418
+ <b>Paused / active research</b>
419
+ </div>
420
+ </div>
421
+
422
+ </div>
423
+ </div>
424
+
425
+ <section id="mission">
426
+ <div class="container">
427
+
428
+ <div class="label">
429
+ Mission
430
+ </div>
431
+
432
+ <h2>
433
+ Exploring what Polish language models
434
+ can look like outside standard scaling paths.
435
+ </h2>
436
+
437
+ <div class="prose">
438
+
439
+ <p class="lead">
440
+ ORIS was created to explore unconventional gaps
441
+ in the Polish language-model ecosystem.
442
+ </p>
443
+
444
+ <p>
445
+ The project does not treat a higher benchmark score
446
+ as the only meaningful outcome. Architecture,
447
+ compression, recovery behavior, dataset construction,
448
+ compute efficiency and failure modes are all considered
449
+ part of the result.
450
+ </p>
451
+
452
+ <p>
453
+ ORIS 660M is one of those experiments: a heavily
454
+ depth-pruned descendant of Bielik-1.5B-v3 that was
455
+ then partially recovered through continued Polish
456
+ language modeling.
457
+ </p>
458
+
459
+ <div class="lineage">
460
+ <span>Qwen 2.5</span>
461
+ <b>→</b>
462
+ <span>Bielik-1.5B-v3</span>
463
+ <b>→</b>
464
+ <span>ORIS 660M</span>
465
+ </div>
466
+
467
+ </div>
468
+
469
+ </div>
470
+ </section>
471
+
472
+ <section id="architecture">
473
+ <div class="container">
474
+
475
+ <div class="label">
476
+ Architecture
477
+ </div>
478
+
479
+ <h2>
480
+ 1.596B teacher → 660M student
481
+ </h2>
482
+
483
+ <div class="grid">
484
+
485
+ <div class="box">
486
+ <small>Parameters</small>
487
+ <strong>660,131,328</strong>
488
+ </div>
489
+
490
+ <div class="box">
491
+ <small>Decoder layers</small>
492
+ <strong>12</strong>
493
+ </div>
494
+
495
+ <div class="box">
496
+ <small>Hidden size</small>
497
+ <strong>1536</strong>
498
+ </div>
499
+
500
+ <div class="box">
501
+ <small>Intermediate size</small>
502
+ <strong>8960</strong>
503
+ </div>
504
+
505
+ <div class="box">
506
+ <small>Attention heads</small>
507
+ <strong>12</strong>
508
+ </div>
509
+
510
+ <div class="box">
511
+ <small>KV heads</small>
512
+ <strong>2</strong>
513
+ </div>
514
+
515
+ <div class="box">
516
+ <small>Head dimension</small>
517
+ <strong>128</strong>
518
+ </div>
519
+
520
+ <div class="box">
521
+ <small>Vocabulary</small>
522
+ <strong>32,000</strong>
523
+ </div>
524
+
525
+ </div>
526
+
527
+ <div class="prose" style="margin-top: 40px;">
528
+
529
+ <p>
530
+ The main compression operation was depth reduction.
531
+ The original width, FFN geometry, attention geometry,
532
+ embeddings and LM head were preserved.
533
+ </p>
534
+
535
+ <p>
536
+ Retained teacher blocks:
537
+ </p>
538
+
539
+ <div class="layers">
540
+ <span>0</span>
541
+ <span>1</span>
542
+ <span>2</span>
543
+ <span>3</span>
544
+ <span>4</span>
545
+ <span>21</span>
546
+ <span>23</span>
547
+ <span>24</span>
548
+ <span>25</span>
549
+ <span>29</span>
550
+ <span>30</span>
551
+ <span>31</span>
552
+ </div>
553
+
554
+ </div>
555
+
556
+ </div>
557
+ </section>
558
+
559
+ <section>
560
+ <div class="container">
561
+
562
+ <div class="label">
563
+ Initial pruning result
564
+ </div>
565
+
566
+ <h2>
567
+ The student started badly damaged.
568
+ </h2>
569
+
570
+ <div class="prose">
571
+ <p>
572
+ A fixed 128 × 1024 evaluation showed the scale
573
+ of the initial damage immediately after pruning.
574
+ </p>
575
+ </div>
576
+
577
+ <div class="table-wrap">
578
+ <table>
579
+ <thead>
580
+ <tr>
581
+ <th>Model</th>
582
+ <th>Loss</th>
583
+ <th>Perplexity</th>
584
+ <th>Tokens/s</th>
585
+ <th>Peak VRAM</th>
586
+ </tr>
587
+ </thead>
588
+
589
+ <tbody>
590
+ <tr class="highlight">
591
+ <td>ORIS 660M step0</td>
592
+ <td>7.1613</td>
593
+ <td>1288.58</td>
594
+ <td>17.29k</td>
595
+ <td>1.54 GiB</td>
596
+ </tr>
597
+
598
+ <tr>
599
+ <td>Bielik-1.5B</td>
600
+ <td>2.2692</td>
601
+ <td>9.67</td>
602
+ <td>6.69k</td>
603
+ <td>3.29 GiB</td>
604
+ </tr>
605
+ </tbody>
606
+ </table>
607
+ </div>
608
+
609
+ <p class="note">
610
+ The step0 comparison is a fixed evaluation.
611
+ It is not directly comparable with later training-window loss.
612
+ </p>
613
+
614
+ </div>
615
+ </section>
616
+
617
+ <section id="training">
618
+ <div class="container">
619
+
620
+ <div class="label">
621
+ Recovery training
622
+ </div>
623
+
624
+ <h2>
625
+ 170.23M label tokens of clean continuation
626
+ </h2>
627
+
628
+ <div class="grid">
629
+
630
+ <div class="box">
631
+ <small>Sequence length</small>
632
+ <strong>1024</strong>
633
+ </div>
634
+
635
+ <div class="box">
636
+ <small>Micro batch</small>
637
+ <strong>2</strong>
638
+ </div>
639
+
640
+ <div class="box">
641
+ <small>Gradient accumulation</small>
642
+ <strong>256</strong>
643
+ </div>
644
+
645
+ <div class="box">
646
+ <small>Tokens / optimizer step</small>
647
+ <strong>523,776</strong>
648
+ </div>
649
+
650
+ <div class="box">
651
+ <small>Precision</small>
652
+ <strong>BF16</strong>
653
+ </div>
654
+
655
+ <div class="box">
656
+ <small>Learning rate</small>
657
+ <strong>2e-5</strong>
658
+ </div>
659
+
660
+ <div class="box">
661
+ <small>Training throughput</small>
662
+ <strong>~9.1k tok/s</strong>
663
+ </div>
664
+
665
+ <div class="box">
666
+ <small>Latest checkpoint</small>
667
+ <strong>325</strong>
668
+ </div>
669
+
670
+ </div>
671
+
672
+ <div class="status">
673
+ <strong>
674
+ Checkpoint 325
675
+ </strong>
676
+
677
+ <p>
678
+ 170,227,200 label tokens ·
679
+ 190,720 documents read ·
680
+ 190,720 EOS tokens added ·
681
+ last training-window loss: 3.7726.
682
+ </p>
683
+ </div>
684
+
685
+ </div>
686
+ </section>
687
+
688
+ <section id="evaluation">
689
+ <div class="container">
690
+
691
+ <div class="label">
692
+ Evaluation
693
+ </div>
694
+
695
+ <h2>
696
+ Small diagnostic runs, not final leaderboard claims.
697
+ </h2>
698
+
699
+ <div class="prose">
700
+ <p>
701
+ ORIS 660M never reached a full pretraining schedule.
702
+ The current benchmarks are used mainly to understand
703
+ how much capability returned during recovery.
704
+ </p>
705
+ </div>
706
+
707
+ <div class="table-wrap">
708
+ <table>
709
+ <thead>
710
+ <tr>
711
+ <th>Model</th>
712
+ <th>Params</th>
713
+ <th>Custom MC</th>
714
+ <th>Normalized MC</th>
715
+ <th>Continuation NLL</th>
716
+ </tr>
717
+ </thead>
718
+
719
+ <tbody>
720
+ <tr class="highlight">
721
+ <td>ORIS 660M step325</td>
722
+ <td>660M</td>
723
+ <td>0.750</td>
724
+ <td>0.500</td>
725
+ <td>3.3525</td>
726
+ </tr>
727
+
728
+ <tr>
729
+ <td>Qra-1b</td>
730
+ <td>~1.10B</td>
731
+ <td>0.917</td>
732
+ <td>0.583</td>
733
+ <td>1.5715</td>
734
+ </tr>
735
+ </tbody>
736
+ </table>
737
+ </div>
738
+
739
+ <div class="table-wrap">
740
+ <table>
741
+ <thead>
742
+ <tr>
743
+ <th>Open PL polish_mc</th>
744
+ <th>Accuracy</th>
745
+ <th>Acc. norm</th>
746
+ <th>F1</th>
747
+ </tr>
748
+ </thead>
749
+
750
+ <tbody>
751
+ <tr class="highlight">
752
+ <td>ORIS 660M step325</td>
753
+ <td>0.399</td>
754
+ <td>0.386</td>
755
+ <td>0.0116</td>
756
+ </tr>
757
+
758
+ <tr>
759
+ <td>APT3-1B-Base</td>
760
+ <td>0.330</td>
761
+ <td>0.300</td>
762
+ <td>0.3215</td>
763
+ </tr>
764
+ </tbody>
765
+ </table>
766
+ </div>
767
+
768
+ <p class="note">
769
+ Open PL LLM Leaderboard polish_mc · 0-shot ·
770
+ limited to 100 examples per task.
771
+ These are diagnostic subset results,
772
+ not official leaderboard scores.
773
+ </p>
774
+
775
+ <div class="status">
776
+ <strong>
777
+ Accuracy alone is misleading here.
778
+ </strong>
779
+
780
+ <p>
781
+ ORIS showed severe class bias on some binary tasks.
782
+ The high aggregate accuracy therefore does not mean
783
+ that ORIS generally outperforms APT3.
784
+ </p>
785
+ </div>
786
+
787
+ </div>
788
+ </section>
789
+
790
+ <section>
791
+ <div class="container">
792
+
793
+ <div class="label">
794
+ Generation behavior
795
+ </div>
796
+
797
+ <h2>
798
+ The language came back before stability did.
799
+ </h2>
800
+
801
+ <div class="good-bad">
802
+
803
+ <div>
804
+ <strong>
805
+ Recovered
806
+ </strong>
807
+
808
+ <ul>
809
+ <li>Polish syntax</li>
810
+ <li>local sentence fluency</li>
811
+ <li>basic factual associations</li>
812
+ <li>usable sampled continuations</li>
813
+ </ul>
814
+ </div>
815
+
816
+ <div>
817
+ <strong>
818
+ Still unstable
819
+ </strong>
820
+
821
+ <ul>
822
+ <li>greedy repetition loops</li>
823
+ <li>topic drift</li>
824
+ <li>long-range coherence</li>
825
+ <li>class calibration</li>
826
+ <li>web-pattern residue</li>
827
+ </ul>
828
+ </div>
829
+
830
+ </div>
831
+
832
+ <div class="code">PROMPT:
833
+ Inflacja oznacza wzrost
834
+
835
+ GREEDY:
836
+ o 1,5 proc. W 2013 r. w Polsce...
837
+ w porównaniu do 1,5 proc...
838
+ w porównaniu do 1,5 proc...</div>
839
+
840
+ <div class="code">PROMPT:
841
+ Kiedy rano otworzył okno, zobaczył
842
+
843
+ SAMPLED:
844
+ A recognizable Polish narrative continuation appears,
845
+ but semantic drift and unrelated learned patterns
846
+ still enter the generation.</div>
847
+
848
+ </div>
849
+ </section>
850
+
851
+ <section id="data">
852
+ <div class="container">
853
+
854
+ <div class="label">
855
+ Data
856
+ </div>
857
+
858
+ <h2>
859
+ The project became a data-throughput problem.
860
+ </h2>
861
+
862
+ <div class="prose">
863
+
864
+ <p class="lead">
865
+ Training a few hundred million tokens was not
866
+ the difficult part. Managing reliable data
867
+ at tens or eventually more than 100B tokens was.
868
+ </p>
869
+
870
+ <p>
871
+ Early recovery corpora still contained web boilerplate,
872
+ repeated fragments, SEO text, listing pages,
873
+ forum residue, broken document boundaries,
874
+ encoding problems and unrelated topics merged
875
+ into single examples.
876
+ </p>
877
+
878
+ <p>
879
+ Scaling compute on top of those representations
880
+ would mostly reinforce their defects.
881
+ Work therefore shifted toward a V2 corpus pipeline
882
+ with four main decisions:
883
+ </p>
884
+
885
+ </div>
886
+
887
+ <div class="grid">
888
+
889
+ <div class="box">
890
+ <small>KEEP</small>
891
+ <strong>Usable document</strong>
892
+ </div>
893
+
894
+ <div class="box">
895
+ <small>CLEAN</small>
896
+ <strong>Recoverable core</strong>
897
+ </div>
898
+
899
+ <div class="box">
900
+ <small>SPLIT</small>
901
+ <strong>Multiple regions</strong>
902
+ </div>
903
+
904
+ <div class="box">
905
+ <small>DROP</small>
906
+ <strong>No useful core</strong>
907
+ </div>
908
+
909
+ </div>
910
+
911
+ <div class="prose" style="margin-top: 35px;">
912
+
913
+ <p>
914
+ The pipeline combines structural features,
915
+ repetition analysis, template detection,
916
+ semantic coherence, document-region analysis
917
+ and mmBERT-assisted scoring.
918
+ </p>
919
+
920
+ <p>
921
+ In one large V2 shard run, more than 1.39M
922
+ documents and roughly 1.55B approximate raw tokens
923
+ were processed at around 17.2 documents per second.
924
+ </p>
925
+
926
+ <p>
927
+ A conservative KEEP hygiene stage retained
928
+ approximately 99.77% of input tokens,
929
+ because its purpose was cleanup rather than
930
+ aggressive filtering.
931
+ </p>
932
+
933
+ </div>
934
+
935
+ </div>
936
+ </section>
937
+
938
+ <section id="status">
939
+ <div class="container">
940
+
941
+ <div class="label">
942
+ Current status
943
+ </div>
944
+
945
+ <h2>
946
+ ORIS 660M is paused, not finished.
947
+ </h2>
948
+
949
+ <div class="status">
950
+
951
+ <p>
952
+ The 660M branch reached a useful recovery milestone,
953
+ but further training was temporarily deprioritized.
954
+ </p>
955
+
956
+ <p>
957
+ The next meaningful stage requires a reliable
958
+ data-selection, reconstruction, deduplication
959
+ and evaluation pipeline capable of operating
960
+ at a scale approaching or exceeding 100B tokens.
961
+ </p>
962
+
963
+ <p>
964
+ Parts of that system have already been tested,
965
+ but the complete large-scale infrastructure
966
+ and independent evaluation throughput are not
967
+ yet deployed.
968
+ </p>
969
+
970
+ <p>
971
+ Additional compute infrastructure is also planned.
972
+ Until then, the 660M checkpoint remains a research
973
+ reference rather than a finished release.
974
+ </p>
975
+
976
+ </div>
977
+
978
+ </div>
979
+ </section>
980
+
981
+ </main>
982
+
983
+ <footer>
984
+ <div class="container">
985
+ ORIS LLM · Started 07.08.2026 ·
986
+ Polish language model research · Work in progress
987
+ </div>
988
+ </footer>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
989
 
990
  </body>
991
+ </html>