Hugging Face's logo

Dsg2
/
LS3-Micro-Base

Text Generation
English
Model card Files
xet
 Community
Dsg2 commited on
Commit
4f6f1ef
·
verified ·
1 Parent(s): 8bc9d60

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -19,12 +19,12 @@ This repo contains the Base (completed pretrain cudalm checkpoint) variant of LS
19
 
20
  <img src="https://cdn-uploads.huggingface.co/production/uploads/691aa5bf8411a45dc9e761c3/v_irkP1sB30tm48uVcGDH.webp" width="900">
21
 
22
- | (acc norm except LAMBADA) | HellaSwag | ARC-E | ARC-C | PIQA | LAMBADA | ArithMark | \*II | \*\*Intelligence Density |
23
- | ------------------------- | --------- | ----- | ----- | -------- | ------- | --------- | ----- | ------------------------ |
24
- | LS2.5-108M-A17M-Base | 28.24 | 36.66 | 23.21 | 57.40 | 17.89 | 37.00 | 9.89 | 0.231 |
25
- | LS-Tiny-Base (31M) | 27.11 | 32.24 | 24.49 | 53.81 | 2.99 | 34.00 | 6.22 | 0.288 |
26
- | LS-Micro-Base (11.49M) | 27.41 | 34.72 | 21.93 | 54.84 | 11.06 | 35.50 | 7.24 | 0.909 |
27
- | LS3-Micro-Base (9.97M) | 27.31 | 34.76 | 23.29 | 57.34 | 12.87 | 38.90 | 9.64 | 1.290 |
28
 
29
  LS3-Micro-Base has a 24.9% higher Intelligence Index than LS-Micro Base, while having 13% less total parameters. It also nearly matches LS2.5-108M-A17M with almost 11x less parameters.
30
 
 
19
 
20
  <img src="https://cdn-uploads.huggingface.co/production/uploads/691aa5bf8411a45dc9e761c3/v_irkP1sB30tm48uVcGDH.webp" width="900">
21
 
22
+ | (acc norm except LAMBADA) | HellaSwag | ARC-E | ARC-C | PIQA | LAMBADA | ArithMark | \*II | \*\*Intelligence Density |
23
+ | ------------------------- | --------- | --------- | --------- | ------------ | ----------- | ------------- | --------- | ---------------------------- |
24
+ | LS2.5-108M-A17M-Base | *28.24* | *36.66* | 23.21 | *57.40* | *17.89* | 37.00 | *9.89* | 0.231 |
25
+ | LS-Tiny-Base (31M) | 27.11 | 32.24 | **24.49** | 53.81 | 2.99 | 34.00 | 6.22 | 0.288 |
26
+ | LS-Micro-Base (11.49M) | **27.41** | 34.72 | 21.93 | 54.84 | 11.06 | 35.50 | 7.24 | 0.909 |
27
+ | LS3-Micro-Base (9.97M) | 27.31 | **34.76** | 23.29 | **57.34** | **12.87** | **38.90** | **9.64** | **1.290** |
28
 
29
  LS3-Micro-Base has a 24.9% higher Intelligence Index than LS-Micro Base, while having 13% less total parameters. It also nearly matches LS2.5-108M-A17M with almost 11x less parameters.
30