athrvk commited on
Commit
d75dc87
·
verified ·
1 Parent(s): 0695d62

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +15 -15
README.md CHANGED
@@ -32,7 +32,7 @@ model never predicts the value directly).
32
  - live demo: https://huggingface.co/spaces/athrvk/gpu-sankhya-demo
33
  - gold evaluation sets: https://huggingface.co/datasets/athrvk/gpu-sankhya-gold
34
 
35
- This model card describes weights version `v0.3.1` (arch `v2`).
36
 
37
  ## Architecture
38
 
@@ -62,15 +62,15 @@ units, and range handling.
62
  | --- | ---: |
63
  | `charset.json` | 930 bytes |
64
  | `classes.json` | 1,571 bytes |
65
- | `gold_metrics_json_float32.json` | 4,410 bytes |
66
- | `gold_metrics_json_int8.json` | 4,412 bytes |
67
- | `gold_metrics_torch.json` | 4,410 bytes |
68
- | `kaggle_metrics.json` | 15,863 bytes |
69
  | `matrix.md` | 409 bytes |
70
  | `sankhya.onnx` | 161,024 bytes |
71
  | `sankhya.pt` | 168,310 bytes |
72
- | `sankhya.weights.int8.json` | 59,003 bytes |
73
- | `sankhya.weights.json` | 398,219 bytes |
74
 
75
  - `sankhya.pt` -- torch checkpoint (vocab, classes, arch, channels, state_dict)
76
  - `sankhya.onnx` -- ONNX graph, for interop/inspection
@@ -92,9 +92,9 @@ card](athrvk/gpu-sankhya-gold)):
92
 
93
  | gold set | examples | spans | value_acc | precision | recall | F1 |
94
  | --- | ---: | ---: | ---: | ---: | ---: | ---: |
95
- | gold.jsonl | 214 | 188 | 0.9255 | 0.9167 | 0.9362 | 0.9263 |
96
- | gold_deva.jsonl | 182 | 151 | 0.9735 | 0.9737 | 0.9801 | 0.9769 |
97
- | **combined** | 396 | 339 | **0.9469** | 0.9419 | 0.9558 | 0.9488 |
98
 
99
  Negatives (zero-gold-span examples): 73, false
100
  positives: 0 (0.00%).
@@ -103,13 +103,13 @@ Per-category value accuracy (combined):
103
 
104
  | category | spans | value_acc |
105
  | --- | ---: | ---: |
106
- | digits | 91 | 0.9670 |
107
- | words | 248 | 0.9395 |
108
- | prefix | 81 | 0.9259 |
109
  | range | 24 | 0.9167 |
110
- | currency | 47 | 1.0000 |
111
  | multi_unit | 21 | 0.9524 |
112
- | symbol_unit | 33 | 0.9697 |
113
  | mixed_script | 2 | 1.0000 |
114
  | long | 10 | 0.8000 |
115
 
 
32
  - live demo: https://huggingface.co/spaces/athrvk/gpu-sankhya-demo
33
  - gold evaluation sets: https://huggingface.co/datasets/athrvk/gpu-sankhya-gold
34
 
35
+ This model card describes weights version `v0.3.2` (arch `v2`).
36
 
37
  ## Architecture
38
 
 
62
  | --- | ---: |
63
  | `charset.json` | 930 bytes |
64
  | `classes.json` | 1,571 bytes |
65
+ | `gold_metrics_json_float32.json` | 4,444 bytes |
66
+ | `gold_metrics_json_int8.json` | 4,415 bytes |
67
+ | `gold_metrics_torch.json` | 4,444 bytes |
68
+ | `kaggle_metrics.json` | 15,934 bytes |
69
  | `matrix.md` | 409 bytes |
70
  | `sankhya.onnx` | 161,024 bytes |
71
  | `sankhya.pt` | 168,310 bytes |
72
+ | `sankhya.weights.int8.json` | 59,004 bytes |
73
+ | `sankhya.weights.json` | 398,513 bytes |
74
 
75
  - `sankhya.pt` -- torch checkpoint (vocab, classes, arch, channels, state_dict)
76
  - `sankhya.onnx` -- ONNX graph, for interop/inspection
 
92
 
93
  | gold set | examples | spans | value_acc | precision | recall | F1 |
94
  | --- | ---: | ---: | ---: | ---: | ---: | ---: |
95
+ | gold.jsonl | 220 | 194 | 0.9381 | 0.9293 | 0.9485 | 0.9388 |
96
+ | gold_deva.jsonl | 182 | 151 | 0.9735 | 0.9867 | 0.9801 | 0.9834 |
97
+ | **combined** | 402 | 345 | **0.9536** | 0.9540 | 0.9623 | 0.9582 |
98
 
99
  Negatives (zero-gold-span examples): 73, false
100
  positives: 0 (0.00%).
 
103
 
104
  | category | spans | value_acc |
105
  | --- | ---: | ---: |
106
+ | digits | 91 | 0.9560 |
107
+ | words | 254 | 0.9528 |
108
+ | prefix | 81 | 0.9630 |
109
  | range | 24 | 0.9167 |
110
+ | currency | 48 | 1.0000 |
111
  | multi_unit | 21 | 0.9524 |
112
+ | symbol_unit | 33 | 0.9394 |
113
  | mixed_script | 2 | 1.0000 |
114
  | long | 10 | 0.8000 |
115