athrvk commited on
Commit
6fecceb
·
verified ·
1 Parent(s): 1db7d2c

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +15 -15
README.md CHANGED
@@ -32,7 +32,7 @@ model never predicts the value directly).
32
  - live demo: https://huggingface.co/spaces/athrvk/gpu-sankhya-demo
33
  - gold evaluation sets: https://huggingface.co/datasets/athrvk/gpu-sankhya-gold
34
 
35
- This model card describes weights version `v0.3.2` (arch `v2`).
36
 
37
  ## Architecture
38
 
@@ -62,15 +62,15 @@ units, and range handling.
62
  | --- | ---: |
63
  | `charset.json` | 930 bytes |
64
  | `classes.json` | 1,571 bytes |
65
- | `gold_metrics_json_float32.json` | 4,444 bytes |
66
- | `gold_metrics_json_int8.json` | 4,415 bytes |
67
- | `gold_metrics_torch.json` | 4,444 bytes |
68
- | `kaggle_metrics.json` | 15,934 bytes |
69
  | `matrix.md` | 409 bytes |
70
  | `sankhya.onnx` | 161,024 bytes |
71
  | `sankhya.pt` | 168,310 bytes |
72
- | `sankhya.weights.int8.json` | 59,004 bytes |
73
- | `sankhya.weights.json` | 398,513 bytes |
74
 
75
  - `sankhya.pt` -- torch checkpoint (vocab, classes, arch, channels, state_dict)
76
  - `sankhya.onnx` -- ONNX graph, for interop/inspection
@@ -92,9 +92,9 @@ card](athrvk/gpu-sankhya-gold)):
92
 
93
  | gold set | examples | spans | value_acc | precision | recall | F1 |
94
  | --- | ---: | ---: | ---: | ---: | ---: | ---: |
95
- | gold.jsonl | 220 | 194 | 0.9381 | 0.9293 | 0.9485 | 0.9388 |
96
- | gold_deva.jsonl | 182 | 151 | 0.9735 | 0.9867 | 0.9801 | 0.9834 |
97
- | **combined** | 402 | 345 | **0.9536** | 0.9540 | 0.9623 | 0.9582 |
98
 
99
  Negatives (zero-gold-span examples): 73, false
100
  positives: 0 (0.00%).
@@ -103,13 +103,13 @@ Per-category value accuracy (combined):
103
 
104
  | category | spans | value_acc |
105
  | --- | ---: | ---: |
106
- | digits | 91 | 0.9560 |
107
- | words | 254 | 0.9528 |
108
  | prefix | 81 | 0.9630 |
109
- | range | 24 | 0.9167 |
110
  | currency | 48 | 1.0000 |
111
- | multi_unit | 21 | 0.9524 |
112
- | symbol_unit | 33 | 0.9394 |
113
  | mixed_script | 2 | 1.0000 |
114
  | long | 10 | 0.8000 |
115
 
 
32
  - live demo: https://huggingface.co/spaces/athrvk/gpu-sankhya-demo
33
  - gold evaluation sets: https://huggingface.co/datasets/athrvk/gpu-sankhya-gold
34
 
35
+ This model card describes weights version `v0.3.3` (arch `v2`).
36
 
37
  ## Architecture
38
 
 
62
  | --- | ---: |
63
  | `charset.json` | 930 bytes |
64
  | `classes.json` | 1,571 bytes |
65
+ | `gold_metrics_json_float32.json` | 4,314 bytes |
66
+ | `gold_metrics_json_int8.json` | 4,295 bytes |
67
+ | `gold_metrics_torch.json` | 4,314 bytes |
68
+ | `kaggle_metrics.json` | 15,554 bytes |
69
  | `matrix.md` | 409 bytes |
70
  | `sankhya.onnx` | 161,024 bytes |
71
  | `sankhya.pt` | 168,310 bytes |
72
+ | `sankhya.weights.int8.json` | 58,997 bytes |
73
+ | `sankhya.weights.json` | 397,100 bytes |
74
 
75
  - `sankhya.pt` -- torch checkpoint (vocab, classes, arch, channels, state_dict)
76
  - `sankhya.onnx` -- ONNX graph, for interop/inspection
 
92
 
93
  | gold set | examples | spans | value_acc | precision | recall | F1 |
94
  | --- | ---: | ---: | ---: | ---: | ---: | ---: |
95
+ | gold.jsonl | 220 | 194 | 0.9536 | 0.9585 | 0.9536 | 0.9561 |
96
+ | gold_deva.jsonl | 182 | 151 | 0.9801 | 0.9867 | 0.9801 | 0.9834 |
97
+ | **combined** | 402 | 345 | **0.9652** | 0.9708 | 0.9652 | 0.9680 |
98
 
99
  Negatives (zero-gold-span examples): 73, false
100
  positives: 0 (0.00%).
 
103
 
104
  | category | spans | value_acc |
105
  | --- | ---: | ---: |
106
+ | digits | 91 | 0.9780 |
107
+ | words | 254 | 0.9606 |
108
  | prefix | 81 | 0.9630 |
109
+ | range | 24 | 0.9583 |
110
  | currency | 48 | 1.0000 |
111
+ | multi_unit | 21 | 1.0000 |
112
+ | symbol_unit | 33 | 1.0000 |
113
  | mixed_script | 2 | 1.0000 |
114
  | long | 10 | 0.8000 |
115