athrvk commited on
Commit
5a404c1
·
verified ·
1 Parent(s): 3dc34fb

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +12 -12
README.md CHANGED
@@ -32,7 +32,7 @@ model never predicts the value directly).
32
  - live demo: https://huggingface.co/spaces/athrvk/gpu-sankhya-demo
33
  - gold evaluation sets: https://huggingface.co/datasets/athrvk/gpu-sankhya-gold
34
 
35
- This model card describes weights version `v0.3.4` (arch `v2`).
36
 
37
  ## Architecture
38
 
@@ -62,10 +62,10 @@ units, and range handling.
62
  | --- | ---: |
63
  | `charset.json` | 930 bytes |
64
  | `classes.json` | 1,571 bytes |
65
- | `gold_metrics_json_float32.json` | 4,572 bytes |
66
- | `gold_metrics_json_int8.json` | 4,572 bytes |
67
- | `gold_metrics_torch.json` | 4,572 bytes |
68
- | `kaggle_metrics.json` | 16,439 bytes |
69
  | `matrix.md` | 739 bytes |
70
  | `sankhya.onnx` | 161,024 bytes |
71
  | `sankhya.pt` | 167,990 bytes |
@@ -92,9 +92,9 @@ card](athrvk/gpu-sankhya-gold)):
92
 
93
  | gold set | examples | spans | value_acc | precision | recall | F1 |
94
  | --- | ---: | ---: | ---: | ---: | ---: | ---: |
95
- | gold.jsonl | 225 | 197 | 0.9543 | 0.9497 | 0.9594 | 0.9545 |
96
- | gold_deva.jsonl | 185 | 154 | 0.9740 | 0.9805 | 0.9805 | 0.9805 |
97
- | **combined** | 410 | 351 | **0.9630** | 0.9632 | 0.9687 | 0.9659 |
98
 
99
  Negatives (zero-gold-span examples): 75, false
100
  positives: 0 (0.00%).
@@ -104,14 +104,14 @@ Per-category value accuracy (combined):
104
  | category | spans | value_acc |
105
  | --- | ---: | ---: |
106
  | digits | 92 | 0.9674 |
107
- | words | 259 | 0.9614 |
108
  | prefix | 81 | 0.9630 |
109
- | range | 27 | 0.8889 |
110
  | currency | 48 | 1.0000 |
111
- | multi_unit | 24 | 0.9167 |
112
  | symbol_unit | 33 | 1.0000 |
113
  | mixed_script | 2 | 1.0000 |
114
- | long | 12 | 0.6667 |
115
 
116
  ## Usage
117
 
 
32
  - live demo: https://huggingface.co/spaces/athrvk/gpu-sankhya-demo
33
  - gold evaluation sets: https://huggingface.co/datasets/athrvk/gpu-sankhya-gold
34
 
35
+ This model card describes weights version `v0.4.0` (arch `v2`).
36
 
37
  ## Architecture
38
 
 
62
  | --- | ---: |
63
  | `charset.json` | 930 bytes |
64
  | `classes.json` | 1,571 bytes |
65
+ | `gold_metrics_json_float32.json` | 4,848 bytes |
66
+ | `gold_metrics_json_int8.json` | 4,849 bytes |
67
+ | `gold_metrics_torch.json` | 4,848 bytes |
68
+ | `kaggle_metrics.json` | 17,436 bytes |
69
  | `matrix.md` | 739 bytes |
70
  | `sankhya.onnx` | 161,024 bytes |
71
  | `sankhya.pt` | 167,990 bytes |
 
92
 
93
  | gold set | examples | spans | value_acc | precision | recall | F1 |
94
  | --- | ---: | ---: | ---: | ---: | ---: | ---: |
95
+ | gold.jsonl | 227 | 199 | 0.9548 | 0.9502 | 0.9598 | 0.9550 |
96
+ | gold_deva.jsonl | 186 | 155 | 0.9806 | 0.9806 | 0.9806 | 0.9806 |
97
+ | **combined** | 413 | 354 | **0.9661** | 0.9635 | 0.9689 | 0.9662 |
98
 
99
  Negatives (zero-gold-span examples): 75, false
100
  positives: 0 (0.00%).
 
104
  | category | spans | value_acc |
105
  | --- | ---: | ---: |
106
  | digits | 92 | 0.9674 |
107
+ | words | 262 | 0.9656 |
108
  | prefix | 81 | 0.9630 |
109
+ | range | 30 | 0.9333 |
110
  | currency | 48 | 1.0000 |
111
+ | multi_unit | 27 | 0.9630 |
112
  | symbol_unit | 33 | 1.0000 |
113
  | mixed_script | 2 | 1.0000 |
114
+ | long | 15 | 0.8000 |
115
 
116
  ## Usage
117