v9: header-synonym augmentation (BUYER_NAME 0.764→0.800, macroF1 0.566→0.588) + ONNX INT8
Browse files- README.md +32 -40
- config.json +64 -46
- label2id.json +32 -23
- model_int8.onnx +3 -0
- pytorch_model.bin +2 -2
README.md
CHANGED
|
@@ -7,58 +7,50 @@ tags:
|
|
| 7 |
- invoice-extraction
|
| 8 |
- gst
|
| 9 |
- pytorch
|
|
|
|
| 10 |
datasets:
|
| 11 |
- Mosal1985/gst-smoke-dataset
|
| 12 |
pipeline_tag: token-classification
|
| 13 |
-
metrics:
|
| 14 |
-
- precision
|
| 15 |
-
- recall
|
| 16 |
-
- f1
|
| 17 |
---
|
| 18 |
|
| 19 |
-
#
|
| 20 |
|
| 21 |
-
|
| 22 |
-
|
| 23 |
-
|
| 24 |
-
|
| 25 |
|
| 26 |
-
|
| 27 |
-
(synthetic + real internet invoices), `MAX_LEN=768` (tail-truncated, v4 baseline).
|
| 28 |
|
| 29 |
-
**
|
| 30 |
-
|
| 31 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
|
| 33 |
-
##
|
| 34 |
-
|
| 35 |
-
```python
|
| 36 |
-
from transformers import LayoutLMForTokenClassification, AutoTokenizer
|
| 37 |
-
|
| 38 |
-
model = LayoutLMForTokenClassification.from_pretrained("Mosal1985/gst-layoutlm-tiny")
|
| 39 |
-
tok = AutoTokenizer.from_pretrained("microsoft/layoutlm-base-uncased")
|
| 40 |
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
```
|
|
|
|
|
|
|
| 44 |
|
| 45 |
-
|
| 46 |
-
pipeline: dataset builder, training runs (`smoke_run_v2/v3/v4`), OCR
|
| 47 |
-
integration, and Tally XML generation.
|
| 48 |
|
| 49 |
-
|
|
|
|
| 50 |
|
| 51 |
-
|
| 52 |
-
|
| 53 |
-
|
| 54 |
-
|
| 55 |
-
|
| 56 |
|
| 57 |
-
##
|
| 58 |
|
| 59 |
-
|
| 60 |
-
|
| 61 |
-
|
| 62 |
-
CGST/SGST/IGST_AMOUNT, CGST/SGST/IGST_RATE, TOTAL, O...)
|
| 63 |
-
- Data: 16 pages, 11 vendors — see the GstEngine repo for the builder
|
| 64 |
-
- License: CC BY-NC 4.0
|
|
|
|
| 7 |
- invoice-extraction
|
| 8 |
- gst
|
| 9 |
- pytorch
|
| 10 |
+
- onnx
|
| 11 |
datasets:
|
| 12 |
- Mosal1985/gst-smoke-dataset
|
| 13 |
pipeline_tag: token-classification
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
---
|
| 15 |
|
| 16 |
+
# GST LayoutLM Tiny (v9)
|
| 17 |
|
| 18 |
+
Fine-tuned tiny LayoutLM student for extracting fields from Indian GST invoices
|
| 19 |
+
(6L/256H/4A, ~13M params). Trained on 1,942 pages (199 original + 1,761
|
| 20 |
+
header-synonym augmented) across 40 vendors; evaluated on 4 held-out vendor
|
| 21 |
+
families (18 pages, identical to the v8 eval split for A/B comparison).
|
| 22 |
|
| 23 |
+
## v9 highlights
|
|
|
|
| 24 |
|
| 25 |
+
- **BUYER_NAME F1: 0.800** (v8: 0.764) — robust to header synonyms:
|
| 26 |
+
`Buyer`, `Customer`, `Purchaser`, `Bill To`, `Consignee`, `Recipient`,
|
| 27 |
+
`Party (Buyer)`, `Customer Details`, `Billed To`, `Party Name` (+ email
|
| 28 |
+
distractors so usernames like `saif.mr` are not picked up as buyer names)
|
| 29 |
+
- **Macro Field F1: 0.588** (v8: 0.566) · **Entity F1: 0.649** (v8: 0.642)
|
| 30 |
+
- Big gains on tax fields: TAX_AMOUNT 0.727 (+0.30), SGST_AMOUNT 0.800 (+0.13),
|
| 31 |
+
QUANTITY 0.606 (+0.08), TAXABLE_VALUE 0.615 (+0.07)
|
| 32 |
|
| 33 |
+
## Files
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 34 |
|
| 35 |
+
| File | Size | Use |
|
| 36 |
+
|---|---|---|
|
| 37 |
+
| `pytorch_model.bin` | 52 MB | PyTorch `from_pretrained` (LayoutLMForTokenClassification) |
|
| 38 |
+
| `model_int8.onnx` | 13.17 MB | Android / onnxruntime INT8 (99.48% token parity, ~126 ms CPU @ seq 768) |
|
| 39 |
+
| `config.json` / `label2id.json` | — | label map + config |
|
| 40 |
|
| 41 |
+
## Quickstart
|
|
|
|
|
|
|
| 42 |
|
| 43 |
+
```python
|
| 44 |
+
from transformers import LayoutLMConfig, LayoutLMForTokenClassification
|
| 45 |
|
| 46 |
+
config = LayoutLMConfig.from_pretrained("Mosal1985/gst-layoutlm-tiny")
|
| 47 |
+
model = LayoutLMForTokenClassification.from_pretrained(
|
| 48 |
+
"Mosal1985/gst-layoutlm-tiny", config=config
|
| 49 |
+
)
|
| 50 |
+
```
|
| 51 |
|
| 52 |
+
## Training
|
| 53 |
|
| 54 |
+
`gst_finetune_smoke.py` (canonical trainer, MAX_LEN=768, 40 epochs, T4 ~25 min)
|
| 55 |
+
with dataset augmentation from `augment_header_synonyms.py`
|
| 56 |
+
(v9 = `data/gst_smoke_dataset_v9.jsonl`, 1,960 records).
|
|
|
|
|
|
|
|
|
config.json
CHANGED
|
@@ -6,56 +6,74 @@
|
|
| 6 |
"hidden_dropout_prob": 0.1,
|
| 7 |
"hidden_size": 256,
|
| 8 |
"id2label": {
|
| 9 |
-
"0": "B-
|
| 10 |
-
"1": "
|
| 11 |
-
"2": "
|
| 12 |
-
"3": "
|
| 13 |
-
"4": "
|
| 14 |
-
"5": "
|
| 15 |
-
"6": "
|
| 16 |
-
"7": "
|
| 17 |
-
"8": "
|
| 18 |
-
"9": "
|
| 19 |
-
"10": "
|
| 20 |
-
"11": "
|
| 21 |
-
"12": "
|
| 22 |
-
"13": "S-
|
| 23 |
-
"14": "S-
|
| 24 |
-
"15": "S-
|
| 25 |
-
"16": "S-
|
| 26 |
-
"17": "S-
|
| 27 |
-
"18": "S-
|
| 28 |
-
"19": "S-
|
| 29 |
-
"20": "S-
|
| 30 |
-
"21": "S-
|
| 31 |
-
"22": "S-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
},
|
| 33 |
"initializer_range": 0.02,
|
| 34 |
"intermediate_size": 768,
|
| 35 |
"label2id": {
|
| 36 |
-
"B-
|
| 37 |
-
"
|
| 38 |
-
"
|
| 39 |
-
"
|
| 40 |
-
"
|
| 41 |
-
"
|
| 42 |
-
"
|
| 43 |
-
"
|
| 44 |
-
"
|
| 45 |
-
"
|
| 46 |
-
"
|
| 47 |
-
"
|
| 48 |
-
"
|
| 49 |
-
"S-
|
| 50 |
-
"S-
|
| 51 |
-
"S-
|
| 52 |
-
"S-
|
| 53 |
-
"S-
|
| 54 |
-
"S-
|
| 55 |
-
"S-
|
| 56 |
-
"S-
|
| 57 |
-
"S-
|
| 58 |
-
"S-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 59 |
},
|
| 60 |
"layer_norm_eps": 1e-12,
|
| 61 |
"max_2d_position_embeddings": 1024,
|
|
|
|
| 6 |
"hidden_dropout_prob": 0.1,
|
| 7 |
"hidden_size": 256,
|
| 8 |
"id2label": {
|
| 9 |
+
"0": "B-BUYER_NAME",
|
| 10 |
+
"1": "B-INVOICE_DATE",
|
| 11 |
+
"2": "B-ITEM_NAME",
|
| 12 |
+
"3": "B-SELLER_NAME",
|
| 13 |
+
"4": "E-BUYER_NAME",
|
| 14 |
+
"5": "E-INVOICE_DATE",
|
| 15 |
+
"6": "E-ITEM_NAME",
|
| 16 |
+
"7": "E-SELLER_NAME",
|
| 17 |
+
"8": "I-BUYER_NAME",
|
| 18 |
+
"9": "I-INVOICE_DATE",
|
| 19 |
+
"10": "I-ITEM_NAME",
|
| 20 |
+
"11": "I-SELLER_NAME",
|
| 21 |
+
"12": "O",
|
| 22 |
+
"13": "S-BUYER_NAME",
|
| 23 |
+
"14": "S-CGST_AMOUNT",
|
| 24 |
+
"15": "S-CGST_RATE",
|
| 25 |
+
"16": "S-DISCOUNT",
|
| 26 |
+
"17": "S-HSN_SAC",
|
| 27 |
+
"18": "S-IGST_AMOUNT",
|
| 28 |
+
"19": "S-IGST_RATE",
|
| 29 |
+
"20": "S-INVOICE_DATE",
|
| 30 |
+
"21": "S-INVOICE_NUMBER",
|
| 31 |
+
"22": "S-ITEM_NAME",
|
| 32 |
+
"23": "S-PLACE_OF_SUPPLY",
|
| 33 |
+
"24": "S-QUANTITY",
|
| 34 |
+
"25": "S-SELLER_GSTIN",
|
| 35 |
+
"26": "S-SGST_AMOUNT",
|
| 36 |
+
"27": "S-SGST_RATE",
|
| 37 |
+
"28": "S-TAXABLE_VALUE",
|
| 38 |
+
"29": "S-TAX_AMOUNT",
|
| 39 |
+
"30": "S-TOTAL",
|
| 40 |
+
"31": "S-UNIT_PRICE"
|
| 41 |
},
|
| 42 |
"initializer_range": 0.02,
|
| 43 |
"intermediate_size": 768,
|
| 44 |
"label2id": {
|
| 45 |
+
"B-BUYER_NAME": 0,
|
| 46 |
+
"B-INVOICE_DATE": 1,
|
| 47 |
+
"B-ITEM_NAME": 2,
|
| 48 |
+
"B-SELLER_NAME": 3,
|
| 49 |
+
"E-BUYER_NAME": 4,
|
| 50 |
+
"E-INVOICE_DATE": 5,
|
| 51 |
+
"E-ITEM_NAME": 6,
|
| 52 |
+
"E-SELLER_NAME": 7,
|
| 53 |
+
"I-BUYER_NAME": 8,
|
| 54 |
+
"I-INVOICE_DATE": 9,
|
| 55 |
+
"I-ITEM_NAME": 10,
|
| 56 |
+
"I-SELLER_NAME": 11,
|
| 57 |
+
"O": 12,
|
| 58 |
+
"S-BUYER_NAME": 13,
|
| 59 |
+
"S-CGST_AMOUNT": 14,
|
| 60 |
+
"S-CGST_RATE": 15,
|
| 61 |
+
"S-DISCOUNT": 16,
|
| 62 |
+
"S-HSN_SAC": 17,
|
| 63 |
+
"S-IGST_AMOUNT": 18,
|
| 64 |
+
"S-IGST_RATE": 19,
|
| 65 |
+
"S-INVOICE_DATE": 20,
|
| 66 |
+
"S-INVOICE_NUMBER": 21,
|
| 67 |
+
"S-ITEM_NAME": 22,
|
| 68 |
+
"S-PLACE_OF_SUPPLY": 23,
|
| 69 |
+
"S-QUANTITY": 24,
|
| 70 |
+
"S-SELLER_GSTIN": 25,
|
| 71 |
+
"S-SGST_AMOUNT": 26,
|
| 72 |
+
"S-SGST_RATE": 27,
|
| 73 |
+
"S-TAXABLE_VALUE": 28,
|
| 74 |
+
"S-TAX_AMOUNT": 29,
|
| 75 |
+
"S-TOTAL": 30,
|
| 76 |
+
"S-UNIT_PRICE": 31
|
| 77 |
},
|
| 78 |
"layer_norm_eps": 1e-12,
|
| 79 |
"max_2d_position_embeddings": 1024,
|
label2id.json
CHANGED
|
@@ -1,25 +1,34 @@
|
|
| 1 |
{
|
| 2 |
-
"B-
|
| 3 |
-
"
|
| 4 |
-
"
|
| 5 |
-
"
|
| 6 |
-
"
|
| 7 |
-
"
|
| 8 |
-
"
|
| 9 |
-
"
|
| 10 |
-
"
|
| 11 |
-
"
|
| 12 |
-
"
|
| 13 |
-
"
|
| 14 |
-
"
|
| 15 |
-
"S-
|
| 16 |
-
"S-
|
| 17 |
-
"S-
|
| 18 |
-
"S-
|
| 19 |
-
"S-
|
| 20 |
-
"S-
|
| 21 |
-
"S-
|
| 22 |
-
"S-
|
| 23 |
-
"S-
|
| 24 |
-
"S-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
}
|
|
|
|
| 1 |
{
|
| 2 |
+
"B-BUYER_NAME": 0,
|
| 3 |
+
"B-INVOICE_DATE": 1,
|
| 4 |
+
"B-ITEM_NAME": 2,
|
| 5 |
+
"B-SELLER_NAME": 3,
|
| 6 |
+
"E-BUYER_NAME": 4,
|
| 7 |
+
"E-INVOICE_DATE": 5,
|
| 8 |
+
"E-ITEM_NAME": 6,
|
| 9 |
+
"E-SELLER_NAME": 7,
|
| 10 |
+
"I-BUYER_NAME": 8,
|
| 11 |
+
"I-INVOICE_DATE": 9,
|
| 12 |
+
"I-ITEM_NAME": 10,
|
| 13 |
+
"I-SELLER_NAME": 11,
|
| 14 |
+
"O": 12,
|
| 15 |
+
"S-BUYER_NAME": 13,
|
| 16 |
+
"S-CGST_AMOUNT": 14,
|
| 17 |
+
"S-CGST_RATE": 15,
|
| 18 |
+
"S-DISCOUNT": 16,
|
| 19 |
+
"S-HSN_SAC": 17,
|
| 20 |
+
"S-IGST_AMOUNT": 18,
|
| 21 |
+
"S-IGST_RATE": 19,
|
| 22 |
+
"S-INVOICE_DATE": 20,
|
| 23 |
+
"S-INVOICE_NUMBER": 21,
|
| 24 |
+
"S-ITEM_NAME": 22,
|
| 25 |
+
"S-PLACE_OF_SUPPLY": 23,
|
| 26 |
+
"S-QUANTITY": 24,
|
| 27 |
+
"S-SELLER_GSTIN": 25,
|
| 28 |
+
"S-SGST_AMOUNT": 26,
|
| 29 |
+
"S-SGST_RATE": 27,
|
| 30 |
+
"S-TAXABLE_VALUE": 28,
|
| 31 |
+
"S-TAX_AMOUNT": 29,
|
| 32 |
+
"S-TOTAL": 30,
|
| 33 |
+
"S-UNIT_PRICE": 31
|
| 34 |
}
|
model_int8.onnx
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:76680802d9f8cc20b5b0f1e0102b8b23fabfed4c99825a0c76e808018747b739
|
| 3 |
+
size 13807989
|
pytorch_model.bin
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:05a10d81c1bac409274c8963becf2d301cd03308c5a39cae9986586f0b1edac5
|
| 3 |
+
size 52383614
|