gurvgupta commited on
Commit
241ae6e
·
verified ·
1 Parent(s): 960c0a5

Update README.md

Browse files

---
language: en
license: mit

---

# LayoutLM
**Multimodal (text + layout/format + image) pre-training for document AI**

[Microsoft Document AI](https://www.microsoft.com/en-us/research/project/document-ai/) | [GitHub](https://aka.ms/layoutlm)

## Model description

LayoutLM is a simple but effective pre-training method of text and layout for document image understanding and information extraction tasks, such as form understanding and receipt understanding. LayoutLM archives the SOTA results on multiple datasets. For more details, please refer to research paper:

[LayoutLM: Pre-training of Text and Layout for Document Image Understanding](https://arxiv.org/abs/1912.13318)
Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, [KDD 2020](https://www.kdd.org/kdd2020/accepted-papers)

## Training data

I fine tuned the LayoutLM-Base, Uncased (11M documents, 2 epochs): 12-layer, 768-hidden, 12-heads, 113M parameters
on RVL-CDIP Dataset(Total 3200 images : 1940 train, 640 test, 640 valid) for 50 epochs.

## Citation

``` latex
@misc {xu2019layoutlm,
title={LayoutLM: Pre-training of Text and Layout for Document Image Understanding},
author={Yiheng Xu and Minghao Li and Lei Cui and Shaohan Huang and Furu Wei and Ming Zhou},
year={2019},
eprint={1912.13318},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```

Files changed (1) hide show
  1. README.md +35 -3
README.md CHANGED
@@ -1,3 +1,35 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: mit
4
+
5
+ ---
6
+
7
+ # LayoutLM
8
+ **Multimodal (text + layout/format + image) pre-training for document AI**
9
+
10
+ [Microsoft Document AI](https://www.microsoft.com/en-us/research/project/document-ai/) | [GitHub](https://aka.ms/layoutlm)
11
+
12
+ ## Model description
13
+
14
+ LayoutLM is a simple but effective pre-training method of text and layout for document image understanding and information extraction tasks, such as form understanding and receipt understanding. LayoutLM archives the SOTA results on multiple datasets. For more details, please refer to research paper:
15
+
16
+ [LayoutLM: Pre-training of Text and Layout for Document Image Understanding](https://arxiv.org/abs/1912.13318)
17
+ Yiheng Xu, Minghao Li, Lei Cui, Shaohan Huang, Furu Wei, Ming Zhou, [KDD 2020](https://www.kdd.org/kdd2020/accepted-papers)
18
+
19
+ ## Training data
20
+
21
+ I fine tuned the LayoutLM-Base, Uncased (11M documents, 2 epochs): 12-layer, 768-hidden, 12-heads, 113M parameters
22
+ on RVL-CDIP Dataset(Total 3200 images : 1940 train, 640 test, 640 valid) for 50 epochs.
23
+
24
+ ## Citation
25
+
26
+ ``` latex
27
+ @misc{xu2019layoutlm,
28
+ title={LayoutLM: Pre-training of Text and Layout for Document Image Understanding},
29
+ author={Yiheng Xu and Minghao Li and Lei Cui and Shaohan Huang and Furu Wei and Ming Zhou},
30
+ year={2019},
31
+ eprint={1912.13318},
32
+ archivePrefix={arXiv},
33
+ primaryClass={cs.CL}
34
+ }
35
+ ```