SandLogicTechnologies commited on
Commit
b27eb0d
·
verified ·
1 Parent(s): a3b19f2

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +160 -0
README.md ADDED
@@ -0,0 +1,160 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ language:
4
+ - multilingual
5
+ base_model:
6
+ - rednote-hilab/dots.ocr
7
+ tags:
8
+ - multimodal
9
+ - ocr
10
+ - document-understanding
11
+ - vision-language-model
12
+ - document-parsing
13
+ - layout-analysis
14
+ - image-to-text
15
+ - efficient-model
16
+ ---
17
+
18
+ # DOTS.OCR
19
+
20
+ DOTS.OCR is a vision-language document understanding model developed by RedNote HiLab, designed for OCR, document parsing, layout reasoning, and structured content understanding. This repository contains GGUF quantized variants of the model optimized for efficient local inference using llama.cpp.
21
+
22
+ Rather than functioning as a conventional OCR engine, DOTS.OCR is designed to understand complete document layouts while recognizing textual content. The model jointly interprets paragraphs, tables, mathematical expressions, figures, diagrams, forms, and hierarchical document structures, enabling accurate reconstruction of visually complex documents for downstream AI workflows.
23
+
24
+ The quantized formats significantly reduce memory requirements while preserving document understanding capability, making the model practical for local deployment, enterprise document intelligence, and large-scale document processing applications.
25
+
26
+ ---
27
+
28
+ # Model Overview
29
+
30
+ - **Model Name:** DOTS.OCR
31
+ - **Base Model:** rednote-hilab/dots.ocr
32
+ - **Architecture:** Vision-Language Document Understanding Model
33
+ - **Parameter Count:** Approximately 1.7 Billion Parameters
34
+ - **Modalities:** Text, Image
35
+ - **Primary Languages:** Multilingual
36
+ - **Developer:** RedNote HiLab
37
+ - **License:** Apache 2.0
38
+
39
+ ---
40
+
41
+ # Quantization Formats
42
+
43
+ This repository provides various GGUF quantized versions of the DOTS.OCR model optimized for efficient local inference using llama.cpp.
44
+
45
+ ## IQ3_M
46
+
47
+ - Size reduction of approx 75.41% (836 MB)compared to 16-bit (3.32 GB)
48
+ - Aggressive 3-bit quantization optimized for lightweight document understanding and parsing workloads
49
+ - Suitable for large-scale document processing on resource-constrained systems
50
+ - Enables efficient interpretation of documents containing mixed layouts, tables, figures, and textual content
51
+ - Fine-grained preservation of complex layouts, mathematical notation, and structural relationships may decrease compared to higher-precision variants
52
+
53
+ ## IQ4_NL
54
+
55
+ - Size reduction of approx 69.92% (1023 MB) compared to 16-bit (3.32 GB)
56
+ - Advanced 4-bit non-linear quantization designed to retain document parsing quality and structural understanding
57
+ - Better suited for workflows involving layout-aware analysis, structured extraction, and semantic document interpretation
58
+ - Provides improved consistency when processing visually complex documents while minimizing quantization loss
59
+ - May require slightly increased computational overhead during inference
60
+
61
+ ## IQ4_XS
62
+
63
+ - Size reduction of approx 71.23% (979 MB) compared to 16-bit (3.32 GB)
64
+ - Balanced 4-bit quantization optimized for efficient document reasoning and dependable parsing performance
65
+ - Provides a practical balance between memory efficiency, document comprehension quality, and runtime speed
66
+ - Suitable for document intelligence systems, content indexing, document conversion, and structured information extraction
67
+ - Maintains stable performance across diverse real-world document formats
68
+
69
+ ---
70
+
71
+ # Training Background (Original Model)
72
+
73
+ DOTS.OCR is trained with an emphasis on document understanding, multimodal reasoning, layout analysis, and structured document interpretation across a diverse collection of visual documents.
74
+
75
+ ## Pretraining
76
+
77
+ - Large-scale multimodal pretraining using document-centric image and text datasets
78
+ - Focus on visual-text alignment, semantic document representation, and layout-aware learning
79
+ - Optimized for downstream OCR, document parsing, and structured information understanding
80
+
81
+ ## Document Understanding Optimization
82
+
83
+ - Enhanced for preserving document hierarchy, reading order, and structural semantics
84
+ - Optimized for interpreting tables, forms, equations, diagrams, and mixed-content layouts
85
+ - Improved consistency for document parsing and machine-readable document reconstruction
86
+
87
+ ---
88
+
89
+ # Key Capabilities
90
+
91
+ - **Document Parsing**
92
+ Understands complete document layouts while preserving structural relationships.
93
+
94
+ - **Optical Character Recognition (OCR)**
95
+ Extracts textual information from scanned documents and visual content.
96
+
97
+ - **Layout Understanding**
98
+ Identifies logical organization across headings, paragraphs, tables, figures, and forms.
99
+
100
+ - **Structured Content Extraction**
101
+ Generates machine-readable representations while maintaining semantic document structure.
102
+
103
+ - **Complex Document Analysis**
104
+ Processes visually rich documents containing mixed layouts, equations, diagrams, and technical content.
105
+
106
+ - **Efficient Local Deployment**
107
+ Quantized variants enable practical document intelligence workloads on consumer hardware.
108
+
109
+ ---
110
+
111
+ # Usage Example
112
+
113
+ ## Using llama.cpp
114
+
115
+ ```bash
116
+ ./llama-mtmd-cli \
117
+ -m SandlogicTechnologies/DOTS-OCR_IQ4_NL.gguf \
118
+ --mmproj SandlogicTechnologies/mmproj-dots.ocr-f16.gguf \
119
+ --image research_paper.png \
120
+ -p "Convert this document into structured Markdown while preserving headings, tables, equations, and figures."
121
+ ```
122
+
123
+ ---
124
+
125
+ # Recommended Usecases
126
+
127
+ - **Document Parsing**
128
+ Convert visually complex documents into structured machine-readable formats.
129
+
130
+ - **Enterprise Document Intelligence**
131
+ Automate understanding of reports, contracts, manuals, and technical documentation.
132
+
133
+ - **Layout-Aware Information Extraction**
134
+ Preserve document hierarchy and semantic relationships during extraction.
135
+
136
+ - **Knowledge Base Construction**
137
+ Prepare structured documents for enterprise search and Retrieval-Augmented Generation (RAG).
138
+
139
+ - **Technical Document Processing**
140
+ Parse scientific papers, books, forms, diagrams, and engineering documentation.
141
+
142
+ - **Research and Evaluation**
143
+ Benchmark multimodal document understanding and layout reasoning capabilities.
144
+
145
+ ---
146
+
147
+ # Acknowledgments
148
+
149
+ These quantized models are based on the original work by the **RedNote HiLab** development team.
150
+
151
+ Special thanks to:
152
+
153
+ - The RedNote HiLab team for developing and releasing the DOTS.OCR model.
154
+ - **Georgi Gerganov** and the `llama.cpp` open-source community for enabling efficient quantization and inference via the GGUF format.
155
+
156
+ ---
157
+
158
+ # Contact
159
+
160
+ For questions, feedback, or support, please reach out at **[support@sandlogic.com](mailto:support@sandlogic.com)** or visit **https://www.sandlogic.com/**