Add files using upload-large-folder tool

README.md

@@ -1,4 +1,199 @@
 ---
 library_name: transformers
-license: cc-by-nc-sa-4.0
+tags: []
 ---
+
+# Model Card for Model ID
+
+<!-- Provide a quick summary of what the model is/does. -->
+
+
+
+## Model Details
+
+### Model Description
+
+<!-- Provide a longer summary of what this model is. -->
+
+This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
+
+- **Developed by:** [More Information Needed]
+- **Funded by [optional]:** [More Information Needed]
+- **Shared by [optional]:** [More Information Needed]
+- **Model type:** [More Information Needed]
+- **Language(s) (NLP):** [More Information Needed]
+- **License:** [More Information Needed]
+- **Finetuned from model [optional]:** [More Information Needed]
+
+### Model Sources [optional]
+
+<!-- Provide the basic links for the model. -->
+
+- **Repository:** [More Information Needed]
+- **Paper [optional]:** [More Information Needed]
+- **Demo [optional]:** [More Information Needed]
+
+## Uses
+
+<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
+
+### Direct Use
+
+<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
+
+[More Information Needed]
+
+### Downstream Use [optional]
+
+<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
+
+[More Information Needed]
+
+### Out-of-Scope Use
+
+<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
+
+[More Information Needed]
+
+## Bias, Risks, and Limitations
+
+<!-- This section is meant to convey both technical and sociotechnical limitations. -->
+
+[More Information Needed]
+
+### Recommendations
+
+<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
+
+Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
+
+## How to Get Started with the Model
+
+Use the code below to get started with the model.
+
+[More Information Needed]
+
+## Training Details
+
+### Training Data
+
+<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
+
+[More Information Needed]
+
+### Training Procedure
+
+<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
+
+#### Preprocessing [optional]
+
+[More Information Needed]
+
+
+#### Training Hyperparameters
+
+- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+
+#### Speeds, Sizes, Times [optional]
+
+<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+
+[More Information Needed]
+
+## Evaluation
+
+<!-- This section describes the evaluation protocols and provides the results. -->
+
+### Testing Data, Factors & Metrics
+
+#### Testing Data
+
+<!-- This should link to a Dataset Card if possible. -->
+
+[More Information Needed]
+
+#### Factors
+
+<!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
+
+[More Information Needed]
+
+#### Metrics
+
+<!-- These are the evaluation metrics being used, ideally with a description of why. -->
+
+[More Information Needed]
+
+### Results
+
+[More Information Needed]
+
+#### Summary
+
+
+
+## Model Examination [optional]
+
+<!-- Relevant interpretability work for the model goes here -->
+
+[More Information Needed]
+
+## Environmental Impact
+
+<!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
+
+Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
+
+- **Hardware Type:** [More Information Needed]
+- **Hours used:** [More Information Needed]
+- **Cloud Provider:** [More Information Needed]
+- **Compute Region:** [More Information Needed]
+- **Carbon Emitted:** [More Information Needed]
+
+## Technical Specifications [optional]
+
+### Model Architecture and Objective
+
+[More Information Needed]
+
+### Compute Infrastructure
+
+[More Information Needed]
+
+#### Hardware
+
+[More Information Needed]
+
+#### Software
+
+[More Information Needed]
+
+## Citation [optional]
+
+<!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
+
+**BibTeX:**
+
+[More Information Needed]
+
+**APA:**
+
+[More Information Needed]
+
+## Glossary [optional]
+
+<!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
+
+[More Information Needed]
+
+## More Information [optional]
+
+[More Information Needed]
+
+## Model Card Authors [optional]
+
+[More Information Needed]
+
+## Model Card Contact
+
+[More Information Needed]

config.json

@@ -4,9 +4,12 @@
   ],
   "bbox_embed_size": 64,
   "bbox_size": 1024,
+  "beacon_token_id": 151679,
+  "beacon_token_interval": 64,
   "blank_bbox_token_id": 1025,
   "bos_token_id": {
     "block_without_boxes": 151673,
+    "layout": 151674,
     "ocr_with_boxes": 151671,
     "ocr_without_boxes": 151672
   },
@@ -98,21 +101,26 @@
   "image_embed_encoding_multiplier": 256,
   "image_embed_encoding_size": 1024,
   "image_token_id": 151667,
-  "max_sequence_length": 1024,
+  "max_multi_out": 8,
+  "max_sequence_length": 2560,
   "merge_size": 2,
   "model_type": "surya-multimodal-foundation",
+  "multi_output_distance": 1,
   "num_attention_heads": 16,
+  "num_beacon_tokens": 1,
   "num_hidden_layers": 12,
   "num_key_value_heads": 4,
   "num_register_tokens": 4,
+  "num_styles": 5,
   "pad_token_id": 151668,
   "patch_size": 14,
   "register_token_ids": [
-    151674,
     151675,
     151676,
-    151677
+    151677,
+    151678
   ],
+  "sliding_window": 256,
   "special_ocr_tokens": {
     "all": [
       "</S>",
@@ -124,10 +132,12 @@
       "<OCR-WB>",
       "<OCR-WOB>",
       "<BLOCKS-WOB>",
+      "<LAYOUT>",
       "<REG1>",
       "<REG2>",
       "<REG3>",
       "<REG4>",
+      "<BEACON>",
       "<NO-MATH>",
       "<b>",
       "</b>",
@@ -183,6 +193,24 @@
       "<SCRIPT-KHMER>",
       "<SCRIPT-MONGOLIAN>",
       "<SCRIPT-MATH>",
+      "<page-header>",
+      "<page-footer>",
+      "<footnote>",
+      "<image>",
+      "<figure>",
+      "<text>",
+      "<caption>",
+      "<list-item>",
+      "<section-header>",
+      "<table>",
+      "<table-of-contents>",
+      "<form>",
+      "<equation-block>",
+      "<code-block>",
+      "<complex-block>",
+      "<think1>",
+      "<think2>",
+      "<think3>",
       "<reserved_0>",
       "<reserved_1>",
       "<reserved_2>",
@@ -1118,27 +1146,7 @@
       "<reserved_932>",
       "<reserved_933>",
       "<reserved_934>",
-      "<reserved_935>",
-      "<reserved_936>",
-      "<reserved_937>",
-      "<reserved_938>",
-      "<reserved_939>",
-      "<reserved_940>",
-      "<reserved_941>",
-      "<reserved_942>",
-      "<reserved_943>",
-      "<reserved_944>",
-      "<reserved_945>",
-      "<reserved_946>",
-      "<reserved_947>",
-      "<reserved_948>",
-      "<reserved_949>",
-      "<reserved_950>",
-      "<reserved_951>",
-      "<reserved_952>",
-      "<reserved_953>",
-      "<reserved_954>",
-      "<reserved_955>"
+      "<reserved_935>"
     ],
     "formatting": [
       "<b>",
@@ -1161,6 +1169,23 @@
       "<code>",
       "</code>"
     ],
+    "layout": [
+      "<page-header>",
+      "<page-footer>",
+      "<footnote>",
+      "<image>",
+      "<figure>",
+      "<text>",
+      "<caption>",
+      "<list-item>",
+      "<section-header>",
+      "<table>",
+      "<table-of-contents>",
+      "<form>",
+      "<equation-block>",
+      "<code-block>",
+      "<complex-block>"
+    ],
     "math_external": [
       "<math>",
       "<math display='block'>",
@@ -1169,6 +1194,11 @@
       "<math display=\"inline\">",
       "</math>"
     ],
+    "reasoning": [
+      "<think1>",
+      "<think2>",
+      "<think3>"
+    ],
     "reserved": [
       "<reserved_0>",
       "<reserved_1>",
@@ -2105,27 +2135,7 @@
       "<reserved_932>",
       "<reserved_933>",
       "<reserved_934>",
-      "<reserved_935>",
-      "<reserved_936>",
-      "<reserved_937>",
-      "<reserved_938>",
-      "<reserved_939>",
-      "<reserved_940>",
-      "<reserved_941>",
-      "<reserved_942>",
-      "<reserved_943>",
-      "<reserved_944>",
-      "<reserved_945>",
-      "<reserved_946>",
-      "<reserved_947>",
-      "<reserved_948>",
-      "<reserved_949>",
-      "<reserved_950>",
-      "<reserved_951>",
-      "<reserved_952>",
-      "<reserved_953>",
-      "<reserved_954>",
-      "<reserved_955>"
+      "<reserved_935>"
     ],
     "script": [
       "<SCRIPT-LATIN>",
@@ -2168,14 +2178,23 @@
       "<OCR-WB>",
       "<OCR-WOB>",
       "<BLOCKS-WOB>",
+      "<LAYOUT>",
       "<REG1>",
       "<REG2>",
       "<REG3>",
       "<REG4>",
+      "<BEACON>",
       "<NO-MATH>"
     ]
   },
   "special_token_count": 4,
+  "styles": [
+    "Plain",
+    "Handwriting",
+    "Math",
+    "Chemical",
+    "Code"
+  ],
   "tasks": {
     "block_without_boxes": {
       "img_size": [
@@ -2183,23 +2202,28 @@
         512
       ]
     },
+    "layout": {
+      "img_size": [
+        1024,
+        1024
+      ]
+    },
     "ocr_with_boxes": {
       "img_size": [
         1024,
-        256
+        512
       ]
     },
     "ocr_without_boxes": {
       "img_size": [
         1024,
-        256
+        512
       ]
     }
   },
   "torch_dtype": "bfloat16",
   "transformers_version": "4.50.3",
-  "unmask_image": false,
-  "use_ce_loss": false,
+  "use_cut_cross_entropy": false,
   "vision_encoder": {
     "_attn_implementation_autoset": true,
     "_name_or_path": "",
@@ -2211,7 +2235,7 @@
     "chunk_size_feed_forward": 0,
     "cross_attention_hidden_size": null,
     "decoder_start_token_id": null,
-    "depth": 8,
+    "depth": 12,
     "diversity_penalty": 0.0,
     "do_sample": false,
     "early_stopping": false,
@@ -2223,7 +2247,8 @@
     "forced_eos_token_id": null,
     "fullatt_block_indexes": [
       3,
-      7
+      7,
+      11
     ],
     "hidden_act": "silu",
     "hidden_size": 1280,

manifest.json

@@ -1 +1 @@
-{"files": ["model.safetensors", "added_tokens.json", "tokenizer_config.json", "special_tokens_map.json", "config.json", "README.md", "merges.txt", ".gitattributes", "vocab.json", "preprocessor_config.json"]}
+{"files": [".gitattributes", "merges.txt", "README.md", "training_args.bin", "special_tokens_map.json", "added_tokens.json", "tokenizer_config.json", "preprocessor_config.json", "config.json", "vocab.json", "model.safetensors"]}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:30818e0e67898880036bb6b0738104366e8fe4197dc1f21b96c3c21d6ee2d671
-size 1634909470
+oid sha256:b4efa3897c82b31aaae7941cfc91308357a4783f2e2477424bcf537f81496fe8
+size 2357747926

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:555cdb558a7ac24c8241387d5c72b1657c81cae1b0a50ad4be0d65eb65d3a487
+size 7505