Release MONA (base + chat) and app assets

LICENSE

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Mrittunjay Dubey
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

NOTICE.md

@@ -0,0 +1,11 @@
+# NOTICE: data attribution
+
+MONA's code is MIT-licensed. Data used for training and in the demo bundle:
+
+- **FineWeb-Edu** (HuggingFaceFW/fineweb-edu), ODC-By 1.0. © the FineWeb authors; underlying web text belongs to its owners.
+- **Sangraha** (ai4bharat/sangraha), CC-BY-4.0. © AI4Bharat. Its Wikipedia-derived (synthetic) parts originate
+  from Wikipedia, CC BY-SA 4.0; the bundled samples of those parts are shared under CC BY-SA 4.0.
+- **smol-smoltalk** (HuggingFaceTB/smol-smoltalk), Apache-2.0. © Hugging Face.
+- **Aya dataset** (CohereLabs/aya_dataset), Apache-2.0. © Cohere For AI and contributors.
+- **Tulsidas** (Ramcharitmanas, Vinay Patrika, Kavitavali, Parvati Mangal and other works): 16th–17th century
+  verse, public domain. Only the verse text is used; no modern commentary or translation is included.

README.md

@@ -0,0 +1,64 @@
+---
+language: [en, hi]
+license: mit
+library_name: pytorch
+pipeline_tag: text-generation
+tags: [education, multilingual, hindi, hinglish, awadhi, from-scratch, small-language-model]
+---
+
+# MONA: a multilingual small language model you can open up
+
+MONA is a **110M-parameter Llama-style language model trained from scratch on one laptop GPU** for
+**English, Hindi, Hinglish and Awadhi** (Tulsidas). It was built to **teach how LLMs work**: the
+companion terminal app lets anyone look inside it, stage by stage, in English, हिंदी or Hinglish.
+
+- Code, app and full build story: https://github.com/JayD108/Mona
+- `pip install` the repo, then run `mona`: the app downloads these files on first run.
+
+## Model
+| | |
+|---|---|
+| Architecture | decoder-only transformer: 12 layers, width 768, 12 heads, SwiGLU 2048, RMSNorm, RoPE, tied embeddings |
+| Parameters | 110.1M (85.0M non-embedding) |
+| Tokenizer | byte-level BPE, 32,768 tokens, trained on a balanced EN / HI / Hinglish / Awadhi sample (Hindi 1.33 tokens/word) |
+| Context | 1,024 tokens |
+| Pretraining | 2.5B tokens, AdamW, bf16, WSD learning-rate schedule (peak 6e-4), ~19 h on an RTX 5080 Laptop GPU |
+| Chat tuning | supervised fine-tuning with loss masking on ~100K conversations |
+
+## Evaluation (held-out text, bits per byte, lower is better)
+| English | Hindi | Hinglish |
+|---|---|---|
+| 1.027 | 0.455 | 1.058 |
+
+Final held-out loss per language (nats/token): english 3.146, hindi 3.063, hinglish 2.899, awadhi 5.445
+
+Sample (MONA-Chat, "Who are you?"): *I'm Emily Wilson, the executive director of the National Geographic Society. I'm the lead author of the new report, "The Greatest Planet: The Greatest Earthquake in History." I'm thrilled to share my *
+
+## Files
+- `assets/models/mona/mona.pt`: base model (bf16 state dict)  ·  `assets/runs/mona_m_chat/model.pt`: MONA-Chat
+- `assets/models/mona/tokenizer.json`: tokenizer (Hugging Face `tokenizers` format)
+- `assets/…`: a small, licence-clean demo bundle used by the app (see NOTICE.md)
+
+```python
+from mona.engine.glassbox import GlassBox          # from the GitHub repo
+gb = GlassBox()                                    # loads the newest weights on CPU
+print(gb.next_word("The capital of India is", top=5))
+```
+
+## Intended use and limits
+For **education and experimentation**. MONA is small: it writes fluent text but **often states things
+that are wrong**, cannot do arithmetic, and must not be used for factual, medical, legal or other
+consequential decisions.
+
+## Training data and licences
+English: FineWeb-Edu (ODC-By 1.0) · Hindi and romanized Hindi: AI4Bharat Sangraha (CC-BY-4.0; its
+Wikipedia-derived parts are CC BY-SA) · chat: smol-smoltalk (Apache-2.0), Aya dataset (Apache-2.0) ·
+Awadhi: Tulsidas's verses (public domain). See NOTICE.md for full attribution.
+
+**Copyright note:** an earlier Tulsidas corpus also contained a modern Hindi commentary (Gita Press,
+likely still under copyright). When this was noticed, at 0.8B of 2.5B training tokens (~0.1% of
+batches up to then), it was removed: the rest of pretraining, the chat tuning and everything in this
+repository use only public-domain verse. No commentary text is distributed here.
+
+## Credits
+Built by Mrittunjay Dubey. Coding assisted by Claude (Anthropic).

assets/data/mona_tokens/awadhi_train.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad7facb2586fc6e966c004d7d1d16b024f5805ff7cb47c7a85dabd8b48892ca7
+size 4096

assets/data/mona_tokens/awadhi_val.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:876816d975015cdcfea3139a6c5ea925ea9b67d9ff020269a5b704ae3a56ef96
+size 27668

assets/data/mona_tokens/english_train.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad7facb2586fc6e966c004d7d1d16b024f5805ff7cb47c7a85dabd8b48892ca7
+size 4096

assets/data/mona_tokens/english_val.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a914c3560aa952ed7ac519509630a094780dcefc06fe8220345996e2ede16afa
+size 400000

assets/data/mona_tokens/hindi_train.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad7facb2586fc6e966c004d7d1d16b024f5805ff7cb47c7a85dabd8b48892ca7
+size 4096

assets/data/mona_tokens/hindi_val.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0e85cbfcc90eb340492bdd99b0fb4d1f7d537ad2a4b9ec1e221a3de72e0fc3b5
+size 400000

assets/data/mona_tokens/hinglish_train.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ad7facb2586fc6e966c004d7d1d16b024f5805ff7cb47c7a85dabd8b48892ca7
+size 4096

assets/data/mona_tokens/hinglish_val.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0241574e0438b04384cb7d26b9811fa1e31d6eeab89f30130993ca066cc6500a
+size 400000

assets/data/mona_tokens/manifest.json

@@ -0,0 +1,22 @@
+{
+  "awadhi": {
+    "train_tokens": 245710,
+    "val_tokens": 13834,
+    "docs": 342
+  },
+  "hinglish": {
+    "train_tokens": 130173215,
+    "val_tokens": 1002269,
+    "docs": 145157
+  },
+  "hindi": {
+    "train_tokens": 972688126,
+    "val_tokens": 2000370,
+    "docs": 1712280
+  },
+  "english": {
+    "train_tokens": 1600674267,
+    "val_tokens": 2000899,
+    "docs": 1435996
+  }
+}

assets/data/raw/english_fineweb/sample/10BT/000_00000.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:34216a3f00d9342915630b16d2b3a813178d198981836c29fdbfa0e282fc4cd5
+size 1095351

assets/data/raw/hindi_sangraha/verified/hin/data-3.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a68ade0fb17cab60d8dec052d92b19193899e5c7693561f442d4b077da3327f9
+size 763491

assets/data/raw/hinglish_sangraha/synthetic/hin_Latn/wiki_hin_Latn_0000_of_0063.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6444885bf7a09a5d71ebf3892296cc636d1fa0033a4a7d20ba1bd238ad063c8c
+size 1832378

assets/data/raw/sft/hindi_wiki/synthetic/hin_Deva/wiki_hin_Deva_0000_of_0063.parquet

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:8dcd574383b46892a7b38e506745e24475f022060d3d43477bf9c6bd75db7d92
+size 5169142

assets/models/mona/mona.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:848dd15faa79619d071927939205a224888cb7854fc0da788197d30823c32054
+size 220260109

assets/runs/mona_m/eval.txt

@@ -0,0 +1,4 @@
+model                                      english     hindi  hinglish    awadhi   (bits per byte, lower is better)
+C:\LLM\runs\mona_m\final.pt                  1.027     0.455     1.058     1.239
+C:\LLM\runs\mona_m_chat\model.pt             1.144     0.529     1.126     1.343
+MANAS v1 (character-level, Awadhi only)                                    1.408

assets/runs/mona_m/eval_log.csv

@@ -0,0 +1,21 @@
+step,tokens,english,hindi,hinglish,awadhi
+250,131072000,4.8809,4.7861,4.8582,6.5483
+500,262144000,4.0583,4.1149,3.8876,6.1460
+750,393216000,3.7848,3.8089,3.6117,5.9238
+1000,524288000,3.5992,3.5334,3.4795,5.8012
+1250,655360000,3.5488,3.5486,3.3592,5.7329
+1500,786432000,3.4506,3.4253,3.3486,5.7018
+1750,917504000,3.3966,3.3440,3.2510,5.8079
+2000,1048576000,3.4351,3.2545,3.2459,5.8613
+2250,1179648000,3.4215,3.2711,3.1633,5.7966
+2500,1310720000,3.3224,3.3013,3.1575,5.7275
+2750,1441792000,3.3301,3.2391,3.1226,5.7084
+3000,1572864000,3.3094,3.2389,3.0966,5.7107
+3250,1703936000,3.3605,3.2391,3.0732,5.6027
+3500,1835008000,3.2819,3.1934,3.0436,5.6696
+3750,1966080000,3.2770,3.1561,3.0766,5.6384
+4000,2097152000,3.2482,3.1706,3.0642,5.6130
+4250,2228224000,3.2055,3.0726,2.9832,5.6031
+4500,2359296000,3.2199,3.0767,2.9666,5.4828
+4750,2490368000,3.1361,3.0689,2.9371,5.4606
+4769,2500329472,3.1455,3.0626,2.8986,5.4447

assets/runs/mona_m/samples.txt

@@ -0,0 +1,152 @@
+
+===== step 250  (0.131B tokens) =====
+[english] The history of mathematics and services. Using this information, I would be here to a webbire that could be used to make music in the language.
+In conclusion, I say that you can tell you when you have seen what you are doing is about it? No!
+[hindi] भारत की नदियाँ तेज होगी. वहीं 11 वर्षीय महिला कांग्रेस ने ही एक बार फिर 15 साल का बहाव किया. एक दिन पहले इजून को दो घंटे बाद ही उसकी शादी कर दी. इससे पहले लगातार उसे 10 साल का समय नहीं दिया. अब साल 2014 में 2 करोड़ रुपये
+[hinglish] aaj mausam bahut prastaavle-utten bhi shamil tha. unhe "bhu" ke roop mein jaanaa jata tha aur vaha ek anya sevaaon mein vriddhi aur apne madhyam se ek udyog mein apne "shaticin" ke liye bhi ek aur "stel" ke tahat iske parinamon ko 21 aprail ko
+[awadhi] राम कथा सुंदर भट्ट ने सबसे महत्वपूर्ण फिल्म बनन के साथ साथ और उन्होंने आज भी भी अपनी तैयारी की। उन्होंने कहा कि, इस साल दिसंबर 2021 के बीच, एषा (सी) ने 2014 में केरल के एक नए इलाके में 1, 5, 21, 6,
+
+===== step 500  (0.262B tokens) =====
+[english] The history of mathematics, in particular, has already been that they did. The results, which in turn led to a third year of teaching, is a very complex task in the world. The emphasis on the novel of literature is clear, so we are always better for research than to do. The early-sounding
+[hindi] भारत की नदियाँ चीन में है।
+भारत का सबसे बड़ा भूभाग चीन में है। यहां का क्षेत्रफल 19,038 है और लोग सीमा से जुड़े हुए है। चीन में इस देश का सबसे बड़ा कृषि राज्य है। यहाँ का कहना है कि भारत में जो गामण राज्य है। इस देश की दृष्टि
+[hinglish] aaj mausam bahut mahatvapurna mahatvapurna mahatvapurna hai, 1920 ke dashak ke dauran, 1930 ke dashak se 1935 tak ek adhik ya cumm umr ke liye ek sarkari sansad tha.
+yeh kahani "aff. doubleu. di. bee. aeye." aur "aeye. aff. aiss. di. se.
+[awadhi] राम कथा सुंदर श्रदा है । जहाँ उगल दिये जाते हैं वे नहीं । इनके सहारे कोई भी न कोई हो । वहाँ पर कोई वृत्तियाँ नहीं ।
+१- जयप्रकाश व्यास । यह संकलन है । खर्तन भी है । यहाँ पर खन्थक । प्रक्षेपण करने के लिए सबों को अपने
+
+===== step 750  (0.393B tokens) =====
+[english] The history of mathematics is demonstrated by the English word “tutor” (cf. William Shakespeare) and by the Scottish writers of the 20th century the use of modern mathematics to develop a revolutionary definition of the mathematics: “true” (cf. William Shakespeare, 1968), a more
+[hindi] भारत की नदियाँ जैसे दिल्ली के निकट चल रहे युद्धक्षेत्र के सभी क्षेत्रों में धुलने से बच कर रह गई थीं। जिस प्रकार यहाँ के जनादेशों के अनुसार कठोर नियम बनाये जाते थे। इस प्रकार नगर का नाम यक्षदेव था। परन्तु कुछ के अनुसार मन्दिरों में ही नगर के धार्मिक निवास स्थान
+[hinglish] aaj mausam bahut kharaab hocker bitaaya gaya tha, lekin yeh ek kaar durghatana mein thi. phir bhi, yeh ek sanic tha jise naazi ki adhik achchi tarah se sangathit kiya gaya tha, isaliye yeh bahut hii kabhi bhi nahi tha. 1926 mein, ek gulami ka upayog kabhi bhi ek
+[awadhi] राम कथा सुंदर रानी के प्रियतम का जन्म हुआ था। इस साल इसका एक और खास संकेत हो रहा है। यह बात सभी जानते हैं कि इसके पीछे एक रहस्यकारक नायक की ही कहानी है। ये घटना तब घटित हुई जब जब फिल्म सिट��� में सुनील शेट्टी की जोड़ी ने अपना जीवन निर्वाह किया। इस घटना
+
+===== step 1000  (0.524B tokens) =====
+[english] The history of mathematics by the first physicist at Stanford University, and the primary history of astronomy by experts in the field of mathematics is a powerful tool of mathematical and intellectual knowledge, and it gives its customers a much-needed boost to become real majors in physics.
+The fourth study of mathematics by studying mathematics in
+[hindi] भारत की नदियाँ बहती रहती हैं। इन नदियों का उद्गरण होकर दुःख और सुखो का अनुभव होता है। यही बात अफगानी और लज्जास्पद होती है। कदीर, हिमालय और खैबर के समुद्र में बसा है। समुद्र तट समुद्र के तट पर स्थित है। . सिन्धु घाटी
+[hinglish] aaj mausam bahut samay tak, kewal 40 pratishat loga ek baar khaadya honey par kaam karne ke liye sangharsh karne ke liye ek pratibhaagi the.
+baahari failaav ke kaaran, isane 45 pratishat kood ka 50 pratishat ka mulyankan kiya, jisme 3 pratishat aur 7 pratishat ne daavaa
+[awadhi] राम कथा सुंदर से ऊपर उठे थे। दूसरे स्थान पर बाल कलाकार थे, फिर भी अत्रि ने इस नाम के साक्षी को जन्म दिया। अपनी जीवन लीला-यात्रा के दौरान वह तीन बार भी मंच पर बैठे थे।
+
+===== step 1250  (0.655B tokens) =====
+[english] The history of mathematics, now renowned in the English language.
+One of the first topics to be explored in 1896 is the amount of time that a certain number of people take for granted as a result of the law. The first part of this subject is the fact that the law of time is the law of
+[hindi] भारत की नदियाँ हैं, जो दक्षिण में स्थित हैं। पूर्व में बंगाल की खाड़ी है, जिसके पश्चिम में बन्दरगाह हैं। पश्चिम में बंगाल की खाड़ी है तथा पश्चिम में बंगाल की खाड़ी है। इसमें बंगाल की खाड़ी है तथा पश्चिम में अरब सागर हैं। यह हिन्द महासागर से लगे द्वीप समूह में से एक है
+[hinglish] aaj mausam bahut door karne ke liye kiya jata tha, jisse uchch kshamata vaali badali hoti thi.
+taba se, aeye. aiss. aine. aar. se. mein scouton apne munch par apni mahila ko oopar dhakaa karne ki koshish karta hai. aff. se. ke karibi dost ka peech
+[awadhi] राम कथा सुंदर दिखना जानता है । फिर आपका कितना ही जोर से इस लेखका उच्चारण कर लेना कि गीत सुनके और बोलोंमें जहाँ तक लगता है वहा आकर बैठ जाना चाहिए । इसलिए वागको इसे देखके उस घोडेको निकाल लेना चाहिए और यह मानना कि यह गीतकारको अपने
+
+===== step 1500  (0.786B tokens) =====
+[english] The history of mathematics is very much in the new age of the 20th century.
+"Capital is a very important part of mathematics and it is one of the most important parts of the human body. It is the fundamental part of the human body, and it helps us to be able to define it in
+[hindi] भारत की नदियाँ, भारत की नदियों से, पश्चिम की ओर बहती हुई, विकसित हुई और उसीकी भूमि हो गयी । मैंने देखा कि भारतीय सभ्यता का जन्म भी भारत के इतिहास से होता है । हमारे ऊपर हमारे पूर्वजों का बहुत प्रभाव पड़ा । मैं अपने मातृभूमि से बाहर निकल कर उन्हें अपनी माँ के रूप
+[hinglish] aaj mausam bahut khush nahi hai. yeh ek baar hua jab paani ne do manjila tanaav paida kiya aur paani ke neeche koi bhi raasila nahi padaa, jaisa ki ek toofaan ke kaaran hua. 17 navambar ko, toofaan ek mahatvapurna mausam hua. yeh bhi bataaya gaya ki chhoot ke aspas bhi tapman
+[awadhi] राम कथा सुंदर, अ���िस्मरणीय व शंकित हो गई है।
+
+===== step 1750  (0.918B tokens) =====
+[english] The history of mathematics, from the proletariat to the proletariat, which was completed at the end of the 20th century. The chapter on the
+Apart from a thorough discussion of mathematics, you will find excellent examples of mathematical
+synthesis that relate to the scientific study of mathematics
+[hindi] भारत की नदियाँ, नहरें, मुर्गी, बर्गर, मक़सूद आदि नदियाँ, जानवरों के नाम, नदी, बाग, तालाब, तालाब, सरोवर, इत्यादि। .
+अमरीका का जनवादी गणराज्य (अंग्रेज़ीःUnited States of America) देश का एक गणतंत्र है। इसकी
+[hinglish] aaj mausam bahut jyada hai aur yeh ek chhota saa dweep hai jo kataav ke liye ullekhaniya hai. (2011 ki garmiyon ke dauran "kewal saa dweep" (kewal dweep) ke nimbu naam ko iss tarah se paribhaashit kiya gaya hai kyonki yeh ek mahaan cheeni vyanjan
+[awadhi] राम कथा सुंदर से उठकर प्रेम का रंग लगाया। इस दौरान भक्त अपने भक्त के साथ राधा के चरणों में विराजमान हो गए। इस दौरान भगवान श्रीहरि, माता पार्वती और भगवान विष्णु के भक्तों ने उनके सामने राधा के दर्शन किए। वहीं, भक्त मंदिर में श्रद्धालुओं के द्वारा भगवान विष्णु और माता पार्वती की पूजा की गई
+
+===== step 2000  (1.049B tokens) =====
+[english] The history of mathematics is centred in the philosophy of mathematics, which involves the study of the universe and the concepts of space, space, and space. It is therefore a fact of life that mathematics will be one of the most used and influential in the world of mathematics.
+Mathematics of Mathematics
+The primary reason
+[hindi] भारत की नदियाँ आज नदी की तराई के लिए अपनी जमीन तलाशती हुई निकलती हैं। पश्चिमी हिमालय के जंगलों से मछलियाँ बहुत अधिक मात्रा में पानी का सामना करती हैं। पश्चिमी हिमालय को प्राकृतिक रूप से प्राकृतिक जल से अधिक मात्रा में बहाना होता है। पश्चिमी हिमालय पर प्रायः 27 प्रतिशत जलाशय रहते
+[hinglish] aaj mausam bahut hii prabhaavit hota hai.
+australiyai janganana ke anusaar, 2011 ki janganana ke anusaar, kshetra mein 6,742 loga, 1,533 parivaar aur 3,860 parivaar rahate the.
+aitihaasik roop se, 2010 ki janganana ke anusaar, 6
+[awadhi] राम कथा सुंदरकांड कथा (Rajasthan Chandrasoli) में सोमवार को 4060 बच्चों के मृत शरीर के बारे में जानकर राहत मिली है. यहां 10 बच्चों के जन्म के बाद रविवार को 41 बच्चों की मौत हो गई. यह घटना कर्नाटक के कन्याकुमारी जिले में रात 
+
+===== step 2250  (1.180B tokens) =====
+[english] The history of mathematics is not just about the history of mathematics, it is also about the development of the technology, and also the implementation of the various engineering and engineering technologies. The development of modern computer science is of fundamental importance for the field of computing science. In the time of the invention of computers, there is no
+[hindi] भारत की नदियाँ भी पानी से रहित हैं, इसलिए इसका शमन नदियों की रक्षा करने के लिए किया जाता है। नदियों के प्रवाह के कारण नदियों में बाढ़ आ गई है। बाढ़ से नदियों में नहाने वाले स्थानों पर रहने वाले लोगों की संख्या 3 लाख 59 हजार के पार है, जबकि कई नदियों का
+[hinglish] aaj mausam bahut lokpriya tha.
+gaanv ne 16,000 se adhik parivaaron ko aakarshit kiya aur 28,000 se adhik parivaaron ko apne gharon mein parivartit kiya. iss parshadon ke 10 pratishat aabaadi ne shahari kshetron mein rahane ke liye kull 9,044 awas ka utpaadan kiya. 198
+[awadhi] राम कथा सुंदरकण, प्रबोधिनी, वत्सलता, सगुणता, सगुणता, श्लेषणता, सगुणता, सगुणता, सगुणता, सगुणता, सगुणता, सगुणता, सगुणता, सगुणता, सगुणता,
+
+===== step 2500  (1.311B tokens) =====
+[english] The history of mathematics may include the vast expanse of the world, but the world is a mystery. Here, we can examine the ancient Greeks and the Greeks, how they changed their world, and how they influenced the world. We can explore the developments that made the Greeks and the Greeks, the Greeks, the
+[hindi] भारत की नदियाँ बहती हैं, तो हवा बिल्कुल नहीं चलेगी, हवा का प्रवाह नहीं चलेगा, तो उसे कौन रोक सकता है? आप जानते ही होंगे कि मध्यप्रदेश में वायु प्रदूषण चरम सीमा पर पहुँच चुका है, तो आप देखिए कि एक प्रकार की हवा में जब हवा निकल रही है, तो क्या आप शहर की हवा
+[hinglish] aaj mausam bahut seemit tha, lekin jab humm chaley gaye, tou isamen 20 ghante tak ki paatr the, jisme 20 se adhik baar ghar ke karib se baahar nikalate hain. bageeche ki sadak 3,022 feat tak pahunch gayi aur 20 se adhik ki sadak paar ki jaa rahi
+[awadhi] राम कथा सुंदरपुर के प्रधानाचार्य भी उपस्थित थे।
+
+===== step 2750  (1.442B tokens) =====
+[english] The history of mathematics is a continuum of the knowledge and applications of mathematics, and of the development of computer science. In the post-modern era, we have seen great changes in the way mathematics and mathematics are derived from each other. Some have become better understood and more sophisticated, while others have also become more
+[hindi] भारत की नदियाँ-सिखनेवाल और पाखड़ की भारत की नदियाँ हैं। ये भारत की उन नदियों की भूमि हैं, जो सोलर कनेक्टिविटी से भरती हैं। इन नदियों के किनारे-किनारे भी पाँच-छह किलोमीटर की दूरी पर स्थित हैं। इनकी पूर्वी सीमा हिमालय से तोलव
+[hinglish] aaj mausam bahut garmi se puuraa hota hai. iss mausam mein, 20,000 se adhik loga awas mein rahate hain. shahar ke uchch star ke nivaasiyon ko shahar ke kendra mein rahane ke liye majboor kiya jata hai, kyonki ve aksar ek vishesh awas sthal ke roop mein kaam karte hain. kuwait
+[awadhi] राम कथा सुंदर और सुरुचिपूर्ण है। इसके अलावा हर कोई उनकी इच्छा का स्वागत करता है।
+अपने समय के महानायक अमिताभ बच्चन के साथ काम करने से उनके सपने जरूर टूटें। अगर आप भी उन्हें अपने दादा-दादी के प्यार और आशीर्वाद से याद कर रहे हैं तो यहां जान लीजिए एक किस्सा
+
+===== step 3000  (1.573B tokens) =====
+[english] The history of mathematics, particularly when one considers the way in which mathematics has changed as a result of the failed mathematics of the past. It is important to remember that mathematics is also an important topic in the world and not just in mathematics. It is also important for the understanding and application of mathematics to be a key part
+[hindi] भारत की नदियाँ अपनी जगह ले रही हैं, लेकिन अब हमें उनका नाम वापस लेना पड़ा। इस साल भी उन्होंने अपने घर पर अपनी एक तस्वीर सोशल मीडिया पर पोस्ट की थी। इसमें उन्होंने लिखा था, 'भारत की नदियाँ अपने घर पर हैं। यह एक विलुप्तप्राय घटना है। यह हमारी धरती पर
+[hinglish] aaj mausam bahut tej aur germ mausam ki tulanaa mein adhik tej hota hai. vartamaan mein, rujhaanon mein ghumaavdaar gaharaai aur ek lamba vistaar hota hai, jisse mausam mein dhumil karne ke liye ek sthirata hoti hai. mausam mein rujhaanon ke mausam mein sam
+[awadhi] राम कथा सुंदर है। इसके अलावा रामचरित मानस में भगवान राम की कथा का वर्णन भी बहुत है।
+(डिस्क्लेमरः इस आर्टिकल में दी गई जानकारी की सटीकता, सटीकता और व्यापकता की गारंटी नहीं है। किसी भी जानकारी की सटीकता, विश्वसनीयता और विश्वसनीयता की गारंटी नहीं
+
+===== step 3250  (1.704B tokens) =====
+[english] The history of mathematics in the United States is highly in line with its “modern-day traditions” and our age-old tradition of being taught in the world. In fact, it is even more revealing that the US has been one of the most progressive nations in history. The internet has provided a sense of
+[hindi] भारत की नदियाँ, नदियाँ और जलीय भू-आधिकारी का काम करता है। एक दूसरी समस्या को हल करने की दृष्टि से तो और भी महत्त्वपूर्ण है। भारत में पानी की कमी और दुर्गम स्थानों में बाढ़ के कारण अनेक नदियाँ ऐसी हो गयी हैं, जिनसे नदियों का जल-जन्तु तथा
+[hinglish] aaj mausam bahut jaldi hoti hai, ek aur dinn hai jo sardiyon mein hota hai. gaanv ke maidan mein ek ghanaa awas hota hai aur ek badaa chappel ya paani ki ek chhoti se saansaaraau nivaas hota hai. do gaanvon mein se ek mein ek kaidi hai, jo gaanv ke
+[awadhi] राम कथा सुंदर स्वरूप को अपना सकता है । जिस प्रकार हर घर में प्रत्येक मनुष्य अपना इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्ट इष्टिष्ट इष्ट इष्ट इष्ट
+
+===== step 3500  (1.835B tokens) =====
+[english] The history of mathematics, which is being studied in a more modern-day sense by a few scientists, is the subject of much debate. The two main theories are the empirical and the theoretical. When mathematical theory is studied, theories are changed and when theories are studied in a new way. Thus the theory of numbers is
+[hindi] भारत की नदियाँ, नदियाँ, पहाड़ और नमन के साथ लाती हैं। ।
+[hinglish] aaj mausam bahut prabhaavit ho sakati hai. 30 janwari ko 5 varsh se cumm umr ke bachche paida hote hain, aur 20 saal ki umr ke bachche paida hote hain. 30 maheene ke bachche ke roop mein, 60 saal ki umr ke bachche paida hote hain, aur 30 saal ki umr ke
+[awadhi] राम कथा सुंदरम को 15 दिसंबर, 1999 में दिल्ली में अखिल भारतीय आयुर्विज्ञान संस्थान (एम्स) में भर्ती कराया गया था। दिल्ली में पिछले महीने की शुरुआत में इसके बाद से ही स्वास्थ्य समस्याओं से जूझ रहे लोगों को उपचार के लिए दिल्ली के एक अस्पताल में भर्ती होना पड़ा।
+पीड़िता
+
+===== step 3750  (1.966B tokens) =====
+[english] The history of mathematics is one of the most important in the field of mathematics. With its phenomenal scale and its rapid development, the Mathematics Department at Macquarie University has been producing many exciting and fascinating mathematical content.
+- The reason for the success of this program is that the curriculum has the capacity to provide a wealth
+[hindi] भारत की नदियाँ उफान-फानूस करतीं, निर्जन हो कर अलहदा, गिरगिट और खदानों के बीच से बहती हुई, ऐसी कि किलेनुमा पहाड़ियाँ भी बड़ी-बड़ी नदियाँ अपनी जगह से बहती हैं। यह साफ़ नहीं होता कि इन नदियो��� में क्या-
+[hinglish] aaj mausam bahut mahatvapurna hai.
+kai logon ke saath, 2023 mein shaniwar ki raat ko, lagbhag sabhi samay beetane aur paardarshita ke saath samaapt ho gaye. yeye bhi 14 disambar, 2022 ko lagu hue, kyonki varsh ke adhikansh samay ke liye lagbhag 5 dinon ki
+[awadhi] राम कथा सुंदर के राजा रूप को देख
+दिखाकर चुप हो जाता है । राजा दुभर उसके सामने मोठो पर रख देता है, फिर उसे मद से चीर कर (छलकर ) ग्राये हुए राजा को अपने अधीन कर लेता है । ( इस प्रकार राजा बली, मायाज
+
+===== step 4000  (2.097B tokens) =====
+[english] The history of mathematics, however, is not lost. We have a range of practical applications and examples, but we are at a loss to all sorts of situations. It is essential to choose the best mathematics for your particular situation, but let’s keep it simple. In the course, we will explore the basics of
+[hindi] भारत की नदियाँ भारत की संस्कृति और इतिहास से जुड़ी हुई हैं। इन्हें एक १०-१२-१२१९ ईस्वी में उपमहाद्वीप में ब्रिटिश साम्राज्य के द्वारा स्थापित किया गया था। इन लोगों ने १७-१९ बार हिन्द-फारसी-महासम्मिलित किया था। २०१२
+[hinglish] aaj mausam bahut adhik hai. haalaanki, shahar ki cumm aur nimn seema ke kaaran, durlabh paristhitiyon mein, mausam mein girawat mein kamee hai. 2013 ke aarthik varsh mein, 2009 mein ausat vaarshik tapman 13.7 °C (106 °C) tak pahunch gaya,
+[awadhi] राम कथा सुंदरकांड की आयोजना के लिए चयनित है। यह संवाद हिन्दी कथा का नाटकीय प्रभावों के कारण है। .
+थाई-पौड़ी, ९८ - ३१० ई॰ के मध्य में एक साधारण किसान था। उसने अपने खेतों में कीटनाशकों का प्रयोग करते हुए
+
+===== step 4250  (2.228B tokens) =====
+[english] The history of mathematics and physics at the National Academies of Science.
+[hindi] भारत की नदियाँ कैसे हैं, इस समय आज मानव जीवन का सर्वश्रेष्ठ लक्ष्य यही है कि सभी देश एक हो और सभी की वहन करती है। यह वही जगह है जहां भारत की पैठ नहीं हैं, ये वही जगह है जहां भारत का विकास होता है। प्रधानमंत्री नरेंद्र मोदी ने कहा कि दुनिया की जितनी भी बड़ी
+[hinglish] aaj mausam bahut thhandi hai. vasant mein vasant ki shuruat ke liye, 2019 mein ek lamba mausam darj kiya gaya tha, jiska arth hai ki garmiyon ki shuruat ki tarikh ko sardiyon ki shuruat ke saath 26 aprail tak badal diya gaya tha. vasant ki shuruat 18 aprail ko hui thi,
+[awadhi] राम कथा सुंदराय में 100 लोगों के लिए एक विशेष भोजन का आयोजन किया गया। इस अवसर पर शिवसेना के राष्ट्रीय प्रवक्ता संजय राउत और पार्टी के राष्ट्रीय प्रवक्ता संजय राउत सहित अन्य गणमान्य लोग उपस्थित थे।
+इस मौके पर शिवसेना के प्रवक्ता संजय राउत ने कहा कि, यह एक विशेष स्थान है जहां हम रहते थे
+
+===== step 4500  (2.359B tokens) =====
+[english] The history of mathematics, and its application to the sciences, is marked by a series of events, such as the discovery of gravitation of the fundamental forces of Newton's laws of motion, the discovery of the laws of conservation of the energy of the universal law of conservation of energy, and the discovery of the universal
+[hindi] भारत की नदियाँ।
+"ऊंचाई" की परिभाषा के अंतर्गत इस क्षेत्र में सिंचाई के साथ-साथ पर्यटन की भी व्यवस्था की गयी है।
+- इन क्षेत्रों में पर्यटन के लिये व���शेष प्रावधान किये गये हैं।
+- हालाँकि भारतीय वायु सेना के विमान, सैन्य हेलीकॉप्टर, नौसेना के हेलीकॉप्टर, सैन्य हेलीकॉप्टर, तोपखाने विमान
+[hinglish] aaj mausam bahut adhik hoti hai. sanyukt raajya america mein ausat tapman 31 janwari ko 13 se 17 degree celsius tak rahata hai. yeh ek germ, shushk, chaara tha jo 22 degree celsius se adhik ho sakata hai. shushk mausam ka mausam lagbhag 11 se 
+[awadhi] राम कथा सुंदर ने कहा कि मेरे पास इतने पैसे नहीं थे, मगर मैं तो यहां रहूंगा। उन्होंने कहा कि मैंने ही सबसे ज्यादा पैसे दिए। मैंने ही सबसे ज्यादा पैसे दिए। मैं एक मंदिर में जाता हूं, फिर मंदिर की तरफ चला जाता हूं, वहां मंदिर के पुजारी रहते हैं। मंदिर की जनता का
+
+===== step 4750  (2.490B tokens) =====
+[english] The history of mathematics, and from its origins to modern times, can be traced back to the 15th century, when the author of the Candle Tree Graphs, Newton's Third Law of Thermodynamics, introduced the concept of proportional equilibrium and applied it to place value functions
+[hindi] भारत की नदियाँ दिल्ली और कटरा की तरह बिखरते हैं. यमुना में 5,000 से अधिक मछलियाँ हैं. यमुना में तीन लाख से अधिक मछलियाँ हैं. यहां जल स्तर बहुत कम है.
+शिरडी या अलास्का के पास स्थित कई झीलें, जिनकी झीलें समुद्र
+[hinglish] aaj mausam bahut adhik hai.
+vittiya karyalaya.
+kharaab mausam ke liye anupayuktata ke saath, season 2 mein 2 season aur 4 upakram hain. chhah dinn, 6 maheene aur 4 maheene hain. sabse cumm 2 dinn, 2 dinn aur 3 dinn
+[awadhi] राम कथा सुंदरबन में 29 मई को रिलीज हुई है।
+
+===== step 4769  (2.500B tokens) =====
+[english] The history of mathematics is fascinating. It tells us that people from many different cultures, including Americans, Latinx Americans, Native Americans and American Indians were at the center of the history of mathematics.
+It’s not just the mathematics that’s being studied. It’s also the mathematics that’s being studied.
+[hindi] भारत की नदियाँ आपस में मिलती हैं, पर उनकी खालें पानी में उतरती हैं और उनसे पानी की धारा बहती है। इस प्रकार के काम से यह अनुमान किया जाता है कि समुद्र और नदी दोनों एक ही दिशा से प्रवाहित होकर बहती हैं। इस कारण से नदियों में नहरों का जाल नहीं बँ
+[hinglish] aaj mausam bahut lambi hai.
+[awadhi] राम कथा सुंदरम रे, जय रईस रे, रफी रईस रे, खोसला रे, जुमले रे, बजीर रे, बजीर रे, साजी रे, साजी रे, साजी रे, साजी रे, साजी रे, साजी रे, साजी

assets/runs/mona_m/train_log.csv

@@ -0,0 +1,478 @@
+step,tokens,lr,loss,grad_norm,tokens_per_s,gpu_temp_c
+1,524288,6.000e-06,10.5534,4.592,31114,47
+10,5242880,1.132e-04,9.3174,1.364,46214,78
+20,10485760,2.391e-04,8.3100,2.133,45785,79
+30,15728640,3.649e-04,7.5873,1.722,45668,80
+40,20971520,4.907e-04,7.3273,1.079,45737,77
+50,26214400,6.000e-04,7.0700,0.581,45815,77
+60,31457280,6.000e-04,6.8522,0.703,45835,77
+70,36700160,6.000e-04,6.6333,0.851,45841,74
+80,41943040,6.000e-04,6.4254,0.489,45828,76
+90,47185920,6.000e-04,6.2861,0.439,45865,77
+100,52428800,6.000e-04,6.1470,0.499,43733,76
+110,57671680,6.000e-04,5.9822,0.434,45763,78
+120,62914560,6.000e-04,5.9253,0.635,45797,79
+130,68157440,6.000e-04,5.8141,0.510,45684,78
+140,73400320,6.000e-04,5.7676,0.628,45788,78
+150,78643200,6.000e-04,5.5982,0.363,45664,77
+160,83886080,6.000e-04,5.5617,0.594,44697,80
+170,89128960,6.000e-04,5.4494,0.342,45548,79
+180,94371840,6.000e-04,5.3783,0.526,45564,80
+190,99614720,6.000e-04,5.2621,0.463,45529,80
+200,104857600,6.000e-04,5.1823,0.446,45513,79
+210,110100480,6.000e-04,5.0841,0.444,45490,79
+220,115343360,6.000e-04,5.0420,0.478,45624,80
+230,120586240,6.000e-04,4.9764,0.452,45503,81
+240,125829120,6.000e-04,4.8823,0.366,45508,80
+250,131072000,6.000e-04,4.8260,0.415,45546,82
+260,136314880,6.000e-04,4.7957,0.371,42081,79
+270,141557760,6.000e-04,4.7249,0.607,45494,80
+280,146800640,6.000e-04,4.7017,0.418,45522,80
+290,152043520,6.000e-04,4.6312,0.408,45428,80
+300,157286400,6.000e-04,4.5876,0.526,45354,81
+310,162529280,6.000e-04,4.5846,0.465,45487,79
+320,167772160,6.000e-04,4.5672,0.441,44774,83
+330,173015040,6.000e-04,4.4982,0.451,45210,82
+340,178257920,6.000e-04,4.4664,0.404,45172,82
+350,183500800,6.000e-04,4.4584,0.506,45208,81
+360,188743680,6.000e-04,4.4084,0.422,45454,80
+370,193986560,6.000e-04,4.3505,0.367,45465,79
+380,199229440,6.000e-04,4.3243,0.400,45520,80
+390,204472320,6.000e-04,4.2768,0.354,45469,79
+400,209715200,6.000e-04,4.2944,0.470,45443,80
+410,214958080,6.000e-04,4.2709,0.374,45386,80
+420,220200960,6.000e-04,4.2226,0.342,45415,80
+430,225443840,6.000e-04,4.2465,0.374,45338,81
+440,230686720,6.000e-04,4.1509,0.377,45340,81
+450,235929600,6.000e-04,4.1529,0.331,45471,81
+460,241172480,6.000e-04,4.1293,0.439,45442,80
+470,246415360,6.000e-04,4.1176,0.374,44565,80
+480,251658240,6.000e-04,4.0998,0.307,45586,79
+490,256901120,6.000e-04,4.0765,0.385,45503,79
+500,262144000,6.000e-04,4.0368,0.357,45548,79
+510,267386880,6.000e-04,4.0194,0.367,43005,79
+520,272629760,6.000e-04,4.0098,0.354,45584,79
+530,277872640,6.000e-04,3.9920,0.334,45553,79
+540,283115520,6.000e-04,3.9399,0.322,45537,79
+550,288358400,6.000e-04,3.9806,0.364,45642,80
+560,293601280,6.000e-04,3.9710,0.340,45557,79
+570,298844160,6.000e-04,3.9157,0.363,45544,79
+580,304087040,6.000e-04,3.9155,0.313,45524,78
+590,309329920,6.000e-04,3.8963,0.357,45511,80
+600,314572800,6.000e-04,3.9024,0.333,45454,80
+610,319815680,6.000e-04,3.8490,0.305,45449,82
+620,325058560,6.000e-04,3.8817,0.343,45338,84
+630,330301440,6.000e-04,3.8560,0.342,44294,85
+640,335544320,6.000e-04,3.7777,0.375,45047,85
+650,340787200,6.000e-04,3.8259,0.307,44954,84
+660,346030080,6.000e-04,3.8327,0.300,44967,85
+670,351272960,6.000e-04,3.8360,0.404,45006,85
+680,356515840,6.000e-04,3.8300,0.330,44930,86
+690,361758720,6.000e-04,3.7866,0.309,44976,85
+700,367001600,6.000e-04,3.7860,0.335,45000,85
+710,372244480,6.000e-04,3.7759,0.314,45036,85
+720,377487360,6.000e-04,3.7829,0.293,45041,84
+730,382730240,6.000e-04,3.7503,0.361,44778,85
+740,387973120,6.000e-04,3.7855,0.292,44970,85
+750,393216000,6.000e-04,3.7742,0.334,45011,85
+760,398458880,6.000e-04,3.7542,0.280,42057,86
+770,403701760,6.000e-04,3.6957,0.296,44970,87
+780,408944640,6.000e-04,3.7091,0.283,44295,85
+790,414187520,6.000e-04,3.6989,0.340,44957,86
+800,419430400,6.000e-04,3.6832,0.302,44934,84
+810,424673280,6.000e-04,3.6945,0.293,45005,83
+820,429916160,6.000e-04,3.6798,0.295,45054,84
+830,435159040,6.000e-04,3.6520,0.278,44927,85
+840,440401920,6.000e-04,3.6817,0.278,44780,86
+850,445644800,6.000e-04,3.6968,0.304,44811,86
+860,450887680,6.000e-04,3.6800,0.334,44536,87
+870,456130560,6.000e-04,3.6930,0.285,44430,86
+880,461373440,6.000e-04,3.6544,0.286,43326,86
+890,466616320,6.000e-04,3.6536,0.311,43932,87
+900,471859200,6.000e-04,3.6751,0.305,44429,85
+910,477102080,6.000e-04,3.6606,0.275,43748,87
+920,482344960,6.000e-04,3.6357,0.316,44588,86
+930,487587840,6.000e-04,3.6608,0.300,44801,85
+940,492830720,6.000e-04,3.6388,0.303,44016,86
+950,498073600,6.000e-04,3.6253,0.292,44958,85
+960,503316480,6.000e-04,3.6193,0.290,45153,84
+970,508559360,6.000e-04,3.6535,0.269,45178,85
+980,513802240,6.000e-04,3.6435,0.259,44882,85
+990,519045120,6.000e-04,3.6187,0.280,43979,87
+1000,524288000,6.000e-04,3.5881,0.272,44013,87
+1010,529530880,6.000e-04,3.6105,0.286,36097,86
+1020,534773760,6.000e-04,3.5725,0.258,43923,87
+1030,540016640,6.000e-04,3.5983,0.309,43747,87
+1040,545259520,6.000e-04,3.5917,0.276,44106,86
+1050,550502400,6.000e-04,3.5957,0.278,42811,87
+1060,555745280,6.000e-04,3.6021,0.250,44050,87
+1070,560988160,6.000e-04,3.5725,0.311,44518,85
+1080,566231040,6.000e-04,3.5650,0.256,44359,85
+1090,571473920,6.000e-04,3.6169,0.298,44386,84
+1100,576716800,6.000e-04,3.5547,0.249,45063,85
+1110,581959680,6.000e-04,3.5800,0.293,45135,85
+1120,587202560,6.000e-04,3.5761,0.296,45162,85
+1130,592445440,6.000e-04,3.5440,0.281,45145,85
+1140,597688320,6.000e-04,3.5422,0.253,45131,84
+1150,602931200,6.000e-04,3.5673,0.250,45153,85
+1160,608174080,6.000e-04,3.5868,0.253,45183,85
+1170,613416960,6.000e-04,3.5428,0.321,45174,85
+1180,618659840,6.000e-04,3.5563,0.249,45175,85
+1190,623902720,6.000e-04,3.5611,0.244,45189,84
+1200,629145600,6.000e-04,3.5284,0.320,45200,85
+1210,634388480,6.000e-04,3.5163,0.242,45132,85
+1220,639631360,6.000e-04,3.5550,0.251,44976,85
+1230,644874240,6.000e-04,3.5420,0.282,45165,85
+1240,650117120,6.000e-04,3.5525,0.261,44646,81
+1250,655360000,6.000e-04,3.5065,0.258,45221,85
+1260,660602880,6.000e-04,3.5262,0.250,42321,83
+1270,665845760,6.000e-04,3.5366,0.276,45245,85
+1280,671088640,6.000e-04,3.5150,0.255,45221,85
+1290,676331520,6.000e-04,3.5099,0.295,45221,84
+1300,681574400,6.000e-04,3.5335,0.240,45215,84
+1310,686817280,6.000e-04,3.5335,0.264,45175,87
+1320,692060160,6.000e-04,3.4858,0.259,44868,86
+1330,697303040,6.000e-04,3.4857,0.262,45172,85
+1340,702545920,6.000e-04,3.4968,0.256,45144,86
+1350,707788800,6.000e-04,3.4882,0.254,45100,86
+1360,713031680,6.000e-04,3.4716,0.262,44703,86
+1370,718274560,6.000e-04,3.5226,0.260,43782,86
+1380,723517440,6.000e-04,3.5057,0.241,43850,86
+1390,728760320,6.000e-04,3.4988,0.252,43799,86
+1400,734003200,6.000e-04,3.4742,0.261,43012,87
+1410,739246080,6.000e-04,3.4720,0.274,43663,85
+1420,744488960,6.000e-04,3.4402,0.227,43606,87
+1430,749731840,6.000e-04,3.4267,0.267,43597,87
+1440,754974720,6.000e-04,3.4691,0.246,43585,86
+1450,760217600,6.000e-04,3.4831,0.253,43444,86
+1460,765460480,6.000e-04,3.4517,0.254,43591,86
+1470,770703360,6.000e-04,3.4721,0.232,43445,87
+1480,775946240,6.000e-04,3.5073,0.276,44078,86
+1490,781189120,6.000e-04,3.4640,0.260,45090,86
+1500,786432000,6.000e-04,3.4446,0.241,45121,86
+1510,791674880,6.000e-04,3.4423,0.256,42584,85
+1520,796917760,6.000e-04,3.4124,0.223,45102,82
+1530,802160640,6.000e-04,3.4587,0.270,45249,81
+1540,807403520,6.000e-04,3.4770,0.249,45803,76
+1550,812646400,6.000e-04,3.4630,0.243,21027,74
+1560,817889280,6.000e-04,3.4604,0.279,45507,81
+1570,823132160,6.000e-04,3.4238,0.255,41306,66
+1580,828375040,6.000e-04,3.4412,0.225,42481,80
+1590,833617920,6.000e-04,3.4221,0.268,38364,78
+1600,838860800,6.000e-04,3.4242,0.237,38497,79
+1610,844103680,6.000e-04,3.4200,0.249,38579,81
+1620,849346560,6.000e-04,3.3969,0.241,38658,77
+1630,854589440,6.000e-04,3.4394,0.247,38680,80
+1640,859832320,6.000e-04,3.4067,0.258,38588,82
+1650,865075200,6.000e-04,3.4067,0.240,38605,81
+1660,870318080,6.000e-04,3.4458,0.238,38592,79
+1670,875560960,6.000e-04,3.4460,0.266,38601,81
+1680,880803840,6.000e-04,3.3810,0.233,38581,81
+1690,886046720,6.000e-04,3.4325,0.240,38616,81
+1700,891289600,6.000e-04,3.4028,0.246,38571,76
+1710,896532480,6.000e-04,3.4067,0.232,38088,81
+1720,901775360,6.000e-04,3.4005,0.235,38601,82
+1730,907018240,6.000e-04,3.4057,0.222,38501,82
+1740,912261120,6.000e-04,3.4456,0.223,38510,80
+1750,917504000,6.000e-04,3.4000,0.250,38486,82
+1760,922746880,6.000e-04,3.3928,0.243,36518,82
+1770,927989760,6.000e-04,3.3709,0.225,38593,83
+1780,933232640,6.000e-04,3.3675,0.244,38591,82
+1790,938475520,6.000e-04,3.4235,0.238,38536,81
+1800,943718400,6.000e-04,3.3995,0.229,38638,82
+1810,948961280,6.000e-04,3.4015,0.233,38589,82
+1820,954204160,6.000e-04,3.3584,0.219,38613,82
+1830,959447040,6.000e-04,3.3834,0.219,38643,82
+1840,964689920,6.000e-04,3.4251,0.231,38071,82
+1850,969932800,6.000e-04,3.4154,0.233,38412,81
+1860,975175680,6.000e-04,3.3826,0.231,38393,77
+1870,980418560,6.000e-04,3.3786,0.230,34399,80
+1880,985661440,6.000e-04,3.3873,0.246,38229,80
+1890,990904320,6.000e-04,3.3941,0.234,38417,80
+1900,996147200,6.000e-04,3.3986,0.220,38502,80
+1910,1001390080,6.000e-04,3.3624,0.254,38462,79
+1920,1006632960,6.000e-04,3.3832,0.237,38737,79
+1930,1011875840,6.000e-04,3.3617,0.226,38740,75
+1940,1017118720,6.000e-04,3.3628,0.229,38788,79
+1950,1022361600,6.000e-04,3.3318,0.225,29146,75
+1960,1027604480,6.000e-04,3.3862,0.225,38540,82
+1970,1032847360,6.000e-04,3.4005,0.219,35672,78
+1980,1038090240,6.000e-04,3.3915,0.216,38312,79
+1990,1043333120,6.000e-04,3.3809,0.251,38322,81
+2000,1048576000,6.000e-04,3.3892,0.227,38386,81
+2010,1053818880,6.000e-04,3.3662,0.236,36745,78
+2020,1059061760,6.000e-04,3.3405,0.261,38707,78
+2030,1064304640,6.000e-04,3.3244,0.238,38770,78
+2040,1069547520,6.000e-04,3.3599,0.222,38770,78
+2050,1074790400,6.000e-04,3.3637,0.222,38756,75
+2060,1080033280,6.000e-04,3.3901,0.223,26251,76
+2070,1085276160,6.000e-04,3.3605,0.234,25636,81
+2080,1090519040,6.000e-04,3.3218,0.242,38510,80
+2090,1095761920,6.000e-04,3.3418,0.256,37982,81
+2100,1101004800,6.000e-04,3.3746,0.213,38745,80
+2110,1106247680,6.000e-04,3.3387,0.257,38380,82
+2120,1111490560,6.000e-04,3.3363,0.229,38389,81
+2130,1116733440,6.000e-04,3.3636,0.233,38408,81
+2140,1121976320,6.000e-04,3.3782,0.228,38488,82
+2150,1127219200,6.000e-04,3.3592,0.220,29434,80
+2160,1132462080,6.000e-04,3.3374,0.240,38627,79
+2170,1137704960,6.000e-04,3.3294,0.219,38762,82
+2180,1142947840,6.000e-04,3.3487,0.244,38767,76
+2190,1148190720,6.000e-04,3.3421,0.255,38884,77
+2200,1153433600,6.000e-04,3.3353,0.231,39060,78
+2210,1158676480,6.000e-04,3.3100,0.232,38902,72
+2220,1163919360,6.000e-04,3.3550,0.219,39579,76
+2230,1169162240,6.000e-04,3.3347,0.228,39006,78
+2240,1174405120,6.000e-04,3.3412,0.230,39408,77
+2250,1179648000,6.000e-04,3.3553,0.222,39596,78
+2260,1184890880,6.000e-04,3.3284,0.237,37109,74
+2270,1190133760,6.000e-04,3.3418,0.222,38963,77
+2280,1195376640,6.000e-04,3.3209,0.223,27789,79
+2290,1200619520,6.000e-04,3.2959,0.213,38678,76
+2300,1205862400,6.000e-04,3.3211,0.233,38665,81
+2310,1211105280,6.000e-04,3.3198,0.254,38636,81
+2320,1216348160,6.000e-04,3.3256,0.216,38638,81
+2330,1221591040,6.000e-04,3.3824,0.252,38667,79
+2340,1226833920,6.000e-04,3.3285,0.238,38657,80
+2350,1232076800,6.000e-04,3.3383,0.232,38205,81
+2360,1237319680,6.000e-04,3.3125,0.219,38624,79
+2370,1242562560,6.000e-04,3.3126,0.227,38619,80
+2380,1247805440,6.000e-04,3.3221,0.234,38565,81
+2390,1253048320,6.000e-04,3.2946,0.216,38569,77
+2400,1258291200,6.000e-04,3.3515,0.222,38629,80
+2410,1263534080,6.000e-04,3.3340,0.219,38675,76
+2420,1268776960,6.000e-04,3.2756,0.211,38682,81
+2430,1274019840,6.000e-04,3.2972,0.248,38635,79
+2440,1279262720,6.000e-04,3.3320,0.216,38793,81
+2450,1284505600,6.000e-04,3.2970,0.231,38735,81
+2460,1289748480,6.000e-04,3.3117,0.222,38734,78
+2470,1294991360,6.000e-04,3.3032,0.268,38728,81
+2480,1300234240,6.000e-04,3.3221,0.242,38230,78
+2490,1305477120,6.000e-04,3.3027,0.219,38816,76
+2500,1310720000,6.000e-04,3.3107,0.216,38591,80
+2510,1315962880,6.000e-04,3.2972,0.231,37128,76
+2520,1321205760,6.000e-04,3.2876,0.227,39261,74
+2530,1326448640,6.000e-04,3.3044,0.226,40055,78
+2540,1331691520,6.000e-04,3.2870,0.212,39811,77
+2550,1336934400,6.000e-04,3.3262,0.215,39626,77
+2560,1342177280,6.000e-04,3.2960,0.228,39470,77
+2570,1347420160,6.000e-04,3.2641,0.228,39475,76
+2580,1352663040,6.000e-04,3.2691,0.216,39198,74
+2590,1357905920,6.000e-04,3.3172,0.236,39887,77
+2600,1363148800,6.000e-04,3.2827,0.231,39249,78
+2610,1368391680,6.000e-04,3.2858,0.232,39077,77
+2620,1373634560,6.000e-04,3.3369,0.219,39738,74
+2630,1378877440,6.000e-04,3.3122,0.221,40213,78
+2640,1384120320,6.000e-04,3.2961,0.220,40796,74
+2650,1389363200,6.000e-04,3.2886,0.229,39052,77
+2660,1394606080,6.000e-04,3.2981,0.226,39456,75
+2670,1399848960,6.000e-04,3.2839,0.232,39414,76
+2680,1405091840,6.000e-04,3.2687,0.233,39441,77
+2690,1410334720,6.000e-04,3.2712,0.248,39591,78
+2700,1415577600,6.000e-04,3.2692,0.229,39614,77
+2710,1420820480,6.000e-04,3.2917,0.248,40113,74
+2720,1426063360,6.000e-04,3.2923,0.229,39125,73
+2730,1431306240,6.000e-04,3.3032,0.220,39608,77
+2740,1436549120,6.000e-04,3.2954,0.218,39781,77
+2750,1441792000,6.000e-04,3.2915,0.230,39137,72
+2760,1447034880,6.000e-04,3.3195,0.222,37386,78
+2770,1452277760,6.000e-04,3.2719,0.233,39177,75
+2780,1457520640,6.000e-04,3.3007,0.221,40092,77
+2790,1462763520,6.000e-04,3.2607,0.214,40006,77
+2800,1468006400,6.000e-04,3.2488,0.225,39646,77
+2810,1473249280,6.000e-04,3.2767,0.222,39691,75
+2820,1478492160,6.000e-04,3.2817,0.235,39385,76
+2830,1483735040,6.000e-04,3.2561,0.219,40116,76
+2840,1488977920,6.000e-04,3.2832,0.217,39785,76
+2850,1494220800,6.000e-04,3.2761,0.215,39788,77
+2860,1499463680,6.000e-04,3.2835,0.228,39368,75
+2870,1504706560,6.000e-04,3.2378,0.217,39959,75
+2880,1509949440,6.000e-04,3.2728,0.226,23822,80
+2890,1515192320,6.000e-04,3.2664,0.222,38257,78
+2900,1520435200,6.000e-04,3.2474,0.224,36391,81
+2910,1525678080,6.000e-04,3.2568,0.272,27191,73
+2920,1530920960,6.000e-04,3.2442,0.240,39255,81
+2930,1536163840,6.000e-04,3.2868,0.227,36112,81
+2940,1541406720,6.000e-04,3.2305,0.223,38536,83
+2950,1546649600,6.000e-04,3.2703,0.216,38506,78
+2960,1551892480,6.000e-04,3.2588,0.226,38461,79
+2970,1557135360,6.000e-04,3.2664,0.247,38444,82
+2980,1562378240,6.000e-04,3.2645,0.221,38520,79
+2990,1567621120,6.000e-04,3.2658,0.226,38517,81
+3000,1572864000,6.000e-04,3.2762,0.218,38601,81
+3010,1578106880,6.000e-04,3.2548,0.213,34662,80
+3020,1583349760,6.000e-04,3.2401,0.215,38909,79
+3030,1588592640,6.000e-04,3.2377,0.224,38945,75
+3040,1593835520,6.000e-04,3.2571,0.236,40134,76
+3050,1599078400,6.000e-04,3.2715,0.241,40427,76
+3060,1604321280,6.000e-04,3.2734,0.228,3464,64
+3070,1609564160,6.000e-04,3.2443,0.227,44965,78
+3080,1614807040,6.000e-04,3.2354,0.204,27264,76
+3090,1620049920,6.000e-04,3.2359,0.214,41735,78
+3100,1625292800,6.000e-04,3.2901,0.221,38863,79
+3110,1630535680,6.000e-04,3.2261,0.237,39213,79
+3120,1635778560,6.000e-04,3.2336,0.249,39122,78
+3130,1641021440,6.000e-04,3.2465,0.224,39130,78
+3140,1646264320,6.000e-04,3.2518,0.226,39469,74
+3150,1651507200,6.000e-04,3.2521,0.234,39066,72
+3160,1656750080,6.000e-04,3.2357,0.225,39831,74
+3170,1661992960,6.000e-04,3.2523,0.238,40912,74
+3180,1667235840,6.000e-04,3.2324,0.218,41556,76
+3190,1672478720,6.000e-04,3.2355,0.222,42053,76
+3200,1677721600,6.000e-04,3.2629,0.224,41826,76
+3210,1682964480,6.000e-04,3.2395,0.238,42759,73
+3220,1688207360,6.000e-04,3.2296,0.230,44115,77
+3230,1693450240,6.000e-04,3.2618,0.218,44804,77
+3240,1698693120,6.000e-04,3.2226,0.229,44768,77
+3250,1703936000,6.000e-04,3.2558,0.228,43354,74
+3260,1709178880,6.000e-04,3.2430,0.225,40563,77
+3270,1714421760,6.000e-04,3.2466,0.237,43310,78
+3280,1719664640,6.000e-04,3.2067,0.219,43456,75
+3290,1724907520,6.000e-04,3.2644,0.218,43891,77
+3300,1730150400,6.000e-04,3.2235,0.226,44415,77
+3310,1735393280,6.000e-04,3.2157,0.226,43833,76
+3320,1740636160,6.000e-04,3.2557,0.223,43872,77
+3330,1745879040,6.000e-04,3.2171,0.219,40923,76
+3340,1751121920,6.000e-04,3.2361,0.222,41402,75
+3350,1756364800,6.000e-04,3.2178,0.224,39907,78
+3360,1761607680,6.000e-04,3.1994,0.212,39227,76
+3370,1766850560,6.000e-04,3.2260,0.239,39297,77
+3380,1772093440,6.000e-04,3.2401,0.223,39403,76
+3390,1777336320,6.000e-04,3.2190,0.222,40876,80
+3400,1782579200,6.000e-04,3.1929,0.242,39106,81
+3410,1787822080,6.000e-04,3.2202,0.225,39508,76
+3420,1793064960,6.000e-04,3.1784,0.217,41342,76
+3430,1798307840,6.000e-04,3.2592,0.230,42478,77
+3440,1803550720,6.000e-04,3.2636,0.222,43215,75
+3450,1808793600,6.000e-04,3.2292,0.225,43134,77
+3460,1814036480,6.000e-04,3.2062,0.230,43096,77
+3470,1819279360,6.000e-04,3.2305,0.233,43183,76
+3480,1824522240,6.000e-04,3.2030,0.225,43968,77
+3490,1829765120,6.000e-04,3.2272,0.243,43607,79
+3500,1835008000,6.000e-04,3.2483,0.222,40341,76
+3510,1840250880,6.000e-04,3.2265,0.225,38047,75
+3520,1845493760,6.000e-04,3.1857,0.233,40729,71
+3530,1850736640,6.000e-04,3.2112,0.247,43006,77
+3540,1855979520,6.000e-04,3.2521,0.231,43964,74
+3550,1861222400,6.000e-04,3.2257,0.252,42319,78
+3560,1866465280,6.000e-04,3.1944,0.232,38841,80
+3570,1871708160,6.000e-04,3.2354,0.212,39052,76
+3580,1876951040,6.000e-04,3.2072,0.223,38789,82
+3590,1882193920,6.000e-04,3.2476,0.210,39063,82
+3600,1887436800,6.000e-04,3.2464,0.235,39208,80
+3610,1892679680,6.000e-04,3.2457,0.217,38882,79
+3620,1897922560,6.000e-04,3.2259,0.221,38797,81
+3630,1903165440,6.000e-04,3.2517,0.218,38387,77
+3640,1908408320,6.000e-04,3.2307,0.235,39512,75
+3650,1913651200,6.000e-04,3.2131,0.241,40004,76
+3660,1918894080,6.000e-04,3.2252,0.216,41352,72
+3670,1924136960,6.000e-04,3.2172,0.225,40786,76
+3680,1929379840,6.000e-04,3.2054,0.214,39153,76
+3690,1934622720,6.000e-04,3.2218,0.229,39733,74
+3700,1939865600,6.000e-04,3.2164,0.226,41522,78
+3710,1945108480,6.000e-04,3.2095,0.232,40380,77
+3720,1950351360,6.000e-04,3.2232,0.218,39594,72
+3730,1955594240,6.000e-04,3.2091,0.244,40594,77
+3740,1960837120,6.000e-04,3.2255,0.227,40068,77
+3750,1966080000,6.000e-04,3.2530,0.224,39487,75
+3760,1971322880,6.000e-04,3.2188,0.212,37574,73
+3770,1976565760,6.000e-04,3.2120,0.219,38529,78
+3780,1981808640,6.000e-04,3.1867,0.202,38823,81
+3790,1987051520,6.000e-04,3.1640,0.233,38720,79
+3800,1992294400,6.000e-04,3.2371,0.252,38717,82
+3810,1997537280,6.000e-04,3.1914,0.217,38766,81
+3820,2002780160,6.000e-04,3.2086,0.213,38583,81
+3830,2008023040,6.000e-04,3.2116,0.239,38874,79
+3840,2013265920,6.000e-04,3.2074,0.213,38782,80
+3850,2018508800,6.000e-04,3.1931,0.261,38871,80
+3860,2023751680,6.000e-04,3.2435,0.218,38856,80
+3870,2028994560,6.000e-04,3.1917,0.212,38862,81
+3880,2034237440,6.000e-04,3.1847,0.223,38841,81
+3890,2039480320,6.000e-04,3.1748,0.218,38714,82
+3900,2044723200,6.000e-04,3.2130,0.222,38286,78
+3910,2049966080,6.000e-04,3.2217,0.205,38718,81
+3920,2055208960,6.000e-04,3.2211,0.216,38663,83
+3930,2060451840,6.000e-04,3.1875,0.242,38693,80
+3940,2065694720,6.000e-04,3.1928,0.213,38915,80
+3950,2070937600,6.000e-04,3.2105,0.227,38919,80
+3960,2076180480,6.000e-04,3.1961,0.223,38938,79
+3970,2081423360,6.000e-04,3.1892,0.238,38973,79
+3980,2086666240,6.000e-04,3.2422,0.238,38973,78
+3990,2091909120,6.000e-04,3.1984,0.220,39085,79
+4000,2097152000,6.000e-04,3.1873,0.248,39050,78
+4010,2102394880,6.000e-04,3.1777,0.208,37251,76
+4020,2107637760,6.000e-04,3.1937,0.224,39062,76
+4030,2112880640,6.000e-04,3.1685,0.240,38592,80
+4040,2118123520,6.000e-04,3.1963,0.222,39052,81
+4050,2123366400,6.000e-04,3.2227,0.248,38989,79
+4060,2128609280,5.953e-04,3.2363,0.227,38885,82
+4070,2133852160,5.873e-04,3.1734,0.224,39134,78
+4080,2139095040,5.794e-04,3.2312,0.221,39212,77
+4090,2144337920,5.714e-04,3.1760,0.232,39355,79
+4100,2149580800,5.634e-04,3.1960,0.206,39257,78
+4110,2154823680,5.555e-04,3.1657,0.219,39228,79
+4120,2160066560,5.475e-04,3.1352,0.215,39243,77
+4130,2165309440,5.395e-04,3.2009,0.220,39198,79
+4140,2170552320,5.316e-04,3.2230,0.215,39293,78
+4150,2175795200,5.236e-04,3.1543,0.239,39237,77
+4160,2181038080,5.156e-04,3.1662,0.222,39375,74
+4170,2186280960,5.076e-04,3.2005,0.202,38692,78
+4180,2191523840,4.997e-04,3.1574,0.211,39057,77
+4190,2196766720,4.917e-04,3.1651,0.196,39361,78
+4200,2202009600,4.837e-04,3.1770,0.201,39054,78
+4210,2207252480,4.758e-04,3.1769,0.237,39169,78
+4220,2212495360,4.678e-04,3.1435,0.219,39060,78
+4230,2217738240,4.598e-04,3.1558,0.211,39091,76
+4240,2222981120,4.519e-04,3.1518,0.211,39295,79
+4250,2228224000,4.439e-04,3.1513,0.211,39071,76
+4260,2233466880,4.359e-04,3.1625,0.213,37315,73
+4270,2238709760,4.280e-04,3.1461,0.204,39164,79
+4280,2243952640,4.200e-04,3.1184,0.202,39288,76
+4290,2249195520,4.120e-04,3.1397,0.203,39151,78
+4300,2254438400,4.041e-04,3.1475,0.205,38597,76
+4310,2259681280,3.961e-04,3.1370,0.207,39130,76
+4320,2264924160,3.881e-04,3.1178,0.203,39719,75
+4330,2270167040,3.801e-04,3.1451,0.205,40191,75
+4340,2275409920,3.722e-04,3.1320,0.195,39208,74
+4350,2280652800,3.642e-04,3.1535,0.196,39097,77
+4360,2285895680,3.562e-04,3.1480,0.201,39370,73
+4370,2291138560,3.483e-04,3.1670,0.199,41384,76
+4380,2296381440,3.403e-04,3.1326,0.216,39396,75
+4390,2301624320,3.323e-04,3.1057,0.193,39974,76
+4400,2306867200,3.244e-04,3.1500,0.201,40082,76
+4410,2312110080,3.164e-04,3.1301,0.193,40040,77
+4420,2317352960,3.084e-04,3.1758,0.199,39630,77
+4430,2322595840,3.005e-04,3.1097,0.205,40444,77
+4440,2327838720,2.925e-04,3.1166,0.188,38905,77
+4450,2333081600,2.845e-04,3.0939,0.186,39756,77
+4460,2338324480,2.765e-04,3.1479,0.195,23948,63
+4470,2343567360,2.686e-04,3.1480,0.204,41977,79
+4480,2348810240,2.606e-04,3.1278,0.199,38729,77
+4490,2354053120,2.526e-04,3.0768,0.189,36456,79
+4500,2359296000,2.447e-04,3.1736,0.196,39020,78
+4510,2364538880,2.367e-04,3.0955,0.181,37129,78
+4520,2369781760,2.287e-04,3.1195,0.206,38977,76
+4530,2375024640,2.208e-04,3.0919,0.193,39109,80
+4540,2380267520,2.128e-04,3.1393,0.184,39135,80
+4550,2385510400,2.048e-04,3.1008,0.193,39015,77
+4560,2390753280,1.969e-04,3.0852,0.189,39048,77
+4570,2395996160,1.889e-04,3.0823,0.197,38466,82
+4580,2401239040,1.809e-04,3.0785,0.178,38769,81
+4590,2406481920,1.729e-04,3.1156,0.185,38883,79
+4600,2411724800,1.650e-04,3.1143,0.190,38964,80
+4610,2416967680,1.570e-04,3.0988,0.176,38884,81
+4620,2422210560,1.490e-04,3.0625,0.179,38971,81
+4630,2427453440,1.411e-04,3.1121,0.173,38663,79
+4640,2432696320,1.331e-04,3.1143,0.172,38721,79
+4650,2437939200,1.251e-04,3.0878,0.174,38907,79
+4660,2443182080,1.172e-04,3.0650,0.176,38824,76
+4670,2448424960,1.092e-04,3.0798,0.181,38875,80
+4680,2453667840,1.012e-04,3.0871,0.174,38897,78
+4690,2458910720,9.325e-05,3.1076,0.170,2422,74
+4700,2464153600,8.528e-05,3.0842,0.168,41573,77
+4710,2469396480,7.731e-05,3.0744,0.165,39250,75
+4720,2474639360,6.935e-05,3.0910,0.162,39025,80
+4730,2479882240,6.138e-05,3.1213,0.166,38981,79
+4740,2485125120,5.341e-05,3.0687,0.167,39111,79
+4750,2490368000,4.544e-05,3.0800,0.161,38861,75
+4760,2495610880,3.747e-05,3.1070,0.160,37741,77

assets/runs/mona_m_chat/model.pt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:100af18b0b952021f8b66d5ac55f169d1c746039c2d71826d220e10a30ca8c21
+size 220260201

config.json

@@ -0,0 +1,12 @@
+{
+  "vocab_size": 32768,
+  "d_model": 768,
+  "n_layers": 12,
+  "n_heads": 12,
+  "ffn_hidden": 2048,
+  "context": 1024,
+  "rope_theta": 10000.0,
+  "dropout": 0.0,
+  "model_type": "mona",
+  "tokenizer": "assets/models/mona/tokenizer.json"
+}