jbduran
/

think.nano

+{
+  "experiment_id": "think-d12-r20-alt44",
+  "stage": "base",
+  "base_experiment_id": "think-d12-r20-alt44",
+  "parent_experiment_id": null,
+  "parent_checkpoint_step": null,
+  "dataset": "jbduran/think-dataset",
+  "dataset_revision": "main",
+  "step": 4200,
+  "depth": 12,
+  "target_param_data_ratio": 20.0,
+  "training_tokens": 2202009600,
+  "final_sampled_val_bpb": 1.0739757134682362,
+  "minimum_sampled_val_bpb": 1.0739757134682362,
+  "full_val_bpb": 1.0180559919724057,
+  "core_metric": 0.0774704140744213,
+  "centered_results": {
+    "hellaswag_zeroshot": 0.04321845372517904,
+    "jeopardy": 0.0004723665479104966,
+    "bigbench_qa_wikidata": 0.057133015245199203,
+    "arc_easy": 0.09876541296641032,
+    "arc_challenge": -0.03868033488591512,
+    "copa": 0.059999942779541016,
+    "commonsense_qa": 0.12878789007663724,
+    "piqa": 0.10337316989898682,
+    "openbook_qa": -0.005333324273427327,
+    "lambada_openai": 0.22084222733974457,
+    "hellaswag": 0.04215625921885172,
+    "winograd": 0.09157514572143555,
+    "winogrande": -0.008681952953338623,
+    "bigbench_dyck_languages": 0.11100000888109207,
+    "agi_eval_lsat_ar": 0.08152174204587935,
+    "bigbench_cs_algorithms": 0.38181817531585693,
+    "bigbench_operators": 0.10952381044626236,
+    "bigbench_repeat_copy_logic": 0.0,
+    "squad": 0.03405865654349327,
+    "coqa": 0.0860578715801239,
+    "boolq": -0.06872696625558952,
+    "bigbench_language_identification": 0.1754675396729355
+  },
+  "conditioned_samples": [
+    {
+      "prompt": "The capital of France is",
+      "text": "<|bos|>The capital of France is 10,000,000 francs, or 10,"
+    },
+    {
+      "prompt": "The chemical symbol of gold is",
+      "text": "<|bos|>The chemical symbol of gold is the same as the symbol of the sun, and the same as the symbol of"
+    },
+    {
+      "prompt": "If yesterday was Friday, then tomorrow will be",
+      "text": "<|bos|>If yesterday was Friday, then tomorrow will be Saturday. \n\nIf yesterday was Saturday, then tomorrow will be Sunday. \n\n"
+    },
+    {
+      "prompt": "The opposite of hot is",
+      "text": "<|bos|>The opposite of hot is a very common error, and is not a little remarkable. It is a very"
+    },
+    {
+      "prompt": "The planets of the solar system are:",
+      "text": "<|bos|>The planets of the solar system are: \n\n1. The sun, 2. The moon, 3. The"
+    },
+    {
+      "prompt": "My favorite color is",
+      "text": "<|bos|>My favorite color is a reddish brown, and the color of the skin is a redd"
+    },
+    {
+      "prompt": "If 5*x + 3 = 13, then x is",
+      "text": "<|bos|>If 5*x + 3 = 13, then x is the number of the square of the number of the square of the number of the"
+    }
+  ],
+  "unconditioned_samples": [
+    "<|bos|>asi that of her reputed father. There were in her last year or two here so many words of reproach, accusing all her priests, waiting on her travail of life, that they called her true wife therefore, and implored for forgiveness. There was one again who, after so many curses, murmured induced hope through advantages, confidence derived by human hopes, thus she bethought her of the tempted profligate, bethinking her what she was doing; and there was a third person who, in attempting to induce her to accept either the fall or the punishment of the false accuser, vindicated herself from the foul",
+    "<|bos|> Carrapal, the lips visible, and, unlike \n\nLeblanc, its lips sinuous, and\n\n Rod consumed them and, what is more, they are ashes of poisons, and, to shut out therefrom the \n\n6 18k of a retail price, every part of his body has an appletree within his bowels, which they are said to destroy; his heart acts fiery compositions. \n\nRABINS. A narrow process on a chemical tree. \n\n1\u00ba 1008. GOLD AND SILVER BENCH. \n\n1179. BLACK and red ink, one in dye of black or black t",
+    "<|bos|>ANA COMMISSIONER'S EXPRESS-POWER OF STUDIES \n\nWants not to be shown in museum rulings without such warrant, as where a survey is not admissible as error to show the boundary of a\n\nKANSAS HISTORY \n\nKENTUCKY OPINIONS OR DOCUMENTS 23 \n\nREPORTS \n\nCOMPL \n\nJOHNSTON \n\nJOHNSON \n\nMORE \n\nJOHN GREEN \n\nST. LOUIS \n\nJOHNSTON \n\nTRAPP \n\nLOVE \n\nLOUISE LOAKE \n\n ANDORE \n\nChastity de- with was reported by the Superintendent of Education opinion that Washington was the nearest approximation Vincennes, the wisdom merchandise to do the actual route to to coalfields is",
+    "<|bos|> wield hard 160,6 G.C.M \n\n3.1\n\n10439 An Introduction \n\nFind a good Equinoxa (S.P.M.C.C.) \n\nFind a good\n\nEquinoxa \n\nNa (S.P.M.C.C.) \n\nAnt oc \"Soft may the light serene \n\nCome through to us that liveth \n\nSweet air of heaven, and while flutes \n\nBurn on the Sabbaths that thy soul \n\nBlows with unspeakable bliss\" (S.P.C.) Fra\n\n\u0399\u0399 Chant chosen rather than a plowbox) \n\n11 be the good gentle wind",
+    "<|bos|> Lac they are still four small animals which deserve to be treated as tame things.' \n\nFor making them wild I have also made in three mounds the beating of large pipes, a process in which Paul Ursula is interribted with a small fsel, or rather escape of the mauds: will,' says Augustine, 'only \n\n1 Hist. Ancient Cities, iii, 4.\n\nWAORIES IN BAB LANGUAGES \n\nmuch trouble.' For the range and torridity of the Mediterranean they which chiefly merit attention are these: (I.) the solitary growth of the baize trees thrown out by the Tartars from Aujib",
+    "<|bos|>PLmillan, 1,433), and p. 758. Ay, now tell me, but let him tell thee v.: III.\n\nI must apply it to touch the where he has desired to see it. It need hardly be said, that in the nursery, Diogenes seeing the anachronymus hesitates: or, in the pining out of Franklin's poisoned spider, passage \u00e4n his retort to the school-house, was saying: \"I cannot shave better than I saved from drowning, and knocked out again from living ten years, and rained down curds",
+    "<|bos|>1749.11 \n\n17434721S+ Vpels during 1749), and again at the end of the year 7. 9 1\n\n2044 020 035 844 \n\nStowe, 91",
+    "<|bos|> PEOPLE MEET OTHERS IN THEIT\u00c9 OF A GREAT BUNTER HILL \n\nTHE \n\nTHE READERS THAT FORTUNATELY MEET\n\nTWO OCCURRENCES NEAR THE TROAD NICOLO JAM THE BRITISH \n\nThe well-known type of New England ferry-boat presented to Captain John Chapman Wilson some years ago has been very generally appreciated (or ignored) and a current of eighty yards was paid down by Professor\n\nCleghorn as 54 cents. This was his generous way of paying anything to a schoolmate under any circumstances. When Capt. John Chapman first tried to reach the shore of St. Laurent in Camp Bellingham, he did not"
+  ],
+  "training_time_seconds": 11197.636986970901,
+  "stage_training_flops": 1.9533980655157248e+18,
+  "inherited_parent_flops": 0.0,
+  "cumulative_pipeline_training_flops": 1.9533980655157248e+18,
+  "config_fingerprint": "60b9890a3df95e25",
+  "git_commit_sha": "0ea306100c54d5e0950d28c092ec5291ee71c247",
+  "wandb_url": "https://wandb.ai/jbduran-thinkingmachinesncsu/think.nano/runs/4b198ee6",
+  "huggingface_url": "https://huggingface.co/jbduran/think.nano/tree/main/experiments/think-d12-r20-alt44",
+  "dataset_fingerprint": "147853d67cb3de71",
+  "tokenizer_fingerprint": "3dc1a109161e9100",
+  "unique_train_tokens": 2268069888,
+  "effective_epochs": 0.970873786407767
+}