Upload evals for clean1930s-d12-r11.25-ctx4096-full-fulltok-ablation-v1

experiments/clean1930s-d12-r11.25-ctx4096-full-fulltok-ablation-v1/evals/samples.json

@@ -0,0 +1,48 @@
+{
+  "model": "base_model (step 2362)",
+  "step": 2362,
+  "bpb": {},
+  "core_metric": null,
+  "core_results": null,
+  "centered_results": null,
+  "conditioned_samples": [
+    {
+      "prompt": "The capital of France is",
+      "text": "<|bos|>The capital of France is the capital of the kingdom of France. The capital of the kingdom of France is"
+    },
+    {
+      "prompt": "The chemical symbol of gold is",
+      "text": "<|bos|>The chemical symbol of gold is the same as that of the sun, and the same as that of the sun"
+    },
+    {
+      "prompt": "If yesterday was Friday, then tomorrow will be",
+      "text": "<|bos|>If yesterday was Friday, then tomorrow will be Saturday. I have been in the habit of going to the house of Mr."
+    },
+    {
+      "prompt": "The opposite of hot is",
+      "text": "<|bos|>The opposite of hot is the same as the opposite of cold. The former is the same as the latter"
+    },
+    {
+      "prompt": "The planets of the solar system are:",
+      "text": "<|bos|>The planets of the solar system are: the sun, the moon, the stars, the planets, the sun, the"
+    },
+    {
+      "prompt": "My favorite color is",
+      "text": "<|bos|>My favorite color is a dark, dark, and dark color, and I have no doubt that the"
+    },
+    {
+      "prompt": "If 5*x + 3 = 13, then x is",
+      "text": "<|bos|>If 5*x + 3 = 13, then x is the number of the parts of the body which are in the body, and the"
+    }
+  ],
+  "unconditioned_samples": [
+    "<|bos|>PREFACE.\n\nTHIS essay was contributed to the \"Introduction to English Literature,\" by the celebrated Mr. A. H.\n\nSmithfield Windle, the author of the Life of Windle, LL.D.\n\nTerritorial Entry Book in Faneuil Hall, Norwich.\n\nBeing a compilation from the Journals of the company which Dunning called the \"Baldive,\" or Committee of the House of Commons, held at a time when the woollen manufacture of New England was taking its full advantage to wear more favourable conditions, it is now very little altered from what it really is.\n\nIn order to have the best assortment of text-books for",
+    "<|bos|> members were privileged, not asinders, but as guests. Various expressions, for which privileges and responsions would be legal, were freely, but imperfectly disposed of at the time of their introduction, and, so far as it was possible, nothing could serve them except the courtesy of those friendly, courteous, and communicative powers. These statements, we are glad to infer, were understood and appro- 172. priated by friendship. Some leaders of great opinion, such as Joseph Brawns, Van\n\nJoseph reviewers, and all the other leaders of the present war, confined their influence to the side of excluding those who",
+    "<|bos|>The vision of the man who is mighty to convert brute animals-a man also worthy of the unity which it reveals, wherein he leads a world that is new in its way-Military civilization has attained its unity. Story\n\nApril 10. The vision first revealed to the cison, William\n\nFemale Arnoy as a young warrior who had to find a place in another and more attractive world-a man who formed the purpose of the world of the future-he became first and chiefly interested in the progress of moral and spiritual emancipation which has since made it the aim and object of that great impulse in advance. Essay on the Form of",
+    "<|bos|>ESLIE'S CHIEFRY.\n\nXX\n\nION.\n\n12 CHANGE DEMOX.\n\nEVE\n\nFAGE OF OPENING THE NILE.\n\nN RATTENOORKS\n\nJEREMIAH PARKER.\n\nNABIKIE BONDLEY.\n\nRAPP SOUTH RADER.\n\nTHE ROCK DAY.\n\nDYCE HIS HOUSE ON A WELL.\n\nPRICES.\n\nPALSTATE OF A CONVERT HOME.\n\nREOTHING\n\nTRANSFORT.\n\nSUPERSET SOUTH AMERICA.\n\n[LIST.]\n\nStraight SPEECH OF CHARLES A. Thacher.\n\nE DELHAND.-THE ROOTS - MEDALS",
+    "<|bos|>CHAPTER II.\n\nTHE TIDE OF MOUNTAIN PUNISHMENT.\n\nTHE gold has risen by slow stages, but averaged by a slow process. Then it was that the sea, with its red currents running through it, rushed in and pursued its great voyage; and the whole country in full wonder at our eagerness soon seemed to vanish, of the torrents of blood rushing in, on either side, like liquid salt streams [430] ready to overflow. And at last this mixture of wind and tide came into use [441] much as in the ancient days of that ancient city the sea called Adria\n\nCONCLUDED",
+    "<|bos|>PREFACE\n\nand PERS. likewise. But pictures and pictures of the passions pass into the hands of the beholder after they are painted: at first, but not before, it is the furthest stage of thoughts-catching always that pursuit the quiet enjoyment, and the most immediate order, of nature.\n\nA people so polished that they cannot look at people without perceiving much vanity and often whimsicality, an expression of fine sense, a thousand ways excelling the common language of the middle ages, and that modes of thought are the most subtle, rare, and beautiful that could have been devised.\n\nAnd, lastly, the feelings when painted are",
+    "<|bos|>Clatim. Sultan\n\nLocker v. Manchester, &c., Co., 34 Fed. 222.\n\n125a. \u00fc 180 a; 3.5 P.\n\n180 a; 7.8 P. b. 181 a; 8.79 P. b. 182; 9.2 P. b. 185a; 10.4 P. b. 187q.\n\n184 a; 11.6 P. b. 187 b; 12.5 P. b. 185 b.\n\n18",
+    "<|bos|>Lestr Menderella and Victoria.\" \"You know that that parent of ours the conductor was not forgotten in this place.\" \"For many days large numbers of People were detained at Passes.\" \"About four people intervened, chiefly middle-sized disreputable boys, unaccus-\n\ntimed with that kind of respectability which Blot had never reached but in those days when life was so unsatisfactory.\" \"Do you remember having acted as conductor?\" \"I remember easily enough.\" \"Well, I know about very many people.\" \"6 \"Ah, is it true that Representatives are allowed to become securities for themselves?\"\n\nMass. \"Disability"
+  ]
+}

experiments/clean1930s-d12-r11.25-ctx4096-full-fulltok-ablation-v1/evals/val_bpb.json

@@ -0,0 +1,12 @@
+{
+  "model": "base_model (step 2362)",
+  "step": 2362,
+  "bpb": {
+    "val": 1.0353479590828456
+  },
+  "core_metric": null,
+  "core_results": null,
+  "centered_results": null,
+  "conditioned_samples": [],
+  "unconditioned_samples": []
+}