Upload inference/inference_step14074174_2026-03-16T20-55-52Z.md with huggingface_hub

inference/inference_step14074174_2026-03-16T20-55-52Z.md

@@ -0,0 +1,46 @@
+# Inference Report — step14074174 (36.7% of 35B tokens)
+**Date:** 2026-03-16T20:55:40Z
+**Checkpoint:** pretrain_step14074174.pt
+**Tokens:** ~12.86B / 35B (36.7%)
+**Device:** CPU (GPU reserved for training)
+
+## AR Inference (3 tests)
+
+### AR 1: "The physics of aurora borealis involves charged particles from"
+> ThephysicsofauroraborealisinvolveschargedparticlesfromtheChancelleryorParamount+,butnotingthatnumberofchildsareindicatedtoanumberofdisorders.FrontwasntabletocausePalestineasastateforchildrenandhaveaprominentrisk,includingtheoppositeofPalestinianidentity.Aspartoftheirunlawfulpresenceintheireligibility,thegovernmentisworkingcloselyintoPalestine
+
+### AR 2: "Archimedes discovered the principle of buoyancy when he"
+> ArchimedesdiscoveredtheprincipleofbuoyancywhenhewasgIventheunpopularsingerandtiredofherclassicalartistactress.ThesongwasspecificallyreleasedbyAllysonandWillieNelson,whowasalso"inabooktochampionvictoryoverthetimeoftheshow."BenHarper,whoco-foundedRealMadridandblendingattheChampionsLeaguematcheofB
+
+### AR 3: "The process of nitrogen fixation by bacteria converts atmospheric"
+> Theprocessofnitrogenfixationbybacteriaconvertsatmosphericchemicalvehicles.Cidapitesareferventoutovereconomicgrowth,withsomefurtherdiscussingthepotentialclimatecrisisandeconomicchallenges.Inadditiontoitspotentialimpactonpublicsafety,seeconomiceffortthroughfinancialstability,weaskforcertainpersonalinfluenceandindustrialcomplexspeech
+
+**AR Assessment:** No spaces between tokens. Severe topic drift — prompts about physics/science generate political/entertainment gibberish. Same pattern as previous checkpoints at 36.7%.
+
+## SAT Fixed Inference (2 tests)
+
+### SAT Fixed 1: "how the human respiratory system exchanges oxygen and carbon dioxide"
+> howthehumanrespiratorysystemexchangesoxygenandcarbondioxidebO:MeesTberconsueniatheatedtheannthethetheSausasswith,thetheof4the'sfromtheemtenhatby);inFlywe/),imeonelichtheam,"astàhietheimerapp1oussreegVorero,butidigershzindsteaufYDaverew25werSch
+
+### SAT Fixed 2: "the mechanics of how suspension bridges distribute weight and tension"
+> themechanicsofhowsuspensionbridgesdistributeweightandtensiondelfromTrumpated.FJTusziretheitwhtheSicieocicfercoass.C,esetengonweiceligcomSescofincicconordindiededeenns3ienchverereicoerNdemndepar);antire,"ementethduubässil.SLenderonsicC.re?WThemore
+
+**SAT Fixed Assessment:** Still garbled subword fragments at 36.7%. No coherent output.
+
+## SAT Variable Inference (2 tests)
+
+### SAT Var 1: "the invention of penicillin and its impact on modern medicine"
+> theinventionofpenicillinanditsimpactonmodernmedicineinter:byMeesundatedecTOwJ).DferF.FathteríiereTheSabLzéNInil,derap1ichtsene6del.ichegour?Vresñoutururl,dasiedàigèforherareverortweleansssC20SeSt.LhstergFacebookheineisin
+
+### SAT Var 2: "how the Doppler effect explains the redshift of distant galaxies"
+> howtheDopplereffectexplainstheredshiftofdistantgalaxiesusundOes:thethethethethethetheandSfromitsFo4thethewithore,thetheierCthewebyerof,"'shappareouagela/onlyonTingubimdelrowasemlysistaysinfthe.ieerniaulaind,butigerVe);ichinquSchforDPaufattL
+
+**SAT Variable Assessment:** Still garbled subword fragments. Same status as previous checkpoint.
+
+## Summary
+- Training: RUNNING at 96% GPU, 63C, ~25.6k tok/s
+- Progress: 36.7% (12.86B/35B tokens)
+- AR: generates text without spaces, severe topic drift from prompt topic
+- SAT fixed: garbled subword fragments
+- SAT var: garbled subword fragments
+- No meaningful improvement over previous checkpoint observations