Update README.md

README.md

@@ -96,11 +96,11 @@ Use the code below to get started with the model.
 
 #### Training Hyperparameters
 
-- **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
+- **Training regime:** bf16 non-mixed precision, used own version of Muon with lr from 5e-3 to 1e-3. <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
 
 #### Speeds, Sizes, Times [optional]
 
-<!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
+Throughput = infinite
 
 [More Information Needed]
 
@@ -130,7 +130,8 @@ Use the code below to get started with the model.
 
 ### Results
 
-[More Information Needed]
+Bits-per-byte: ~1
+HellaSwag Accuracy: 33.4% (removed Wikihow entries)
 
 #### Summary