Update README.md

README.md

@@ -37,16 +37,24 @@ In addition, Doge uses Dynamic Mask Attention as sequence transformation and can
 > TODO: The larger model is under training and will be uploaded soon.
 
 **Training**:
+
 | Model | Training Data | Steps | Content Length | Tokens | LR | Batch Size | Precision |
 |---|---|---|---|---|---|---|---|
-| [Doge-20M](https://huggingface.co/JingzeShi/Doge-20M) | [HuggingFaceTB/smollm-corpus](https://huggingface.co/datasets/HuggingFaceTB/smollm-corpus) | 8k  | 2048 | 5B | 8e-4 | 0.5M | bfloat16 |
+| [Doge-20M](https://huggingface.co/JingzeShi/Doge-20M) | [HuggingFaceTB/smollm-corpus](https://huggingface.co/datasets/HuggingFaceTB/smollm-corpus) | 8k  | 2048 | 4B | 8e-3 | 0.5M | bfloat16 |
 
 **Evaluation**:
-| Model | TriviaQA | MMLU | ARC-E | ARC-C | PIQA | HellaSwag | OBQA | Winogrande |
+
+| Model | MMLU | TriviaQA | ARC-E | ARC-C | PIQA | HellaSwag | OBQA | Winogrande |
 |---|---|---|---|---|---|---|---|---|
-| [Doge-20M](https://huggingface.co/JingzeShi/Doge-20M) | 0 | 25.04 | 38.38 | 22.95 | 56.64 | 26.97 | 25.40 | 51.54 |
+| [Doge-20M](https://huggingface.co/JingzeShi/Doge-20M) | 25.43 | 0 | 36.83 | 22.53 | 58.38 | 27.25 | 25.60 | 50.20 |
+
+**Procedure**:
+
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/loser_cheems/huggingface/runs/p8x93v5l) 
+
 
 **Environment**:
+
 - Image: nvcr.io/nvidia/pytorch:24.12-py3
 - Hardware: 1x NVIDIA RTX 4090
 - Software: Transformers