Update README.md

README.md

@@ -11,6 +11,21 @@ datasets:
 # phi 3 4x4b
 a continually pretrained phi3-mini sparse moe upcycle
 
+## benchmarks
+### ran locally
+
+|                         | Microsoft/phi-3-4k-instruct | Fizzarolli/phi3-4x4b-v1 |
+| ----------------------- | --------------------------- | ----------------------- |
+| MMLU acc. (0-shot)      | **0.6799**                  | 0.6781                  |
+| Hellaswag acc. (0-shot) | **0.6053**                  | 0.5962                  |
+| ARC-E acc. (0-shot)     | 0.8325                      | **0.8367**              |
+| ARC-C acc. (0-shot)     | 0.5546                      | **0.5606**              |
+
+honestly i was expecting it to do worse :p, but those are all within a margin of error! so it didn't *lose* any performance, at least
+
+### open llm leaderboard
+todo!
+
 ## support me on ko-fi!
 [~~please i need money to stay alive and keep making models~~](https://ko-fi.com/fizzai)