Update README.md

README.md

@@ -16,6 +16,6 @@ The code to run this custom model can be found [here](https://github.com/tdooms/
 - model dimension 1024
 - bilinear MLP with expansion factor 4
 - context length of 512
-- trained for 132B tokens
+- trained for 32B tokens
 - rotary positional embedding
 - Mixtral [tokenizer](https://huggingface.co/mistral-community/Mixtral-8x22B-v0.1)