Update README.md

README.md

@@ -7,13 +7,14 @@ language:
 - en
 ---
 Micro Mistral
-This is a small mistral model with 6 layers
 
-This architecture takes GQA and tied embeddings to create an effeceint 0.5B model that uses the mistral architecture(It is supported in downstream applications).
+A small version of mistral.
 
-Uses GQA, tied embeddings, and sliding window attention.
+Similiar to some of the small llama variants, but uses GQA, tied embeddings, and sliding window attention.
 
 Dataset
 Minipile Instruct Math OpenOrca Synthetic Data
 
+
+
 TODO: Complete Dataset section