File size: 335 Bytes
246db29 8ebf499 246db29 8ebf499 246db29 8ebf499 246db29 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 |
---
license: openrail
datasets:
- JeanKaddour/minipile
- Open-Orca/OpenOrca
language:
- en
---
Micro Mistral
A small version of mistral.
Similiar to some of the small llama variants, but uses GQA, tied embeddings, and sliding window attention.
Dataset
Minipile Instruct Math OpenOrca Synthetic Data
TODO: Complete Dataset section |