File size: 335 Bytes
246db29
 
 
 
 
 
 
 
 
 
8ebf499
246db29
8ebf499
246db29
 
 
 
8ebf499
 
246db29
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
---
license: openrail
datasets:
- JeanKaddour/minipile
- Open-Orca/OpenOrca
language:
- en
---
Micro Mistral

A small version of mistral.

Similiar to some of the small llama variants, but uses GQA, tied embeddings, and sliding window attention.

Dataset
Minipile Instruct Math OpenOrca Synthetic Data



TODO: Complete Dataset section