mzbac commited on
Commit
e602790
·
verified ·
1 Parent(s): 45194e5

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -3,7 +3,7 @@ license: mit
3
  language:
4
  - en
5
  ---
6
- A Moe model built on top of microsoft/phi-2, g-ronimo/phi-2-OpenHermes-2.5 and mlx-community/phi-2-dpo-7k, then qlora on WizardLM_evol_instruct_70k
7
 
8
 
9
  ## Example
 
3
  language:
4
  - en
5
  ---
6
+ A Moe model built on top of microsoft/phi-2, g-ronimo/phi-2-OpenHermes-2.5 and mlx-community/phi-2-dpo-7k, random init gates weights
7
 
8
 
9
  ## Example