LH-Tech-AI commited on
Commit
b8b1ac5
·
verified ·
1 Parent(s): a5f05f9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -17,7 +17,7 @@ tags:
17
  - 1m
18
  ---
19
 
20
- # Quark-0.5M
21
 
22
  **Quark-0.5M** is an ultra-lightweight Llama-based model with only **465,504 parameters**.
23
  It was trained from scratch to demonstrate the power of high-quality data (FineWeb-Edu) on extremely small architectures.
@@ -39,7 +39,7 @@ It was trained from scratch to demonstrate the power of high-quality data (FineW
39
  - **Optimizer:** AdamW with Cosine Learning Rate Decay
40
 
41
  ## Intended Use
42
- Quark is a research project to explore the limits of "Micro-LLMs". It is surprisingly capable of forming grammatically correct English sentences and structured lists, despite fitting into less than 1MB of disk space.
43
 
44
  ## Performance Example
45
  > **Prompt:** "Artificial intelligence is "
 
17
  - 1m
18
  ---
19
 
20
+ # 🔬 Quark-0.5M
21
 
22
  **Quark-0.5M** is an ultra-lightweight Llama-based model with only **465,504 parameters**.
23
  It was trained from scratch to demonstrate the power of high-quality data (FineWeb-Edu) on extremely small architectures.
 
39
  - **Optimizer:** AdamW with Cosine Learning Rate Decay
40
 
41
  ## Intended Use
42
+ Quark is a research project to explore the limits of "Micro-LLMs". It is surprisingly capable of forming grammatically correct English sentences and structured lists, despite fitting into less than 2MB of disk space.
43
 
44
  ## Performance Example
45
  > **Prompt:** "Artificial intelligence is "