MarxistLeninist commited on
Commit
5873fe4
·
verified ·
1 Parent(s): 5e5b8de

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -1 +1,3 @@
1
- AGI LLM experiments use a3 file to inference the ar and nat
 
 
 
1
+ AGI LLM experiments use a3 file to inference the ar and nat; trained on 100 million token with 120 epochs; while that follow kaplan law, it undertrained by chinilla standards
2
+ -----
3
+ The AGI-LLM experiments use an A3 file to run inference on AR and NAT. The model was trained on 100 million tokens over 120 epochs. While this complies with Kaplan’s scaling law, it is still under-trained by Chinchilla standards.