Aispace2001 commited on
Commit
a876969
·
verified ·
1 Parent(s): cc8b7b2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -1
README.md CHANGED
@@ -142,7 +142,8 @@ We would like to thank the dataset providers and the open-source community whose
142
  - **CAIS** for the **MMLU** dataset used for auxiliary knowledge and reasoning supervision.
143
  - **HuggingFaceTB** for the **OpenHermes-2.5-H4** dataset used in the final instruction refinement phase.
144
  - **Weights & Biases (W&B)** for logging and visualization tools used to monitor training progress.
145
-
 
146
 
147
  We also acknowledge the broader open-source research community for their continuous efforts in advancing efficient model architectures and training methodologies.
148
 
 
142
  - **CAIS** for the **MMLU** dataset used for auxiliary knowledge and reasoning supervision.
143
  - **HuggingFaceTB** for the **OpenHermes-2.5-H4** dataset used in the final instruction refinement phase.
144
  - **Weights & Biases (W&B)** for logging and visualization tools used to monitor training progress.
145
+ - Additionally, we drew valuable insights from **The Smol Training Playbook: The Secrets to Building World-Class LLMs**, published by Hugging Face, which informed several practical decisions in our training and experimentation workflow.
146
+ Playbook link: https://huggingfacetb-smol-training-playbook.hf.space/the-smol-training-playbook-the-secrets-to-building-world-class-llms.pdf
147
 
148
  We also acknowledge the broader open-source research community for their continuous efforts in advancing efficient model architectures and training methodologies.
149