# HackerNet v1 — Training Notes

- **Avg Loss**: 0.0000
- **Datasets**: OpenAssistant/oasst_top1_2023-08-25, ai4bharat/indic-instruct-data-v0.1, HydraLM/hindi_multiturn_conversations, uonlp/CulturaX, HydraLM/hinglish_multiturn_conversations, festvox/cmu_indic, HuggingFaceH4/ultrachat_200k, teknium/OpenHermes-2.5
- **Layers**: 16
- **Hidden Dim**: 768
- **MoE Experts**: 4
- **Precision**: float16
- **Epochs**: 4