Update README.md

README.md

@@ -7,7 +7,7 @@ datasets:
 
 OLMo-Bitnet-1B is a 1B parameter model trained using the method described in [The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits](https://arxiv.org/abs/2402.17764).
 
-It was trained on a 60B subset of the [Dolma](https://huggingface.co/datasets/allenai/dolma) dataset, so it is merely a research proof-of-concept to test out the methodolgy.
+It was trained on the first 60B tokens of the [Dolma](https://huggingface.co/datasets/allenai/dolma) dataset, so it is merely a research proof-of-concept to test out the methodolgy.
 
 A separate training run was run with the exact same hyperparameters, but using standard fp16 weights.
 The comparison can be found in [this wandb report](https://api.wandb.ai/links/emozilla/evltqiv7).