KeisukeMiyamoto
/

lambda-1-360m-it

Text Generation

instruction-tuned

supervised-fine-tuning

grouped-query-attention

rotary-position-embedding

Model card Files Files and versions

KeisukeMiyamoto commited on 5 days ago

Commit

f643652

·

verified ·

1 Parent(s): 832cdb9

Remove training step count

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -49,7 +49,7 @@ All training code is publicly available at [KeisukeMiyamoto1324/lambda](https://
 The base model was pretrained on [`KeisukeMiyamoto/lambda-corpus`](https://huggingface.co/datasets/KeisukeMiyamoto/lambda-corpus) and further pretrained on [`KeisukeMiyamoto/SyntheticTextbook-jp`](https://huggingface.co/datasets/KeisukeMiyamoto/SyntheticTextbook-jp).
-This model was then supervised fine-tuned on [`KeisukeMiyamoto/SyntheticTalk-jp`](https://huggingface.co/datasets/KeisukeMiyamoto/SyntheticTalk-jp) for 5,000 steps.
 ## Usage

 The base model was pretrained on [`KeisukeMiyamoto/lambda-corpus`](https://huggingface.co/datasets/KeisukeMiyamoto/lambda-corpus) and further pretrained on [`KeisukeMiyamoto/SyntheticTextbook-jp`](https://huggingface.co/datasets/KeisukeMiyamoto/SyntheticTextbook-jp).
+This model was then supervised fine-tuned on [`KeisukeMiyamoto/SyntheticTalk-jp`](https://huggingface.co/datasets/KeisukeMiyamoto/SyntheticTalk-jp).
 ## Usage