Add model card

README.md

@@ -0,0 +1,59 @@
+---
+language:
+- ja
+library_name: transformers
+tags:
+- lambda
+- causal-lm
+- custom-code
+- pytorch
+pipeline_tag: text-generation
+---
+
+# lambda-1-360m-mid
+
+lambda-1-360m-mid is an experimental Japanese language model based on [`lambda-1-360m-base`](https://huggingface.co/KeisukeMiyamoto/lambda-1-360m-base) and further pretrained on a synthetic Japanese textbook corpus.
+
+All training code is publicly available at [KeisukeMiyamoto1324/lambda](https://github.com/KeisukeMiyamoto1324/lambda).
+
+## Model Details
+
+| Item | Value |
+|---|---:|
+| Parameters | 359.9M |
+| Architecture | Decoder-only Transformer |
+| Context length | 1,024 tokens |
+| Tokenizer | Byte-level BPE |
+| Vocabulary size | 65,536 |
+| Layers | 32 |
+| Hidden size | 960 |
+| Attention heads | 15 |
+| Key-value heads | 5 |
+| FFN size | 4,096 |
+
+## Training Data
+
+The base model was pretrained on [`KeisukeMiyamoto/lambda-corpus`](https://huggingface.co/datasets/KeisukeMiyamoto/lambda-corpus).
+
+This model was then further pretrained on [`KeisukeMiyamoto/SyntheticTextbook-jp`](https://huggingface.co/datasets/KeisukeMiyamoto/SyntheticTextbook-jp) for 20,480 steps.
+
+## Usage
+
+```bash
+git clone https://github.com/KeisukeMiyamoto1324/lambda.git
+cd lambda
+python3 -m venv venv
+source venv/bin/activate
+pip3 install -r requirements.txt
+
+python3 src/inference_base/inference_hf.py \
+  --model-dir "KeisukeMiyamoto/lambda-1-360m-mid" \
+  --prompt "人工知能とは" \
+  --max-new-tokens 64
+```
+
+## Limitations
+
+This model is not instruction-tuned or safety-aligned. It may generate incorrect, biased, unsafe, or low-quality text.
+
+The model was trained primarily on Japanese text and has not been evaluated on standard benchmarks.