Add model card

README.md

@@ -0,0 +1,57 @@
+---
+language:
+- ja
+library_name: transformers
+tags:
+- lambda
+- causal-lm
+- custom-code
+- pytorch
+pipeline_tag: text-generation
+---
+
+# lambda-1-360m-base
+
+lambda-1-360m-base is an experimental Japanese language model created with a custom decoder-only Transformer implementation.
+
+All training code is publicly available at [KeisukeMiyamoto1324/lambda](https://github.com/KeisukeMiyamoto1324/lambda).
+
+## Model Details
+
+| Item | Value |
+|---|---:|
+| Parameters | 359.9M |
+| Architecture | Decoder-only Transformer |
+| Context length | 1,024 tokens |
+| Tokenizer | Byte-level BPE |
+| Vocabulary size | 65,536 |
+| Layers | 32 |
+| Hidden size | 960 |
+| Attention heads | 15 |
+| Key-value heads | 5 |
+| FFN size | 4,096 |
+
+## Training Data
+
+The model was pretrained on the Japanese text corpus [`KeisukeMiyamoto/lambda-corpus`](https://huggingface.co/datasets/KeisukeMiyamoto/lambda-corpus).
+
+## Usage
+
+```bash
+git clone https://github.com/KeisukeMiyamoto1324/lambda.git
+cd lambda
+python3 -m venv venv
+source venv/bin/activate
+pip3 install -r requirements.txt
+
+python3 src/inference_base/inference_hf.py \
+  --model-dir "KeisukeMiyamoto/lambda-1-360m-base" \
+  --prompt "人工知能とは" \
+  --max-new-tokens 64
+```
+
+## Limitations
+
+This model is not instruction-tuned or safety-aligned. It may generate incorrect, biased, unsafe, or low-quality text.
+
+The model was trained primarily on Japanese text and has not been evaluated on standard benchmarks.