| # yujiepan/starcoder-tiny-random | |
| This model is **randomly initialized**, using the config from [bigcode/starcoderbase-7b](https://huggingface.co/bigcode/starcoderbase-7b/tree/main) but with the following modifications: | |
| ```json | |
| { | |
| "n_embd": 32, | |
| "n_head": 8, | |
| "n_inner": 128, | |
| "n_layer": 1, | |
| } | |
| ``` |