README.md

# yujiepan/starcoder-tiny-random

This model is **randomly initialized**, using the config from [bigcode/starcoderbase-7b](https://huggingface.co/bigcode/starcoderbase-7b/tree/main) but with the following modifications:

```json
{
  "n_embd": 32,
  "n_head": 8,
  "n_inner": 128,
  "n_layer": 1,
}
```