---
license: mit
datasets:
- TerenceLau/sparrow
language:
- ar
- fr
- es
- en
- zh
- ru
---

<div align="center">
<h1>Sparrow</h1>

麻雀虽小 五脏俱全

 Small as it is, the sparrow has all the vital organs

<image src="https://raw.githubusercontent.com/TerenceLiu98/sparrow/master/.github/sparrow.png" width="300" />
</div>

For more detail pleace check: [Sparrow](https://github.com/TerenceLiu98/sparrow)

To run the model, first download the code from huggingface: 

```bash
git clone https://huggingface.co/TerenceLau/sparrow && cd ./sparrow/
```

then, you can register the `SparrowConfig` and `SparrowModel` to `AutoConfig` and `AutoModelForCausalLM`:
```python
from modelling_sparrow import SparrowModelForCausalLM, SparrowConfig
from transformers import AutoConfig, AutoModelForCausalLM, AutoTokenizer
AutoConfig.register("sparrow", SparrowConfig)
AutoModelForCausalLM.register(SparrowConfig, SparrowModelForCausalLM)
model = AutoModelForCausalLM.from_pretrained("TerenceLau/sparrow")
```