|
|
--- |
|
|
license: mit |
|
|
datasets: |
|
|
- TerenceLau/sparrow |
|
|
language: |
|
|
- ar |
|
|
- fr |
|
|
- es |
|
|
- en |
|
|
- zh |
|
|
- ru |
|
|
--- |
|
|
|
|
|
<div align="center"> |
|
|
<h1>Sparrow</h1> |
|
|
|
|
|
麻雀虽小 五脏俱全 |
|
|
|
|
|
Small as it is, the sparrow has all the vital organs |
|
|
|
|
|
<image src="https://raw.githubusercontent.com/TerenceLiu98/sparrow/master/.github/sparrow.png" width="300" /> |
|
|
</div> |
|
|
|
|
|
For more detail pleace check: [Sparrow](https://github.com/TerenceLiu98/sparrow) |
|
|
|
|
|
To run the model, first download the code from huggingface: |
|
|
|
|
|
```bash |
|
|
git clone https://huggingface.co/TerenceLau/sparrow && cd ./sparrow/ |
|
|
``` |
|
|
|
|
|
then, you can register the `SparrowConfig` and `SparrowModel` to `AutoConfig` and `AutoModelForCausalLM`: |
|
|
```python |
|
|
from modelling_sparrow import SparrowModelForCausalLM, SparrowConfig |
|
|
from transformers import AutoConfig, AutoModelForCausalLM, AutoTokenizer |
|
|
AutoConfig.register("sparrow", SparrowConfig) |
|
|
AutoModelForCausalLM.register(SparrowConfig, SparrowModelForCausalLM) |
|
|
model = AutoModelForCausalLM.from_pretrained("TerenceLau/sparrow") |
|
|
``` |
