|
|
--- |
|
|
license: apache-2.0 |
|
|
--- |
|
|
# Finetuning llama 2 on our celebrity news dataset located [here](https://huggingface.co/datasets/2nji/makebelieve-480) |
|
|
|
|
|
Disclaimer: This is still work in progress as we need to preprocess our celebrity news dataset to match Llama 2's prompt format as described [here](https://huggingface.co/blog/llama2#how-to-prompt-llama-2) |
|
|
|
|
|
## Reserve GPU on g5k |
|
|
|
|
|
Log into your Grid5000 account using ssh and run the following code in the terminal |
|
|
|
|
|
```script |
|
|
oarsub -p "cluster='graffiti'" -l gpu=1 -I -q production |
|
|
``` |
|
|
|
|
|
Wait till GPUs are available and assigned to you, if you need more information about g5k, you can refer to [here](https://www.grid5000.fr/w/Getting_Started) |
|
|
|
|
|
### Create a virtual environment |
|
|
|
|
|
- Installing PIP |
|
|
|
|
|
```script |
|
|
pip install virtualenv |
|
|
``` |
|
|
|
|
|
- Creating environment |
|
|
|
|
|
```script |
|
|
virtualenv venv |
|
|
``` |
|
|
|
|
|
- Activating environment |
|
|
|
|
|
```script |
|
|
source venv/bin/activate |
|
|
``` |
|
|
|
|
|
## Install requirements file |
|
|
|
|
|
```script |
|
|
pip install -r requirements.txt |
|
|
``` |
|
|
|
|
|
## Running the script to finetune Llama-2-7b-chat-hf and push to huggingface model repository |
|
|
|
|
|
```script |
|
|
python makebelieve.py |
|
|
``` |
|
|
|
