|
|
--- |
|
|
library_name: peft |
|
|
base_model: unsloth/codellama-34b-bnb-4bit |
|
|
--- |
|
|
|
|
|
# Model Card for Model ID |
|
|
|
|
|
Unsloth base model Code Llama2 34b (https://huggingface.co/unsloth/codellama-34b-bnb-4bit) |
|
|
trained on Alpaca Dataset. |
|
|
|
|
|
This is a repository for another 34B instruct-tuned version. |
|
|
|
|
|
|
|
|
``` |
|
|
|
|
|
|
|
|
Tue Apr 30 18:21:29 2024 |
|
|
+---------------------------------------------------------------------------------------+ |
|
|
| NVIDIA-SMI 535.129.03 Driver Version: 535.129.03 CUDA Version: 12.2 | |
|
|
|-----------------------------------------+----------------------+----------------------+ |
|
|
| GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | |
|
|
| Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | |
|
|
| | | MIG M. | |
|
|
|=========================================+======================+======================| |
|
|
| 0 NVIDIA A100-SXM4-40GB On | 00000000:07:00.0 Off | 0 | |
|
|
| N/A 75C P0 389W / 400W | 20959MiB / 40960MiB | 100% Default | |
|
|
| | | Disabled | |
|
|
+-----------------------------------------+----------------------+----------------------+ |
|
|
|
|
|
+---------------------------------------------------------------------------------------+ |
|
|
| Processes: | |
|
|
| GPU GI CI PID Type Process name GPU Memory | |
|
|
| ID ID Usage | |
|
|
|=======================================================================================| |
|
|
| 0 N/A N/A 9175 C python 20938MiB | |
|
|
+---------------------------------------------------------------------------------------+ |
|
|
|
|
|
|
|
|
``` |
|
|
|
|
|
|
|
|
|
|
|
### Framework versions |
|
|
|
|
|
- Unsloth |
|
|
- Torch |
|
|
- PEFT 0.10.0 |
