Quantization made by Richard Erkhov.
sbc_project_models_16bit - bnb 8bits
- Model creator: https://huggingface.co/jamesjazz/
- Original model: https://huggingface.co/jamesjazz/sbc_project_models_16bit/
Original model description:
base_model: unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit tags: - text-generation-inference - transformers - unsloth - llama - trl - dpo license: apache-2.0 language: - en
Uploaded model
- Developed by: jamesjazz
- License: apache-2.0
- Finetuned from model : unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.
