PriyanshiD
/

Llama-3.2-3B-bnb-4bit-python-DPO

Question Answering

Model card Files Files and versions

Uploaded model

Developed by: PriyanshiD
License: apache-2.0
Finetuned from model : unsloth/Llama-3.2-3B-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month: -; Downloads are not tracked for this model. How to track

Model tree for PriyanshiD/Llama-3.2-3B-bnb-4bit-python-DPO

Base model

meta-llama/Llama-3.2-3B

Quantized

unsloth/Llama-3.2-3B-bnb-4bit

Finetuned

(151)

this model

Dataset used to train PriyanshiD/Llama-3.2-3B-bnb-4bit-python-DPO