7B AWQ
Collection
These models are selected for their compatibility with small 12GB memory GPUs. • 203 items • Updated • 2
bophades-v2-mistral-7B finetuned on kyujinpy/orca_math_dpo.
Finetuned using an A100 on Google Colab. 🙏
Fine-tune a Mistral-7b model with Direct Preference Optimization - Maxime Labonne
Base model
nbeerbower/bophades-v2-mistral-7B