Llama3 8B LLM SFT+DPO and quantized LLM. Finetuned on EPFL tech courses and more (stack overflow books ...).