model: add SFT adapter adapter_model.safetensors

model: add SFT adapter adapter_config.json

model: add DPO adapter vocab.json

model: add DPO adapter tokenizer_config.json

model: add DPO adapter tokenizer.json

model: add DPO adapter special_tokens_map.json

model: add DPO adapter merges.txt

model: add DPO adapter chat_template.jinja

model: add DPO adapter added_tokens.json

model: add DPO adapter adapter_model.safetensors

model: add DPO adapter adapter_config.json

docs: add comprehensive model card with load/call/host instructions

initial commit