yrhong/diat-adapters-index

DIAT LoRA Adapters Index (Qwen3-8B, Llama-3.1-8B-Instruct)

This repository is an index for LoRA adapters used in our DIAT models.

Base Models

• Qwen/Qwen3-8B
• meta-llama/Llama-3.1-8B-Instruct

Qwen3-8B Adapters

SFT

• seed 42: https://huggingface.co/yrhong/qwen3-8b-sft-seed42
• seed 43: https://huggingface.co/yrhong/qwen3-8b-sft-seed43
• seed 44: https://huggingface.co/yrhong/qwen3-8b-sft-seed44

DIAT

• seed 42: https://huggingface.co/yrhong/qwen3-8b-diat-seed42
• seed 43: https://huggingface.co/yrhong/qwen3-8b-diat-seed43
• seed 44: https://huggingface.co/yrhong/qwen3-8b-diat-seed44

Llama-3.1-8B-Instruct Adapters

SFT

• seed 42: https://huggingface.co/yrhong/llama-3.1-8b-instruct-sft-seed42
• seed 43: https://huggingface.co/yrhong/llama-3.1-8b-instruct-sft-seed43
• seed 44: https://huggingface.co/yrhong/llama-3.1-8b-instruct-sft-seed44

DIAT

• seed 42: https://huggingface.co/yrhong/llama-3.1-8b-instruct-diat-seed42
• seed 43: https://huggingface.co/yrhong/llama-3.1-8b-instruct-diat-seed43
• seed 44: https://huggingface.co/yrhong/llama-3.1-8b-instruct-diat-seed44

Programmatic Mapping

See adapters.json in this repository.

Usage (PEFT)

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_model = "Qwen/Qwen3-8B"
adapter_repo = "yrhong/qwen3-8b-diat-seed42"

model = AutoModelForCausalLM.from_pretrained(base_model, torch_dtype="auto", device_map="auto")
model = PeftModel.from_pretrained(model, adapter_repo)
tokenizer = AutoTokenizer.from_pretrained(base_model)