Qwen3-1.7B · MBT-R

MBT-R (main table) — final checkpoint (SFT → GRPO). Base: Qwen/Qwen3-1.7B. Paper: Metacognitive Behavioral Tuning of Large Language Models for Multi-Hop Question Answering.

  • Method: MBT-R (Refinement): the student's own reasoning traces are rewritten into the 5-phase structure for SFT, then GRPO.
  • Base model: Qwen/Qwen3-1.7B
  • Training: SFT (LR 1e-4, BS 128, HotpotQA) → GRPO
  • Benchmarks: HotpotQA (ID), MuSiQue / 2WikiMultiHopQA (OOD)

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "metacognitive-behavioral-tuning/Qwen3-1.7B-MBT-R"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, dtype="bfloat16", device_map="auto")
Downloads last month
280
Safetensors
Model size
2B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for metacognitive-behavioral-tuning/Qwen3-1.7B-MBT-R

Finetuned
Qwen/Qwen3-1.7B
Finetuned
(851)
this model