TaH2-1.7B-max8

Qwen3-1.7B with adaptive latent iteration, at most eight iterations per token. Uses duo attention, a learned iteration decider (threshold 0.5), and stop_prob_mix. Fine-tuned on the 1.7B subset of TaH2 AMTeam Tool.

Code: thu-nics/TaH · Paper: arXiv:2609.35748.

Install TaH2 with pip install -e '.[tah2]' in the code repository, then load the backbone and both TaH2 modules:

import torch
from huggingface_hub import snapshot_download
from transformers import AutoTokenizer
from tah2.model.tah_model import TaHForCausalLM

path = snapshot_download("nics-efc/TaH2-1.7B-max8")
tokenizer = AutoTokenizer.from_pretrained(path)
model = TaHForCausalLM.from_pretrained(
    path, dtype=torch.bfloat16, device_map="cuda").eval()