Meta-Task-32B / README.md
saulpzh's picture
Upload README.md with huggingface_hub
60a1bbc verified
|
Raw History Blame Contribute Delete
1.47 kB
metadata
license: apache-2.0
base_model: Qwen/Qwen3-32B
language:
  - en
library_name: transformers
tags:
  - terminal-agents
  - code-agent
  - task-synthesis
  - qwen3

Meta-Task-32B

Qwen3-32B fine-tuned on 3,221 trajectories synthesized by the Meta-Task framework, for solving terminal tasks.

This model accompanies the paper "Meta-Task: Turning Terminal Task Synthesis into a Terminal Task for Scalable Agent Training" (arXiv:2607.27929). Official code: https://github.com/goodmanpzh/meta-task

Results

Terminal-Bench 2.0, Terminus-2 scaffold, non-thinking mode: 31.8 % Avg Pass@1 (base Qwen3-32B: 4.1 %).

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "saulpzh/Meta-Task-32B"
tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(model_id, torch_dtype="bfloat16", device_map="auto")

Training

LoRA SFT with the SWIFT framework (rank/alpha 64/128, dropout 0.05, lr 1e-4, cosine schedule, 5 epochs, sequence length 40,960, BF16, 8×A100 80GB with DeepSpeed ZeRO-3). Training data: saulpzh/Meta-Task-Data.

Links

License

Apache-2.0.