greeky commited on
Commit
91bb999
·
verified ·
1 Parent(s): aa6e3a6

Add model card

Browse files
Files changed (1) hide show
  1. README.md +151 -0
README.md ADDED
@@ -0,0 +1,151 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: Qwen/Qwen3.6-27B
4
+ library_name: transformers
5
+ language:
6
+ - en
7
+ - zh
8
+ tags:
9
+ - agents
10
+ - agentic-systems
11
+ - harness-generation
12
+ - tool-use
13
+ - code-generation
14
+ - jit-agent
15
+ ---
16
+
17
+ # JIT-Agent-27B
18
+
19
+ **JIT-Agent-27B** is a harness intelligence model for synthesizing executable,
20
+ task-conditioned agent harnesses. Given a task, an available tool registry, a
21
+ shared runtime protocol, and natural-language descriptions of reference
22
+ harnesses, the model generates a complete operational scaffold tailored to the
23
+ task at hand.
24
+
25
+ Instead of directly solving the task, JIT-Agent writes the system through which
26
+ another foundation model acts: how it maintains memory, forms and updates plans,
27
+ executes actions, and orchestrates tools and skills.
28
+
29
+ ## Checkpoint Overview
30
+
31
+ This repository contains the initial research release of JIT-Agent-27B. The
32
+ checkpoint builds on the Stage-I harness-customization model and is further
33
+ trained through distillation from the final research checkpoint.
34
+
35
+ ## Model Details
36
+
37
+ | Property | Value |
38
+ |---|---|
39
+ | Base model | [`Qwen/Qwen3.6-27B`](https://huggingface.co/Qwen/Qwen3.6-27B) |
40
+ | Parameters | 27.36B |
41
+ | Weight precision | BF16 |
42
+ | Architecture context length | 262,144 tokens |
43
+ | Recommended serving context | 163,840 tokens |
44
+ | Primary input | Task, tools, protocol, and reference-harness descriptions |
45
+ | Primary output | Four Python modules and one YAML prompt configuration |
46
+
47
+ JIT-Agent generates harnesses under a fixed four-module protocol:
48
+
49
+ - `memory.py`: constructs and updates the agent's working context;
50
+ - `planning.py`: forms directives and manages plan state;
51
+ - `action.py`: implements the task-execution loop;
52
+ - `tool_policy.py`: controls tool and skill exposure;
53
+ - `prompt.yaml`: defines the prompts consumed by the generated modules.
54
+
55
+ The model emits these files using the following tagged format:
56
+
57
+ ```text
58
+ <<<PYTHON_MEMORY>>>
59
+ ...
60
+ <<<END_PYTHON_MEMORY>>>
61
+
62
+ <<<PYTHON_PLANNING>>>
63
+ ...
64
+ <<<END_PYTHON_PLANNING>>>
65
+
66
+ <<<PYTHON_ACTION>>>
67
+ ...
68
+ <<<END_PYTHON_ACTION>>>
69
+
70
+ <<<PYTHON_TOOL_POLICY>>>
71
+ ...
72
+ <<<END_PYTHON_TOOL_POLICY>>>
73
+
74
+ <<<YAML>>>
75
+ ...
76
+ <<<END_YAML>>>
77
+ ```
78
+
79
+ ## Recommended Usage
80
+
81
+ The checkpoint is designed to be used with the
82
+ [JIT-Agent runtime](https://github.com/bingreeky/JIT), which constructs the full
83
+ generation prompt, validates the structured output, installs the resulting
84
+ harness, and executes it against an off-the-shelf agentic model.
85
+
86
+ ### 1. Set up the runtime
87
+
88
+ ```bash
89
+ git clone https://github.com/bingreeky/JIT.git
90
+ cd JIT
91
+
92
+ conda env create -f environment.yml
93
+ conda activate jit
94
+ ```
95
+
96
+ ### 2. Serve the checkpoint
97
+
98
+ The repository provides a vLLM launcher with the recommended serving settings:
99
+
100
+ ```bash
101
+ MODEL=JIT-Agent/jit-27b \
102
+ TP=4 \
103
+ bash scripts/serve_meta_model.sh
104
+ ```
105
+
106
+ This exposes an OpenAI-compatible endpoint at `http://localhost:8000/v1`.
107
+
108
+ ### 3. Generate and execute a task-conditioned harness
109
+
110
+ ```bash
111
+ python -m scripts.run_jit \
112
+ --bench xbench \
113
+ --meta-model jit \
114
+ --meta-base http://localhost:8000/v1 \
115
+ --harness-refs desc \
116
+ --max-samples 5
117
+ ```
118
+
119
+ The released checkpoint should be used with description references:
120
+
121
+ ```text
122
+ --harness-refs desc
123
+ ```
124
+
125
+ In this mode, the model receives natural-language design descriptions of the
126
+ reference harnesses rather than their source code. This is also the default mode
127
+ of the released runtime.
128
+
129
+ For best-of-N inference, the runtime generates three candidate harnesses at
130
+ temperature 1.0 and selects one before task execution.
131
+
132
+ ## Intended Use
133
+
134
+ JIT-Agent-27B is intended for research on:
135
+
136
+ - task-adaptive agent architecture generation;
137
+ - model–harness co-design;
138
+ - modular agent runtimes;
139
+ - memory, planning, action, and tool-policy composition;
140
+ - best-of-N harness synthesis;
141
+ - harness transfer across executor models and task domains.
142
+
143
+ It is a harness generator rather than a general-purpose chat model. Direct
144
+ chat-style prompting without the accompanying protocol and runtime context is
145
+ unlikely to produce valid executable harnesses.
146
+
147
+ ## License
148
+
149
+ The checkpoint is released under the Apache License 2.0. It is derived from
150
+ [`Qwen/Qwen3.6-27B`](https://huggingface.co/Qwen/Qwen3.6-27B), which is also
151
+ released under Apache 2.0.