AIMS2025 commited on
Commit
e2d7816
·
verified ·
1 Parent(s): 96ad5e1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -39,12 +39,12 @@ where the number is the phase index (starting from 0) and the seconds is the dur
39
 
40
  | Model | Avg Saturation | Avg Queue Length (veh/s) | Avg Throughput (veh/5min) | Avg Response Time (s) |
41
  |:---:|:---:|:---:|:---:|:---:|
42
- | [`GPT-OSS-20B (thinking)`](https://huggingface.co/openai/gpt-oss-20b) | 0.3801 | 0.476210 | 77.910075 | 6.768 |
43
- | **DeepSignal-4B (Ours)** | 0.4219 | 0.498338 | 79.883430 | 2.131 |
44
- | [`Qwen3-30B-A3B`](https://huggingface.co/Qwen/Qwen3-VL-30B-A3B-Instruct) | 0.4314 | 0.580256 | 79.059117 | 2.727 |
45
- | [`Qwen3-4B`](https://huggingface.co/Qwen/Qwen3-4B-Instruct-2507) | 0.4655 | 2.453933 | 75.711907 | 1.994 |
46
- | Max Pressure | 0.4647 | 0.639584 | 77.235637 | ** |
47
- | [`LightGPT-8B-Llama3`](https://huggingface.co/lightgpt/LightGPT-8B-Llama3) | 0.5230 | 1.258782 | 75.512073 | 3.025*** |
48
 
49
  `*`: Each simulation scenario runs for 60 minutes. We discard the first **5 minutes** as warm-up, then compute metrics over the next **20 minutes** (minute 5 to 25). We cap the evaluation window because, when an LLM controls signal timing for only a single intersection, spillback from neighboring intersections may occur after ~20+ minutes and destabilize the scenario. All evaluations are conducted on a **Mac Studio M3 Ultra**.
50
  `**`: Max Pressure is a fixed signal-timing optimization algorithm (not an LLM), so we omit its Avg Response Time; this metric is only defined for LLM-based signal-timing optimization.
 
39
 
40
  | Model | Avg Saturation | Avg Queue Length (veh/s) | Avg Throughput (veh/5min) | Avg Response Time (s) |
41
  |:---:|:---:|:---:|:---:|:---:|
42
+ | [`GPT-OSS-20B (thinking)`](https://huggingface.co/openai/gpt-oss-20b) | 0.380 | 0.476 | 77.910 | 6.768 |
43
+ | **DeepSignal-4B (Ours)** | 0.422 | 0.498 | **79.883** | 2.131 |
44
+ | [`Qwen3-30B-A3B`](https://huggingface.co/Qwen/Qwen3-VL-30B-A3B-Instruct) | 0.431 | 0.580 | 79.059 | 2.727 |
45
+ | [`Qwen3-4B`](https://huggingface.co/Qwen/Qwen3-4B-Instruct-2507) | 0.466 | 2.454 | 75.712 | 1.994 |
46
+ | Max Pressure | 0.465 | 0.640 | 77.236 | ** |
47
+ | [`LightGPT-8B-Llama3`](https://huggingface.co/lightgpt/LightGPT-8B-Llama3) | 0.523 | 1.259 | 75.512 | 3.025*** |
48
 
49
  `*`: Each simulation scenario runs for 60 minutes. We discard the first **5 minutes** as warm-up, then compute metrics over the next **20 minutes** (minute 5 to 25). We cap the evaluation window because, when an LLM controls signal timing for only a single intersection, spillback from neighboring intersections may occur after ~20+ minutes and destabilize the scenario. All evaluations are conducted on a **Mac Studio M3 Ultra**.
50
  `**`: Max Pressure is a fixed signal-timing optimization algorithm (not an LLM), so we omit its Avg Response Time; this metric is only defined for LLM-based signal-timing optimization.