SWE-bench/SWE-bench_Multimodal
Benchmark • Updated • 580 • 10.5k • 14
SWE-bench
community
AI & ML interests
None defined yet.
Papers
SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
john-b-yangÂ
updated 5
datasets 2 months ago
Update Read.md
1
#2 opened 6 months ago
by 
Samabe1109
Add eval.yaml
4
#3 opened 3 months ago
by 
nielsr
john-b-yangÂ
authored 9
papers 6 months ago
SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?
Paper • 2410.03859 • Published • 3
OpenThoughts: Data Recipes for Reasoning Models
Paper • 2506.04178 • Published • 57
LongCodeBench: Evaluating Coding LLMs at 1M Context Windows
Paper • 2505.07897 • Published
EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security Vulnerabilities
Paper • 2409.16165 • Published
Collaborative Gym: A Framework for Enabling and Evaluating Human-Agent Collaboration
Paper • 2412.15701 • Published
Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfaces
Paper • 2601.11868 • Published • 38
SWE-Protégé: Learning to Selectively Collaborate With an Expert Unlocks Small Language Models as Software Engineering Agents
Paper • 2602.22124 • Published • 2
SWE-chat: Coding Agent Interactions From Real Users in the Wild
Paper • 2604.20779 • Published • 21
ProgramBench: Can Language Models Rebuild Programs From Scratch?
Paper • 2605.03546 • Published • 4
arpandeepkÂ
published a
dataset 7 months ago
arpandeepkÂ
updated a
dataset 7 months ago
john-b-yangÂ
updated a
collection 8 months ago