IBM and UC Berkeley Diagnose Why Enterprise Agents Fail Using IT-Bench and MAST
•
18
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
Papers
General Agent Evaluation
SPARC: Separating Perception And Reasoning Circuits for Test-time Scaling of VLMs
Articles
ibm-research/BPO-Bench
Preview
• Updated
• 23 • 1
ibm-research/VAREX
Viewer
• Updated
• 1.78k • 4
ibm-research/watsonxDocsQA
Viewer
• Updated
• 1.22k • 99 • 4
ibm-research/AITQARetrieval
Viewer
• Updated
• 3.99k • 57
ibm-research/ITBench-Lite
Updated
• 746 • 5
ibm-research/flow-bench
Viewer
• Updated
• 546 • 26 • 2
ibm-research/ScarfBench
Updated
• 27 • 1
ibm-research/AssetOpsBench
Viewer
• Updated
• 467 • 739 • 14
ibm-research/FailureSensorIQ
Viewer
• Updated
• 8.3k • 190 • 6
ibm-research/WatsonxDocsQARetrieval
Viewer
• Updated
• 1.2k • 43
ibm-research/StatCanDialogueRetrieval
Viewer
• Updated
• 7.65k • 33
ibm-research/MultiHierttRetrieval
Viewer
• Updated
• 11.9k • 37
ibm-research/OTTQASmallRetrieval
Viewer
• Updated
• 31.1k • 39
ibm-research/NQTablesRetrieval
Viewer
• Updated
• 533k • 57 • 1
ibm-research/OpenWikiTablesRetrieval
Viewer
• Updated
• 178k • 60
ibm-research/FeTaQARetrieval
Viewer
• Updated
• 24.7k • 51
ibm-research/rag-hpo-bench
Preview
• Updated
• 1.81k • 2
ibm-research/acp_bench
Viewer
• Updated
• 3.72k • 1.82k • 13
ibm-research/data-product-benchmark
Viewer
• Updated
• 20.8k • 606 • 3
ibm-research/dp-bench
Updated
• 29 • 1
ibm-research/ITBench-Trajectories
Updated
• 886 • 3
ibm-research/nc-bench
Viewer
• Updated
• 720 • 41 • 1
ibm-research/ReasonLab
Viewer
• Updated
• 4.35k • 163 • 1
ibm-research/Auto-BenchmarkCard
Viewer
• Updated
• 105 • 62 • 3
ibm-research/MermaidSeqBench
Viewer
• Updated
• 132 • 70 • 5
ibm-research/knowledge_consistency_of_LLMs
Preview
• Updated
• 58 • 3
ibm-research/ToolRM-train-data
Viewer
• Updated
• 459k • 134 • 7
ibm-research/BFCL-FC-robustness
Updated
• 13
ibm-research/SQL-API-Bench
Viewer
• Updated
• 3.41k • 273 • 4
ibm-research/fc-reward-bench
Viewer
• Updated
• 1.5k • 160 • 5