Scikit-learn
Joblib
English
protocol-routing
llm-routing
multi-agent-systems
cost-aware-inference
protocol-selection
calibration
reasoning
reproducibility
emnlp2026
Instructions to use AgentsSci/EMNLP_Cost-Aware-Protocol-Routing with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Scikit-learn
How to use AgentsSci/EMNLP_Cost-Aware-Protocol-Routing with Scikit-learn:
from huggingface_hub import hf_hub_download import joblib model = joblib.load( hf_hub_download("AgentsSci/EMNLP_Cost-Aware-Protocol-Routing", "sklearn_model.joblib") ) # only load pickle files from sources you trust # read more about it here https://skops.readthedocs.io/en/stable/persistence.html - Notebooks
- Google Colab
- Kaggle
File size: 2,166 Bytes
0d3ef4a | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 | cff-version: 1.2.0
message: "If you use this software or dataset, please cite the paper."
title: "LLMs Can Predict Failure Risk, But Struggle to Predict Which Collaboration Protocol Pays Off: Cost-Aware Protocol Routing Across Reasoning Tasks"
abstract: >-
Research artifact for the EMNLP 2026 paper on cost-aware protocol routing.
Releases matched four-protocol outcomes, fixed-order oracle labels, held-out
router evaluations, and post-answer confidence analyses across ten
model-condition settings.
authors:
- family-names: Yang
given-names: Chih-Hsuan
affiliation: Argonne National Laboratory
email: bellayang@anl.gov
- family-names: Jiang
given-names: Jingyan
affiliation: Argonne National Laboratory
- family-names: Yang
given-names: Cheng-Hau
affiliation: Argonne National Laboratory
- family-names: Vasudevan
given-names: Vikram
affiliation: Oregon State University
- family-names: Zheng
given-names: Huihuo
affiliation: Argonne National Laboratory
- family-names: Vishwanath
given-names: Venkatram
affiliation: Argonne National Laboratory
- family-names: Thakur
given-names: Rajeev
affiliation: Argonne National Laboratory
identifiers:
- type: other
value: "arXiv:2608.14927"
description: arXiv preprint
url: "https://chihhsuan-yang.github.io/EMNLP_Cost-Aware-Protocol-Routing/"
repository-code: "https://github.com/ChihHsuan-Yang/EMNLP_Cost-Aware-Protocol-Routing"
license: MIT
preferred-citation:
type: article
title: "LLMs Can Predict Failure Risk, But Struggle to Predict Which Collaboration Protocol Pays Off: Cost-Aware Protocol Routing Across Reasoning Tasks"
authors:
- family-names: Yang
given-names: Chih-Hsuan
- family-names: Jiang
given-names: Jingyan
- family-names: Yang
given-names: Cheng-Hau
- family-names: Vasudevan
given-names: Vikram
- family-names: Zheng
given-names: Huihuo
- family-names: Vishwanath
given-names: Venkatram
- family-names: Thakur
given-names: Rajeev
year: 2026
journal: "arXiv preprint arXiv:2608.14927"
url: "https://arxiv.org/abs/2608.14927"
|