Scikit-learn
Joblib
English
protocol-routing
llm-routing
multi-agent-systems
cost-aware-inference
protocol-selection
calibration
reasoning
reproducibility
emnlp2026
Instructions to use AgentsSci/EMNLP_Cost-Aware-Protocol-Routing with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Scikit-learn
How to use AgentsSci/EMNLP_Cost-Aware-Protocol-Routing with Scikit-learn:
from huggingface_hub import hf_hub_download import joblib model = joblib.load( hf_hub_download("AgentsSci/EMNLP_Cost-Aware-Protocol-Routing", "sklearn_model.joblib") ) # only load pickle files from sources you trust # read more about it here https://skops.readthedocs.io/en/stable/persistence.html - Notebooks
- Google Colab
- Kaggle
| cff-version: 1.2.0 | |
| message: "If you use this software or dataset, please cite the paper." | |
| title: "LLMs Can Predict Failure Risk, But Struggle to Predict Which Collaboration Protocol Pays Off: Cost-Aware Protocol Routing Across Reasoning Tasks" | |
| abstract: >- | |
| Research artifact for the EMNLP 2026 paper on cost-aware protocol routing. | |
| Releases matched four-protocol outcomes, fixed-order oracle labels, held-out | |
| router evaluations, and post-answer confidence analyses across ten | |
| model-condition settings. | |
| authors: | |
| - family-names: Yang | |
| given-names: Chih-Hsuan | |
| affiliation: Argonne National Laboratory | |
| email: bellayang@anl.gov | |
| - family-names: Jiang | |
| given-names: Jingyan | |
| affiliation: Argonne National Laboratory | |
| - family-names: Yang | |
| given-names: Cheng-Hau | |
| affiliation: Argonne National Laboratory | |
| - family-names: Vasudevan | |
| given-names: Vikram | |
| affiliation: Oregon State University | |
| - family-names: Zheng | |
| given-names: Huihuo | |
| affiliation: Argonne National Laboratory | |
| - family-names: Vishwanath | |
| given-names: Venkatram | |
| affiliation: Argonne National Laboratory | |
| - family-names: Thakur | |
| given-names: Rajeev | |
| affiliation: Argonne National Laboratory | |
| identifiers: | |
| - type: other | |
| value: "arXiv:2608.14927" | |
| description: arXiv preprint | |
| url: "https://chihhsuan-yang.github.io/EMNLP_Cost-Aware-Protocol-Routing/" | |
| repository-code: "https://github.com/ChihHsuan-Yang/EMNLP_Cost-Aware-Protocol-Routing" | |
| license: MIT | |
| preferred-citation: | |
| type: article | |
| title: "LLMs Can Predict Failure Risk, But Struggle to Predict Which Collaboration Protocol Pays Off: Cost-Aware Protocol Routing Across Reasoning Tasks" | |
| authors: | |
| - family-names: Yang | |
| given-names: Chih-Hsuan | |
| - family-names: Jiang | |
| given-names: Jingyan | |
| - family-names: Yang | |
| given-names: Cheng-Hau | |
| - family-names: Vasudevan | |
| given-names: Vikram | |
| - family-names: Zheng | |
| given-names: Huihuo | |
| - family-names: Vishwanath | |
| given-names: Venkatram | |
| - family-names: Thakur | |
| given-names: Rajeev | |
| year: 2026 | |
| journal: "arXiv preprint arXiv:2608.14927" | |
| url: "https://arxiv.org/abs/2608.14927" | |