Spaces:
Sleeping
Sleeping
fix: Space README
Browse files- README.md +57 -1
- pages/interface.py +1 -0
- pages/retrieval.py +1 -0
README.md
CHANGED
|
@@ -1 +1,57 @@
|
|
| 1 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
title: AgentBase Platform
|
| 3 |
+
emoji: π€
|
| 4 |
+
colorFrom: blue
|
| 5 |
+
colorTo: green
|
| 6 |
+
sdk: streamlit
|
| 7 |
+
sdk_version: 1.44.0
|
| 8 |
+
app_file: streamlit_app.py
|
| 9 |
+
pinned: false
|
| 10 |
+
---
|
| 11 |
+
|
| 12 |
+
# AgentBase Search Platform
|
| 13 |
+
|
| 14 |
+
**AgentBase** is an interactive search demo for AI agent retrieval, built on nearly 10,000 real-world agents sourced from the [GPT Store](https://chatgpt.com/gpts), [Google Cloud Marketplace](https://cloud.google.com/marketplace), and [AgentAI Platform](https://agent.ai/).
|
| 15 |
+
|
| 16 |
+
π [Project Page](https://bingo-w.github.io/AgentSearchBench) β’ π» [Codebase](https://github.com/Bingo-W/AgentSearchBench) β’ π [Paper](https://arxiv.org/abs/2604.22436)
|
| 17 |
+
|
| 18 |
+
---
|
| 19 |
+
|
| 20 |
+
## Overview
|
| 21 |
+
|
| 22 |
+
This Space is a live demo for **AgentSearchBench**: a large-scale benchmark for AI agent search. Given a natural language query, the platform retrieves the most relevant agents from AgentBase using a choice of retrieval models and indexing configurations.
|
| 23 |
+
|
| 24 |
+
**Retrieval models:**
|
| 25 |
+
- **BGE-Large** β dense retrieval using `BAAI/bge-large-en-v1.5`
|
| 26 |
+
- **ToolRet** β dense retrieval fine-tuned for tool search
|
| 27 |
+
- **BM25** β sparse retrieval baseline
|
| 28 |
+
- **Keyword** β boolean keyword matching
|
| 29 |
+
|
| 30 |
+
**Indexing configurations:**
|
| 31 |
+
- **v1** β all metadata columns with priority ordering (name and description weighted first)
|
| 32 |
+
- **naive** β agent name and description only
|
| 33 |
+
|
| 34 |
+
---
|
| 35 |
+
|
| 36 |
+
## Related Resources
|
| 37 |
+
|
| 38 |
+
| Resource | Description |
|
| 39 |
+
|----------|-------------|
|
| 40 |
+
| [AgentSearchBench-Tasks](https://huggingface.co/datasets/AgentSearch/AgentSearchBench-Tasks) | Benchmark tasks for agent retrieval and reranking |
|
| 41 |
+
| [AgentSearchBench-Agents](https://huggingface.co/datasets/AgentSearch/AgentSearchBench-Agents) | AgentBase: 9,759 real-world AI agents with metadata |
|
| 42 |
+
| [AgentSearchBench-Responses](https://huggingface.co/datasets/AgentSearch/AgentSearchBench-Responses) | 60K+ raw agent execution responses |
|
| 43 |
+
|
| 44 |
+
---
|
| 45 |
+
|
| 46 |
+
## Citation
|
| 47 |
+
|
| 48 |
+
```bibtex
|
| 49 |
+
@article{wu2026agentsearchbench,
|
| 50 |
+
title={AgentSearchBench: A Benchmark for AI Agent Search in the Wild},
|
| 51 |
+
author={Bin Wu and Arastun Mammadli and Xiaoyu Zhang and Emine Yilmaz},
|
| 52 |
+
year={2026},
|
| 53 |
+
eprint={2604.22436},
|
| 54 |
+
archivePrefix={arXiv},
|
| 55 |
+
primaryClass={cs.AI},
|
| 56 |
+
}
|
| 57 |
+
```
|
pages/interface.py
CHANGED
|
@@ -87,6 +87,7 @@ class AgentBaseUI:
|
|
| 87 |
st.write('''
|
| 88 |
- **Retrieval Models**:
|
| 89 |
- **BGE-Large**: a dense retrieval model.
|
|
|
|
| 90 |
- **BM25**: a sparse retrieval model.
|
| 91 |
- **Keyword**: simple boolean keyword matching.
|
| 92 |
- **Indexing Configurations**:
|
|
|
|
| 87 |
st.write('''
|
| 88 |
- **Retrieval Models**:
|
| 89 |
- **BGE-Large**: a dense retrieval model.
|
| 90 |
+
- **ToolRet**: a dense retrieval model fine-tuned for tool search.
|
| 91 |
- **BM25**: a sparse retrieval model.
|
| 92 |
- **Keyword**: simple boolean keyword matching.
|
| 93 |
- **Indexing Configurations**:
|
pages/retrieval.py
CHANGED
|
@@ -70,6 +70,7 @@ class AgentBaseUI:
|
|
| 70 |
st.write('''
|
| 71 |
- **Retrieval Models**:
|
| 72 |
- **BGE-Large**: a dense retrieval model.
|
|
|
|
| 73 |
- **BM25**: a sparse retrieval model.
|
| 74 |
- **Indexing Configurations**:
|
| 75 |
- **v1**: using all columns with priority ordering (e.g., name, description come first).
|
|
|
|
| 70 |
st.write('''
|
| 71 |
- **Retrieval Models**:
|
| 72 |
- **BGE-Large**: a dense retrieval model.
|
| 73 |
+
- **ToolRet**: a dense retrieval model fine-tuned for tool search.
|
| 74 |
- **BM25**: a sparse retrieval model.
|
| 75 |
- **Indexing Configurations**:
|
| 76 |
- **v1**: using all columns with priority ordering (e.g., name, description come first).
|