Spaces:
Running
title: README
emoji: π‘
colorFrom: blue
colorTo: indigo
sdk: static
pinned: false
Welcome to the official GSMA organization on Hugging Face!
The GSMA represents mobile operators and organisations across the mobile ecosystem worldwide. We are building open resources to advance AI in telecommunications β making telecom-domain evaluation, benchmarking, and knowledge accessible to the global research community.
Open Telco AI
Open Telco is a comprehensive suite of telco-specific benchmarks built on the Inspect AI framework, designed to ensure safe and optimal deployment of AI in telecommunications environments. A collaborative effort with major telecom providers, research institutions, and universities.
- ot-full β 16,866 evaluation samples across 7 benchmarks β the complete evaluation suite
- ot-lite β 1,700 sample subset for fast iteration during model development
- Leaderboard Scores β Published benchmark scores with standard errors
Benchmarks
The evaluation suite curates 7 telecom-domain benchmarks from academic and industry sources:
| Benchmark | Samples | Task |
|---|---|---|
| TeleQnA | 10,000 | Multiple-choice Q&A on telecom standards |
| TeleMath | 1,500 | Mathematical reasoning in telecom contexts |
| TeleTables | 500 | Table interpretation from 3GPP specifications |
| TeleLogs | 586 | Log analysis and network troubleshooting |
| 3GPP TSG | 3,780 | 3GPP Technical Specification Group document understanding |
| ORANBench | 200 | O-RAN architecture and specifications |
| SRSRANBench | 300 | srsRAN open-source network stack |
OTel β Open Telco AI Models
A collaborative effort to build AI models for the global telecommunications sector, optimized for RAG and agentic applications.
Model Suite:
- 18 Language Models (270Mβ32B parameters)
- 10 Embedding Models (22Mβ8B parameters)
- 3 Reranker Models (0.6Bβ8B parameters)
Models are trained on telecom-domain data β including 3GPP specifications, O-RAN documentation, and RFC standards β curated by 200+ domain experts from AT&T, GSMA, Purdue University, Khalifa University, University of Leeds, Yale University, and others.
Resources:
- Training & Inference Code (GitHub)
- Open-Telco-1 Dataset
- LLM Collection
- Embedding Collection
- Reranker Collection
License: Apache-2.0
Additional Resources
Models
- AdaptKey-Nemotron-30b β NVIDIA Nemotron 3 Nano fine-tuned by AdaptKey for telecom. Contributed by NVIDIA and AdaptKey.
Datasets
- telecom-kg-rel19 β Large-scale telecom knowledge graph built from 3GPP Release 19 specifications, with text chunks for retrieval-augmented generation (RAG) and LLM reasoning over standards
- oran_spec_knowledge_graph A knowelge graph of 25,103 nodes and 98,679 relationships extracted from official O-RAN Alliance specification documents using OpenAI GPT-4.1
- AdaptKey Nemotron 30B Training Data β Dataset used to fine-tune Nemotron 3 Nano for telecom. Contributed by NVIDIA and AdaptKey.
Guides & Blueprints
- NVIDIA Blueprint: AI Agent for Telecom Network Configuration Planning β Agentic blueprint for RAN configuration. Contributed by NVIDIA (in collaboration with BubbleRAN).
- NVIDIA Blueprint: Intent Driven RAN Energy Efficiency β Agentic blueprint for RAN energy saving with simulation. Contributed by NVIDIA (in collaboration with VIAVI).
- NVIDIA Guide: Teaching a Model to Reason Over Telecom Network Incidents β Guide on how to build NOC reasoning agents. Contributed by NVIDIA (in collaboration with Tech Mahindra).
Satellite β Eval Runner
Satellite provides telecom-focused evaluation operations built on Inspect AI. Run the full Open Telco benchmark suite locally within your own infrastructure with a single command.
Telecom Simulation Sandboxes
Purpose-built sandbox environments that place AI agents inside live telecom network simulations β for evaluating whether models can operate networks, not just answer questions about them.
inspect-kathara β Run AI agent evaluations inside isolated network topologies. Integrates Inspect AI with Docker-based network sandboxes to evaluate agents' ability to diagnose and resolve network connectivity issues in reproducible environments.
5gs-sandbox β Run AI agent evaluations inside a complete 5G Standalone network. A full 5G SA deployment with 15 Docker containers (Open5GS + UERANSIM), enabling agents to configure, diagnose, and optimize real 5G network functions with actual performance measurement.
Research and Community
- GSMA AI Initiatives: https://www.gsma.com/solutions-and-impact/technologies/artificial-intelligence/open-telco.ai/
- Open Gateway: https://www.gsma.com/solutions-and-impact/gsma-open-gateway/
- MWC (Mobile World Congress): https://www.mwcbarcelona.com/