catalog / README.md
fredoline005's picture
Add benchmark leaderboard (HumanEval+/MBPP+/TurkishMMLU) + live model catalog
839b969 verified
|
Raw
History Blame Contribute Delete
2.98 kB
---
title: RunLocalAI leaderboard & catalog
emoji: πŸ†
colorFrom: yellow
colorTo: red
sdk: gradio
sdk_version: 5.49.1
app_file: app.py
pinned: true
license: cc-by-4.0
short_description: Local-AI benchmark leaderboard + open-weight catalog
tags:
- local-ai
- llm
- leaderboard
- benchmark
- humaneval
- mbpp
- embedding
- asr
- tts
- diffusion
- catalog
---
# RunLocalAI β€” local AI leaderboard & catalog
A **live, read-only** view of the [RunLocalAI](https://www.runlocalai.co) corpus, in two tabs.
## πŸ† Benchmark leaderboard
Reproducible quality scores on **real consumer hardware** β€” HumanEval+, MBPP+, and TurkishMMLU.
Every run is **measured first-party** and carries:
- a public **run log** (linked per row),
- a one-line **reproduction command**, and
- explicit **first-party / community / verified** provenance status.
Pick a benchmark to see the head-to-head ranking (πŸ₯‡πŸ₯ˆπŸ₯‰). No vibes, no leaderboard laundering β€”
the source is `GET /api/v1/quality-benchmarks`.
## πŸ› οΈ Model catalog
Every open-weight model worth running on your own hardware β€” text LLMs, vision-language models,
embeddings, rerankers, ASR, TTS, image diffusion, and vision encoders.
- Filter by **modality** (text / vision / audio / embedding / rerank / image-gen)
- Filter by **commercial-license-OK** to skip non-commercial license traps
- Cap **max parameters** for SLM-only discovery
- **Search** by model name, vendor, or HuggingFace repo
- Each row links to the full **operator-grade page** on runlocalai.co with hardware fit,
prompt template, runtime + quant recommendation, and common-mistakes section
## Why a mirror?
The source-of-truth lives at **[runlocalai.co](https://www.runlocalai.co)** and is served via the
public, keyless endpoints below. This Space exists so the HuggingFace community can browse the
catalog and leaderboard from inside HF β€” and so HF discovery surfaces (search, trending) can index
local-AI rows.
## Catalog license
Catalog data and benchmark results are licensed **CC-BY-4.0**. Attribute to runlocalai.co
with a link.
## Catalog hubs (read on runlocalai.co)
- [/small-language-models](https://www.runlocalai.co/small-language-models) β€” every model ≀ 3.5B
- [/embeddings](https://www.runlocalai.co/embeddings) β€” embedding + reranker models
- [/audio](https://www.runlocalai.co/audio) β€” ASR + TTS
- [/image-models](https://www.runlocalai.co/image-models) β€” diffusion + vision encoders
- [/coding-models](https://www.runlocalai.co/coding-models) β€” coder-specialised LLMs
- [/turkish-models](https://www.runlocalai.co/turkish-models) β€” Turkish open-weight LLMs
- [/benchmarks/quality](https://www.runlocalai.co/benchmarks/quality) β€” quality benchmark leaderboards
## Machine-readable endpoints
- Models JSON: `https://www.runlocalai.co/api/v1/models`
- Quality benchmarks: `https://www.runlocalai.co/api/v1/quality-benchmarks`
- OpenAPI spec: `https://www.runlocalai.co/api/v2/openapi`