|
|
|
|
|
|
|
|
|
|
|
hero: |
|
|
enable: true |
|
|
weight: 10 |
|
|
template: hero |
|
|
|
|
|
backgroundImage: |
|
|
path: "images/templates/hero" |
|
|
filename: |
|
|
desktop: "gradient-desktop.webp" |
|
|
mobile: "gradient-mobile.webp" |
|
|
|
|
|
badge: |
|
|
text: "⭐ 33.3k+ stars on GitHub!" |
|
|
color: primary |
|
|
pill: false |
|
|
soft: true |
|
|
|
|
|
titleLogo: |
|
|
path: "images/logos" |
|
|
filename: "logo.png" |
|
|
alt: "LocalAI Logo" |
|
|
height: 340px |
|
|
|
|
|
title: "" |
|
|
subtitle: | |
|
|
**The free, OpenAI, Anthropic alternative. Your All-in-One Complete AI Stack** - Run powerful language models, autonomous agents, and document intelligence **locally** on your hardware. |
|
|
|
|
|
**No cloud, no limits, no compromise.** |
|
|
|
|
|
image: |
|
|
path: "images" |
|
|
filename: "localai_screenshot.png" |
|
|
alt: "LocalAI Screenshot" |
|
|
boxShadow: true |
|
|
rounded: true |
|
|
|
|
|
ctaButton: |
|
|
icon: rocket_launch |
|
|
btnText: "Get Started" |
|
|
url: "/installation/" |
|
|
cta2Button: |
|
|
icon: code |
|
|
btnText: "View on GitHub" |
|
|
url: "https://github.com/mudler/LocalAI" |
|
|
|
|
|
info: | |
|
|
**Drop-in replacement for OpenAI API** - modular suite of tools that work seamlessly together or independently. |
|
|
|
|
|
Start with **[LocalAI](https://localai.io)**'s OpenAI-compatible API, extend with **[LocalAGI](https://github.com/mudler/LocalAGI)**'s autonomous agents, and enhance with **[LocalRecall](https://github.com/mudler/LocalRecall)**'s semantic search - all running locally on your hardware. |
|
|
|
|
|
**Open Source** MIT Licensed. |
|
|
|
|
|
|
|
|
featureGrid: |
|
|
enable: true |
|
|
weight: 20 |
|
|
template: feature grid |
|
|
|
|
|
title: Why choose LocalAI? |
|
|
subtitle: | |
|
|
**OpenAI API Compatible** - Run AI models locally with our modular ecosystem. From language models to autonomous agents and semantic search, build your complete AI stack without the cloud. |
|
|
|
|
|
items: |
|
|
- title: LLM Inferencing |
|
|
icon: memory_alt |
|
|
description: LocalAI is a free, **Open Source** OpenAI alternative. Run **LLMs**, generate **images**, **audio** and more **locally** with consumer grade hardware. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: /basics/getting_started/ |
|
|
- title: Agentic-first |
|
|
icon: smart_toy |
|
|
description: | |
|
|
Extend LocalAI with LocalAGI, an autonomous AI agent platform that runs locally, no coding required. |
|
|
Build and deploy autonomous agents with ease. Interact with REST APIs or use the WebUI. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: https://github.com/mudler/LocalAGI |
|
|
|
|
|
- title: Memory and Knowledge base |
|
|
icon: psychology |
|
|
description: |
|
|
Extend LocalAI with LocalRecall, A local rest api for semantic search and memory management. Perfect for AI applications. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: https://github.com/mudler/LocalRecall |
|
|
|
|
|
- title: OpenAI Compatible |
|
|
icon: api |
|
|
description: Drop-in replacement for OpenAI API. Compatible with existing applications and libraries. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: /basics/getting_started/ |
|
|
|
|
|
- title: No GPU Required |
|
|
icon: memory |
|
|
description: Run on consumer grade hardware. No need for expensive GPUs or cloud services. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: /basics/getting_started/ |
|
|
|
|
|
- title: Multiple Models |
|
|
icon: hub |
|
|
description: | |
|
|
Support for various model families including LLMs, image generation, and audio models. |
|
|
Supports multiple backends for inferencing, including vLLM, llama.cpp, and more. |
|
|
You can switch between them as needed and install them from the Web interface or the CLI. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: /model-compatibility |
|
|
|
|
|
- title: Privacy Focused |
|
|
icon: security |
|
|
description: Keep your data local. No data leaves your machine, ensuring complete privacy. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: /basics/container/ |
|
|
|
|
|
- title: Easy Setup |
|
|
icon: settings |
|
|
description: Simple installation and configuration. Get started in minutes with Binaries installation, Docker, Podman, Kubernetes or local installation. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: /basics/getting_started/ |
|
|
|
|
|
- title: Community Driven |
|
|
icon: groups |
|
|
description: Active community support and regular updates. Contribute and help shape the future of LocalAI. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: https://github.com/mudler/LocalAI |
|
|
|
|
|
|
|
|
|
|
|
- title: Extensible |
|
|
icon: extension |
|
|
description: Easy to extend and customize. Add new models and features as needed. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: /docs/integrations/ |
|
|
|
|
|
- title: Peer 2 Peer |
|
|
icon: hub |
|
|
description: | |
|
|
LocalAI is designed to be a decentralized LLM inference, powered by a peer-to-peer system based on libp2p. |
|
|
It is designed to be used in a local or remote network, and is compatible with any LLM model. |
|
|
It works both in federated mode or by splitting models weights. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: /features/distribute/ |
|
|
|
|
|
- title: Open Source |
|
|
icon: code |
|
|
description: MIT licensed. Free to use, modify, and distribute. Community contributions welcome. |
|
|
ctaLink: |
|
|
text: learn more |
|
|
url: https://github.com/mudler/LocalAI |
|
|
|
|
|
imageText: |
|
|
enable: true |
|
|
weight: 25 |
|
|
template: image text |
|
|
|
|
|
title: LocalAI - Run AI models locally with ease |
|
|
subtitle: | |
|
|
LocalAI makes it simple to run various AI models on your own hardware. From text generation to image creation, autonomous agents to semantic search - all orchestrated through a unified API. |
|
|
LocalAI, created by **Ettore Di Giacinto (mudler)**, is a Free and Open Source, community-driven project to make Free, Open AI accessible to everyone. The LocalAI stack is MIT licensed, and the models trained by LocalAI are available under the Apache 2.0 License. |
|
|
|
|
|
list: |
|
|
- text: OpenAI API compatibility |
|
|
icon: api |
|
|
|
|
|
- text: Multiple model support |
|
|
icon: hub |
|
|
|
|
|
- text: Image understanding |
|
|
icon: image |
|
|
|
|
|
- text: Image generation |
|
|
icon: image |
|
|
|
|
|
- text: Audio generation |
|
|
icon: music_note |
|
|
|
|
|
- text: Voice activity detection |
|
|
icon: mic |
|
|
|
|
|
- text: Speech recognition |
|
|
icon: mic |
|
|
|
|
|
- text: Video generation |
|
|
icon: movie |
|
|
|
|
|
- text: Privacy focused |
|
|
icon: security |
|
|
|
|
|
- text: Autonomous agents with [LocalAGI](https://github.com/mudler/LocalAGI) |
|
|
icon: smart_toy |
|
|
|
|
|
- text: MCP Support [MCP](https://localai.io/docs/features/mcp/) |
|
|
icon: api |
|
|
|
|
|
- text: Semantic search with [LocalRecall](https://github.com/mudler/LocalRecall) |
|
|
icon: psychology |
|
|
|
|
|
- text: Agent orchestration |
|
|
icon: hub |
|
|
|
|
|
image: |
|
|
path: "images" |
|
|
filename: "imagen.png" |
|
|
alt: "LocalAI Image generation" |
|
|
|
|
|
imgOrder: |
|
|
desktop: 2 |
|
|
mobile: 1 |
|
|
|
|
|
ctaButton: |
|
|
text: Learn more |
|
|
url: "/basics/getting_started/" |
|
|
|
|
|
|
|
|
imageCompare: |
|
|
enable: false |
|
|
weight: 30 |
|
|
template: image compare |
|
|
|
|
|
title: LocalAI in Action |
|
|
subtitle: See how LocalAI can transform your local AI experience with various models and capabilities. |
|
|
|
|
|
items: |
|
|
- title: Text Generation |
|
|
config: { |
|
|
startingPoint: 50, |
|
|
addCircle: true, |
|
|
addCircleBlur: false, |
|
|
showLabels: true, |
|
|
labelOptions: { |
|
|
before: 'Dark', |
|
|
after: 'Light', |
|
|
onHover: false |
|
|
} |
|
|
} |
|
|
imagePath: "images/screenshots" |
|
|
imageBefore: "text_generation_input.webp" |
|
|
imageAfter: "text_generation_output.webp" |
|
|
|
|
|
- title: Image Generation |
|
|
config: { |
|
|
startingPoint: 50, |
|
|
addCircle: true, |
|
|
addCircleBlur: true, |
|
|
showLabels: true, |
|
|
labelOptions: { |
|
|
before: 'Prompt', |
|
|
after: 'Result', |
|
|
onHover: true |
|
|
} |
|
|
} |
|
|
imagePath: "images/screenshots" |
|
|
imageBefore: "imagen_before.webp" |
|
|
imageAfter: "imagen_after.webp" |
|
|
|
|
|
- title: Audio Generation |
|
|
config: { |
|
|
startingPoint: 50, |
|
|
addCircle: true, |
|
|
addCircleBlur: false, |
|
|
showLabels: true, |
|
|
labelOptions: { |
|
|
before: 'Text', |
|
|
after: 'Audio', |
|
|
onHover: false |
|
|
} |
|
|
} |
|
|
imagePath: "images/screenshots" |
|
|
imageBefore: "audio_generation_text.webp" |
|
|
imageAfter: "audio_generation_waveform.webp" |
|
|
|