LocalAI
LocalAI is a drop-in replacement REST API that's compatible with OpenAI API specifications for local inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-premises with consumer grade hardware, supporting multiple model families and not requiring GPU.
Quick Info
| Field | Value |
|---|---|
| Category | AI & LLM |
| Subcategory | Chat & Assistants |
| Default Port | 8080 |
| Docker Image | localai/localai:v2.29.0-aio-cpu |
| Dependencies | Docker |
| OS Support | Ubuntu 22.04, Ubuntu 24.04, Debian 12 |
Links
- 🌐 Website
- 📚 Documentation
- 💻 GitHub