LiteLLM
LiteLLM is a lightweight, self-hosted library designed for integrating language models like GPT into your applications. It provides an easy-to-use interface for sending and receiving prompts and responses, with support for multiple model configurations, API keys, and detailed debugging options. With LiteLLM, you can streamline your AI workflows while maintaining full control over your data and configurations.
Quick Info
| Field | Value |
|---|---|
| Category | AI & LLM |
| Subcategory | Machine Learning |
| Default Port | 4000 |
| Docker Image | ghcr.io/berriai/litellm:v1.85.0 |
| Dependencies | Docker, Postgres |
| OS Support | Ubuntu 22.04, Ubuntu 24.04, Debian 12 |
Links
- 📚 Documentation
- 💻 GitHub