Menu
mutinaiPreview: Public preview · figures are illustrative fixture data, attributed to their source · data to May 2025 · read-only
What can I run?
Tools · 14 tracked

The software between you and the model.

A local setup is a runtime that loads the model, plus something you type into. Everything else is optional.

Gateways1 of 14

Show all tools

AllRuntimes 6Chat interfaces 2Coding assistants 2Fine-tuning 2Evaluation 1Gateways 1
1 tool

Gateways

One API in front of many models, local or hosted.

  • LiteLLM
    The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]BerriAI · Python
    Any OpenAI-compatible model API
    Permissive