Menu
mutinaiPreview: Public preview · figures are illustrative fixture data, attributed to their source · data to May 2025 · read-only
What can I run?
Tools · 14 tracked

The software between you and the model.

A local setup is a runtime that loads the model, plus something you type into. Everything else is optional.

Evaluation1 of 14

Show all tools

AllRuntimes 6Chat interfaces 2Coding assistants 2Fine-tuning 2Evaluation 1Gateways 1
1 tool

Evaluation

Measures how good a model really is.

  • lm-evaluation-harness
    A framework for few-shot evaluation of language models.EleutherAI · Python
    Any OpenAI-compatible model API
    Permissive