Public preview · figures are illustrative fixture data, attributed to their source · data to May 2025 · read-only

Tools

1 of 13

All Runtimes 6 Chat interfaces 1 Coding assistants 2 Fine-tuning 2 Evaluation 1 Gateways 1

lm-evaluation-harness
Evaluation · EleutherAI · Python
A framework for few-shot evaluation of language models.
Works withAny OpenAI-compatible model API
LicensePermissive
Measurements—