bots-bench / open weights

How far do open-weight models get?

Only aggregate results are public. Prompts, answers, traces, and run IDs stay private.

Leaders

The best open-weight models, and the closed ones to measure them against

The first three cards are closed models: the highest score, the lowest cost per case, and the strongest proprietary model from China. The strongest open-weight models follow, one card each, best run first. Every run is in the chart and the table below.

Chart

Score and cost, every model

Models measured for the first time in this release are marked New.

How to read scores and costs

Run-specific caveats

    Table

    All open-weight runs

    Click a column heading to re-sort.