bots-bench / open weights

How far do open-weight models get?

Only aggregate results are public. Prompts, answers, traces, and run IDs stay private.

Open weights

The open-weight field

The first three cards hold closed models. They mark the high score, the lowest cost per case, and the strongest Chinese model.

Every model measured

Cases solved, and what each one cost

Each bar shows cases solved out of 59. The figure beside it is what the whole run cost.

All open-weight runs

Every open-weight run in one sortable table

Click a column heading to re-sort.