Skip to content

Tutorial: let models debate, then measure them

Which model should get your hardest work? Don’t guess — make them compete. The Model Council has models argue a question in rounds; the Benchmark suite scores them on your actual tasks.

Open Tools → Model Council:

The Model Council pane, ready to seat models around a question

Give it a question that matters (“How should we structure the sync engine?”), seat two or more models, and run. Each states a position, reads the others, and rebuts — you get the strongest version of every side, not one model’s first take.

Public leaderboards test someone else’s problems. Tools → Benchmark tests yours:

The Benchmark suite: your tasks, your contenders, real scores

Add tasks (real prompts from your work), pick contenders, run. Results are scored side by side, so “which model writes our kind of code best” becomes a number instead of a vibe.

Winners earn assignments: set the strong model as an agent window’s model, point the Kanban Crew’s Judge at the most critical one, route cheap tasks to the budget pick. Benchmark and Council results feed the same intuition the Command Center tracks over time.

Frequently asked questions

How many models does a Council need?

At least two (plus at least one task for a Benchmark run) — the Run button stays disabled until the run makes sense.

Which models can take part?

Anything you can run: your installed agent CLIs and any OpenRouter model you've configured.