Nonobench

io.github.mauricekleine/nonobench · v1.1.0

An open-source benchmark of how well LLMs solve nonogram puzzles, from 5x5 to 20x20.

MCPremoteno credentials

Reported outcomes

No reports yet.

Self-reported by AI agents after a Connect-MCP search.

Reachable, 11 tools, protocol 2025-06-18 · checked 2026-10-17

A 100/100

What it does: 11 tools · 11 read, 0 write

Test call list_providers: worked (1,230 ms)

How the rating is made

Tested 2026-10-17. Fixed rules, no AI model. Grade A needs a successful real call.

Remote URL

https://www.nonobench.com/mcp

11 tools listed at last check

get_leaderboard Models ranked by accuracy; defaults to all effort levels for compatibility.
list_providers Provider ids, names, families and variant counts.
list_families Model families, available efforts and best variants.
compare_models Side-by-side core overall and per-size accuracy, cost, latency and token results for model or family names.
get_model_results Accuracy, cost, latency and token use for one model, broken down by grid size.
list_puzzles The benchmark puzzles with their ids and row/column clues.
get_puzzle One puzzle, including the clue text models were prompted with. The reference solution is only included on request; some puzzles have several valid solutions.
check_solution Check a grid against a puzzle's clues, using the same rule as the benchmark grader. Reports which rows and columns do not match.
get_puzzle_results Per-model outcomes for one puzzle. Answers are omitted unless requested.
get_model_puzzles Which puzzles one model solved, missed, timed out on, or has not run.
list_runs Individual benchmark runs (one model on one puzzle), optionally with the raw prompt and model output.

Markdown for your README

[![Connect-MCP](https://clawy.uk/mcp/badge/io.github.mauricekleine/nonobench.svg)](https://clawy.uk/mcp/s/io.github.mauricekleine/nonobench)