Pick a real bug. Ship the fix with AI.
Every challenge is a genuine GitHub issue from a major Python project, graded by the hidden tests from the fix that actually merged. Read the briefs here and create an account to start a round.
- Challenges
- 199 challenges
- Repositories
- 11 repositories
- Graded rounds
- 62 graded rounds
Multi-level FilteredRelation with select_related() may set wrong related object.
Queryset raises NotSupportedError when RHS has filterable=False attribute.
+300 XPCompete →
Track your progress
Sign in to see what you have solved, keep a streak, earn badges and XP, and climb the leaderboard.
Open a practice track
Datadog-style logs and operational debugging practice
Improve the evidence a developer sees when a program fails. Check structured output alongside the original exception.
View track ↗- —0 rounds—hardINTERNALERROR when exception in __repr__pytest-dev/pytesttestingtoolinghardnew
- 0%3 rounds30easyTraceback printed for unrecognized optionpylint-dev/pylintlintingtoolingeasy0% solved
- —0 rounds—easyUsing custom braces in message template does not workpylint-dev/pylintlintingtoolingeasynew
- —0 rounds—easyImprove default logging formatpytest-dev/pytesttestingtoolingeasynew
- —0 rounds—easyHostname and timestamp properties in generated JUnit XML reportspytest-dev/pytesttestingtoolingeasynew
- —0 rounds—easyError message prints extra code line when using assert in python3.9pytest-dev/pytesttestingtoolingeasynew
Build from a brief
envcheck: a .env linter and diff tool ↗
A developer tool that lints .env files with line numbers and reports drift against .env.example, never printing secrets.
24-hour project window / about 2.5h suggested effort / paid plan
Durable background job queue ↗
Durable jobs, safe concurrent claiming, retries with backoff, leases for crashed workers, dead letters and graceful shutdown.
24-hour project window / about 5h suggested effort / paid plan
From Start to score in four steps
- 1
Open your workspace
VS Code opens in a new tab with the repository, dependencies and tests ready. Read the instructions, then press Start inside the workspace to begin the timer.
- 2
Fix it with the agent
Standard rounds give you 60 minutes and up to 1M tokens; Speedrun gives you 20 minutes and Frugal lowers the token budget. Check your selected mode and allowance before starting. Paid rounds spend agent credit; free rounds do not.
- 3
Your work builds the report
The workspace records prompts, agent actions, edits, test runs and token use. It also records pastes and time away from the tab. It does not watch activity outside the workspace.
- 4
Submit and get scored
Hidden tests from the original fix check your patch. Graded rounds include a free score and test result. A paid plan adds the detailed breakdown, prompt coaching and replay. Eligible graded attempts also earn XP.
How the score is made
Your overall score is a weighted blend of six sub-scores. Solving the issue matters most, but how you drove the agent, checked your work and spent your tokens is what separates a good engineer with AI from a lucky one. Non-empty practice submissions can earn XP. Your best result on each task counts, with harder tasks and passing tests worth more.
- Outcome35%
Do the hidden tests pass, and does nothing that worked before break?
- Prompt quality15%
Specific, contextual instructions beat “fix it”.
- Token economy15%
Solving it without burning the budget.
- Verification15%
Running the tests yourself before you submit.
- Speed10%
Time to a working fix (only counts when it works).
- Recovery10%
Getting out of error loops instead of repeating them.