Pick a real bug. Ship the fix with AI.
Every challenge is a genuine GitHub issue from a major Python project, graded by the hidden tests from the fix that actually merged. Read any of them free; start a round when you are ready.
- Challenges
- 201 challenges
- Repositories
- 11 repositories
- Graded rounds
- 62 graded rounds
Wrong path to test file when directory changed in fixture
Queryset raises NotSupportedError when RHS has filterable=False attribute.
+300 XPCompete →
Track your progress
Sign in to see what you have solved, keep a streak, earn badges and XP, and climb the leaderboard.
Meta-style AI coding practice
Focused bug fixUse an AI assistant to fix a focused bug in an unfamiliar application. Review its edits, test the change and explain how it works.
- 0%3 rounds30mediumAdd a file mode parameter to flask.Config.from_file()pallets/flaskwebmicroframeworkmedium0% solved
- —0 rounds—mediumManagementUtility instantiates CommandParser without passing already-computed prog argumentdjango/djangowebormmediumnew
- —0 rounds—mediumSimpleLazyObject doesn't implement __radd__django/djangowebormmediumnew
- 33%9 rounds40easy★Raise error when blueprint name contains a dotpallets/flaskblueprintsvalidationeasy33% solved
- 90%29 rounds75easy★UsernameValidator allows trailing newline in usernamesdjango/djangovalidationregexeasy90% solved
- 100%4 rounds76easy★delete() on instances of models without any dependencies doesn't clear PKsdjango/djangoormmodelseasy100% solved
- —0 rounds—easySitemaps without items raise ValueError on callable lastmod.django/djangowebormeasynew
- —2 rounds—easy★get_backend() clears the current figurematplotlib/matplotlibbackendfigureseasynew
- —0 rounds—easyto_unstacked_dataset broken for single-dim variablespydata/xarraydataarrayseasynew
From Start to score in four steps
- 1
Open your workspace
VS Code opens in a new tab with the repository, dependencies and tests ready. Read the instructions, then press Start inside the workspace to begin the timer.
- 2
Fix it with the agent
Standard rounds give you 60 minutes and up to 1M tokens; Speedrun gives you 20 minutes and Frugal lowers the token budget. Check your selected mode and allowance before starting. Paid rounds spend agent credit; free rounds do not.
- 3
Your work builds the report
The workspace records prompts, agent actions, edits, test runs and token use. It also records pastes and time away from the tab. It does not watch activity outside the workspace.
- 4
Submit and get scored
Hidden tests from the original fix check your patch. Graded rounds include a free score and test result. A paid plan adds the detailed breakdown, prompt coaching and replay. Eligible graded attempts also earn XP.
How the score is made
Your overall score is a weighted blend of six sub-scores. Solving the issue matters most, but how you drove the agent, checked your work and spent your tokens is what separates a good engineer with AI from a lucky one. Non-empty practice submissions can earn XP. Your best result on each task counts, with harder tasks and passing tests worth more.
- Outcome35%
Do the hidden tests pass, and does nothing that worked before break?
- Prompt quality15%
Specific, contextual instructions beat “fix it”.
- Token economy15%
Solving it without burning the budget.
- Verification15%
Running the tests yourself before you submit.
- Speed10%
Time to a working fix (only counts when it works).
- Recovery10%
Getting out of error loops instead of repeating them.