Planning lifts weaker coding models, cuts costs for stronger ones

Planning improves accuracy for weaker coding models but mainly cuts token costs for stronger models with little accuracy change, according to a 17 September arXiv study. It tested four models on SWE-Bench Verified and Terminal-Bench 2.1 across 176 matched harness settings.