Highlights

Study finds fancy harnesses make coding agents more expensive but not better

A controlled study found that switching between coding-agent harnesses like Claude Code, OpenCode, or mini-SWE-agent barely moves pass rates more than rerunning the same setup, while adding cost.

Heat 0.0 1 reports 1 sources Since Updated Out of the hot window
  1. The DecoderFancy harnesses make coding agents more expensive but not better, study finds