A deep technical survey of harness engineering as a path toward recursive self-improvement (RSI) in AI systems. A 'harness' is the orchestration layer surrounding a base model that controls how it plans, uses tools, manages context, and evaluates results. The post organizes recent research into four main areas: context engineering (ACE, MCE, Meta-Harness), workflow design automation (ADAS, AFlow, AI Scientist), self-improving harnesses (Self-Harness, STOP), and evolutionary program search (AlphaEvolve, Darwin Gödel Machine, ShinkaEvolve). Key insight: code is a universal language for harness optimization, enabling LLM-based coding agents to search the same design space human engineers use. The post also covers joint harness+weight optimization (SIA) and closes with seven open challenges: weak evaluators, memory lifecycle, negative results, diversity collapse, reward hacking, long-term success metrics, and the role of human oversight.
