DumboDB: Does it Work?

DumboDB is a MongoDB-compatible, version-controlled database built entirely by AI coding agents. The post explains how the team validates correctness without reading the AI-generated application code. Their approach combines: parity testing against MongoDB as a reference implementation (1,989 tests), human verification documents paired with unit tests for DumboDB-specific features (~200 scenarios, ~1,800 assertions), nightly load tests on AWS that caught a memory leak in the $group aggregation operator, and compatibility testing against third-party MongoDB apps like Compass, mongo-express, and parse-server. The parity test suite categorizes results as full parity, MongoDB-only (unsupported features like capped collections), expected failures, and intentional deviations. The author concludes that despite the AI-generated codebase, the testing strategy gives high confidence in correctness, and that maintainability over the long term remains an open question.