A developer shares progress on adding snapshot read support to the Apache Trino Kafka connector. The core change introduces a new session variable and a `TopicPartitionOffsetProvider` interface to the `KafkaSplitManager` class, allowing users to specify exact start and end offsets per partition instead of always reading the full live topic. This enables repeatable, consistent reads from Kafka — a prerequisite for building a transactionally isolated data harness across multiple sources. The video also covers the open source contribution workflow (forking, PRs, CLAs), using Guice vs Dagger for dependency injection in Trino, and plans to next tackle time-travel/snapshot queries in the Trino Hudi connector.

18m watch time
1 Impression