Redpanda Connect now ships a native `oracledb_cdc` input that reads Oracle redo logs via LogMiner to capture row-level changes without Debezium, Kafka Connect, or a JVM. The walkthrough builds a two-stage pipeline: Oracle changes flow into a durable Redpanda topic, then a second pipeline reads that topic and writes to ClickHouse using `sql_insert` with the `ReplacingMergeTree(_scn)` engine to automatically deduplicate updates. Both stages are configured as single-binary YAML files run with `rpk connect run`. Key details include enabling ARCHIVELOG mode and supplemental logging on Oracle, using `stream_snapshot: true` for initial data load, setting Kafka keys to primary keys for ordered partitioning, and batching inserts for ClickHouse performance. The `oracledb_cdc` connector is an enterprise feature available via a free 30-day trial license.

8m read timeFrom redpanda.com
Post cover image
Table of contents
Why Oracle to ClickHouse, and why now #The architecture #Prerequisites #Step 2: Prepare Oracle for CDC #Step 3: Stream Oracle changes into Redpanda #Step 4: Land the stream in ClickHouse #Step 5: Watch it work end to end #What's next? #
162 Impressions