If you know Trino, you know it allows for flexible architectures that include many systems with varying use cases they support. We've come to accept this potpourri of systems as a general modus operandi for most businesses.
Many times the data is copied to different systems to accomplish varying use cases from performance and data warehousing to merge cross cutting data into a single store. When copying data between systems, how do these systems stay in sync?
We discuss Change Data Capture (CDC) and a particular implementation of it called Debezium as a method that solves this issue. It's a critical need especially for Trino to know that the state across the data sources we query are valid. Tune in to hear about CDC, Debezium, and how they are applied in real world use cases along with Trino on the next show!
- Intro Song: 00:00
- Intro: 00:33
- News: 6:02
- Concept of the week: Change Data Capture: 15:34
- Concept of the week: Debezium: 27:32
- Concept of the week: Debezium + Trino at Zomato: 45:47
- PR of the week: PR 4140 Implement aggregation pushdown in Pinot: 1:04:25
- Question of the week: Is there an array function that flattens a row into three rows?: 1:11:05
Show Notes: https://trino.io/episodes/25.html
Show Page: https://trino.io/broadcast/