Confluent Developer - Videos
Back to ChannelThe Evolution of Data Storage (And What's Next) | Modern Data Engineering Pipelines
https://confluent.io | Due to possible truncation where this is used, locate the most important keywords at the beginning, with additional info (course name, hands-on, etc) at the end Are data...
If Memento was about AI Agents
ReAct agent Viktor must navigate the lost forest of his stateless mind to catch a cunning, clawed villain in order to fulfill his one true purpose: to restore shareholder value. CREDITS "LLMento"...
Why are data engineers building custom furniture (and how to stop)? | Data Engineering Pipelines
More: https://developer.confluent.io/ | Why are data engineers building custom furniture when they could be creating reusable data products? Organizations collect massive amounts of raw data daily...
Building Banking Systems with Kafka Streams with Mateo Rojas | Ep. 28 | Confluent Developer Podcast
Listen: https://confluent.buzzsprout.com | Adi Polak talks to Mateo Rojas (LittleHorse) about his career working with Kafka Streams. Mateo’s first job: building a real-money policy management platf...
Lambda vs Kappa vs Data Streaming Platform — Which One Wins? | Modern Data Engineering Pipelines
https://confluent.io | Which data engineering architecture should you actually use? Most teams start with batch pipelines, then bolt on streaming when someone asks for a real-time dashboard. The re...
The AI Impact on the Developer Future with Joseph Morais | Ep. 27 | Confluent Developer Podcast
Listen: https://confluent.buzzsprout.com | Tim Berglund talks to Joseph Marais (Confluent) about his career in data streaming. Joseph’s first job: SAN administrator. His challenge: AI radically cha...
Why Is It So Hard to Make Data Useful? | Modern Data Engineering Pipelines
More: https://developer.confluent.io/ | Why do organizations spend $12.9 million annually on poor data quality while data engineers waste 80% of their time cleaning up messy data? Despite generati...
Tech vs. People: The Hardest Problem with Will LaForest | Ep. 26 | Confluent Developer Podcast
Listen: https://confluent.buzzsprout.com | Tim Berglund talks to Will LaForest (Confluent) about his career in software and data streaming. Will’s first job: a high school internship at DARPA. His ...
The Hidden Cost of Batch Processing | Modern Data Engineering Pipelines
https://confluent.io | How a 59-minute delay can cost millions and destroy customer trust. What happens when your data pipeline is perfectly functional but fundamentally flawed? This video explores...
Why Modern Data Systems Are Moving to Kappa Architecture
https://confluent.io | Understand the difference between Lambda and Kappa architectures and why stream-first systems are becoming the new standard LEARN MORE ► Confluent Developer: https://develop...
Do You Really Need a Kafka Proxy?
https://confluent.io | Learn what a Kafka proxy actually does, the problems it solves, and when the extra hop, latency, and operational complexity are justified. LEARN MORE ► Confluent Developer: ...
How Maven Changed Java Forever with Baruch Sadogursky | Ep. 25 | Confluent Developer Podcast
Listen: https://confluent.buzzsprout.com | Viktor Gamov talks to Baruch Sadogursky (TuxCare) about his career in developer advocacy. Baruch's first job: fixing electric kettles. His challenge: figu...
Why Kafka Needs Schemas (And What Schema Registry Does)
https://confluent.io | In Apache Kafka, messages are just bytes. Schemas define the structure of those messages, and Schema Registry manages them—versioning schemas, assigning IDs, and enforcing co...
From Batch to Streaming: Modern Data Engineering Pipelines | Modern Data Engineering Pipelines
More: https://developer.confluent.io/ | Are your batch pipelines processing yesterday's data while today's opportunities slip away? The world has changed. AI systems make decisions in milliseconds...
Why Do Data Engineers Exist? (The $4 Million Answer)
https://confluent.io | What if better data engineering could have prevented Coca-Cola's $4 million "New Coke" disaster? In 1985, Coca-Cola conducted 200,000 taste tests and still made one of the w...
Streaming Frontiers - S01E011 - We Need No Keeper
In this episode of Streaming Frontiers, we’ll tackle one of the most requested topics in the Apache Kafka® community: migrating a ZooKeeper-based Kafka cluster to KRaft on Kubernetes. You’ll hear f...
Duplicates or Data Loss? Kafka’s 3 Delivery Guarantees
https://confluent.io | A quick explanation of Kafka’s three delivery guarantees—at-most-once, at-least-once, and exactly-once—and when to use each. LEARN MORE ► Confluent Developer: https://develo...
Inside OpenAI’s Streaming Backbone with Aravind Suresh | Ep. 24 | Confluent Developer Podcast
Listen: https://confluent.buzzsprout.com | Adi Polak talks to Aravind Suresh (OpenAI) about his career in distributed systems and real-time streaming. Arvind’s first job: coding at school. His chal...
Agent2Agent (A2A) at work?
Most multi-agent work today is pretty simple: instances of Claude Code hammering away on a codebase and coordinating through the file system on a laptop. If you want to build multi-agent systems in...
The 1 Billion Row Challenge with Gunnar Morling | Ep. 23 | Confluent Developer Podcast
Listen: https://confluent.buzzsprout.com | Tim Berglund talks to Gunnar Morling (Confluent) about his career in open source Java and data streaming. Gunnar’s first job: a student PHP developer in A...
Real-Time Data with Tableflow | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | In this final module, Tim shows how Confluent’s Tableflow turns Kafka topics into Apache Iceberg tables with exactly-once delivery, auto...
Shift Left in Data Pipelines
https://confluent.io | In modern data systems, fixing problems downstream is too late. Shift left means validating data earlier—right where it’s produced. Schemas, contracts, CI tests, and observab...
Agent Skills or MCP in the era of Claude Code?
Agentic AI and Claude Code are having a moment, thanks in no small part to agent skills. What does this mean for MCP? In his newest lightboard, Tim Berglund sorts it out. Along the way, he recaps w...
Apache Flink in 60 Seconds
https://confluent.io | In this quick 60-second breakdown, learn how Flink powers real-time data processing at massive scale. LEARN MORE ► Confluent Developer: https://developer.confluent.io CONNE...
From Git Blame to Principal Engineer with Sage Pierce | Ep. 22 | Confluent Developer Podcast
Listen: https://confluent.buzzsprout.com | Adi Polak talks to Sage Pierce (Indeed) about his career in software engineering. Sage’s first job: Java Swing development at a Department of Defense–affi...
Kafka as a Queue?
https://confluent.io | With KIP-932, shared consumer groups allow multiple consumers to process the same partition, bringing queue-like scaling while keeping Kafka’s event log semantics. https://c...
Query Engines and Ecosystem | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | Tim shows how Apache Iceberg opens the door to a rich ecosystem of engines and tools, all reading from the same tables with no copies, n...
Clustering | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | Tim is back to explain how clustering techniques like Z-ordering complement Apache Iceberg partitioning to fix skew and keep queries fas...
Metadata Tables | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | Tim is back to explain how Apache Iceberg metadata tables let you query table internals with simple SQL. With them, you can trace table ...
Tagging and Branching | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | Tim is back to show how Apache Iceberg brings Git-style version control to your data. In this session, you’ll learn how branching and ta...
Time Travel and Rollback | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | Tim shows how Apache Iceberg’s time travel feature lets you query tables as they looked at any point in the past, recover from bad delet...
Partitioning and Partition Evolution | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | In this episode of our Apache Iceberg + Tableflow course, Tim explains how Apache Iceberg’s hidden partitioning lets query engines prune...
Table Maintenance | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | Tim is back, this time tackling the unglamorous but essential side of Apache Iceberg: maintenance. He covers how to clean up old snapsho...
External systems & data streaming | The Duchess & The Doctor #3 ft. Anna McDonald & Matthias J. Sax
Apache Kafka® experts Anna McDonald and Matthias J. Sax talk integrating external systems and databases with Kafka Streams. They examine the operational trade-offs between synchronous and asynchron...
From Coding Machines to Leading Humans ft. Leonid Igolnik | Ep. 21 | Confluent Developer Podcast
Viktor Gamov talks to Leonid Igolnik (Former CTO at Clari) about his career in B2B SaaS engineering leadership. Leonid’s first job: teaching kids Pascal. His challenge: changing buyer behavior and ...
Kafka Streams, State & Windowing | The Duchess & The Doctor #2 ft. Anna McDonald & Matthias J. Sax
Apache Kafka® experts Anna McDonald and Matthias J. Sax analyze the suppress function, emit strategies in Kafka Streams, and the architectural trade-offs between in-memory buffers and RocksDB-based...
Kafka experts explain Events | The Duchess & The Doctor #1 ft. Anna McDonald & Matthias J. Sax
Two of Confluent’s most beloved Apache Kafka® experts, The Duchess (Anna McDonald) and The Doctor (Matthias J. Sax), along with their extinct friend, Phil, discuss all things eventing in this remas...
ACID Transactions | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | Tim returns to explain how Apache Iceberg finally brings real ACID transactions to data lake tables stored in object stores, making them...
Updates and Deletes | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | In this episode, Tim Berglund explains how Apache Iceberg handles real-world updates and deletes with full ACID guarantees. He'll show y...
Data Types and Schema Evolution | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | Tim Berglund explores how Apache Iceberg turns schema evolution from a painful migration into a fast, metadata-only update. This episode...
Killing Clusters & Orchestrating Chaos with Colt McNealy | Ep. 20 | Confluent Developer Podcast
Listen: https://confluent.buzzsprout.com | Tim Berglund talks to Colt McNealy (LittleHorse Enterprises) about his career in distributed systems. Colt’s first job: software engineer at a real estate...
Architecture & Concepts | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | In this episode, Tim Berglund traces the evolution from fragile, file-based data lakes to Apache Iceberg, the open table format that mak...
Catalog | Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | In this episode, Tim Berglund breaks down the Iceberg catalog: the layer that maps table names to metadata files so engines like Spark a...
Welcome to Apache Iceberg + Tableflow
Get started: https://cnfl.io/apache-iceberg-101-learn-more | Tim Berglund hosts our newest course: Apache Iceberg and Tableflow. This 14-module course covers how Iceberg brings transactions, time t...
Apache Kafka 4.2 | 38 KIPs, Kafka Streams, Observability Improvements, Rebalance Protocol, and more
Blog: https://kafka.apache.org/blog/2026/01/14/apache-kafka-4.2.0-release-announcement/ | Sandon Jacobs (Senior Developer Advocate, Confluent) highlights the key features in Apache Kafka 4.2, a clo...
Deleting Architecture for Better Systems ft. Daniel Doubrovkine | Ep. 19 | Confluent Developer Pod
Listen: https://confluent.buzzsprout.com | Adi Polak talks to Daniel Doubrovkine (Shopify) about his career building data‑intensive systems. Daniel’s first job: delivering pharmacy medications by b...
Prompt Engineering is dead.
Tim Berglund and the lightboard are back with an overview of Context Engineering in agentic AI. He breaks down the components that make up context (including system prompts, tools, and resources) a...
Fail Fast & Ship It with Jeremy Custenborder | Ep. 18 | Confluent Developer Podcast
Listen: https://confluent.buzzsprout.com | Viktor Gamov talks to Jeremy Custenborder (Confluent) about his career in large-scale systems. Jeremy’s first job: paper boy. His challenge: keeping MySpa...
Cursor Is Not for Code
More: https://developer.confluent.io/ | Think Cursor is just another AI coding assistant? Think again - it's actually designed for something completely different. This video reveals the surprising...
From “This May Never Work” to WarpStream with Richie Artoul | Ep. 17 | Confluent Developer Podcast
Listen: https://confluent.buzzsprout.com | Tim Berglund talks to Richie Artoul (WarpStream/Confluent) about his career in data infrastructure. Richie’s first job: working at Howie’s Game Shack, a w...