A couple of weeks ago I outlined how Confluent, alongside some of its competitors, had formed the Streamhouse Working Group to back an open, vendor-neutral Streamhouse category. A Streamhouse is a data architecture that aims to keep the current state…
Join us for NODES 2026: Engineering better intelligence | Nov 12 | Register today We are the knowledge layer that delivers accurate, explainable, and trusted AI. AI and graph technologies give agents the understanding they need to generate trustworthy outputs, and humans the understanding…
Join us for NODES 2026: Engineering better intelligence | Nov 12 | Register today We are the knowledge layer that delivers accurate, explainable, and trusted AI. AI and graph technologies give agents the understanding they need to generate trustworthy outputs, and humans the understanding…
Migrate to modernize → Modernize to unlock data → unlock data to run AI From startups to enterprises, find AWS solutions scaled to your needs. Access tailored resources, pricing models, and support levels. In this post, you learn how queue consumption mode…
The Kafka protocol is still open. The commercial center of gravity is not. Seven months after IBM closed Confluent, the questions that matter are dual-run, replay, and who owns batch when the streaming story is watsonx. Apache Kafka is still…
The following example is based on Kafka 3 runtime arguments and may differ for Kafka 2. Since you already have Kafka, Pinot, and Zookeeper installed, ensure they are running. It is recommended to create new topics for each service to do testing.
This page shows how to configure Pinot schema and table files for ingesting data from a Kerberized Kafka source. It includes Kafka security settings, JAAS config, and the command to add the table using pinot-admin.sh. Use the following command…
helps you run Kafka clusters at scale. It automates Kafka operations such as monitoring cluster workload, rebalancing a cluster based on predefined constraints, and detecting and fixing anomalies. Cruise Control comprises four components — Load Monitor, Analyzer, Anomaly Detector, and Executor…
This page explains how to deploy a standalone Kafka 4 cluster in KRaft mode: get the Kafka binaries, configure the controller and broker, initialize storage, start the cluster, and create, write, and read events from a topic. Download the standalone binaries…
Kafka MirrorMaker 3 refers to MirrorMaker 2on Kafka 3, since Kafka 3 supports the MirrorMaker 2 architecture. Kafka MirrorMaker3 utility is integrated with ODP Ambari, facilitating the replication of Kafka topics between ODP clusters, allowing data transfer from source to destination and vice versa. Before configuring…
Event streaming, pub/sub, backpressure, and consumer groups at scale.
An article joins this feed when it matches these terms. Each one is also a search of its own.