Kafka Connect

The fault-tolerant framework for scalably streaming data between Apache Kafka and external systems (e.g., PostgreSQL, Elasticsearch) using pre-built Source and Sink connectors.

Kafka Connect is the dedicated, open-source tool for reliably moving large datasets between Apache Kafka and external data stores. It operates via configurable **Source** (data in) and **Sink** (data out) connectors, which run on **Workers** in either standalone or highly available **Distributed Mode**. The framework handles critical operational details: offset management, fault tolerance, and automatic scaling via **Tasks**. Operators manage the entire cluster through a dedicated **REST API** (default port 8083), drastically reducing the boilerplate code required for robust data integration pipelines.

https://kafka.apache.org/documentation/#connect