Overview
The Kafka Connects feature provides various capabilities:
- The ability to manage multiple Kafka Connect Clusters.
- Listing all plugins avaible on all brokers.
- Listing and mutating all connectors.
- Creating and validating connector definitions and more...
If you're not familiar with the Kafka Connect concepts, I highly recommend watching this 101 course (opens in a new tab) done by the amazing Danica Fine from Confluent.
Create Local Kafka Connect
- Creating a local Kafka Connect Cluster is a simple process. You'll need to provide a name and the local Kafka Connect URL.
- You can link your Kafka Connect to an already registered Kafka Cluster. For the moment, the only use case is to be able to goto the topics page directly from the connectors table.
- If you enabled basic security on your brokers, you should enable basic authentication on the Blazing KRaft and provide the credentials.
- If you want to opt for JMX metrics, you'll need to provide the full JMX URL.
Main Configuration
Basic Authentication
JMX Configuration
Create Aiven Kafka Connect
After creating a new Aiven Kafka Service, you can enable the Kafka Connect integration.
After that it's super easy to grab the configuration and use it to create a new Kafka Connect connection in Blazing KRaft.