Skip to main content

Monitoring Upstash Kafka Cluster with kafka-ui

kafka-ui is a GUI for monitoring Apache Kafka. From their description:

Kafka UI for Apache Kafka is a simple tool that makes your data flows observable, helps find and troubleshoot issues faster and deliver optimal performance. Its lightweight dashboard makes it easy to track key metrics of your Kafka clusters - Brokers, Topics, Partitions, Production, and Consumption.

You can connect and monitor your Upstash Kafka cluster using kafka-ui.

info

Note that some administrative actions (such as "Update Configs" or "Delete Topic") on the UI will fail with Cluster authorization failed. error. This is expected because Upstash restricts these API on protocol level and allows only on the Upstash Console.

To be able to use kafka-ui, first you should create a yaml configuration file:

kafka:
clusters:
- name: my-cluster
bootstrapServers: "tops-stingray-7863-eu1-rest-kafka.upstash.io:9092"
properties:
sasl.mechanism: SCRAM-SHA-512
security.protocol: SASL_SSL
sasl.jaas.config: org.apache.kafka.common.security.scram.ScramLoginModule required username="ZmlycG9iZXJtYW4ZHtSXVwmyJQ" password="J6ocnQfe25vUsI8AX-XxA==";
note

You should replace bootstrap.servers and sasl.jaas.config attributes with your cluster endpoint and credentials.

You can start kafka-ui application directly using jar file. First download the latest release from releases page. Then launch the application using following command in the same directory with application.yml file:

java -jar kafka-ui-api-X.Y.Z.jar

Alternatively you can start using Docker:

docker run -p 8080:8080 -v ~/kafka-ui/application.yml:/application.yml provectuslabs/kafka-ui:latest

After launching the kafka-ui app, just go to http://localhost:8080 to access UI.

For more information see kafka-ui documentation.