• Stars
    star
    3,769
  • Rank 11,674 (Top 0.3 %)
  • Language
    Go
  • Created about 5 years ago
  • Updated about 2 months ago

Reviews

There are no reviews yet. Be the first to send feedback to the community and the maintainers!

Repository Details

Redpanda Console is a developer-friendly UI for managing your Kafka/Redpanda workloads. Console gives you a simple, interactive approach for gaining visibility into your topics, masking data, managing consumer groups, and exploring real-time data with time-travel debugging.

Redpanda Console – A UI for Data Streaming

Go Report Card GitHub release (latest SemVer) Docker Repository

Redpanda Console (previously known as Kowl) is a web application that helps you manage and debug your Kafka/Redpanda workloads effortlessly.

preview.mp4

Features

  • Message viewer: Explore your topics' messages in our message viewer through ad-hoc queries and dynamic filters. Find any message you want using JavaScript functions to filter messages. Supported encodings are: JSON, Avro, Protobuf, XML, MessagePack, Text and Binary (hex view). The used enconding (except Protobuf) is recognized automatically.
  • Consumer groups: List all your active consumer groups along with their active group offsets, edit group offsets (by group, topic or partition) or delete a consumer group.
  • Topic overview: Browse through the list of your Kafka topics, check their configuration, space usage, list all consumers who consume a single topic or watch partition details (such as low and high water marks, message count, ...), embed topic documentation from a git repository and more.
  • Cluster overview: List ACLs, available brokers, their space usage, rack id and other information to get a high level overview of your brokers in your cluster.
  • Schema Registry: List all Avro, Protobuf or JSON schemas within your schema registry.
  • Kafka connect: Manage connectors from multiple connect clusters, patch configs, view their current state or restart tasks.

Getting Started

Prerequisites

  • Redpanda or any Kafka deployment (v1.0.0+) compatible
  • Docker runtime (single binary builds will be provided in the future)

Installing

We offer pre built docker images for RP Console, a Helm chart and a Terraform module to make the installation as comfortable as possible for you. Please take a look at our dedicated Installation documentation.

Quick Start

Do you just want to test RP Console against one of your Kafka clusters without spending too much time on the test setup? Here are some docker commands that allow you to run it locally against an existing Redpanda or Kafka cluster:

Redpanda/Kafka is running locally

Since Console runs in its own container (which has its own network scope), we have to use host.docker.internal as a bootstrap server. That DNS resolves to the host system's ip address. However since the brokers send a list of all brokers' DNS when a client has connected, you have to make sure your advertised listener is connected accordingly, e.g.: PLAINTEXT://host.docker.internal:9092

docker run -p 8080:8080 -e KAFKA_BROKERS=host.docker.internal:9092 docker.redpanda.com/redpandadata/console:latest

Docker supports the --network=host option only on Linux. So Linux users use localhost:9092 as an advertised listener and use the host network namespace instead. Console will then be run as it would be executed on the host machine.

docker run --network=host -p 8080:8080 -e KAFKA_BROKERS=localhost:9092 docker.redpanda.com/redpandadata/console:latest

Kafka is running remotely

Protected via SASL_SSL and trusted certificates (e.g. Confluent Cloud):

docker run -p 8080:8080 -e KAFKA_BROKERS=pkc-4r000.europe-west1.gcp.confluent.cloud:9092 -e KAFKA_TLS_ENABLED=true -e KAFKA_SASL_ENABLED=true -e KAFKA_SASL_USERNAME=xxx -e KAFKA_SASL_PASSWORD=xxx docker.redpanda.com/redpandadata/console:latest

I don't have a running Kafka cluster to test against

We maintain a docker-compose file that launches Redpanda and Console: /docs/local.

Community

Slack is the main way the community interacts with one another in real time :)

GitHub Issues can be used for issues, questions and feature requests.

Code of conduct code of conduct for the community

Contributing docs

Companies that use Redpanda Console

More Repositories

1

redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
C++
9,485
star
2

connect

Fancy stream processing made operationally mundane
Go
8,113
star
3

awesome-distributed-transactions

Awesome list of distributed transactions
725
star
4

kminion

KMinion is a feature-rich Prometheus exporter for Apache Kafka written in Go. It is lightweight and highly configurable so that it will meet your requirements.
Go
615
star
5

benthos

Go
205
star
6

redpanda-connect-plugin-example

Benthos plugin examples
Go
89
star
7

helm-charts

Redpanda Helm Chart
Go
75
star
8

deployment-automation

Cluster configuration best practices
HCL
64
star
9

redpanda-operator

Go
36
star
10

openmessaging-benchmark

Java
35
star
11

observability

Python
34
star
12

redpanda-connect-helm-chart

Helm 3 repository for benthosdev/benthos
Smarty
34
star
13

seastar-starter

Seastar boilerplate project with cmake
C++
30
star
14

redpanda-edge-agent

Lightweight internet of things agent that forwards events from the edge
Go
28
star
15

pglogicalstream

PostgreSQL Logical Replication CDC Module for Streaming Database Changes with Golang
Go
23
star
16

redpanda-labs

The home for Redpanda Labs projects.
Go
22
star
17

pg_stream

Postgres Logical Replication plugin for benthos
Go
18
star
18

redpanda-examples

A collection of examples to demonstrate how to interact with Redpanda from various clients and languages.
Go
9
star
19

redpanda-ansible-collection

Python
7
star
20

docs-extensions-and-macros

Extensions and macros developed for Redpanda documentation.
JavaScript
6
star
21

client-swarm

Test utility for running large numbers of concurrent client sessions
Rust
6
star
22

chaos

Python
6
star
23

terraform-provider-redpanda

Go
6
star
24

flink-kafka-examples

A repo of Java examples using Apache Flink with flink-connector-kafka
Java
6
star
25

rp-connect-docs

Documentation for Redpanda Connect
Shell
6
star
26

docs

Open source content for the Redpanda documentation
JavaScript
5
star
27

github-action

Shell
5
star
28

kgo-verifier

Test utility based on franz-go, for consistency checking of Redpanda reads vs. writes
Go
5
star
29

2023-stream-processing-apache-flink-redpanda

Repository containing all the code you need to build a simple streaming ETL pipeline from scratch.
Python
5
star
30

alien_thread

Tools for interoperating with native threads from Seastar
C++
4
star
31

common-go

Go
3
star
32

terraform-aws-redpanda-cluster

HCL
3
star
33

2023-build-time-series-data-stream-timescale-db

This is the GitHub repo for the Redpanda tutorial on building a time series data stream using TimescaleDB
Dockerfile
2
star
34

docs-ui

UI project for the Redpanda documentation site.
CSS
2
star
35

cloud-docs

Redpanda Cloud documentation
JavaScript
2
star
36

kubecon-na-2023

Different Redpanda in Kubernetes Deployment Examples
Shell
1
star
37

how-to-connect-code-snippets

1
star
38

databalancer

Go
1
star
39

2023-unify-log-data-parseable

1
star
40

homebrew-tap

Redpanda Homebrew Tap
Ruby
1
star
41

gcp-psc

HCL
1
star
42

kafka-fsync

Dockerfile
1
star
43

developer-diaries

This repository serves as a comprehensive resource for beginner and intermediate learners in the fields of data engineering and analytics. It contains a curated collection of sketch notes designed to simplify complex concepts and system designs through visual diagrams and concise summaries.
1
star