KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#typescript #ai-agents #cli #claude-code #codex #developer-tools #ai #dsh-plugin #ai-agent #mcp #deepseek-harness #windows

kafka-tunnel

★ 57 Open GitHub ↗

Access kafka/zookeeper in your AWS cloud via ssh tunnel to consume and produce messages

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

kafkatunnel.py
============
Access kafka/zookeeper via ssh tunnel to consume and produce messages from your local machine

Requirements
------------
You need python3 in order to use kafkatunnel.py

* python3
* pip3

**Note:** for AWS mode: you need to tag your ec2 zookeeper and kafka instances with Name=kafka/zookeeper

see https://aws.amazon.com/premiumsupport/knowledge-center/ec2-resource-tags/

Install
-------

```bash
$ git clone https://github.com/simple-machines/kafka-tunnel
$ make
```

Usage
-----

`kafkatool.py` supports two ways of passing the remote zookeeper/kafka and optionally schema registry IPs:

* automatic retrival by ec2 resource tags (Name=zookeeper/kafka)

```bash
$ kafkatunnel aws ec2-user@awsjumphost
```

* manual passing your remote zookeeper/kafka and optionally schema registry IPs

```bash
$ kafkatunnel manual ec2-user@awsjumphost 10.11.85.128,10.11.82.30,10.11.83.9 10.11.80.7,10.11.80.123,10.11.81.13 10.11.82.10,10.11.82.11
```
afterwards you have to provide your root password in order to create the interfaces

zookeeper  on 10.11.85.128    port  2181
    zookeeper  on 10.11.82.30     port  2181
    zookeeper  on 10.11.83.9      port  2181
    kafka      on 10.11.80.7      port  9091
    kafka      on 10.11.80.123    port  9091
    kafka      on 10.11.81.13     port  9091
    schemareg  on 10.11.82.10     port  8081
    schemareg  on 10.11.82.11     port  8081
     * adding interface, user password might be needed
    Password:
    connecting to jump host
    Last login: Wed Mar  4 08:19:59 2020 from 203.44.116.49

__|  __|_  )
       _|  (     /   Amazon Linux AMI
      ___|\___|___|

[ec2-user@ip-10-11-85-128 ~]$

On a second screen just do whatever you want, e.g. list all topics.

```bash
$ kafka-topics --zookeeper 10.11.85.128:2181 --list
```

kafka-tunnel

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README