kafkajs-metrics

KO | EN

gitlite — search

#javascript #python #ai #android #machine-learning #deep-learning #linux #docker #macos #java #awesome-list #mcp #openai #open-source

kafkajs-metrics

(★ 62)

A lightweight KafkaJS library that provides simple access to key metrics and real-time alerts within your code

kafkajs-metrics Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# **KafkaJSMetrics**

A lightweight KafkaJS library that provides simple access to key metrics within your code. KafkaJSMetrics enables custom breakpoint alerts and logging of key metrics, allowing for client health to be monitored within applications. The optional visualizer feature introduces a real-time, web browser display of the metrics associated with your KafkaJS client.

## Table of Contents

- [Introduction](#introduction)
- [Features](#features)
- [Getting Started](#getting-started)
  - [Installation](#installation)
  - [Usage](#usage)
  - [Visualization](#visualization)
- [Community](#Community)
- [Contributors](#contributors)
- [Other](#other)

# **Introduction**

Apache Kafka is a distributed event streaming platform that is designed to handle high performance data pipelines in real-time. KafkaJS is a lightweight, user-friendly Apache Kafka client library that runs on Node.js, providing a simple and reliable way to produce and consume messages from Kafka clusters. Event emitters called instrumentation events are built into KafkaJS and provide information about the performance and behavior of a user's Kafka producers and consumers. These events are designed to help developers monitor and troubleshoot their Kafka applications. However, incorporating instrumentation events into code can be tedious and repetitive.

KafkaJSMetrics is a continuously-growing open source product that is designed to simplify and shorten the metric exposing processes. By committing to 100% Javascript alongside KafkaJS, the library leverages already built-in instrumentation events without relying on other third-party applications or requiring any additional installations. The library gives developers simple access to key metrics required to monitor the health of a Kafka instance.

## **Features**

Below are some of the key features from KafkaJSMetrics. For a full explanation of library functionality, visit our [docs](https://www.kafkajsmetrics.com/docs/index.html).

**Key features:**

- Access to key consumer/producer/admin metrics, including
  - offset lag
  - messages consumed
  - total number of consumer/producer/admin currently connected
  - heartbeat
  - partition assignment
  - see [docs](https://www.kafkajsmetrics.com/docs/index.html) for complete metrics
- Custom Breakpoint Alerts and On/Off metrics logging options, including
  - heartbeat monitor
  - request queue size monitor
  - request pending duration monitor
  - offset lag monitor
  - see [docs](https://www.kafkajsmetrics.com/docs/index.html) for complete Breakpoint Alert and metrics logging options
- Web browser visualizer displays consumer metrics in real-time
  - Secure token access and developer-friendly interface

---

# **Getting Started**

KafkaJSMetrics works with your KafkaJS client. For information on setting up your KafkaJS client, visit [KafkaJS](https://kafka.js.org/).

- [Installation](#installation) and [Usage](#usage) walk through setting up the KafkaJSMetrics library for use within your KafkaJS Client code

- [Visualization](#visualization) takes you through the optional feature set-up for web browser visual display of your KafkaJS Client metrics

## **Installation**

---

Install the kafkajs-metrics-visualize package from [npm](https://www.npmjs.com/)

```bash
npm install kafkajs-metrics-visualize
```

---

## **Usage**

KafkaJSMetrics works with your existing KafkaJS client. More information about KafkaJS at [kafka.js.org](https://kafka.js.org/).

1. Require KafkaJSMetrics in your KafkaJS Client file to access metricize function
<img src="https://raw.githubusercontent.com/oslabs-beta/kafkajs-metrics/main/assets/requireInKafkaJSMetrics.png" width='400' style="margin-top: 10px; margin-bottom: 10px;">

2. Pass your KafkaJS Client instance into the metricize function (sample KafkaJS Client provided)

- All consumer, producer, and admin instances created from this client will now have metrics and metrics-associated functionality

3. Run your KafkaJS Client file (skip this step if you are planning use the visualizer)

```bash
node client.js
```

### **Turn on logging methods**

Visit the [docs](https://www.kafkajsmetrics.com/docs/index.html) for a full list of available logging methods

Example:

Prints to console:

### **Turn on breakpoint alerts**

Visit the [docs](https://www.kafkajsmetrics.com/docs/index.html) for a full list of available breakpoint alert methods

Example:

Prints to console:

---

## **Visualization**

The following steps will allow you to access the web browser visualizer to display metrics. This visualizer is an optional feature and will not affect the library performance.

1. Open the [KafkaJSMetrics webpage](https://www.kafkajsmetrics.com). Click on the [visualizer tab](https://www.kafkajsmetrics.com/#/visualizer) and generate a new token

2. Copy the token and head back to your KafkaJS client file. Inside the metricize function, add two additional arguments:

- first argument is the boolean value true
   - second argument is your copied token

3. Run your KafkaJS Client file

```bash
node client.js
```

4.  Back in the browser, click authenticate to access your web browser metrics display

---

# **Community**

As KafkaJSMetrics continues to grow, we welcome and encourage feedback! We are also always trying to improve our code so we actively welcome all contributions! If you would like to be a part of this product, please follow the steps below.

1. Fork this repo of KafkaJSMetrics and then clone it to your machine
2. Check out into the branch that you want to make contributions in

1. Contributions to the website and/or visualizer:

```bash
      git checkout visualizer
      ```

2. Contributions to the library:

```bash
      git checkout library
      ```

3. Create a feature branch

```bash
git checkout -b [feature/AmazingFeature]
```

4. Add all your changes with the add command

```bash
git add [all your changes]
```

5. Commit all your changes

```bash
git commit -m '<your comment>'
```

6. Make sure the visualizer OR library branch is up to date

1. Check back out to the visualizer OR library branch

```bash
   git checkout visualizer [OR] library
   ```

2. Pull down the latest version

```bash
   git pull origin visualizer [OR] library
   ```

3. Check back out to your feature branch

```bash
   git checkout [feature/AmazingFeature]
   ```

7. Merge your branch with visualizer OR library

```bash
git merge visualizer [OR] library
```

8. Resolve any merge conflicts
9. Run unit tests and make sure all tests pass

```bash
npm test
```

10. Push up your branch with the command

```bash
git push origin [feature/AmazingFeature]
```

11. Finally, open a pull request for us to review!

---

# **Contributors**

- Rebecca Anderson - [GitHub](https://github.com/Randers9) | [LinkedIn](https://www.linkedin.com/in/rebecca--anderson/)
- Paul Davey - [GitHub](https://github.com/pauldavey1) | [LinkedIn](https://www.linkedin.com/in/paulcdavey/)
- Ranan Hui - [GitHub](https://github.com/rananhui) | [LinkedIn](https://www.linkedin.com/in/rananhui/)
- Amanda Smith - [GitHub](https://github.com/amsmithf) | [LinkedIn](https://www.linkedin.com/in/amanda-margaret-smith/)
- Josh Tesoro - [GitHub](https://github.com/jshwatsoro) | [LinkedIn](https://www.linkedin.com/in/joshwa-tesoro/)

---

# **Other**

Important links:

- [Full Documentation](https://www.kafkajsmetrics.com/docs/index.html)
- [Website](https://www.kafkajsmetrics.com) and [Visualizer](https://www.kafkajsmetrics.com/#/visualizer)
- Check out our latest [Medium article](https://medium.com/@ranan.n.hui/introducing-kafkajsmetrics-a-revolutionary-way-to-expose-metrics-in-kafkajs-ae62678bd3b0)

_KafkaJSMetrics and KafkaJSMetrics Visualizer are licensed under the Mozilla Public License version 2.0 and are available for free. We have no affiliation with and are not endorsed by either The Apache Software Foundation or the developers of KafkaJS._

---

kafkajs-metrics

kafkajs-metrics Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

kafkajs-metrics

kafkajs-metrics Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README