KO | EN

GitLite

Minimalist Open Source Repository Search Engine

gitlite — search

#developer-tools #codex #typescript #ai-agents #ai-agent #cli #claude-code #open-source #deepseek-harness #dsh-plugin #python #mcp

bullmq

★ 9,300 Open GitHub ↗

BullMQ - Message Queue and Batch processing for NodeJS, Python, .NET, Elixir, Rust and PHP based on Redis or PostgreSQL

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

<div align="center">
  <br/>
  <img src="https://user-images.githubusercontent.com/95200/143832033-32e868df-f3b0-4251-97fb-c64809a43d36.png" width="800" />
  <br/>
  <br/>
  <p>
    The fastest, most reliable, Redis-based distributed queue for Node.js, Python, Elixir, .NET, Rust, PHP, and more. <br/>
    Carefully written for rock solid stability and atomicity.
  </p>
  Read the <a href="https://docs.bullmq.io">documentation</a>
  <br/>
  <br/>
  <p>
    <a href="https://join.slack.com/t/bullmq/shared_invite/zt-1nbtpk6mv-TItWpF9jf3k4yrCaS0PPZA">
      <img src="https://img.shields.io/badge/Slack-4A154B"/>
    </a>    
    <a href="https://badge.fury.io/js/bullmq">
      <img src="https://badge.fury.io/js/bullmq.svg"/>
    </a>
    <a href="https://coveralls.io/github/taskforcesh/bullmq?branch=master">
      <img src="https://coveralls.io/repos/github/taskforcesh/bullmq/badge.svg?branch=master"/>
    </a>
    <a href="https://github.com/semantic-release/semantic-release">
      <img src="https://img.shields.io/badge/%20%20%F0%9F%93%A6%F0%9F%9A%80-semantic--release-e10079.svg"/>
    </a>
    <a href="https://github.com/sponsors/taskforcesh">
      <img src="https://img.shields.io/badge/sponsor-30363D?style=flat&logo=GitHub-Sponsors&logoColor=EA4AAA"/>
    </a>
  </p>
  <p>
    <em><a href="https://x.com/bullmqhq">Follow Us</a> for *important* Bull/BullMQ/BullMQ-Pro news and updates!</em>
  </p>
</div>

# 🛠 Tutorials

You can find tutorials and news in this blog: https://blog.taskforce.sh/

# News 🚀

## 🌐 Language agnostic BullMQ

BullMQ is available natively in multiple languages:

- **Node.js / Bun** — This repository (`npm install bullmq`)
- **Python** — [`python/`](./python) directory (`pip install bullmq`)
- **Rust** — [`rust/`](./rust) directory (`cargo add bullmq-official --rename bullmq`)
- **Elixir** — [`elixir/`](./elixir) directory (`{:bullmq, "~> x.x"}`)
- **.Net** — [`dotnet/`](./dotnet) directory (`dotnet add package BullMQ`)
- **PHP** — [`php/`](./php) directory

For other platforms, check out the [BullMQ Proxy](https://github.com/taskforcesh/bullmq-proxy).

# Official FrontEnd

[<img src="https://taskforce.sh/assets/logo_square.png" width="150" alt="Taskforce.sh, Inc" style="padding: 200px"/>](https://taskforce.sh)

Supercharge your queues with a professional front end:

- Get a complete overview of all your queues.
- Inspect jobs, search, retry, or promote delayed jobs.
- Metrics and statistics.
- and many more features.

# 🚀 Sponsors 🚀

<table cellspacing="0" cellpadding="0" border="0">
  <tr>
    <td>
      <a href="https://www.dragonflydb.io/">
        <img src="https://raw.githubusercontent.com/dragonflydb/dragonfly/main/.github/images/logo-full.svg" width=550 alt="Dragonfly" />
      </a>
    </td>
    <td>
      Dragonfly is a new Redis™ drop-in replacement that is fully compatible with BullMQ and brings some important advantages over Redis™ such as massive
      better performance by utilizing all CPU cores available and faster and more memory efficient data structures. Read more <a href="https://www.dragonflydb.io/docs/integrations/bullmq">here</a> on how to use it with BullMQ.
    </td>
  </tr>
</table>

# Used by

Some notable organizations using BullMQ:

# The gist

Install:

```
$ yarn add bullmq
```

If you use the node-redis adapter (`createNodeRedisClient`), install `redis` v5 or newer (`redis >= 5.0.0`).

If you use the Valkey Glide adapter (`createValkeyGlideClient`), install `@valkey/valkey-glide`.

Add jobs to the queue:

```ts
import { Queue } from 'bullmq';

const queue = new Queue('Paint');

queue.add('cars', { color: 'blue' });
```

Process the jobs in your workers:

```ts
import { Worker } from 'bullmq';

const worker = new Worker('Paint', async job => {
  if (job.name === 'cars') {
    await paintCar(job.data.color);
  }
});
```

Listen to jobs for completion:

```ts
import { QueueEvents } from 'bullmq';

const queueEvents = new QueueEvents('Paint');

queueEvents.on('completed', ({ jobId }) => {
  console.log('done painting');
});

queueEvents.on(
  'failed',
  ({ jobId, failedReason }: { jobId: string; failedReason: string }) => {
    console.error('error painting', failedReason);
  },
);
```

Adds jobs with parent-child relationship:

```ts
import { FlowProducer } from 'bullmq';

const flow = new FlowProducer();

const originalTree = await flow.add({
  name: 'root-job',
  queueName: 'topQueueName',
  data: {},
  children: [
    {
      name: 'child-job',
      data: { idx: 0, foo: 'bar' },
      queueName: 'childrenQueueName',
      children: [
        {
          name: 'grandchild-job',
          data: { idx: 1, foo: 'bah' },
          queueName: 'grandChildrenQueueName',
        },
        {
          name: 'grandchild-job',
          data: { idx: 2, foo: 'baz' },
          queueName: 'grandChildrenQueueName',
        },
      ],
    },
    {
      name: 'child-job',
      data: { idx: 3, foo: 'foo' },
      queueName: 'childrenQueueName',
    },
  ],
});
```

This is just scratching the surface, check all the features and more in the official <a href="https://docs.bullmq.io">documentation</a>

# Feature Comparison

Since there are a few job queue solutions, here is a table comparing them:

| Feature                    | [BullMQ-Pro](https://bullmq.io/#bullmq-pro) | [BullMQ](https://bullmq.io) |      Bull       |  Kue  | Bee      | Agenda |
| :------------------------- | :-----------------------------------------: | :-------------------------: | :-------------: | :---: | -------- | ------ |
| Backend                    |                    redis                    |            redis            |      redis      | redis | redis    | mongo  |
| Observables                |                      ✓                      |                             |                 |       |          |        |
| Group Rate Limit           |                      ✓                      |                             |                 |       |          |        |
| Group Support              |                      ✓                      |                             |                 |       |          |        |
| Batches Support            |                      ✓                      |                             |                 |       |          |        |
| Parent/Child Dependencies  |                      ✓                      |              ✓              |                 |       |          |        |
| Deduplication (Debouncing) |                      ✓                      |              ✓              |        ✓        |       |          |        |
| Deduplication (Throttling) |                      ✓                      |              ✓              |        ✓        |       |          |        |
| Priorities                 |                      ✓                      |              ✓              |        ✓        |   ✓   |          | ✓      |
| Concurrency                |                      ✓                      |              ✓              |        ✓        |   ✓   | ✓        | ✓      |
| Delayed jobs               |                      ✓                      |              ✓              |        ✓        |   ✓   |          | ✓      |
| Global events              |                      ✓                      |              ✓              |        ✓        |   ✓   |          |        |
| Rate Limiter               |                      ✓                      |              ✓              |        ✓        |       |          |        |
| Pause/Resume               |                      ✓                      |              ✓              |        ✓        |   ✓   |          |        |
| Sandboxed worker           |                      ✓                      |              ✓              |        ✓        |       |          |        |
| Repeatable jobs            |                      ✓                      |              ✓              |        ✓        |       |          | ✓      |
| Atomic ops                 |                      ✓                      |              ✓              |        ✓        |       | ✓        |        |
| Persistence                |                      ✓                      |              ✓              |        ✓        |   ✓   | ✓        | ✓      |
| UI                         |                      ✓                      |              ✓              |        ✓        |   ✓   |          | ✓      |
| Optimized for              |               Jobs / Messages               |       Jobs / Messages       | Jobs / Messages | Jobs  | Messages | Jobs   |

## Contributing

Fork the repo, make some changes, submit a pull-request! Here is the [contributing](https://github.com/taskforcesh/bullmq/blob/master/contributing.md) doc that has more details.

# Thanks

Thanks for all the contributors that made this library possible,
also a special mention to Leon van Kammen that kindly donated
his npm bullmq repo.

bullmq

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README