BullMQ
Search…
What is BullMQ
Quick Start
API Reference
Changelog
Guide
Introduction
Connections
Queues
Workers
Jobs
Flows
Metrics
Rate limiting
Retrying failing jobs
Returning job data
Events
QueueScheduler
Architecture
Patterns
Manually processing jobs
Producer - Consumer
Named Processor
Flows
Real time updates
Sender - Receiver
Working with batches
Idempotent jobs
Throttle jobs
Process Step Jobs
Failing fast when Redis is down
BullMQ Pro
Introduction
Install
Observables
Groups
API Reference
Changelog
Bull
Introduction
Install
Quick Guide
Important Notes
Reference
Patterns
Bull 3.x Migration
Compatibility class
Migration
Powered By GitBook
What is BullMQ
General description of BullMQ and its features
BullMQ is a Node.js library that implements a fast and robust queue system built on top of Redis that helps in resolving many modern age micro-services architectures.
The library is designed so that it will fulfil the following goals:
  • Exactly once queue semantics, i.e., attempts to deliver every message exactly one time, but it will deliver at least once in the worst case scenario*.
  • Easy to scale horizontally. Add more workers for processing jobs in parallel.
  • Consistent.
  • High performant. Try to get the highest possible throughput from Redis by combining efficient .lua scripts and pipelining.
View the repository, see open issues, and contribute back on GitHub!

Features

If you are new to Message Queues, you may wonder why they are needed after all. Queues can solve many different problems in an elegant way, from smoothing out processing peaks to creating robust communication channels between micro-services or offloading heavy work from one server to many smaller workers, and many other use cases. Check the Patterns section for getting some inspiration and information about best practices.
  • Minimal CPU usage due to a polling-free design
  • Distributed job execution based on Redis
  • LIFO and FIFO jobs
  • Priorities
  • Delayed jobs
  • Scheduled and repeatable jobs according to cron specifications
  • Retries of failed jobs
  • Concurrency setting per worker
  • Threaded (sandboxed) processing functions
  • Automatic recovery from process crashes
  • Parent-Child dependencies

Used by

BullMQ is used by many organizations big and small, here are some notable examples:
Next
Quick Start
Last modified 3d ago
Copy link
Contents
Features
Used by