BullMQ
Search…
Guide
Patterns
Bull 3.x Migration
Rate limiting
BullMQ provides rate limiting for the queues. It is possible to configure the workers so that they obey a given rate limiting option:
1
import { Worker, QueueScheduler } from "bullmq";
2
​
3
const worker = new Worker('painter', async job => paintCar(job), {
4
limiter: {
5
max: 10,
6
duration: 1000
7
}
8
});
9
​
10
const scheduler = new QueueScheduler('painter');
11
​
Copied!
Jobs that get rate limited will actually end as delayed jobs, so you need at least one QueueScheduler somewhere in your deployment so that jobs are put back to the wait status.
The rate limiter is global, so if you have for example 10 workers for one queue with the above settings, still only 10 jobs will be processed by second.
Group keys
It is also possible to define a rate limiter based on group keys, for example you may want to have a rate limiter per customer instead of a global rate limiter for all customers:
1
import { Queue, Worker, QueueScheduler } from "bullmq";
2
​
3
const queue = new Queue('painter',
4
{
5
limiter: {
6
groupKey: 'customerId',
7
}
8
});
9
​
10
const worker = new Worker('painter', async job => paintCar(job), {
11
limiter: {
12
max: 10,
13
duration: 1000,
14
groupKey: 'customerId'
15
}
16
});
17
​
18
const scheduler = new QueueScheduler('painter');
19
​
20
​
21
// jobs will be rate limited by the value of customerId key:
22
await queue.add('rate limited paint', {Â customerId: 'my-customer-id' });
23
​
24
​
Copied!
​
​
Last modified 8mo ago
Copy link
Contents
Group keys