Loading MQ::STREAM...
“A Consumer Group consists of multiple worker instances sharing a single Group ID. Partitions of a topic are divided evenly among instances in the group. If an instance crashes, the group coordinator initiates a Rebalance to reassign orphaned partitions.”
Distribute partition workloads across multiple worker instances with automatic failover.
// Kafka Consumer Group Definition
const consumer = kafka.consumer({
groupId: 'fraud-detection-service',
sessionTimeout: 30000,
heartbeatInterval: 3000,
partitionAssigners: [PartitionAssigners.cooperativeSticky]
});
await consumer.subscribe({ topic: 'customer-transactions', fromBeginning: false });
await consumer.run({
eachMessage: async ({ topic, partition, message }) => {
console.log(`Partition ${partition} | Offset ${message.offset}: ${message.value}`);
}
});Using Cooperative Sticky Assignor enables incremental rebalancing without stopping the world for unaffected consumers.