Auto scaling rabbitmq consumers
Asked Answered
O

0

6

We run one consumer per python app and run multiple processes based on the queue load. As a next step, I would like to auto scale these consumer processes so that we can avoid unnecessary processes when the queue size is low and add additional processes when the pending messages grow.

How do people handle such an auto scaling mechanism for consumers, if anyone does?

Thanks.

Ory answered 15/11, 2015 at 1:39 Comment(4)
We are using spring framework's rabbittemplate and it handles auto scaling stuff but it does that by changing number of consumer of course not the number of processes. You can look into it for details.Spacecraft
@Spacecraft thanks for the comment; I hate threads/greenlets in python (very error prone if not used carefully), that's why am looking for a solution that scales processes. Thanks.Ory
@Ory did you find the solution?Autobahn
@ShashankMadan noOry

© 2022 - 2024 — McMap. All rights reserved.