RabbitMq : Create queue dynamically

Question

I have a scenario where I want to publish some messages to rabbitmq-exchange using a specific routing key for eg. abc

The issue is there may already be any queue already binded with routing key "abc" or may be not. The behavior for such scenarios seem to be either drop that message or if a dead letter exchange is configured, it will be routed to dead letter exchange.

I want to dynamically create a queue with same name as the routing key i.e. "abc" if no queue is present for that routing key instead of dropping or sending it to DLX.

Is there any known way to do the same?

Madly

In JMS I wouldn't know - if it was .NET i'd suggest using the HareDU package as a starting point to check if the queue is present already. github.com/ahives/HareDu – Marlie

I do not want to make an explicit API hit to check whether the queue exists or not but I want to check if there is a way to modify the default behavior of exchange to create a queue if not present already. – Madly

@rahulroc , #21265742 this might help you – Drops

Kishor, it doesn't help. What he is trying to ask is to attach to queues dynamically on a pattern – Madly

Answer 1

From my research, I'm not aware of a way to configure the server side to create queues dynamically. However, you could do this on the client side to achieve the same effect:

Implement a ReturnListener on the channel to listen for unroutable messages. Look at the "Handling Unroutable Messages" section on this page for an example:

https://www.rabbitmq.com/api-guide.html

Then, you can use the routingKey that's passed into the handler to create a queue with the same name, using the queueDeclare() and queueBind() methods (see "Using exchanges and queues" on the same link for an example).

Liechtenstein

This is again a client side configuration which I was already aware of. What I am looking for is some exchange/broker side configuration – Madly

Answer 2

There is no afaik defaut behaviour for your case. You could create a plugin or you could rely on client logic which are the purpose of my answer.

It is important to know that RabbitMQ queue declare/bind is an idempotent operation

Declare queue, create if needed.This method creates or checks a queue. When creating a new queue the client can specify various properties that control the durability of the queue and its contents, and the level of sharing for the queue.

hypothesis 1 : queues cannot be deleted or queues can be deleted but clients will know it, the queue set can fit in memory

Each client maintains a set of queues. Before sending a message, the client checks if the set contains the queue. If not it declares and binds the queue and put the queue into the set.

At bootstrap, the queues set can be initialized with the existing queues using for example the HTTP API (eg. a java client)

How to do it depends on your RabbitMQ client. For example using spring-amqp, you can extend and override RabbitTemplate#doSend

hypothesis 2: queues can be deleted and clients will not know

As suggested by GeekChick you can register a ReturnListener. All message must be send with the mandatory flag

hypothesis 3: I don't mind the cost of declare/bind queue*

You always, prior of sending a message, declare and bind the queue. AFAIK the cost, once created, should be more or less equals to the network footprint + map lookup.

Dropline

All the methods that you pointed out involve the client side logic which create an extra overhead. I know queue creation is an idempotent operation where some properties needs to be specified while queue creation but what I am trying to figure out is some configuration which may specify some default properties and queues are created automatically. – Madly