I've got a script which checks which MX record belongs to an email address. I've got about 300k emails to check. So a single threaded process is going to take a long time. I've got beanstalkd wit...

I know (but I do not understand) that Celery can use Beanstalk as delivery mechanism. From the Beanstalkd Homepage "Beanstalk is a simple, fast work queue." From the Celery Homepage "It’s a tas...

I want to write a worker for beanstalkd in php, using a Zend Framework 2 controller. It starts via the CLI and will run forever, asking for jobs from beanstalkd like this example. In simple pseudo...

Im looking to build a distributed video encoding cluster of a few dozen machines. Ive never worked with a messaging queue before, but the 2 that I started playing around with were Gearman and Beans...

Here is my needs: Enqueue_in(10.hours, ... ) (DJ syntax is perfect.) Multiply workers, concurrently. (Resque or beanstalkd are good for this, but not DJ) Must handle push and pop of 100 jobs a s...

There's a beanstalkd queue, which gets filled with a lot of tasks say every 10 minutes and it is top priority that each task is processed ASAP. Task can take more that a few milliseconds to complet...

Recently I've been researching the use of Beanstalkd with PHP. I've learned quite a bit but have a few questions about the setup on a server, etc. Here is how I see it working: I install Beansta...

I am very new to ffmpeg and beanstalk and I need a little help. I want to use beanstalk to queue files for ffmpeg to convert. I've downloaded, installed and started beanstalkd (also installed libev...

My situation ... I have a set of workers that are scheduled to run periodically, each at different intervals, and would like to find a good implementation to manage their execution. Example: Let'...

I have beanstalk installed on my server, and run the following: $ telnet localhost 11300 use my_tube USING my_tube peek-ready FOUND 11065 41 {"ts":1295537419,"data":{"nid":"212156"}} Now my ques...

I'm trying to figure out the most efficient way to running a pretty hefty PHP task thousands of times a day. It needs to make an IMAP connection to Gmail, loop over the emails, save this info to th...

I need to set up a job/message queue with the option to set a delay for the task so that it's not picked up immediately by a free worker, but after a certain time (can vary from task to task). I lo...

What's a good way to connect the synchronous http request/response model with an asynchronous queue based model? When the user's HTTP request comes it generates a work request that goes onto a que...

We have a large project coming up soon with quite a lot of media processing (Images, Video) as well email output etc, the sort of stuff normally we'd put into a table called "email_queue" and we us...

would you recommend using beanstalkd [ http://kr.github.com/beanstalkd/ ] for asynchronous processing in PHP ? I need some feedback/comments pros-cons, from anyone that has used this lib. Thanks...

I have an application in Python 2.5 that listens to a beanstalk queue. It works fine on all machines I tested so far, except from my newly acquired MacBook Pro. On that computer, when I try to ru...