How to prevent retrying for some Exception/Error on sidekiq

Question

I have a sidekiq worker which will request 3rd party api(Mailchimp) and got some response. Sometimes it will response an error message which the api gem will raise an error.

However, those Errors are normal and no need to retry. So I would like Sidekiq prevent retry when those Errors raised.

I have tried a simply rescue, but it won't prevent the sidekiq capture the error raised.

def preform(id)
  UpdateMailchimpService.new.(id)
rescue
  Mailchimp::ListInvalidBounceMemberError
end

Any way to do this? Thanks

Update

Finally found that my problem was caused by the broken of our deploy tool(deployment failed but not realised). Actually, the Sidekiq will ignore any rescued error/exception and they are not be retried and reported to Bugsnag.

In Bugsnag's documentation, it clearly said:

Bugsnag should be installed and configured, and any unhandled exceptions will be automatically detected and should appear in your Bugsnag dashboard.

This post on github didn't have an clear explanation so that's why I am confused by this question.

Enantiomorph

"it won't prevent the sidekiq capture the error raised" – what do you mean by that? – Philine

@Philine it means the sidekiq still know this job caused an error ListInvalidBounceMemberError, and will retry this job. – Enantiomorph

@Enantiomorph Your code example looks invalid. Can you provide real example. Because rescue prevents Sidekiq job retry for me. – Whiting

Answer 1

Your assumption/example is incorrect. Do the normal Ruby thing: rescue the error and ignore it.

def perform(id)
  UpdateMailchimpService.new.(id)
rescue NormalError
  # job will succeed normally and Sidekiq won't retry it.
end

Dixon

Hi Mike, thanks for your answer. the def block can treat as a begin block. #1543172 – Enantiomorph

And I also tried your solution but the error still appear on my bugsnag(which I think it's retried) – Enantiomorph

Hi Mike, thanks for you confirmation, I just found my deploy tool have problem so worker didn't deploy successfully. Sidekiq would ignore any rescued error. Thank you for your so wonderful gem. – Enantiomorph

Answer 2

Use retry: false advanced option:

class UpdateMailchimpWorker
  include Sidekiq::Worker
  sidekiq_options retry: false # ⇐ HERE

  def perform(id)
    UpdateMailchimpService.new.(id)
  end
end

Fem

Thanks for your answer. the sidekiq_options will change this worker totally cannot be retried. But what I want is when certain Error raised, the job stop retry. But for others, for example, connection failed, it will retry the job. – Enantiomorph