Ruby on Rails Sidekiq的工人执行顺序

Question

我有与Sidekiq后台工作者一起使用的Rails应用程序

MyWorker1.perform_async(param_1)
MyWorker1.perform_async(param_2) 
MyWorker1.perform_async(param_3)
MyWorker1.perform_async(param_4)

MyWorker2.perform_async(param_5) 

如何使MyWorker2仅在所有MyWorker1完成工作后才能执行？

Answer 1

你可以使用GUSH

class SimpleworkFlow < Gush::Workflow
   run MyWorker1, params: {param_1}
   run Myworker1, params: {param_2}
   run MyWorker1, params: {param_3}
   run MyWorker1, params: {param_4}
   run Myworker2, params: {param_5}, after: MyWorker1
end

出于调试目的，您可以可视化

bundle exec gush viz SampleWorkflow

然后简单的步骤

flow = SampleWorkflow.new
flow.save 

然后开始工作

bundle exec gush workers

然后开始工作流程

flow.start!

Answer 2

无论你为它付出，并使用Sidekiq与亲批 ：

class CallNextJob
  def on_success(status, options)
    MyWorker2.perform_async(options[:bundle])
  end
end

params = [param1, param2, param3, param4]
batch = Sidekiq::Batch.new
batch.on(:success, CallNextJob, bundle: param5)
batch.jobs do
  params.each {|param| MyWorker1.perform_async(param)}
end
puts "Just started Batch #{batch.bid}"

或者，您只需在每个作业的末尾保存完成状态，然后在每个MyWorker1完成时将MyWorker2入队：

# Worker1
def heavy_load(job_id)
  # do the load
  ...
  # save state
  WorkerReport.create(worker_id: job_id)
end

class WorkerReport < ActiveRecord::Base
  after_commit :do_next

  private

  # It's important to do that in after_commit block to evade strange bugs
  # When you create next job here, you are absolutely sure that
  # current WorkerReport is already saved to base
  def do_next
    # Check if other Worker1 jobs from current bundle are finished
    if self.where(...).exists?
      Worker2.perform_async(...)
    end
  end
end

Answer 3

也许您可以保留Worker1结果的结果，并在最后检查结果是否完整。 如果您有一个完整的结果，那么是否比从worker1启动worker2？

MyWorker1.perform_async（param_1）-> {done：false}，

MyWorker1.perform_async（param_2）-> {done：false}，

MyWorker1.perform_async（param_3）-> {done：false}，

MyWorker1.perform_async（param_4）-> {done：true}，

MyWorker1->如果结果完成？ MyWorker2