简体   繁体   中英

Concurrent HTTP requests in a background job (sidekiq)?

I want to check 50k RSS feeds for updates. Right now it takes a -looong- time, so I began looking into gems that do parallel HTTP requests like typhoeus , though sidekiq and typhoeus don't play well together .

What's a good way to do a bunch of simultaneous HTTP requests in the background?

https://github.com/httprb/http声称速度很快,但我还没有尝试过。

看一看em-http- request-它运行在eventmachine之上,后者是非阻塞IO的库。

The technical post webpages of this site follow the CC BY-SA 4.0 protocol. If you need to reprint, please indicate the site URL or the original address.Any question please contact:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM