Ruby on Rails large amount of sql queries

Question

I'm building an app that queries an api and that saves the output of the api into a database. This is no rocket science and it is working but as the amount of data is growing, the inserts are going slower.

I have a simple form that accepts a keyword which is added into the api string to get all the keywords. I now like to show the results of the api onto the screen so the user can choose what results to keep.

I've added threading in my code, so that the inserts are going faster.

Is there a way to trigger an action when all the threads are finished?

Thanks

Answer 1

The simplest way to do this is to join all the threads in a thread pool, this is effectively waiting for them to finish:

threadpool = []

threadpool << Thread.new { do_stuff }
threadpool << Thread.new { do_more }

threadpool.map &:join # wait for all threads to finish
do_final_stuff # code below the join can only run when all threads finish

But that's just if you're using plain threads.