title: How to make multiple parallel concurrent requests with Rails and Heroku
body: <p>I am currently developing a Rails application which takes a long list of links as input, scrapes them using a background worker (Resque), then serves the results to the user. However, in some cases, there are numerous URLs and I would like to be able to make multiple requests in parallel / concurrency such that it would take much less time, rather than waiting for one request to complete to a page, scraping it, and moving on to the next one.</p>
  
  <p>Is there a way to do this in heroku/rails? Where might I find more information?</p>
  
  <p>I've come across resque-pool but I'm not sure whether it would solve this issue and/or how to implement. I've also read about using different types of servers to run rails in order to make concurrency possible, but don't know how to modify my current situation to take advantage of this.</p>
  
  <p>Any help would be greatly appreciated.</p>