title: Run multiple processes of a Scrapy Spider
body: <p>I have a Scrapy project which reads 1 millions product IDs from database and then starts scraping product details based on ID from a website.</p>
  
  <p>My Spider is fully working.</p>
  
  <p>I want to run 10 instances of Spider with each assigned an equal number of product IDs.</p>
  
  <p>I can do it like, </p>
  
  <p><code>SELECT COUNT(*) FROM product_ids</code> and then divide it by 10 and then do </p>
  
  <p><code>SELECT * FROM product_ids LIMIT 0, N</code> and so on</p>
  
  <p>I have an idea I can do it in Terminal by passing <code>LIMIT</code> in scrapy command like <code>scrapy crawl my_spider scrape=1000</code> and so on.</p>
  
  <p>But I want to do it in Spider, so I just run my Spider only once and then it runs 10 another processes of same spider within spider.</p>