title: Crawling and Scraping iTunes App Store
body: <p>I noticed that <a href="http://itunes.apple.com/us/genre/mobile-software-applications/id36?mt=8" rel="noreferrer">iTunes preview</a> allows you to crawl and scrape pages via the <code>http://</code> protocol. However, many of the links are trying to be opened in iTunes rather than the browser. For example, when you go to the <a href="http://itunes.apple.com/us/app/ibooks/id364709193?mt=8&amp;v0=WWW-NAUS-ITUHOME-TOPAPPLICATIONS&amp;ign-mpt=uo%3D2" rel="noreferrer">iBooks</a> page, it immediately tries opening a url with an <code>itms://</code> protocol.</p>
  
  <p>Are there any other methods of crawling the App Store or is this the only way?</p>
  
  <p>Can the <code>itms://</code> protocol links themselves be crawled somehow?</p>