title: Avoiding Google Scholar block for crawling
body: <p>I have used the following python scripts to crawl google scholar from python:</p>
  
  <pre><code>import urllib
  
  filehandle = urllib.urlopen('http://www.techyupdates.blogspot.com')
  
  for lines in filehandle.readlines():
     print lines
  
  filehandle.close()
  </code></pre>
  
  <p>but I am doing it repeatedly so I am getting blocked by the site-google scholar saying:</p>
  
  <blockquote>
    <p>This page appears when Google automatically detects requests coming from your computer network which appear to be in violation of the <a href="http://www.google.com/accounts/TOS" rel="nofollow">Terms of Service</a>. The block will expire shortly after those requests stop.  In the meantime, solving ....</p>
  </blockquote>
  
  <p>Is there an easy way to avoid this? Any suggestions?</p>