title: Java Web Crawler for retrieving google search results
body: <p>This question has been asked many times before. However some of the APIs have changed over time and I want to know a good way to implement this.</p>
  
  <p>The best way to this would be using google search api. However, <a href="https://developers.google.com/custom-search/json-api/v1/overview" rel="nofollow noreferrer">https://developers.google.com/custom-search/json-api/v1/overview</a> tells there are only 100 free search queries per day. I will require more and I dont want to spend money to do it.</p>
  
  <p>I tried it using simple REST apis, however its mostly JavaScript code and I don't seem to find what I need in the response.</p>
  
  <p>I tried using some libraries like <a href="http://jsoup.org/" rel="nofollow noreferrer">http://jsoup.org/</a> , however, even its response doesn't contain the information I need.</p>