title: webscraping of commercial websites in python
body: <p>I'm a chemical engineering student. For a project, I'd like to setup a web scraper in python that could catch certain attributes of the different products. For example, I'd like to go to target and scrape info such as material, weight and a photo. So far I've tried using the lxml library, below is the code that I've tried to use unsuccessfully. I'm not interested in web scraping per se, but the data that I can collect from these websites to perform my calculations. I also found that I'll probably need a web crawler to point the scraper towards the websites I need. Anyways, is it possible for you to point me to a source that can teach this stuff for dummies? I've looked online but so far nothing has really worked.</p>
  
  <pre><code>from lxml import html 
  import requests 
  page = requests.get('https://www.target.com/p/delta-children-skylar-4-in-1-convertible-crib/-/A-52936884#lnk=sametab') 
  tree = html.fromstring(page.content) 
  data = tree.xpath('//div[@id="product-attributes"]/text()')
  </code></pre>
  
  <p>Thanks in advance!!!</p>