title: Scraping data presented on an overlay / new window
body: <p>I am completely new to web scraping and would like to scrape reviews and property replies from: <a href="https://www.hostelworld.com/hosteldetails.php/HI-NYC-Hostel/New-York/1850#reviews" rel="nofollow noreferrer">https://www.hostelworld.com/hosteldetails.php/HI-NYC-Hostel/New-York/1850#reviews</a></p>
  <p>However, the HTML I obtain seems to be for the hostel page rather than the overlay page with the reviews, and I was wondering how to obtain and scrape from the reviews panel instead.</p>
  <p>I can scrape user reviews using the snippet below,</p>
  <pre><code>from bs4 import BeautifulSoup
  
  url = 'https://www.hostelworld.com/hosteldetails.php/HI-NYC-Hostel/New-York/1850#reviews'
  
  response = requests.get(url)
  SoupPage = BeautifulSoup(response.text, 'html.parser')
  reviews = SoupPage.find_all(class_=&quot;review-info&quot;)
  
  for rev in reviews:
      text = rev.find(class_=&quot;notes&quot;)
  </code></pre>
  <p>but it appears to be from a different source to the reviews panel since I do not see any classes or text corresponding to the property replies. Any help or suggestions would be appreciated.</p>