title: How can I load all of a site's resources, including AJAX requests, etc.. in Python?
body: <p>I know how to request a web site and read its text with Python. In the past, I've tried using a library like BeautifulSoup to make all of the requests to links on a site, but that doesn't get things that don't look like full urls, such as AJAX requests and most requests to the original domain (since the "<a href="http://example.com" rel="nofollow">http://example.com</a>" will be missing, and more importantly, isn't in an <code>&lt;a href='url'&gt;Link&lt;/a&gt;</code>format, so BeautifulSoup will miss that).</p>
  
  <p>How can I load all of a site's resources in Python? Will it require interacting with something like Selenium, or is there a way that's not too difficult to implement without that? I haven't used Selenium much, so I'm not sure how difficult that will be.</p>
  
  <p>Thanks</p>