title: Scraping text from long element using Requests bs4 Python3.8
body: <p>I'm using Python3.8.5 on Ubuntu 20.04. How can I scrape this html shown below and found <a href="http://nemweb.com.au/Reports/Current/" rel="nofollow noreferrer">here</a> into a Pandas DataFrame.</p>
  <p>Here is my current code:</p>
  <pre><code>import pathlib
  import sys
  
  import lxml
  import pandas as pd
  import requests
  from bs4 import BeautifulSoup
  
  response = requests.get('http://nemweb.com.au/Reports/Current/')
  soup = BeautifulSoup(response.text, 'lxml')
  names = soup.find('body')
  print(
      f&quot;Type = {type(names)}\n&quot;
      f&quot;Length = {len(names)}\n&quot;
  )
  name_list = names.find('pre')
  print(name_list.text)
  for elem in name_list.text:
      print(elem)
  #Do I need to use regex here?
  </code></pre>
  <p><a href="https://i.stack.imgur.com/7ysMN.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/7ysMN.png" alt="enter image description here" /></a></p>