title: Scraping Twitter data using BeautifulSoup
body: <p>I have tried to scrape twitter data using BeautifulSoup and requests library. I tried to log in first using BeautifulSoup and then scrape the required page. But it is not working. I didn't get the mistake what I have done.</p>
  
  <p>I am adding this code:</p>
  
  <pre><code>import requests
  from bs4 import BeautifulSoup
  session_rqst=requests.session()
  url="https://twitter.com/login"
  r=requests.get(url)
  c=r.content
  soup=BeautifulSoup(c,"html.parser")
  token=soup.find("input",{"name":"authenticity_token"})
  payload = {"username": "test_user", "password": "test_password"}
  result=session_rqst.post(url, data=payload, headers = 
  dict(referer="https://twitter.com/"))
  all=result.content
  soup1=BeautifulSoup(all,"html.parser")
  page=requests.get("https://twitter.com/akhiltaker/following")
  page.content
  soup1=BeautifulSoup(page.content,"html.parser")
  </code></pre>
  
  <p>How I can scrape followers list from the webpage?</p>