title: How to allow googlebot to crawl publically visible pages on my django site that are behind login?
body: <p>I've found several posts about this but can't seem to get a straight answer for my case.</p>
  
  <p>I'm using django allauth to make users sign up before posting anything. However, all the pages are visible to the public and don't require login to view.</p>
  
  <p>How do I allow google to crawl the pages without having to go through the login?</p>
  
  <p>Would a simple sitemap work? </p>
  
  <p>I looked into first click free but from what I read it only crawls the first page after the login? Or should I whitelist the IP's?</p>
  
  <p>Any direction would be great, thanks.</p>