title: How to perform a search in a custom website and read results?
body: <p>I am developing a function to download protein .pdb files online as part of a body of code I am creating to dock protein and ligands generated by our AIBind machine learning model. For around 60% of these proteins I am able to use gene libraries to convert their HGNC IDs to pdb IDs, which I then query through the website uniprot and RCSB to download pdb files. However, for the other 40% there only exist computationally generated alphafold PDB models for the proteins, and the gene libraries I have been using do not recognize these proteins as having valid PDB IDs. Thankfully, there is a search function on the alphafold website, where by searching with the HGNC ID, I recieve a list of entries (where the top one is 99% the protein I am looking for), as shown below;</p>
  <p><a href="https://i.stack.imgur.com/lRqWI.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/lRqWI.png" alt="enter image description here" /></a></p>
  <p>Once I have the uniprot ID (which is shown in this example as Q7K0E6), I can then navigate to the alphafold entry page and access the file server to download the PDB file for that protein, which I have already been able to successfully perform for proteins that have a registered uniprot ID in the databanks that I have been utilizing.</p>
  <p>I've been using the following code to scrape the search webpage with the HGNC symbol inputted as a search entry, putting all of the HTML page data into a text file.</p>
  <pre><code>  import urllib
    import urllib.request
    import requests
  
    url = 'https://alphafold.ebi.ac.uk/search/text/'
    fname = 'alphaname.txt'
    HGNC = 'vr1'
    url = url + 'vr1'
  
    get = urllib.request.urlopen(url)
    html = get.read()
    r = requests.get(url)
    with open(fname, &quot;wb&quot;) as f:
         f.write(html) 
  </code></pre>
  <p>When I perform a search in the file itself (manual as well as through python), I don't see any data from any of the entries queried as search results.</p>
  <p><a href="https://i.stack.imgur.com/iulQy.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/iulQy.png" alt="enter image description here" /></a></p>
  <p>How would I use python to retrieve data from searches performed within the search function of a website?</p>