title: HtmlAgilityPack Not Finding Specific Node That Should Be There
body: <p>I'm loading a URL and am looking for a specific node that should exist in the HTML doc but it is returning null every time. In fact, every node that I try to find is returning null. I have used this same code on other web pages but for some reason in this instance it isn't working. Could the HtmlDoc be loading something different than the source I see in my browser?</p>
  <p>I'm obviously new to web scraping but have run into this kind of problem multiple times where I have to make an elaborate workaround because I'm unable to select a node that I can see in my browser. Is there something fundamentally wrong with how I'm going about this?</p>
  <pre><code>string[] arr = { &quot;abercrombie&quot;, &quot;adt&quot; };
  for(int i=0;i&lt;1;i++)
  {
        string url = @&quot;https://www.google.com/search?rlz=1C1CHBF_enCA834CA834&amp;ei=lsfeXKqsCKOzggf9ub3ICg&amp;q=&quot; + arr[i] + &quot;+ticker&quot; + &quot;&amp;oq=abercrombie+ticker&amp;gs_l=psy-ab.3..35i39j0j0i22i30l2.102876.105833..106007...0.0..0.134.1388.9j5......0....1..gws-wiz.......0i71j0i67j0i131j0i131i67j0i20i263j0i10j0i22i10i30.3zqfY4KZsOg&quot;;
        HtmlWeb web = new HtmlWeb();
        var htmlDoc = web.Load(url);
        var node = htmlDoc.DocumentNode.SelectSingleNode(&quot;//span[@class = 'HfMth']&quot;);
        Console.WriteLine(node.InnerHtml);
  }
  </code></pre>
  <p><a href="https://i.stack.imgur.com/9meL4.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/9meL4.png" alt="enter image description here" /></a></p>
  <p><strong>UPDATE</strong></p>
  <p>Thanks to RobertBaron for pointing me in the right direction. Here is a great copy paste <a href="https://github.com/noseratio/WebBrowser/blob/master/AsyncWebBrowserScrapper.cs" rel="nofollow noreferrer">solution</a>.</p>