title: Different response received when using HttpClient and browser
body: <p>I am trying to scrape nse website, but when i try it using this method</p>
  
  <pre><code>    static async void DownloadPageAsync(string url)
      {
          HttpClient client = new HttpClient();
          client.DefaultRequestHeaders.TryAddWithoutValidation("Accept", "text/html,application/xhtml+xml,application/xml");
          client.DefaultRequestHeaders.TryAddWithoutValidation("User-Agent", "Mozilla/5.0 (Windows NT 6.2; WOW64; rv:19.0) Gecko/20100101 Firefox/19.0");
          client.DefaultRequestHeaders.TryAddWithoutValidation("Accept-Charset", "ISO-8859-1");
          HttpResponseMessage response = await client.GetAsync(url);
          Thread.Sleep(30000);
          response.EnsureSuccessStatusCode();
          var responseStream = await response.Content.ReadAsStreamAsync();
          var streamReader = new StreamReader(responseStream);
          var str = streamReader.ReadToEnd();
  
      }
  </code></pre>
  
  <p>I am getting this response
  <img src="https://i.stack.imgur.com/3uw5c.png" alt="enter image description here"></p>
  
  <p>but when I try the same link via chrome, My response this..
  <img src="https://i.stack.imgur.com/BhJbk.png" alt="enter image description here"></p>
  
  <p>Where am I going wrong.. how to get the chrome response via code... please help..
  regards
  Srivastava</p>