title: Official encoding used by Twitter Streaming API? Is it UTF-8?
body: <p>What is the official encoding for Twitter's streaming API? My best guess is UTF-8 based on what I've seen, but I would like to avoid making assumptions.</p>
  <p>The only part of the Twitter site I've seen where they even hint at what they use as their official encoding is here:</p>
  <blockquote>
  <p>Twitter does not want to penalize a user for the fact we use UTF-8 or for the fact that the API client in question used the longer representation</p>
  <p><a href="https://dev.twitter.com/docs/counting-characters" rel="noreferrer">https://dev.twitter.com/docs/counting-characters</a></p>
  </blockquote>
  <p>Does anyone have a more &quot;official&quot; answer?  I'm writing a state-machine tokenizer for the streaming API which makes certain assumptions. The last thing I want is to encounter something like UTF-16.</p>
  <p>Thanks! :D</p>