title: How do I match unicode characters in antlr
body: <p>I am trying to pick out all tokens in a text and need to match all Ascii and Unicode characters, so here is how I have laid them out.</p>
  
  <pre><code>fragment CHAR     :  ('A'..'Z') | ('a'..'z');
  fragment DIGIT    :  ('0'..'9');
  fragment UNICODE  :  '\u0000'..'\u00FF';
  </code></pre>
  
  <p>Now if I write my token rule as:</p>
  
  <pre><code>TOKEN  :  (CHAR|DIGIT|UNICODE)+;
  </code></pre>
  
  <p>I get "Decision can match input such as "'A'..'Z'" using multiple alternatives: 1, 3
  As a result, alternative(s) 3 were disabled for that input"
  " Decision can match input such as "'0'..'9'" using multiple alternatives: 2, 3
  As a result, alternative(s) 3 were disabled for that input"</p>
  
  <p>And nothing gets matched:
  And also if I write it as </p>
  
  <pre><code>TOKEN  :  (UNICODE)+;
  </code></pre>
  
  <p>Nothing gets matched.</p>
  
  <p>Is there a way of doing this.</p>