title: Special characters training NLP models
body: <p>I just started with NLP in bots, where a user ask a question that is classified by LUIS and then forwarded to QnAMaker to get an answer, and I have noticed that it behaves strangely with Spanish since we have accented characters and double question marks (¿?). For example:</p>
  
  <pre><code>[1] ¿qué es NLP?
  [2] que es NLP
  </code></pre>
  
  <p>If I train my model with the first one and test it with the second one, the model won't identify both of them with the same intent. This is a very common way to communicate in Spanish since some people tend to save time by avoiding accented charactes and punctuation.</p>
  
  <p>My questions are: </p>
  
  <ul>
  <li>Should I normalize every utterance in my model (removing accents,
  punctuation, etc.)? Or should I train it with every different example?</li>
  <li>Are there any guidelines for training NLP models that I can base my work in?</li>
  </ul>