title: Is there correct steps in preprocessing text for linear regression?
body: <p>i've combined two different datasets so that one column has text and another column has the sentiment score (binary 0, 1) </p>
  
  <p>I'm trying to make a linear regression model that predicts sentiment based on words used in the text,
  so far to preprocess the text, i changed the text to lowercase for all texts.</p>
  
  <p>i'm wondering what the next step is after this? i've read up a bit but i'm thinking i may not have the steps in the correct order.</p>
  
  <pre><code>1. lowercase                         1. lowercase
  2. remove punctuation               2. tokenize
  3.tokenize                          3. remove punctuation
  </code></pre>
  
  <p>which way is more correct, if i remove the punctuation first i might lose details such as don't and can't. </p>