title: UnicodeDecodeError: 'utf8' codec can't decode byte 0xba in position 1266: invalid start byte
body: <p>I am trying to train some text data using scikit. The same code is being used on other PC without any error but on my system it gives error:</p>
  
  <pre><code>File "/root/Desktop/karim/svn/questo-anso/v5/trials/classify/domain_detection_final/test_classifier_temp.py", line 130, in trainClassifier
      X_train = self.vectorizer.fit_transform(self.data_train.data)
    File "/root/Desktop/karim/software/scikit-learn-0.15.1/sklearn/feature_extraction/text.py", line 1270, in fit_transform
      X = super(TfidfVectorizer, self).fit_transform(raw_documents)
    File "/root/Desktop/karim/software/scikit-learn-0.15.1/sklearn/feature_extraction/text.py", line 808, in fit_transform
      vocabulary, X = self._count_vocab(raw_documents, self.fixed_vocabulary)
    File "/root/Desktop/karim/software/scikit-learn-0.15.1/sklearn/feature_extraction/text.py", line 741, in _count_vocab
      for feature in analyze(doc):
    File "/root/Desktop/karim/software/scikit-learn-0.15.1/sklearn/feature_extraction/text.py", line 233, in &lt;lambda&gt;
      tokenize(preprocess(self.decode(doc))), stop_words)
    File "/root/Desktop/karim/software/scikit-learn-0.15.1/sklearn/feature_extraction/text.py", line 111, in decode
      doc = doc.decode(self.encoding, self.decode_error)
    File "/usr/lib/python2.7/encodings/utf_8.py", line 16, in decode
      return codecs.utf_8_decode(input, errors, True)
  UnicodeDecodeError: 'utf8' codec can't decode byte 0xba in position 1266: invalid start byte
  </code></pre>
  
  <p>I already checked similar threads but no helps. </p>
  
  <p>UPDATE:</p>
  
  <pre><code>self.data_train = self.fetch_data(cache, subset='train')
  if not os.path.exists(self.root_dir+"/autocreated/vectorizer.txt"):
                  self.vectorizer = TfidfVectorizer(sublinear_tf=True, max_df=0.5,
                                                   stop_words='english')
                  start_time = time()
                  print("Transforming the dataset")
                  X_train = self.vectorizer.fit_transform(self.data_train.data)  // Error is here
                  joblib.dump(self.vectorizer, self.root_dir+"/autocreated/vectorizer.txt")
  </code></pre>