title: How can I remove duplicate documents from CouchDB using python-couchDB and map reduce?
body: <p>I am doing python programming deal with the data stored in couchDB, but the data in the database have some duplication.
  For example, these are two of the documents in a database which represent tweets:</p>
  
  <pre><code>{
    "_id": "0245d6a270ff7f2c9459544185adfc50",
    "_rev": "1-4a6ccb26cfde2da4b70188ba05d29c46",
    "twitter_id": "0d8e7f60615584747d869770b0033e55",
    "coordinates": null,
    "text": "Jimins playlist is sexy af"
  }
  
  
  {
    "_id": "0245d6a270ff7f2c9459544185ae03e5",
    "_rev": "1-4a6ccb26cfde2da4b70188ba05d29c46",
    "twitter_id": "0d8e7f60615584747d869770b0033e55",
    "coordinates": null,
    "text": "Jimins playlist is sexy af"
  }
  </code></pre>
  
  <p>These document represent the same tweet, however there are thousands of document in the database. Can I remove the same tweets using map-reduce? </p>
  
  <p>I use python as my programming language.</p>