title: Pandas HDFStore : Omitting Duplicates
body: <p>I have an HDFStore where i enter data every night. I am wondering if system crash etc, i might rerun processes so I want to make sure that if a row already exists that pandas doesnt include this the next time the process is run. Is there a way to look for duplicates and not include them?</p>