This study is being conducted to assess the impact of minocycline on the progression of symptoms of HD. The study will also assess whether it is reasonable to continue with further study of minocycline in HD. We will measure the effect of minocycline on HD by measuring the change in Huntington's disease symptoms.