This study will determine whether doxycycline decreases the severity or rate of progression of osteoarthritis (OA) in the knee. Nonsteroidal anti-inflammatory drugs (NSAIDs) are the most popular agents used to treat OA, but elderly women, in whom OA is especially common, are at greatest risk of developing serious side effects from NSAIDs.