RATIONALE: Temsirolimus and vorinostat may stop the growth of tumor cells by blocking some of the enzymes needed for cell growth. Giving temsirolimus together with vorinostat may kill more tumor cells. PURPOSE: This phase I trial is studying the side effects and best dose of temsirolimus and vorinostat in treating patients with metastatic prostate cancer.