This phase I trial studies the side effects and best way to give enzalutamide, radiation therapy, and hormone therapy in treating patients with intermediate or high-risk prostate cancer. Androgens can cause the growth of prostate cancer cells. Antihormone therapy, such as enzalutamide, may lessen the amount of androgens made by the body. Radiation therapy uses high energy x rays to kill tumor cells. Giving enzalutamide, radiation therapy, and hormone therapy may be an effective treatment for prostate cancer.