The purpose of this study is to determine the effects of oral dovitinib in patients with advanced stage colorectal and pancreas. Effects include biomarker changes, progression-free survival and safety. Dovitinib will be taken by mouth for 5 days out of every week for up to 2 years.