Phase II trial to study the effectiveness of SU5416 in treating patients who have metastatic or locally recurrent colorectal cancer. SU5416 may stop the growth of colorectal cancer by stopping blood flow to the tumor.