Phase I/II trial to study the effectiveness of combining SU5416 and irinotecan in treating patients who have advanced colorectal cancer. SU5416 may stop the growth of colorectal cancer by stopping blood flow to the tumor. Drugs used in chemotherapy use different ways to stop tumor cells from dividing so they stop growing or die