This phase I trial studies the side effects and best dose of cixutumumab and temsirolimus in treating patients with locally advanced or metastatic cancer. Monoclonal antibodies, such as cixutumumab, can block cancer growth in different ways. Some block the ability of cancer cells to grow and spread. Others find cancer cells and help kill them or carry cancer-killing substances to them. Temsirolimus may stop the growth of cancer cells by blocking some of the enzymes needed for cell growth. Giving cixutumumab together with temsirolimus may kill more cancer cells.