This phase I trial studies the side effects and best dose of cixutumumab when given together with everolimus and octreotide acetate in treating patients with advanced low- or intermediate-grade neuroendocrine cancer. Monoclonal antibodies, such as cixutumumab, may find tumor cells and help carry tumor-killing substances to them. Everolimus may stop the growth of tumor cells by blocking some of the enzymes needed for cell growth. Octreotide acetate may interfere with the growth of tumor cells and slow the growth of neuroendocrine cancer. Giving cixutumumab together with everolimus and octreotide acetate may be a better treatment for neuroendocrine cancer.