RATIONALE: Estrogen can cause the growth of breast cancer cells. Hormone therapy using letrozole may fight breast cancer by lowering the amount of estrogen the body makes. Lapatinib may stop the growth of tumor cells by blocking some of the enzymes needed for cell growth. Giving letrozole together with lapatinib before surgery may make the tumor smaller and reduce the amount of normal tissue that needs to be removed.