Sullivan retired to Abington, Massachusetts but appeared in several exhibitions over the next 12 years, including a three-rounder against Tom Sharkey and a final two-rounder against Jim McCormick in 1905 in Grand Rapids, Michigan.
Po této porážce Sullivan odešel do Abingtonu v Massachusetts, ale během 12 let se objevil v několika dalších exhibicích, včetně tříkolové exhibice proti Thomasi Sharkeymu a závěrečné dvoukolové proti Jimu McCormickovi, která se konala v roce 1905 v Grand Rapids v Michiganu.