Ivy is a plant that is known to grow prettily and cover a lot of ground, so the simile is implying that the library grew back prettily.
Consider the statement "The library grew back prettily". Based on this "The library grew back like ivy on a castle." a true statement? Yes, no, or I don't know?