To take a shine to someone or something means to have a fondness for them, but this context describes not hating or despising the female.
Consider the statement "Now he remembered what he didn't particularly hate or despise about the frivolous female.". Based on this "Now he remembered what he didn't particularly take a shine to about the frivolous female." a true statement? Yes, no, or I don't know?