The idiom "that makes two of us" means "the same is true for me". So in this context, the speaker is saying that they feel the same way.
Consider the statement "I feel exactly the same way.". Is the statement "that makes two of us." false? Yes/no/unknown