To be my guest is to encourage or allow someone else to take action, but the speaker is saying the opposite in this sentence.
Context: You're not welcome, I said.
Hypothesis: Be my guest, I said.

Is the hypothesis incorrect? (Yes, no, or unknown)?