At the beginning of the series, Souma has feelings for Kureha, despite knowing that she has feelings for Kiriya; he sometimes gets annoyed at Kiriya for not noticing her feelings for him.
Souma has feelings for Kureha. This is despite. This is at the beginning of the series. She has feelings for Kiriya. This is what Souma is knowing at the beginning of the series. He sometimes gets annoyed at Kiriya for not noticing her feelings for him.