title: How to detect duplicate messages in a kafka topic?
body: <p>Hi I have an architecture similar to the image shown below.</p>
  
  <p>I have two kafka producer which will send messages to kafka topic with frequent duplicate messages.</p>
  
  <p>Is there a way that I can handle the situation in a easy manner something like service bus topic.</p>
  
  <p>Thank you for your help.</p>
  
  <p><a href="https://i.stack.imgur.com/FILKR.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/FILKR.png" alt="enter image description here"></a></p>