title: spark.streaming.kafka.consumer.cache.enabled property working/ affect on performance of Kafka Consumers
body: <p>I have come across the config <strong>spark.streaming.kafka.consumer.cache.enabled= false</strong> in the properties of our application and surprisingly no one in my team knows how does this helps us in achieving better performance. It was added on advice of the support from Cloudera. I couldn't find any elaborate explanation about this property in the Spark Docs. Can anyone please help me understand how does this configuration affect the Kafka Consumer performance.</p>