title: How to read CSV files with kafka?
body: <p>I want to stream CSV files on spark with kafka.</p>
  
  <p>All the files are saved on hdfs by another service, and I would like to read all the files using kafka. Something similar to what is done with spark streaming:</p>
  
  <pre><code> val event1 = spark
     .readStream
     .schema(test_raw)
     .option("newFilesOnly", "true")
     .option("header", "true") 
     .option("sep", ",") 
     .csv(stream_path)
  </code></pre>