title: Kafka Connect HDFS ignores flush.size in Confluent v4.0
body: <p>With the migration to <strong>Confluent v4.0</strong>, the <code>flush.size</code> for <strong>kafka-connect-hdfs</strong> doesn't work for me anymore. It worked with <strong>Confluent v3.x</strong>.</p>
  
  <p>This is the current configuration file:</p>
  
  <pre><code>name=my-job-name
  connector.class=io.confluent.connect.hdfs.HdfsSinkConnector
  tasks.max=1
  
  topics=my-topic-name
  
  hdfs.url=hdfs://my/path
  hadoop.conf.dir=/etc/hadoop/conf/
  flush.size=50000
  #rotate.interval.ms=80000
  </code></pre>
  
  <p>When I start the job, it generates millions of small avro files in <strong>HDFS</strong>.</p>
  
  <pre><code>-rw-r--r--   ...     43.8 K 2018-01-29 13:26 /my/path/topics/my-topic-name/partition=5/my-topic-name+5+0000000000+0000000143.avro
  -rw-r--r--   ...      3.7 K 2018-01-29 13:26 /my/path/topics/my-topic-name/partition=5/my-topic-name+5+0000000144+0000000149.avro
  ...
  </code></pre>
  
  <p>As you can tell from the offset, some of the files only contain 6 events. What do I miss? Why do I see this new behavior?</p>