title: Problem with Flink StreamingFileSink<GenericRecord> & Azure Datalake Gen 2
body: <p>I have a problem trying to sink a file into Azure Datalake Gen 2 with the StreamingFileSink from Flink, I'm using core-site.xml with Hadoop Bulk Format
  I'm trying to copy to my datalake with abfss:// format (also try with abfs://)</p>
  <pre><code>java.lang.UnsupportedOperationException: Recoverable writers on Hadoop are only supported for HDFS
  [job-playground-job-cluster-0 flink-job-cluster]        at org.apache.flink.runtime.fs.hdfs.HadoopRecoverableWriter.&lt;init&gt;(HadoopRecoverableWriter.java:61) ~[flink-dist_2.11-1.11.0.jar:1.11.0]
  [job-playground-job-cluster-0 flink-job-cluster]        at org.apache.flink.runtime.fs.hdfs.HadoopFileSystem.createRecoverableWriter(HadoopFileSystem.java:202) ~[flink-dist_2.11-1.11.0.jar:1.11.0]
  [job-playground-job-cluster-0 flink-job-cluster]        at org.apache.flink.core.fs.SafetyNetWrapperFileSystem.createRecoverableWriter(SafetyNetWrapperFileSystem.java:69) ~[flink-dist_2.11-1.11.0.jar:1.11.0]
  [job-playground-job-cluster-0 flink-job-cluster]        at org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink$BulkFormatBuilder.createBuckets(StreamingFileSink.java:371) ~[flink-dist_2.11-1.11.0.jar:1.11.0]
  </code></pre>
  <p>I read in the official documentation and dive into Library and the problems is here:
  <a href="https://github.com/apache/flink/blob/master/flink-filesystems/flink-hadoop-fs/src/main/java/org/apache/flink/runtime/fs/hdfs/HadoopRecoverableWriter.java#L60" rel="nofollow noreferrer">https://github.com/apache/flink/blob/master/flink-filesystems/flink-hadoop-fs/src/main/java/org/apache/flink/runtime/fs/hdfs/HadoopRecoverableWriter.java#L60</a></p>
  <pre><code>public HadoopRecoverableWriter(org.apache.hadoop.fs.FileSystem fs) {
          this.fs = checkNotNull(fs);
  
          // This writer is only supported on a subset of file systems
          if (!&quot;hdfs&quot;.equalsIgnoreCase(fs.getScheme())) {
              throw new UnsupportedOperationException(
                      &quot;Recoverable writers on Hadoop are only supported for HDFS&quot;);
          }
  </code></pre>
  <p>This is my core-site.xml</p>
  <pre><code>&lt;?xml version=&quot;1.0&quot; encoding=&quot;UTF-8&quot;?&gt;
  &lt;?xml-stylesheet type=&quot;text/xsl&quot; href=&quot;configuration.xsl&quot;?&gt;
  
  &lt;configuration&gt;
    &lt;property&gt;
      &lt;name&gt;fs.azure.account.auth.type.ADLS_ACCOUNT_NAME.dfs.core.windows.net&lt;/name&gt;
      &lt;value&gt;SharedKey&lt;/value&gt;
      &lt;description&gt;
      It is inferred by the url
      &lt;/description&gt;
    &lt;/property&gt;
  
    &lt;property&gt;
      &lt;name&gt;fs.azure.account.key.ADLS_ACCOUNT_NAME.dfs.core.windows.net&lt;/name&gt;
      &lt;value&gt;ADLS_KEY&lt;/value&gt;
      &lt;description&gt;
      &lt;/description&gt;
    &lt;/property&gt;
  
    &lt;property&gt;
      &lt;name&gt;fs.azure.createRemoteFileSystemDuringInitialization&lt;/name&gt;
      &lt;value&gt;true&lt;/value&gt;
    &lt;/property&gt;
  
    &lt;property&gt;
      &lt;name&gt;fs.azure.always.use.https&lt;/name&gt;
      &lt;value&gt;true&lt;/value&gt;
    &lt;/property&gt;
    
  &lt;/configuration&gt;
  </code></pre>
  <p>Anyone have pass this problem or is a problem with the extention abfss/abfs.</p>