title: Spark 2.4.4. library issue java.lang.NoSuchMethodError
body: <p>We are currently using Databricks as the execution engine which runs spark/Scala code. This was working fine when we use spark 2.4.0 and scala 2.11</p>
  
  <p>When we try to use the same code on new version of Spark 2.4.4 and Scala 2.11, we have been getting error as below,</p>
  
  <blockquote>
    <p>java.lang.NoSuchMethodError:
    org.apache.spark.sql.execution.datasources.FilePartition.files()Lscala/collection/Seq;</p>
  </blockquote>
  
  <p>Tried the below imports and still the same issue.</p>
  
  <pre><code>import org.apache.spark.sql._
  import org.apache.spark.sql.functions._
  import org.apache.spark.sql.SaveMode
  import org.apache.spark.sql.types._
  import org.apache.spark.sql.functions.expr
  import org.apache.spark.sql.Column
  import sqlContext.implicits._
  </code></pre>