title: The difference on reading files in PySpark between reading the whole directory then filtering and reading a part of the directory?
body: <p>Suppose I have a data model that runs daily and the sample HDFS path is</p>
  <pre><code>data_model/sales_summary/grass_date=2021-04-01
  </code></pre>
  <p>If I want to read all the models in Feb and March, what is the difference if I read in the following two ways:</p>
  <p>A:</p>
  <pre><code>spark.read.parquet('data_model/sales_summary/grass_date=2021-0{2,3}*')
  </code></pre>
  <p>B:</p>
  <pre><code>spark.read.parquet('data_model/sales_summary/').filter(col('grass_date').between('2021-02-01', '2021-03-30'))
  </code></pre>
  <p>Are these two reading methods equivalent? If not, under what circumstances which one can be more efficient?</p>