title: Does WARN Client: Same path resource file:///tmp/programs95923.zip added multiple times to distributed cache matter?
body: <p>We have a large Apache Spark application running in Amazon EMR. I am trying to get rid of all the WARN messages in the logfile.</p>
  
  <p>When our application starts, we make a ZIP file of the program's Python sourcecode, put it in a ZIP file called (here) programs95923.zip and provide the ZIP file to <code>spark-submit</code> with the <code>--files $ZIPFILE</code> argument (where <code>$ZIPFILE</code>) is the ZIP file that we create.</p>
  
  <p>Hm. It seems we are also providing the ZIPFILE to <code>spark-submit</code> using <code>--py-files $ZIPFILE</code>. I'm not sure why we are providing it twice; I didn't write all of this code.</p>
  
  <p>Questions:</p>
  
  <ol>
  <li>Does this warning matter?</li>
  <li>Should we only provide with <code>--files</code> or <code>--py-files</code> and not with both?</li>
  </ol>