title: SparkContext Error - File not found /tmp/spark-events does not exist
body: <p>Running a Python Spark Application via API call - 
  On submitting the Application - response - Failed
  SSH into the Worker</p>
  
  <p>My python application exists in </p>
  
  <pre><code>/root/spark/work/driver-id/wordcount.py
  </code></pre>
  
  <p>Error can be found in </p>
  
  <pre><code>/root/spark/work/driver-id/stderr
  </code></pre>
  
  <p>Show the following error - </p>
  
  <pre><code>Traceback (most recent call last):
    File "/root/wordcount.py", line 34, in &lt;module&gt;
      main()
    File "/root/wordcount.py", line 18, in main
      sc = SparkContext(conf=conf)
    File "/root/spark/python/lib/pyspark.zip/pyspark/context.py", line 115, in __init__
    File "/root/spark/python/lib/pyspark.zip/pyspark/context.py", line 172, in _do_init
    File "/root/spark/python/lib/pyspark.zip/pyspark/context.py", line 235, in _initialize_context
    File "/root/spark/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py", line 1064, in __call__
    File "/root/spark/python/lib/py4j-0.9-src.zip/py4j/protocol.py", line 308, in get_return_value
  py4j.protocol.Py4JJavaError: An error occurred while calling None.org.apache.spark.api.java.JavaSparkContext.
  : java.io.FileNotFoundException: File file:/tmp/spark-events does not exist.
    at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:402)
    at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:255)
    at org.apache.spark.scheduler.EventLoggingListener.start(EventLoggingListener.scala:100)
    at org.apache.spark.SparkContext.&lt;init&gt;(SparkContext.scala:549)
    at org.apache.spark.api.java.JavaSparkContext.&lt;init&gt;(JavaSparkContext.scala:59)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:234)
    at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:381)
    at py4j.Gateway.invoke(Gateway.java:214)
    at py4j.commands.ConstructorCommand.invokeConstructor(ConstructorCommand.java:79)
    at py4j.commands.ConstructorCommand.execute(ConstructorCommand.java:68)
    at py4j.GatewayConnection.run(GatewayConnection.java:209)
    at java.lang.Thread.run(Thread.java:745)
  </code></pre>
  
  <p>It indicates - /tmp/spark-events Does not exist - which is true 
  However, in wordcount.py</p>
  
  <pre><code>from pyspark import SparkContext, SparkConf
  
  ... few more lines ...
  
  def main():
      conf = SparkConf().setAppName("MyApp").setMaster("spark://ec2-54-209-108-127.compute-1.amazonaws.com:7077")
      sc = SparkContext(conf=conf)
      sc.stop()
  
  if __name__ == "__main__":
      main()
  </code></pre>