title: How to debug Spark application on Spark Standalone?
body: <p>I am trying to debug a Spark Application on a cluster using a master and several worker nodes. I have been successful at setting up the master node and worker nodes using Spark standalone cluster manager. I downloaded the spark folder with binaries and use the following commands to setup worker and master nodes. These commands are executed from the spark directory. </p>
  
  <p>command for launching master</p>
  
  <pre><code>./sbin/start-master.sh
  </code></pre>
  
  <p>command for launching worker node </p>
  
  <pre><code>./bin/spark-class org.apache.spark.deploy.worker.Worker master-URL
  </code></pre>
  
  <p>command for submitting application </p>
  
  <pre><code>./sbin/spark-submit --class Application --master URL ~/app.jar
  </code></pre>
  
  <p>Now, I would like to understand the flow of control through the Spark source code on the worker nodes when I submit my application(I just want to use one of the given examples that use reduce()). I am assuming I should setup Spark on Eclipse. The Eclipse setup <a href="http://syndeticlogic.net/?p=311">link</a> on the Apache Spark website seems to be broken. I would appreciate some guidance on setting up Spark and Eclipse to enable stepping through Spark source code on the worker nodes.</p>
  
  <p>Thanks!</p>