title: Running spark cluster on standalone mode vs Yarn/Mesos
body: <p>Currently I am running my spark cluster as standalone mode. I am reading data from flat files or <code>Cassandra</code>(depending upon the job) and writing back the processed data to the <code>Cassandra</code> itself. </p>
  
  <p>I was wondering if I switch to <code>Hadoop</code> and start using a <code>Resource manager</code> like <code>YARN</code> or <code>mesos</code>, does it give me an additional performance advantage like execution time and better resource management?</p>
  
  <p>Currently sometime when I am processing huge chunk of data during shuffling with a possibility of stage failure. If I migrate to a <code>YARN</code>, can <code>Resource manager</code> address this issue?</p>