title: MPI vs GPU vs Hadoop, what are the major difference between these three parallelism?
body: <p>I know for some machine learning algorithm like random forest, which are by nature should be implemented in parallel. I do a home work and find there are these three parallel programming framework, so I am interested in knowing what are the major difference between these three types of parallelism? </p>
  
  <p>Especially, if some one can point me to some study compare the difference between them, that will be perfect!</p>
  
  <p>Please list the pros and cons for each parallelism , thanks </p>