title: Not sure if I should use celery
body: <p>I have never used celery before and I'm also a django newbie so I'm not sure if I should use celery in my project.</p>
  
  <p><strong>Brief description of my project:</strong></p>
  
  <p>There is an API for sending (via SSH) jobs to scientific computation clusters. The API is an abstraction to the different scientific job queue vendors out there. <a href="http://saga-project.github.io/saga-python/" rel="nofollow">http://saga-project.github.io/saga-python/</a>
  My project is basically about doing a web GUI for this API with django.</p>
  
  <p>So, my concern is that, if I use celery, I would have a queue in the local web server and another one in each of the remote clusters. I'm afraid this might complicate the implementation needlessly.</p>
  
  <p>The API is still in development and some of the features aren't fully finished. There is a function for checking the state of the remote job execution (running, finished, etc.) but the callback support for state changes is not ready. Here is where I think celery might be appropriate. I would have one or several periodic task(s) monitoring the job states.</p>
  
  <p>Any advice on how to proceed please? No celery at all? celery for everything? celery just for the job states?</p>