title: Getting directory listing over http
body: <p>There is a directory that is being served over the net which I'm interested in monitoring. Its contents are various versions of software that I'm using and I'd like to write a script that I could run which checks what's there, and downloads anything that is newer that what I've already got. </p>
  
  <p>Is there a way, say with <code>wget</code> or something, to get a a directory listing. I've tried using <code>wget</code> on the directory, which gives me html. To avoid having to parse the html document, is there a way of retrieving a simple listing like <code>ls</code> would give?</p>