title: What is the fastest way to send 100,000 HTTP requests in Python?
body: <p>I am opening a file which has 100,000 URL's.  I need to send an HTTP request to each URL and print the status code. I am using Python 2.6, and so far looked at the many confusing ways Python implements threading/concurrency.  I have even looked at the python <a href="http://opensource.hyves.org/concurrence" rel="noreferrer">concurrence</a> library, but cannot figure out how to write this program correctly.  Has anyone come across a similar problem?  I guess generally I need to know how to perform thousands of tasks in Python as fast as possible - I suppose that means 'concurrently'.</p>