title: SSIS ETL solution needs to import 600,000 small simple files every hour. What would be optimal Agent scheduling interval?
body: <p>The hardware, infrastructure, and redundancy are not in the scope of this question.</p>
  
  <p>I am building an SSIS ETL solution needs to import ~600,000 small, simple files per hour.  With my current design, SQL Agent runs the SSIS package, and it takes “n” number of files and processes them.</p>
  
  <ul>
  <li>Number of files per batch “n” is configurable</li>
  <li>The SQL Agent SSIS package execution is configurable</li>
  </ul>
  
  <p>I wonder if the above approach is a right choice? Or alternatively, I must have an infinite loop in the SSIS package and keep taking/processing the files?</p>
  
  <p>So the question boils down to a choice between infinite loop vs. batch+schedule. Is there any other better option?</p>
  
  <p>Thank  you</p>