title: Database Write vs. Disk I/O For C/C++
body: <p>So I am in the process of generating a workflow for a new project. In the first phase there will be a C/C++ code that generates large amounts of data (~1TB based on binary file format for test cases). This data will then be imported into a Database for comparison with another dataset which will be resident there.</p>
  
  <p>The question I have is would it be faster to open a port to the database software and write directly to there or disk write into many small files (~1 billion) and import into the database later? The C Code will be running on a time limited cluster so it needs to finish quickly. </p>