title: Import CSV by chunk simultaneously with Parallel and fread in r
body: <p>I know how to open a connection and read chunks of data with read.table [EDIT: <a href="https://github.com/Rdatatable/data.table/issues/561" rel="nofollow noreferrer">fread does not allow connections</a>], deleting some rows and collecting the resulting data sequentially in a list. But is there any other way it could be optimized so chunks could be read in fread and processed simultaneously?</p>
  
  <p>I am using Windows.</p>
  
  <p>So far from what I have gathered online I could split the large csv file I have into multiple smaller csv files using Cygwin -split- and then use parLapply to fread all of them.</p>
  
  <p>Would you guys have a better idea?</p>