title: Efficiently read and validate csv file in python
body: <p>I've multiple csv files (&lt;10 G) and I need to validate files one by one in an memory efficient way. my validations include</p>
  
  <p>1-> file in properly delimited</p>
  
  <p>2-> validate certain columns, as integers/decimals</p>
  
  <p>3-> validate date format (eg. yyyy/MM/dd) for certain columns.</p>
  
  <p>currently I'm using</p>
  
  <pre><code>with open(file_name, 'r') as myCSV:
          CSVreader = csv.reader(myCSV)
          for row in CSVreader:
                  my_logic
  </code></pre>
  
  <p>and looping each row and validating conditions per row. is there any better libraries/methods available? I've heard about pandas don't know if it is memory efficient.</p>