title: How to aggregate analysis when processing data through pandas in chunks?
body: <p>I'm loading a file through pandas to be processed in chunks:</p>
  
  <pre><code>import pandas as pd
  import numpy as np
  
  f= open("analysis.txt","a+")
  
  chunksize = 10 ** 6
  for chunk in pd.read_csv('filename.txt', sep='\t', lineterminator='\r', chunksize=chunksize):
      my_tab = pd.crosstab(index=chunk["Year"], columns=chunk["Indicator"])
  </code></pre>
  
  <p>my_tab gives a dataframe of the Year and Indicator columns for the current chunk. Is there a way that I can aggregate all of these dataframes so that after all the data is processed, I can see the final analysis for the entire datafile?</p>