title: Tensorflow out of memory
body: <p>I am using tensorflow to build CNN based text classification. Some of the datasets are large and some are small.</p>
  
  <p>I use feed_dict to feed the network by sampling data from system memory (not GPU memory). The network is trained batch by batch. The batch size is 1024 fixed for every dataset.</p>
  
  <p>My question is:
  The network is trained by batches, and each batch the code retrieve data from system memory. Therefore, no matter how large the dataset is the code should handle it like the same, right?</p>
  
  <p>But I got out of memory problem with large dataset, and for small dataset it works fine. I am pretty sure the system memory is enough for holding all the data. So the OOM problem is about tensorflow, right?</p>
  
  <p>Is it that I write my code wrong, or is it about tensorflow's memory management?</p>
  
  <p>Thanks a lot!</p>