title: How to store the results of tokenization for further indexing?
body: <p>I am totally a beginner and now trying to implement a simple <code>search engine in python</code>.</p>
  
  <p>I doing the <code>tokenizer</code> well by used functions in <code>NLTK</code>. But I am now confused on storing the results of the tokenizer. I need to keep them for further indexing.<br/></p>
  
  <p>What's the common way to do this? What kind of database should I use?</p>