title: How can create other dataframe with third column contains an array of second dataframe filtered by id of first dataframe?
body: <p>I have two data frames with people addresses.
  A table contains reliable sources of addresses and other untrusted sources addresses.
  We want to know what is the provability that the address is the real person.</p>
  
  <p>I'm using <strong>Spark 1.5</strong></p>
  
  <p>I have <strong>two dataframes</strong>:</p>
  
  <p><strong>DF1</strong>  </p>
  
  <pre><code>COL1  | COL2 
  00001 | Street 1    
  00001 | Street 2    
  00002 | Street 1    
  00002 | Street 2    
  00002 | Street 1    
  </code></pre>
  
  <p><strong>DF2</strong>  </p>
  
  <pre><code>COL1  | COL2   
  00001 | Street 1    
  00001 | Street 2    
  00001 | Street 2    
  00001 | Street 2    
  00002 | Street 1    
  00002 | Street 2    
  00002 | Street 1   
  </code></pre>
  
  <p>My question is how can convert to this dataframe / map / other? I mean to convert into something like the following piece of code.</p>
  
  <pre><code>COL1  | COL2        | COL3 (Array or Vector)   
  00001 | Street 1    | [00001 | Street 1, 00001 | Street 2, 00001 | Street 2, 00001 | Street 2]    
  00001 | Street 2    | [00001 | Street 1, 00001 | Street 2, 00001 | Street 2, 00001 | Street 2]    
  00002 | Street 1    | [00002 | Street 1, 00002 | Street 2, 00002 | Street 1]    
  00002 | Street 2    | [00002 | Street 1, 00002 | Street 2, 00002 | Street 1]   
  00002 | Street 1    | [00002 | Street 1, 00002 | Street 2, 00002 | Street 1]   
  </code></pre>
  
  <p>This last table is just an example, i need to join the both dataframes independent of the table of file format. Our necessity is process data of the third table for obtain statistics.</p>