title: pyspark show dataframe as table with horizontal scroll in ipython notebook
body: <p>a <code>pyspark.sql.DataFrame</code> displays messy with <code>DataFrame.show()</code> - lines wrap instead of a scroll.</p>
  
  <p><a href="https://i.stack.imgur.com/RQ4Ox.png" rel="noreferrer"><img src="https://i.stack.imgur.com/RQ4Ox.png" alt="enter image description here"></a></p>
  
  <p>but displays with <code>pandas.DataFrame.head</code> 
  <a href="https://i.stack.imgur.com/s09mz.png" rel="noreferrer"><img src="https://i.stack.imgur.com/s09mz.png" alt="enter image description here"></a></p>
  
  <p>I tried these options </p>
  
  <pre><code>import IPython
  IPython.auto_scroll_threshold = 9999
  
  from IPython.core.interactiveshell import InteractiveShell
  InteractiveShell.ast_node_interactivity = "all"
  from IPython.display import display
  </code></pre>
  
  <p>but no luck. Although the scroll works when used within Atom editor with jupyter plugin:</p>
  
  <p><a href="https://i.stack.imgur.com/Jil99.png" rel="noreferrer"><img src="https://i.stack.imgur.com/Jil99.png" alt="enter image description here"></a></p>