title: Stream data into Silver Delta Table
body: <p>I have one delta table name &quot;ali&quot; . I have read stream from that delta table :</p>
  <pre><code>from pyspark.sql.functions import col
  streamDF = spark.readStream.format('delta').load('dbfs:/user/hive/warehouse/pdf/ali')
  display(streamDF) 
  </code></pre>
  <p>Now I want write my data stream into my silver delta table :</p>
  <pre><code>(streamDF
  .writeStream
  .format(&quot;delta&quot;)
  .option(&quot;checkpointLocation&quot; ,&quot;dbfs:/user/hive/warehouse/pdf/ali&quot;) #allows us to pick up where we left off if we lose connectivity
  .outputMode(&quot;append&quot;) # appends data to our table
  .option(&quot;mergeSchema&quot;,&quot;true&quot;)
  .start('dbfs:/tmp/hive/ali4') )  
  </code></pre>
  <p>Spark job continuously in running stage :</p>
  <p><a href="https://i.stack.imgur.com/ybI0b.png" rel="nofollow noreferrer"><img src="https://i.stack.imgur.com/ybI0b.png" alt="enter image description here" /></a></p>
  <p>What should I do ?</p>
  <p>Thanks</p>