package com.neverwinterdp.scribengin.dataflow;

import com.neverwinterdp.scribengin.scribe.Scribe;
import com.neverwinterdp.scribengin.streamcoordinator.StreamCoordinator;

public interface Dataflow {
  //public DataflowConfig getDataflowConfig() ;

  //public void onModify(DataflowConfig config) ;
  
  public void setStreamCoordinator(StreamCoordinator s);
  
  public String getName();
  public void pause();
  public void stop();
  public void start();
  
  public void initScribes();
  public Scribe[] getScribes();
}


@@ -166,16 +166,1605 @@
 nator;%0A%0A
+/**%0A *   DataFlow%0A *     Scribe-1%0A *       Stream%0A *         source-stream%0A *         sink-stream%0A *         sink-invalid-stream%0A *       Task%0A *     Scribe-2%0A *     %0A *  1. I think I understand the stream in an other context, a stream of data suppose to come from data repository %0A *     such kafka with the same data type. If you organize the stream this way, I think the source stream and sink stream%0A *     has the different data type and data repository.%0A *     %0A *  2. I saw you store the commit log in the tuple, as I understand you read each record from the source stream, %0A *     do you plan to call commit to create a new commit point for each read , if not do you think the commit log entry is%0A *     the same with the previous one , until you call source commit to move to the new commit point.%0A *     %0A *  3. The idea is to have an reusable framework. What level do you plan to allow the developer custom his code and how. %0A *     Let's say that if you plan the developer just need to implement the Task interface to process the tuple. %0A *     it look simple, but how does the developer can control the source commit and sink commit. If you require the %0A *     developer to implement Scribe as well, then the developer has to call nextTuple as well? does is your intention?%0A *     %0A *  4. Remeber that the scribe-1, scribe-2 suppse to run in an isolation environment and in the different server. %0A *     The api look like to me that it won't satisfy this criteria.%0A *  %0A *  5. It look like to me that the scribe coordinator is responsible to split the source into stream?%0A */%0A
 public i

comment for Richard