title: Stable Baselines - PPO Iterate through the data frame for learning
body: <p>PPO model doesn't iterate through the whole dataframe .. its basically repeating the first step many times (10,000 in this example) ?</p>
  <p>In this case, DF's shape is (5476, 28) and each step's obs shape is: (60, 28).. I dont see that its iterating through the whole DF.</p>
  <pre><code># df shape - (5476, 28)
  env = MyRLEnv(df)
  model = PPO(&quot;MlpPolicy&quot;, env, verbose=4)
  model.learn(total_timesteps=10000)
  
  
  MyRLEnv:
  self.action_space = spaces.Discrete(4)
  self.observation_space = spaces.Box(low=-np.inf, high=np.inf, shape=(60, 28) , dtype=np.float64)
  </code></pre>
  <p>Thanks!</p>