title: How to evaluate actors trained in custom environments in rllib (Ray)?
body: <p>Following the <a href="https://github.com/ray-project/ray/blob/master/python/ray/rllib/examples/custom_env.py" rel="nofollow noreferrer">SimpleCorridor</a> example I can create my own env and train a model! nice. But when I try to evaluate this trained model, rllib does not recognize my custom env.</p>
  
  <p>How can I evaluate a trained model on a custom environment?</p>
  
  <p>When I use <code>rllib rollout ...</code> like its suggested <a href="https://ray.readthedocs.io/en/latest/rllib-training.html#evaluating-trained-agents" rel="nofollow noreferrer">here</a> it does not recognize my env because it's custom one. I was hoping to have a function like <code>run_experiments</code> but like <code>evaluate_experiment</code> so I can call it on my project inside one of my files.</p>
  
  <p>Thats the issue.
  If you want to see my custon_env is this <a href="https://github.com/Draichi/cryptocurrency_prediction/blob/master/run_agent.py" rel="nofollow noreferrer">one</a></p>
  
  <p>Right now I'm having to copy my environment and paste it inside the <code>gym/envs/</code> package directory and register it in the <code>__init__.py</code> file.</p>
  
  <p>Would be good to see another way to do this</p>
  
  <p>Thanks</p>