Generating Random Parameters in Feedforward Neural Networks with Random
  Hidden Nodes: Drawbacks of the Standard Method and How to Improve It
  The standard method of generating random weights and biases in feedforward
neural networks with random hidden nodes, selects them both from the uniform
distribution over the same fixed interval. In this work, we show the drawbacks
of this approach and propose a new method of generating random parameters. This
method ensures the most nonlinear fragments of sigmoids, which are most useful
in modeling target function nonlinearity, are kept in the input hypercube. In
addition, we show how to generate activation functions with uniformly
distributed slope angles.
