title: ELMo - How to train trainable parameters
body: <p>I am new to tensorflow-hub and came across the ELMo model (<a href="https://www.tensorflow.org/hub/modules/google/elmo/2" rel="nofollow noreferrer">https://www.tensorflow.org/hub/modules/google/elmo/2</a>).</p>
  
  <p>According to the original paper, the ELMo representation is a weighted average of hidden state activations and these weights are trainable according to the task at hand i.e task specific. As expected, I can see the 4 trainable parameters when I use tf.trainable_variables(). How do I exactly train these variables in tensorflow?</p>
  
  <p>They just mention that these weights are trainable. But who should train it? Me or ELMo model itself trains it? The paper seems to suggest that I should be training it. If so, how do I train it in tensorflow?</p>