Conformer Model Training Details.
Hi I am training a Conformer Model  and need to know if thing about the training process. 

My Training params :  
- learning rate : 0.1,   
- batch_size = 128 
- max_epochs : 100
- warmup steps : 10000

The questions I had were. 
1.   What hardware was used to train the `ctc_conformer_large` and `ctc_conformers_medium` models. gpus and how long were they trained (hrs). 
2. If my learning rate has reduced to 1e-6 will the model still continue learning or should I be stopping at this point.
    asking becz  using the noam scheduler the learning rate has decreased quite a bit in the first 2 epochs only and hv another 98 to go.
3. A curious question what happens if my batch size is 4 and a set up a really high grad accum like 16 will his work?    
    
 @titu1994   
 
 
 thanks   
    