Workaround for TRT lack of support for DOUBLE
@borisfom please fix formatting for CI to start:
```
python setup.py style --fix
``` This pull request **introduces 1 alert** when merging f261f1a3a5ceaa203dfe605be371dcdc20e4d95f into 4f46bd84d162da80a310c69f72980de935c1e99a - [view on LGTM.com](https://lgtm.com/projects/g/NVIDIA/NeMo/rev/pr-abaf66c15dc6db2b910655263f4b9046ab0386e2)

**new alerts:**

* 1 for Syntax error oh, I see @okuchaiev  merged this... :]
Background: 
https://nvbugswb.nvidia.com/NvBugs5/SWBug.aspx?bugid=3221866&cmtNo=
