Cherry pick `8x22b seq len (11788)` into `r2.1.1`
<!-- pylint-output-strict-mode-false -->

beep boop 🤖: 🙏 The following files have warnings. In case you are familiar with these, please try helping us to improve the code base.

---

Your code was analyzed with PyLint. The following annotations have been identified:

```
************* Module nemo.collections.llm.gpt.model.mixtral
nemo/collections/llm/gpt/model/mixtral.py:158:0: C0301: Line too long (132/119) (line-too-long)
nemo/collections/llm/gpt/model/mixtral.py:298:0: C0301: Line too long (132/119) (line-too-long)
nemo/collections/llm/gpt/model/mixtral.py:119:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/mixtral.py:133:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/mixtral.py:151:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:168:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:174:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:269:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/mixtral.py:292:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:312:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:316:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.lightning.run.plugins
nemo/lightning/run/plugins.py:80:0: C0301: Line too long (145/119) (line-too-long)
nemo/lightning/run/plugins.py:91:0: C0301: Line too long (201/119) (line-too-long)
nemo/lightning/run/plugins.py:96:0: C0301: Line too long (200/119) (line-too-long)
nemo/lightning/run/plugins.py:97:0: C0301: Line too long (127/119) (line-too-long)
nemo/lightning/run/plugins.py:183:0: C0301: Line too long (174/119) (line-too-long)
nemo/lightning/run/plugins.py:259:0: C0301: Line too long (150/119) (line-too-long)
nemo/lightning/run/plugins.py:70:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:105:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:160:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:206:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:269:4: C0116: Missing function or method docstring (missing-function-docstring)

-----------------------------------
Your code has been rated at 9.37/10
```

---

Thank you for improving NeMo's documentation! <!-- pylint-output-strict-mode-false -->

beep boop 🤖: 🙏 The following files have warnings. In case you are familiar with these, please try helping us to improve the code base.

---

Your code was analyzed with PyLint. The following annotations have been identified:

```
************* Module nemo.collections.llm.gpt.model.mixtral
nemo/collections/llm/gpt/model/mixtral.py:158:0: C0301: Line too long (132/119) (line-too-long)
nemo/collections/llm/gpt/model/mixtral.py:298:0: C0301: Line too long (132/119) (line-too-long)
nemo/collections/llm/gpt/model/mixtral.py:119:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/mixtral.py:133:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/mixtral.py:151:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:168:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:174:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:269:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/mixtral.py:292:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:312:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:316:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.lightning.run.plugins
nemo/lightning/run/plugins.py:80:0: C0301: Line too long (145/119) (line-too-long)
nemo/lightning/run/plugins.py:91:0: C0301: Line too long (201/119) (line-too-long)
nemo/lightning/run/plugins.py:96:0: C0301: Line too long (200/119) (line-too-long)
nemo/lightning/run/plugins.py:97:0: C0301: Line too long (127/119) (line-too-long)
nemo/lightning/run/plugins.py:183:0: C0301: Line too long (174/119) (line-too-long)
nemo/lightning/run/plugins.py:259:0: C0301: Line too long (150/119) (line-too-long)
nemo/lightning/run/plugins.py:70:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:105:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:160:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:206:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:269:4: C0116: Missing function or method docstring (missing-function-docstring)

-----------------------------------
Your code has been rated at 9.37/10
```

---

Thank you for improving NeMo's documentation! <!-- pylint-output-strict-mode-false -->

beep boop 🤖: 🙏 The following files have warnings. In case you are familiar with these, please try helping us to improve the code base.

---

Your code was analyzed with PyLint. The following annotations have been identified:

```
************* Module nemo.collections.llm.gpt.model.mixtral
nemo/collections/llm/gpt/model/mixtral.py:158:0: C0301: Line too long (132/119) (line-too-long)
nemo/collections/llm/gpt/model/mixtral.py:298:0: C0301: Line too long (132/119) (line-too-long)
nemo/collections/llm/gpt/model/mixtral.py:119:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/mixtral.py:133:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/mixtral.py:151:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:168:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:174:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:269:0: C0115: Missing class docstring (missing-class-docstring)
nemo/collections/llm/gpt/model/mixtral.py:292:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:312:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/collections/llm/gpt/model/mixtral.py:316:4: C0116: Missing function or method docstring (missing-function-docstring)
************* Module nemo.lightning.run.plugins
nemo/lightning/run/plugins.py:80:0: C0301: Line too long (145/119) (line-too-long)
nemo/lightning/run/plugins.py:91:0: C0301: Line too long (201/119) (line-too-long)
nemo/lightning/run/plugins.py:96:0: C0301: Line too long (200/119) (line-too-long)
nemo/lightning/run/plugins.py:97:0: C0301: Line too long (127/119) (line-too-long)
nemo/lightning/run/plugins.py:183:0: C0301: Line too long (174/119) (line-too-long)
nemo/lightning/run/plugins.py:259:0: C0301: Line too long (150/119) (line-too-long)
nemo/lightning/run/plugins.py:70:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:105:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:160:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:206:4: C0116: Missing function or method docstring (missing-function-docstring)
nemo/lightning/run/plugins.py:269:4: C0116: Missing function or method docstring (missing-function-docstring)

-----------------------------------
Your code has been rated at 9.37/10
```

---

Thank you for improving NeMo's documentation! Closing this. It can be part of 25.02.
beep boop [🤖]: Hi @malay-nagda 👋,
    
    we've cherry picked #11788 into  for you! 🚀
    
    Please review and approve this cherry pick by your convenience!