gpt SFT model inference did not return the prediction results
This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days. This issue was closed because it has been inactive for 7 days since being marked as stale.
After running the fine-tuning script at examples/nlp/language_modeling/tuning/megatron_gpt_finetuning.py,

I got a sft gpt .nemo model, and I am trying to run the inference script at examples/nlp/language_modeling/tuning/megatron_gpt_generate.py

even though I have specified the output file path in  examples/nlp/language_modeling/tuning/conf/megatron_gpt_generate_config.yaml

the running looks good but it only reported the test loss, it did not generate any inference results (a jsonl/txt file) in the output file path.