Training an original `nn.Module` w/MLM using HF
Hi!  I wanted to useautomodelformaskedlmto pretrain a model I built innn.Modulewith MLM objective.  I searched a lot but it looks like most tutorials still ask that you use a base model within HF.  How can I achieve this?  Meanwhile, I also want to compute the per-unique-token mask reconstruction accuracy.  Is there a parameter or a tutorial for this?  Thanks in advance!