Fill mask model that supports multiple masks
Hello, I recall that there was a model that supports multiple masks by introducing several special mask tokens eg   , but I can’t remember now and cannot find it.Does anyone know which model is it? Thanks.
2022-10-20T18:19:14Z
Oh nvm turns out that it is T5.During training it masks multiple tokens, but notduring inference.Are there models that support multiple masks? Is the current best method to feed one mask at a time?