What's the difference between wordpiece and sentencepiece?
I found that the wordpiece training and the sentencepiece are almost the same.So what’s the difference ?? Thanks
2021-06-10T12:37:22Z
See for example this post:https://towardsdatascience.com/a-comprehensive-guide-to-subword-tokenisers-4bbd3bad9a7c