memray

/

opennmt-kpg

like 2

• "torchtext.data.field.Field",
• "functools.partial",
• "collections.Counter",
• "torch._utils._rebuild_tensor_v2",
• "tokenizers.AddedToken",
• "_codecs.encode",
• "onmt.inputters.text_dataset._feature_tokenize",
• "tokenizers.models.Model",
• "collections.OrderedDict",
• "onmt.inputters.text_dataset.TextMultiField",
• "transformers.models.roberta.tokenization_roberta_fast.RobertaTokenizerFast",
• "argparse.Namespace",
• "onmt.inputters.inputter.make_src",
• "torch.FloatStorage",
• "tokenizers.Tokenizer",
• "onmt.inputters.inputter.make_tgt",
• "torchtext.data.utils._split_tokenizer",
• "torchtext.vocab.Vocab",
• "torchtext.data.field.RawField"

How to fix it?

• "tokenizers.Tokenizer",
• "onmt.inputters.text_dataset.TextMultiField",
• "torch._utils._rebuild_tensor_v2",
• "torchtext.vocab.Vocab",
• "torchtext.data.field.Field",
• "transformers.models.roberta.tokenization_roberta_fast.RobertaTokenizerFast",
• "collections.OrderedDict",
• "onmt.inputters.text_dataset._feature_tokenize",
• "torchtext.data.utils._split_tokenizer",
• "onmt.inputters.inputter.make_tgt",
• "torchtext.data.field.RawField",
• "argparse.Namespace",
• "collections.Counter",
• "torch.FloatStorage",
• "functools.partial",
• "onmt.inputters.inputter.make_src",
• "tokenizers.AddedToken",
• "_codecs.encode",
• "tokenizers.models.Model"

How to fix it?