Reconstructing Original Sentence From Bert Output w/ Added Noise
Hi there,I’m trying to convert a modified bert embedding back to text.I’m shooting for a pipeline like the following:input_textTokenizerBert Base UncasedAdd noise to output tensorAttempt to reconstruct original textI’m somewhat lost on step 5. I have a perturbed torch tensor but how do I convert that back to a sentence? I’m guessing with some logit layer that using the same vocabulary as the tokenizer?Thanks in advance!
2023-04-03T18:32:34Z
I have a similar problem. Have you figured out how to do this ?
2024-01-24T16:54:59Z
have you tried tokenizer.convert_ids_to_tokens(tensor)?