Why each word id from tokenizer distilbert got different even it's the same word ex: "Sebab:2953" & "Sebab:1061"?
I’was try to print out the id from tokenizer which char gonna print out then when I was code it but I only can print out the sentence but for each same word had the different id token, how to make the same word in one ID tokenize? Sorry for bad english grammar…Source Code:model_class, tokenizer_class, pretrained_weights = (ppb.DistilBertModel, ppb.PreTrainedTokenizerFast, 'distilbert-base-uncased')

tokenizer = tokenizer_class.from_pretrained(pretrained_weights)
model = model_class.from_pretrained(pretrained_weights)tokenized = x.apply((lambda x: tokenizer.encode(x, return_offsets_mapping=True, add_special_tokens=True, max_length=50, truncation=True)))
print(tokenized)

0       [101, 1018, 6904, 25509, 2953, 1061, 2290, 736...
1       [101, 13253, 3736, 11463, 4710, 2226, 17076, 2...
2       [101, 7861, 4502, 2102, 6904, 25509, 2953, 736...
3       [101, 21862, 2015, 13253, 3736, 11463, 4710, 2...
4       [101, 13253, 3736, 6239, 10722, 14905, 27225, ...
                              ...                        
1643    [101, 13253, 3736, 21766, 4502, 16183, 4430, 2...
1644    [101, 6187, 5283, 2361, 18414, 19968, 4430, 13...
1645    [101, 7861, 4502, 2102, 6904, 25509, 2953, 132...
1646    [101, 2033, 2386, 2290, 7221, 3148, 2243, 3282...
1647    [101, 13253, 3736, 11463, 4710, 2226, 1999, 20...
Name: jawaban, Length: 1648, dtype: objectmarked_x = []
for i in x:
    marked_x.append("[CLS] " + i + " [SEP]")
print(marked_x[0] ,'\n\t', tokenized[0])

[CLS] 4 faktor yg sebab sebab bahasa melayu angkat jadi bahasa indonesia bahasa melayu rupa lingua franca indonesia bahasa hubung bahasa dagang sistem bahasa melayu sederhana mudah ajar bahasa melayu kenal tingkat bahasa bahasa kasar bahasa halus suku jawa suku sunda suku suku lain sukarela terima bahasa melayu jadi bahasa indonesia bahasa nasional bahasa melayu punya sanggup pakai bahasa budaya dalam arti luas [SEP] 
	 [101, 1018, 6904, 25509, 2953, 1061, 2290, 7367, 3676, 2497, 7367, 3676, 2497, 13253, 3736, 11463, 4710, 2226, 17076, 24498, 14855, 4305, 13253, 3736, 6239, 13253, 3736, 11463, 4710, 2226, 21766, 4502, 17002, 6692, 23151, 3540, 6239, 13253, 3736, 9594, 5575, 13253, 3736, 4830, 24930, 24761, 18532, 13253, 3736, 102]