Amharic BERT Training
@yjerniteProblem While training Amharic Language BERT on oscar dataseta866×711 93.4 KBColab Link
2021-02-23T22:58:59Z
You need to remove theidcolumn in the dataset:tokenized_datasets = datasets.map(tokenize_function, batched=True, num_proc=4, remove_columns=["id", "text"])
2021-02-23T23:57:04Z
That solved it , thank you