While tokenizing the dataset I'm getting this type of error
can anyone help how to solve it…Capture1247×409 10 KB
2022-10-21T16:59:25Z
Hi,I can’t see the error message. Can you paste the trace along with error message.
2022-10-21T17:43:36Z
sorry there is no error message but process stops at 95%I’m using this examplenotebooks/language_modeling_from_scratch.ipynb at main · huggingface/notebooks · GitHuband change the dataset to OSCAR
2022-10-23T13:19:39Z
Hi! This is a (known) bug in the printing logic, not in the processing itself (seeProgress bars have color red and never completed to 100% · Issue #5117 · huggingface/datasets · GitHub), which we’ve already addressed. You can either install from “main” (pip install git+https://github.com/huggingface/datasets.git) or wait for the next release to fetch the fix.