CJRC: A Reliable Human-Annotated Benchmark DataSet for Chinese Judicial
  Reading Comprehension
  We present a Chinese judicial reading comprehension (CJRC) dataset which
contains approximately 10K documents and almost 50K questions with answers. The
documents come from judgment documents and the questions are annotated by law
experts. The CJRC dataset can help researchers extract elements by reading
comprehension technology. Element extraction is an important task in the legal
field. However, it is difficult to predefine the element types completely due
to the diversity of document types and causes of action. By contrast, machine
reading comprehension technology can quickly extract elements by answering
various questions from the long document. We build two strong baseline models
based on BERT and BiDAF. The experimental results show that there is enough
space for improvement compared to human annotators.
