Computer-Assisted Creation of Boolean Search Rules for Text
  Classification in the Legal Domain
  In this paper, we present a method of building strong, explainable
classifiers in the form of Boolean search rules. We developed an interactive
environment called CASE (Computer Assisted Semantic Exploration) which exploits
word co-occurrence to guide human annotators in selection of relevant search
terms. The system seamlessly facilitates iterative evaluation and improvement
of the classification rules. The process enables the human annotators to
leverage the benefits of statistical information while incorporating their
expert intuition into the creation of such rules. We evaluate classifiers
created with our CASE system on 4 datasets, and compare the results to machine
learning methods, including SKOPE rules, Random forest, Support Vector Machine,
and fastText classifiers. The results drive the discussion on trade-offs
between superior compactness, simplicity, and intuitiveness of the Boolean
search rules versus the better performance of state-of-the-art machine learning
models for text classification.
