A BERT-Based Transfer Learning Approach for Hate Speech Detection in
  Online Social Media
  Generated hateful and toxic content by a portion of users in social media is
a rising phenomenon that motivated researchers to dedicate substantial efforts
to the challenging direction of hateful content identification. We not only
need an efficient automatic hate speech detection model based on advanced
machine learning and natural language processing, but also a sufficiently large
amount of annotated data to train a model. The lack of a sufficient amount of
labelled hate speech data, along with the existing biases, has been the main
issue in this domain of research. To address these needs, in this study we
introduce a novel transfer learning approach based on an existing pre-trained
language model called BERT (Bidirectional Encoder Representations from
Transformers). More specifically, we investigate the ability of BERT at
capturing hateful context within social media content by using new fine-tuning
methods based on transfer learning. To evaluate our proposed approach, we use
two publicly available datasets that have been annotated for racism, sexism,
hate, or offensive content on Twitter. The results show that our solution
obtains considerable performance on these datasets in terms of precision and
recall in comparison to existing approaches. Consequently, our model can
capture some biases in data annotation and collection process and can
potentially lead us to a more accurate model.
