Emotion Based Hate Speech Detection using Multimodal Learning
  In recent years, monitoring hate speech and offensive language on social
media platforms has become paramount due to its widespread usage among all age
groups, races, and ethnicities. Consequently, there have been substantial
research efforts towards automated detection of such content using Natural
Language Processing (NLP). While successfully filtering textual data, no
research has focused on detecting hateful content in multimedia data. With
increased ease of data storage and the exponential growth of social media
platforms, multimedia content proliferates the internet as much as text data.
Nevertheless, it escapes the automatic filtering systems. Hate speech and
offensiveness can be detected in multimedia primarily via three modalities,
i.e., visual, acoustic, and verbal. Our preliminary study concluded that the
most essential features in classifying hate speech would be the speaker's
emotional state and its influence on the spoken words, therefore limiting our
current research to these modalities. This paper proposes the first multimodal
deep learning framework to combine the auditory features representing emotion
and the semantic features to detect hateful content. Our results demonstrate
that incorporating emotional attributes leads to significant improvement over
text-based models in detecting hateful multimedia content. This paper also
presents a new Hate Speech Detection Video Dataset (HSDVD) collected for the
purpose of multimodal learning as no such dataset exists today.
