{'fraction_non_alphanumeric': 0.034553954956451575, 'fraction_numerical': 0.010703182476208557, 'mean_word_length': 4.7206081998370895, 'pattern_counts': {'":': 0, '<': 1, '<?xml version=': 0, '>': 5, 'https://': 1, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 5, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Proactively Reducing the Hate Intensity of Online Posts via Hate Speech Normalization

Curbing online hate speech has become the need of the hour; however, a blanket ban on such activities is infeasible for several geopolitical and cultural reasons. To reduce the severity of the problem, in this paper, we introduce a novel task, hate speech normalization, that aims to weaken the intensity of hatred exhibited by an online post. The intention of hate speech normalization is not to support hate but instead to provide the users with a stepping stone towards non-hate while giving online platforms more time to monitor any improvement in the user's behavior. To this end, we manually curated a parallel corpus - hate texts and their normalized counterparts (a normalized text is less hateful and more benign). We introduce NACL, a simple yet efficient hate speech normalization model that operates in three stages - first, it measures the hate intensity of the original sample; second, it identifies the hate span(s) within it; and finally, it reduces hate intensity by paraphrasing the hate spans. We perform extensive experiments to measure the efficacy of NACL via three-way evaluation (intrinsic, extrinsic, and human-study). We observe that NACL outperforms six baselines - NACL yields a score of 0.1365 RMSE for the intensity prediction, 0.622 F1-score in the span identification, and 82.27 BLEU and 80.05 perplexity for the normalized text generation. We further show the generalizability of NACL across other platforms (Reddit, Facebook, Gab). An interactive prototype of NACL was put together for the user study. Further, the tool is being deployed in a real-world setting at Wipro AI as a part of its mission to tackle harmful content on online platforms.


INTRODUCTION
Today, anyone with access to the Internet can learn, share, and participate in matters that concern them. However, anti-social behavior such as spreading fake news, cyberbullying, polarization, and posting hateful messages has increased with Internet penetration. While what constitutes hate speech is subjective, there is a common understanding of what underpins hate [16]. Hate speech can be understood as any communication in speech, writing, or behavior that attacks/discriminates or uses pejorative language against an individual or a group based on who they are. The attack is often targeted at religion, ethnicity, nationality, race, color, descent, gender, or other identity factors [47]. Our experiment aims to capture varying degrees and designs of hatefulness; we use hate as an umbrella term encompassing overlapping definitions of hate, abuse, and offense. Hate speech on social media usually consists of content that is often in violation of the terms of usage of the platform and leads to either flagging of content or banning of users or both. This has led to an influx of banned users turning over to less-restrictive platforms [15]. A cross-platform study of hateful users revealed how the banning of users could backfire for the platform and the Internet community at large. [27].
Motivation and evidence. An alternative solution is to proactively counter [7] hate speech before it goes public. Systematic and proactive sensitization of online users can help them voice their opinions without directly propagating harm. In this case, we believe that promoting users with alternative scenarios nudges a change in attitude [5,29]. Twitter and Instagram, among other platforms, have already rolled out the experimental prompts for 'offensive posts with an option to revise before going public' [23,24]. These tools state that the material is objectionable and leave it to the users to build a more appropriate form. Based on experiments with such prompts, researchers at Twitter published findings [28] that prompted participants to eventually post fewer offensive tweets than non-prompted users in the control group. Such nudging should be more welcoming to the users than them getting banned from the platform without having an opportunity to improve.
Contribution I: Novel problem statement. Prompting users to change their texts to be completely non-hateful can be a significant behavioral shift and may backfire. Therefore, as an experiment, we take the first step of making the content less hateful and hope to build from there. Extending upon the idea of proactive prompts, we propose the novel task of hate speech normalization, which suggests a normalized counterpart of hateful content by weakening the overall hatred exhibited by the original content while retaining the underlying semantics. Additionally, in line with previous studies [28], we observe a significant reduction in user engagement (virality) for normalized sentences compared to the original one. Our hypothesis testing is detailed in Section 2. arXiv:2206.04007v1 [cs.CL] 8 Jun 2022 Table 1: Data samples with hate intensity and spans. Intensity scales from [1 − 10] (a higher score denotes a higher degree hatefulness in the sample). The phrases in blue denote the hate spans in the original sentence. We also provide the respective normalized version of the samples. Section 5 describes the annotation scheme and hate intensity score in details (Int: Intensity). Contribution II: New dataset. Note that our aim is not to render a hateful message into a non-hateful one; instead, it is the reduction of hatred. To this end, we manually curate a parallel corpus of hateful samples and their normalized versions, the first dataset of its kind. Our preliminary analysis of hateful samples suggests that, in general, only a few phrases within a sentence convey major hatred. Therefore, we first identify the hateful spans for each hateful sample and then normalize them to reduce overall hatred. Table 1 lists examples of such posts and their normalized counterparts.
Contribution III: Novel method. We then propose NACL, a Neural hAte speeCh normaLizer, which operates in three stages. It first measures the intensity of hatred exhibited by an incoming sample by employing an attention-driven BiLSTM-based regression model. Following this, a BiLSTM-CRF module operates on the sample to extract the hateful spans from the source sample. In the last stage, we incorporate and fine-tune a BART-based sequence-tosequence model (seq2seq) [31] to normalize the identified hate spans with feedback (reward/penalty) from the hate intensity predictordriven discriminator module. The reward/penalty from the discriminator enforces the generator (BART model) to paraphrase the hate spans to reduce the hate intensity. For each stage, we compare our results with various baselines. We develop an end-to-end system that can be efficiently deployed in the real-world environment. It achieves consistent performance in offline (intrinsic/extrinsic evaluations) as well as online evaluations (as observed by annotators).
Contribution IV: Extensive evaluation and deployment. We perform an extrinsic evaluation on three standard state-ofthe-art hate detection models where we measure the confidence of these models in classifying the normalized samples as 'hate' against the original unnormalized samples. We hypothesize that the models should have lower 'hate' confidence for the normalized (reduced hate) sample compared to the original one. We further compare NACL with six baselines and obtain a performance of 0.136 RMSE, 0.622 F1-score, and 82.27 BLEU in intensity prediction, span identification, and text normalization, respectively.
In partnership with Wipro AI, we develop an interactive web interface and conduct an anonymized human evaluation on the outputs of NACL and other baselines. We observe that NACL reports better results in intrinsic evaluation, higher reduction in confidence of hate detection models in extrinsic evaluation, and coherent and better outputs as evaluated by humans. We further show the generalizability of NACL across three social media platforms -Reddit, Facebook, and Gab. Reproducibility: Being aware of the ethical considerations (Appendix A) of dataset, we are restricting its release. Meanwhile, the models, source codes, annotation guidelines, the questionnaires used for human evaluation (c.f. Section 6.5), and web-tool (c.f. Section 6.7) is available at https://github.com/LCS2-IIITD/Hate_Norm.

APPLICATION AND TARGET AUDIENCE
Target Audience. People initiate and engage in hateful conversation for a variety of reasons. There will always be users who intentionally and constantly spread hateful content. The majority of such users eventually get flagged and reported by the community for their anti-social behavior. However, despite intentionally engaging in hateful content, a section of online users are adaptive and can be nudged to change their opinions via empathy [21] and corrective behavior. Our tool is aimed at the latter set of user groups whose social engagements can be eventually guided to become nonhateful. Meanwhile, prompting tools and the adoption of suggestive texts can help the content moderators understand the linguistic behavior of offensive users and track any changes in user behavior against getting flagged/banned. Evidence. A significant criticism for prompting and suggestive rectification is the debate of reduced expressive powers of the users. However, a recent study by Twitter [28] also revealed that encouraging users to reduce the publishing of offensive text had no significant impact on their ability to participate in the non-offensive conversation. This result is a big motivation for researchers exploring proactive methods of countering hateful/hurtful content, as we do in this paper. Though one can argue that normalized text is still hateful and prone to spreading harm, we hypothesize that in its normalized form with a reduction in intensity, the content should see a decline in the user engagement it receives (i.e., reduces its virality). We take inspiration from the virality prediction models on social media to test this hypothesis. In our setting, the virality of a post is expressed in terms of the total comments it receives. Since ours is a text-only dataset curated from different sources, we lack the availability of any network, temporal and other signals. Engineering various textual features (listed in Appendix B) inspired by the work of Dutta et al. [13] and Cheng et al. [8], we train a user engagement prediction model (trained on Reddit dataset). We use it to predict the comment count for the hateful posts and their normalized counterpart present in our dataset. We use hateful and normalized samples as our control and alternate sets. We randomly sample 300 pairs of test cases for 10 iterations and record differences in median comment count per sampling iteration (depicted in Figure 1). We found the phenomenon (Δ in the median virality of hate vs. normalized) to be statistically significant with a -value of 0.0027 and effect-size of 2.324 on Welch's t-test. Thus, we conclude that even if present online, the normalized form of a post is less likely to gain engagement and go viral. This evidence is in line with existing studies [28] which found that less offensive content is expected to catch fewer eyeballs.

OBJECTIVE & INDIVIDUAL STAGES
For a given hate sample , our objective is to obtain its normalized form ′ such that the intensity of hatred is reduced i.e., ′ < . To achieve this, we divide the overall task into three stages.
• Hate Intensity Prediction (HIP). The task of hate intensity prediction is to determine the extent (degree or intensity) of hatred in a message (inspired by the idea of measuring online toxicity 2 ). Given a sample , it measures the intensity of hatred on a scale of [1,10], with 10 being the highest, i.e., = ( ). • Hateful Span Identification (HSI). Hateful spans in a sentence are the portions of a sentence responsible for conveying hate [38]. The intuition behind this task is that we can achieve sentencelevel normalization if we attempt to normalize these spans. A sample can have multiple, non-overlapping hate spans, and ( ) aims to find all such spans.
• Hate Intensity Reduction (HIR). The objective of hate intensity reduction is to generate a new sample that preserves the original semantic but with weaker hate intensity. Intuitively, we first need to identify the threshold for strong vs weak hate. For our experiments, we set a threshold = 5. For each strong hate sample with > , we aim to generate semantically similar sample ′ ≈ , with the constraint ′ ≤ .

PROPOSED METHODOLOGY
We engineer a real-time system that can normalize hate speech on the fly. Our goal is to design a simple yet effective industrylevel solution that can be deployed at scale. Interestingly from our experimentation, we observe that a simpler architecture produces comparable performance to a complex solution and is more industry-centric in terms of response time and performance. Figure 2 illustrates a high-level overview of the NACL framework. We assume that NACL will be called to action once a text is detected as hateful by a preexisting hate detection model. In our case, we mimic it by only using hateful samples for training NACL (c.f. Section 5). Any future reference of the input sample would mean that it is already labeled as hate. In the first step, we compute the hate intensity ( ) of an input sample and forward it for normalization only if it satisfies the condition, > (i.e., only strongly hateful samples are subject to normalization). Next, the model predicts the hate spans within the incoming sample following the CONLL-2002 BIO notations [45]. Subsequently, NACL normalizes each identified hate span through a generator module. Finally, the outputs of each generator are interleaved in the original span sequence and fed to the discriminator to ensure the reduction of hate intensity ( ≤ ). The pseudo-code is summarized in Appendix D.
NACL-HIP Module: For hate intensity prediction, we employ a Bi-LSTM model. The intermediate representation is then passed through a self-attention layer connected to a fully-connected layer with linear activation to obtain the input sample's continuous hate intensity prediction. Table 3 shows various models and pre-trained embeddings we experimented with.
NACL-HSI Module: For the span detection model, we initially take as input a sequence of a hateful sample ( ). For every token of the sequences, we have manually annotated span labeling that represents the start and end of a hateful span in it. Our goal is to train our model to detect relevant hate spans represented by tags ( , , ) where 'B' represents the beginning of hate span, 'I' forms the continuation of a hate span, and 'O' represents the nonhate tag. For our model, we use bidirectional LSTMs to capture the contextual representation of sequences. The hidden representations are then passed through a Time Distributed dense layer to flatten the embedding structure. We further use a CRF model layer to fit our representations and produce the required tags for our sequences. The CRF layer models the conditional probability of each sequence ( 1 , ...., | 1 , ...., ) by defining a feature map ( 1 , ..., , 1 , ... ) ∈ that maps an entire sequence to a d dimensional feature vector. Then we can model the probability using the feature vector ∈ as follows: where s ranges across different sequences and x represents the POS tag. After getting the feature vector * , we can find the most likely tag for a sentence * by: * = ( | ; * ) NACL-HIR Module: The hate intensity reduction model is a Generative Adversarial Network (GAN) based architecture, which employs both NACL-HIP and NACL-HSI as its assistive modules. NACL-HIR accepts a hateful sample along with its span labels as identified by the HSI model. For NACL-HIR, we use a pre-trained BART [31] and fine-tune it for the hate normalization task. The BART-based seq-to-seq model generates the normalized spans based on the hate spans identified by the NACL-HSI module. The generated spans are amalgamated with the rest of the sample tokens and forwarded to the HIP-based discriminator model.
The discriminator computes the hate intensity score ′ of the normalized text ′ . Since our objective is to reduce the intensity of ′ , we assign a reward/penalty to the generator based on the hate intensity score ′ of the normalized sentence and the accepted threshold value as follows: Note that the threshold value is a hyperparameter. In this paper, we experiment with two threshold values ( = {3, 5}) for the hate normalization. Table 5 shows that = 5 is better suited for the NACL-HIR model. Therefore, for the rest of the experimentation, we continued with = 5 as the threshold value for our model. If the computed hate intensity score is lesser than or equal to the threshold, the positive reward encourages the generator to continue predicting the similar normalized span; otherwise, the negative reward penalizes the generator to improve its prediction. The generator consumes the reward into its loss function as follows: where ℓ is the generator loss. Backpropagation aims to minimize the consolidated loss L in order to generate semantically coherent normalized samples with hate intensity lesser than equal to . Some Engineering Observations. As stated at the beginning of this section, we aim to find a solution that not only performs well for the given problem statement but can also be deployed. Subsequently, we make a trade-off between efficiency and complexity at each modeling stage. For instance, adding additional BiLSTM layers for HIP did not significantly boost the performance; hence, we exclude them from the final modeling. Additionally, with HSI, simpler embedding solutions like Glove and ElMo performed comparably to BERT. We think the main reason for BERT's low performance is that the BERT tokenizer splits the words into subtokens, which causes the spans to be distributed unequally across the subtokenized words. This skews the target values that belong to one of the tags ( ∈ ( , , )), resulting in the model overfitting. As we have limited data, the ELMO model performs better with this data and performs well for the problem. For both HSI and HIR, we make the obvious decision to use the optimized, distilled versions of the larger BERT and BART models (as supported by HuggingFace 3 ), further reducing the number of parameters to train.

DATASET
We sourced and compiled a list of hateful instances from [3,9,11,12,25,35] by restricting our data creation to the hateful labels of the respective datasets. In total, we collected 4423 hateful samples and annotated them with hate intensity scores and hateful spans. At the end of the process, we observed 1396 samples as either implicit (no apparent hate span) or exhibiting hate intensity less than the threshold . Thus, our final gold dataset consists of 3027 parallel hateful and normalized samples, along with the intensity scores and hate spans in original ones (Table 2). Additionally, we annotated each normalized sample with its new hate intensity score. Two annotators were employed for this task. Both annotators annotated all the available samples. In case of disagreement (11% of cases), we employed a third annotator to break the tie. Overall the inter-annotator mean squared error for hate intensity was 0.20. In case of a disagreement on hate-span, if the nonoverlap contains words like abuse or racial slurs, we added them to the span. In the rare case, if both annotators and third annotators were in disagreement over a span, the sample was dropped from the final dataset. Table 2 lists the overall statistics of the data curated and annotated. The detailed annotation guidelines are covered in Appendix C. Table 1 shows a few examples of the original hate samples, along with their normalized forms and intensity scores for both sets. 4 A bar graph representing the original and normalized hate intensity distributions is shown in Figure 3. It is evident that the intensity distribution mass in original samples shifts towards the weaker intensity in normalized samples. Train and test sets: We split the annotated dataset in the 70 : 15 : 15 for the training (2119), validation (454), and testing (455). One may rightfully argue that such a small number of samples in the test set ( ) may not be adequate to evaluate the modules. Therefore, we compiled another set of 1, 111 hate samples from two sources, released by Ziems et al. [49] and Gao and Huang [20] as the secondary test set ( ). Note that samples in do not have gold normalized counterparts; therefore, the normalized samples generated from cannot be used for intrinsic evaluations.

EVALUATION AND ANALYSES
We design a three-way evaluation framework. First, we perform an intrinsic evaluation to measure the model's performance by traditional evaluation metrics. Second, we perform human evaluation where we ask human annotators to rate the quality of the generated output (from our model and the generation baselines). Third, we employ state-of-the-art hate speech detection models to discriminate between the original and normalized hate samples for extrinsic evaluation. Additionally, we evaluate NACL on datasets from three different platforms -Reddit, GAB, and Facebook. We further let human emulators supply their content in English and check in real-time the expected output for randomly supplied content. Both these external evaluations help test the robustness of the model against a host of inputs possible in the real world. This is also the first step toward extending the evaluation for adversarial attacks, which we hope to study in the future.

NACL-HIR Baseline Methods
It should be noted that we lack accurate baselines due to the novelty of the proposed task. Therefore, we adopt six existing methods as baselines that we deem pertinent to our work.
• Dictionary-based Normalization [44]: Inspired by the early work of Su et al. [44], we define a dictionary-based model that learns the mapping between the hateful span and its corresponding normalized span from the training set. We employ tf-idf based cosine similarity to perform a lookup to select the closest normalized span for the hate span in the test sample. • Neutralizing Subjective Bias [40]: This style-transfer model aims to neutralize the subjective bias in news content by converting a piece of opinionated news into a neutral one. It utilizes an LSTM-based sequence-to-sequence model. We re-train the model for the hate normalization task, assuming the strongly hateful content as biased. • FGST [33]: Given a sentence with a polarity label (positive or negative), FGST generates a new sentence having a pre-defined

Intrinsic Evaluation
We compute Pearson correlation, cosine similarity and RMSE scores for HIP (Table 3); whereas, we adopt F1-score for HSI (Table 4). In the case of HIR, which is a generative task, we compute perplexity and BLEU scores ( Table 5). The model hyperparameters are covered in Appendix F. We iteratively build our modules, starting independently with the HIP and HSI modules and then using only the best-performing ones for HIR. For HIP, as shown in Table 3, BERT+BiLSTM models performs better than others. Using BERT+BiLSTM with a linear activation gives the best results with cosine similarity of 0.973, Pearson score of 0.766 and an RMSE of 0.136. Meanwhile, BERT+LSTM with a sigmoid activation (scaling intensity between 0-1 range) reports a cosine similarity of 0.968, Pearson score of 0.704 and RMSE of 0.148. As overall the linear activation beats sigmoid, for the rest of our experimentations, we use BERT+LSTM (linear) as our HIP model.
For HSI, BiLSTM+CRF yields the best F1 of 0.622 and best Recall of 0.634 with ELMo embeddings as reported in Table 4. Among others, the fine-tuned SpanBERT model stands the second-best with 0.583 F1 and highest precision with 0.6913. For the rest of our experimentation, we use ELMo+BiLSTM+CRF as our HSI model.
Finally, we report the performance of NACL-HIR module along with other baselines in Table 5. HIR yields the best perplexity score  (a lower value is better) of 80.05 for the generated normalized sentences. In comparison, the dictionary-based baseline obtains the perplexity of 92. For reference, we also compute perplexity (64.66) for the reference (gold) normalized sentences. Moreover, we observe a similar trend in the BLEU scores as well. The NACL-HIR model achieves the highest BLEU (82.27). The high BLEU score for HIR can be attributed to the fact that we mainly target hate spans for normalization, and a good portion of the original token (not containing hate) sequence gets preserved in the normalized sentence. Categorizing supervised and unsupervised based on whether the method requires parallel data, we observe that supervised methods like Bias Neutralization and some unsupervised methods like FGST perform moderately well in comparison to NACL-HIR. We observe abysmal performance from most unsupervised style transfer methods. This is mainly due to the lack of a large-scale corpus for training these models for our problem definition. Owing to which most of the generated sequences produce junk values. During the human evaluation, we do not consider these unsupervised baselines except for FGST.

Extrinsic Evaluation
Our hypothesis for extrinsic evaluation is that if a hate normalization model produces high quality normalized text with lower hate intensity score, then a hate speech detection method will exhibit less confidence in classifying the normalized text as hate. For this evaluation, we employ three widely-used hate speech detection methods - [47], [11], [19]. We train the methods on their respective datasets. For consistency, we map multiple granular hate labels into hate and non-hate labels. The original dataset provided by respective papers, is summarized in Appendix H. Evaluation on Test Sets S A and S B : For each original sample in + , we extract ( , ), the softmax probability of the hate class as the confidence score, where is the underlying hate detection method. Evidently, (·) ∈ (0, 1]. Subsequently, we compute the confidence score, ( ′ , ) for each generated normalized sample ′ . Considering that hate speech normalization aims to reduce the hate intensity of samples instead of converting to non-hate, we restrict ourselves in analyzing a set of samples in ⊆ + for which ( ) ≥ 0.5 and ( ′ ) ≥ 0.5, i.e., both the original and normalized samples are predicted as hate. Finally, we compute the average difference in confidence score, Δ , for each pair ( , ′ ) in as, Table 6 reports the average difference in confidence scores for NACL-HIR and other baselines 5 . We observe the consistency of NACL-HIR over other normalization models as it obtains confidence scores > 0 across all three hate detection methods. In comparison, Style Transfer DRG gives the highest performance in two cases but reports a negative score in the third. It should be noted that all existing hate speech datasets are highly skewed against hateful labels [18]. Thus, detection models are prone to underperform for the hate class.
Having considered that, extrinsic evaluation aimed at pointing out the general pattern in reduction of hatefulness post-normalization. Such behavior is expected to manifest irrespective of the hate detection model deployed for production.

Error Analysis
Though NACL performs better than other baselines across different evaluations, it does commit mistakes. Table 8 lists a few examples along with their original and predicted hate intensity scores. For the first example, NACL-HIP correctly predicts the hate intensity score as 10; however, for the other three examples, it wrongly predicts the score. NACL-HIP assigns lesser intensity score to the second utterance -the hatred is conveyed by a single word 'qu**r,' and most likely, our model does not assign adequate focus on it in the presence of the positive phrase 'happy birthday'. In the third example, the predicted high score is possibly because of the presence of three words -'bi*ch', 'damn', and 'unfollow'. In comparison, we hypothesize that our model learns to associate color as a cue for hate, thus predicting a high hate intensity score for the last example. We also encounter some misclassifications in hateful span identification, as shown in Table 10. In span identification, NACL-HIP commits three kinds of mistakes -(a) removes a token from hateful span during prediction; (b) includes additional tokens as part of the hateful span; and (c) classifies non-hate spans as hate. The first kind of mistake can be observed from examples 1 and 2 in Table 10,   Table 7 lists a couple of examples considering the hate normalization task. In the first example, NACL-HIR partially normalizes the hate sample, and as a consequence, the generated text has low adequacy and fluency scores. Similarly, in the second, we see: (a) the generated sentence is relatively more fluent than the first; and (b) the intensity value is on the higher side due to the presence of phrases 'Mexicans are t**h' and 'disgusting.' We argue that the problem of partial normalization can be effectively addressed with more volume and variety of training samples.

Human Evaluation
In order to check the viability of the overall system, aided by Wipro AI, we perform a human evaluation and assess the generated text from NACL-HIR and other baselines. We prepare a questionnaire to measure the qualitativeness of the generated texts. Evaluation instructions are listed in Appendix E. For a subset of hateful samples from our dataset, the human annotators are provided with four outputs corresponding to four high performing hate normalization systems, i.e., Dictionary-based, Bias Neutralization, FGST, and NACL. To reduce bias, we anonymize the systems, randomly shuffled the outputs, and labeled them as A, B, C, D. Given an original sample, we ask 20 human annotators 6 to evaluate the generated texts on three dimensionshate intensity, adequacy, and fluency [4]. Adequacy (the higher, the better) measures the semantic perseverance in the generated text, while fluency (the higher, the better) refers to the linguistic smoothness in the target language. We modify the definition of adequacy to adopt it for the hate speech normalization task. A predicted sentence that does not reduce hate intensity is considered inadequate and should have a lower adequacy score. We also provide the intensity of the original sample for reference. Finally, we aggregate the average intensity, adequacy, and fluency scores, as shown in Table 9. We present the average scores for one sample and the overall average scores across all samples. On average, NACL-HIR outperforms others, with hate intensity of 4.08, fluency of 4.38, and adequacy of 4.16.

Platform-Independence Analysis
To further check the robustness of our tool, we extend the human evaluation to a cross-platform analysis of NACL. We evaluate on randomly selected 100 samples from Reddit, GAB and Facebook hateful posts, obtained from [41] (for first two) and [9]. We employ the same set of annotators and annotation process mentioned in Section 6.5 to evaluate the quality of NACL and two best baselines in terms of intensity, adequacy, and fluency. Table 11 shows that NACL performs convincing well compared to others across platforms.

Deployment Details
As hate normalization aims to be deployed as a prompting system, we develop an interactive web interface for the same. The web service analyzes the composed text on the go; it reports the intensity of hate and upon finding the text hateful ( > ) it suggests a normalized text as an alternative. The web interface is developed in Flask 7 , and works in an auto-complete fashion. In Figure  4 (Appendix G), we show the snapshots of the tool for four scenariosno-hate ( ∼ 0), low-hate( ≤ 5), mild-hate ( ≤ 7), and extreme-hate ( > 7). The prototype is being rigorously tested for consistency and scalability by the Wipro AI team. Details of in the wild evaluation are listed in Appendix G. A demo video of our tool is available on our Github. 8

RELATED WORK
Hate Speech Detection: From the simple logistic regression to [11,47] deep learning-based models [2,30], the work on hate speech has diversified in volume [6,18], languages [36], granularity and variety [1]. Fortuna and Nunes [17], and Poletto et al. [39] put together a detailed survey of various hate speech detection methods and their shortcomings. In this work, we do not propose any new hate speech detection method. Our framework comes into use once a speech is detected as hateful. Thus, hate speech detection underpins the work of hate speech normalization.
Rephrasing Hateful Text: In the context of rephrasing offensive text, Su et al. [44] led the initial work by building a rule-based system (29 hand-crafted rules) for rephrasing profane Chinese phrases/terms. We, too, tested such a tf-idf based mapping approach, but the limitations of such rule-based are in terms of out of vocabulary (OOV) phrases. In another work, Nogueira dos Santos et al. Table 9: The left part of the table shows an example of human evaluation where we give the generated text to human annotators to evaluate the output of each competing model on three parameters -intensity, fluency, and adequacy.The results are an average from all the responses received for this example. The right part of the table shows the average scores of all three parameters across all responses (i.e overall system averages). Intensity ranges from 1 − 10, Fluency and Adequacy from 1 − 5.

Overall Average Model
Tweet     [37] built an unsupervised text-transfer model for tackling offensive language across social media platforms. In the latest work on unsupervised text transfer for profanity, Tran et al. [46] employed a vocabulary-based approach to determine if a sentence should be considered as profane and then proceed to generate its non-offensive version. The works by both Tran et al. [46] and Nogueira dos Santos et al. [37] are similar to our use case. However, they differ in that they employed an unsupervised approach that depended on classifiers or lexicons to capture the offensive/profane text and also aim at 180 • transformation into a non-offensive one. In contrast, our aim is the reduction of hate and not the complete absence of it. On the line of negativity reduction, Madaan et al. [34] employed a tag-based approach for increasing the politeness of a question/answer (query) pair. Pryzant et al. [40] adopted the similar tag-based approach but for opinionated news sentences, which is closer to our task than a Q&A-based setup. Starting with Xu et al. [48], several studies (both supervised and unsupervised) showed successful rephrasing of a sentence by modifying its sentiment attribute. These methods [10,22,32,42,43] largely disentangled the sentiment attribute and then relied on a combination of select rephrase and attention mechanism to generate an output sequence. For our use case, we hope to learn the hateful-span attributes. Our experiments show that alternatively reducing bias or sentiment is inadequate for reducing hate intensity due to the subjective nature of hate speech. Additionally, we observed that unsupervised style transfer methods that rely on sizeable monolithic corpus hardly perform well when trained on low-volume datasets such as ours.

CONCLUSION AND FUTURE SCOPES
To combat the severity of online hate speech, we proposed an alternative solution by introducing the novel task of hate speech normalization. To this end, we proposed NACL, a neural hate speech normalizer. We collected and manually annotated a new dataset to support the task. We performed exhaustive evaluations to establish the model's efficacy under different settings. We observed two major challenges for the hate normalization task -first, the lack of parallel data to train more sophisticated generative models, and second, the presence of implicit hate in samples. Though the first hurdle can be addressed (albeit expensive) by annotating more samples, handling the implicit hate is cumbersome [14]. In the current work, we skipped over the implicit hateful samples due to the absence of explicit hate spans. In the future, we would like to put in rigorous effort to handle such cases and increase the size of the dataset. Additionally, it would be interesting to see how NACL can be extended to non-English texts.

APPENDIX A ETHICAL IMPLICATIONS
As pointed out by [26], style transfer techniques in NLP can be a force for both good and bad. While, on the one hand, they help turn the Internet into a more positive space [37], they can also be used to propagate a false/malicious narrative. Reiterating that, our research aims not to support the hateful users but rather to study an alternative approach to prompt users towards a less toxic enunciation of their opinions. Without forcing the users to jump from a negative to a positive space directly, we operate on the space in between as a stepping stone and study the theoretical effectiveness of such a technique (the practical effect is in parts highlighted by human evaluation in Section 6.5). Keeping in mind the nefarious use of the normalized hate speech (without the knowledge of online platforms about such a normalization), we will not be publicly releasing the parallel corpus. However, it shall be made available to researchers subject to their request for fair usage.

B FEATURES FOR VIRALITY PREDICTION
The text-based features employed for predicting comment engagement (aka virality) of the data samples are listed below: • Complexity: Uniqueness of terms introduced as measured by the logarithm of term-frequency in the test samples. • Readability: LIX and RIX readability scores 9 .
• Informativeness: Summation of the Tf-idf vectors of the words in the sample. • Polarity: Overall SentiNet 10 polarity score of the test sample.

C DATASET ANNOTATION GUIDELINE
For this experiment, we followed the definition proposed by [47] for hate speech and marked the hate span if it consists of any of the following explicit mentions: • A sexist or racist slur term, or an abusive term directly attacking a minority group/individual. • A phrase that advocated violent action or hate crime against a group/individual. • Negatively stereotyping a group/individual with unfounded claims or false criminal accusations. • Hashtag(s) supporting one or more of the points as mentioned earlier.
Additionally, the hate intensity of a sample was marked on a scale of 1 − 10, 10 being the highest based on: • Score[8 − 10]: The sample promotes hate crime and calls for violence against the individual/group. • Score [6 − 7]: The sample is mainly composed of sexist/racist terms or portrays a sense of gender/racial superiority on the part of the person sharing the sample.

E HUMAN EVALUATION GUIDELINE
After reading the original sample and the normalized counterparts, the annotators provided their input in the form of the following: • Intensity: The annotators assigned a hateful intensity score to each generated output on a scale of [1,10], 10 being the highest intensity. • Fluency: To understand how well constructed and readable the generated text is, the annotators scored each generated text on a range of [1,5], 5 being the highest fluency. • Adequacy: Additionally, to provide an idea of whether the desired meaning can be interpreted from the output, the annotators were asked to score each generated text on a range of [1,5], 5 being , it shows the level of hate that is detected in the current text, and then recommends the normalized text to the user. the highest. Since our task aims to perform normalization and not the conversion of hate to non-hate, if a sentence changes the sample's polarity, then that can also be taken as a negative case from our intended perspective. The annotators were informed before that a normalized sample with its polarity reversed would have a minimum (1) adequacy even if it is fluent.
For reference, the intensity of the original sample was provided. The fluency and adequacy of the original sample were considered highest. To reduce the annotator's bias, the annotators were unaware of which output text represented our system.

F HYPERPARAMETERS
The models make use of Tensorflow 2.0 and Transformer 4.5.1 with Python 3 libraries, trained on Google Colab with Tesla P100-PCIE-16GB GPU.
• For the HIP model, we employ a single Bi-LSTM layer (hdim=512) followed by a layer of self-attention. For this model, use the MSE loss and the Adam optimizer with linear activation. The input embedding is BERT dim=768. The model is trained for 10 epochs with a batch size of 32. • For the HSI, we employ a 2 layer Bi-LSTM (hdim=512), using a batch size of 32, and the RELU activation function. As the final layer for the Span Model is a CRF, we take crf_loss and crf_accuracy as our loss and accuracy metric respectively, and Adam optimizer. The model is trained for 5 epochs with a batch size of 32. • For the HIR, we employ Facebook's BART-base module, with a cross-entropy loss, RELU activation and Adam optimizer.

G DEPLOYMENT DETAILS
The proposed web-interface can easily be made to work in cross platform settings to proactively curb hate speech, and the screenshot for the same is provided in Figure 4. Again we evaluate the tool in the wild by asking 25 participants to write random hateful content on their own and rate the tool's output. We extend the tool by including the interface of the Bias Neutralization baseline -the tool shows the outputs of NACL and the baseline for a given input. Each participant is asked to input hateful content, assign an original intensity score, and subsequently evaluate the tools' outputs considering fluency, adequacy, and intensity. The normalization methods are anonymized for the participants. In total, we obtain 100 input samples, with an average normalized intensity score of 3.24. Similar to earlier observations, we notice that NACL results in more fluent sentences with higher reduction in intensity. This in-the-wild evaluation further supplements that NACL is not restricted to our dataset.