{'fraction_non_alphanumeric': 0.026670582267666925, 'fraction_numerical': 0.009397442400619377, 'mean_word_length': 5.404171653274064, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 1, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Politicians-based Deep Learning Models for Detecting News, Authors and Media Political Ideology

Non-partisanship is one of the qualities that contribute to journalistic objectivity. Factual reporting alone cannot combat political polarization in the news media. News framing, agenda settings, and priming are influence mechanisms that lead to political polarization, but they are hard to identify. This paper attempts to automate the detection of two political science concepts in news coverage: politician personalization and political ideology. Politicians’ news coverage personalization is a concept that encompasses one more of the influence mechanisms. Political ideologies are often associated with controversial topics such as abortion and health insurance. However, the paper prove that politicians’ personalization is related to the political ideology of the news articles. Constructing deep neural network models based on politicians’ personalization improved the performance of political ideology detection models. Also, deep networks models could predict news articles’ politician personalization with a high F1 score. Despite being trained on less data, personalizedbased deep networks proved to be more capable of capturing the ideology of news articles than other non-personalized models. The dataset consists of two politician personalization labels, namely Obama and Trump, and two political ideology labels, Democrat and Republican. The results showed that politicians’ personalization and political polarization exist in news articles, authors, and media sources. Keywords—Deep neural networks; text classification; political ideology; politician personalization


I. INTRODUCTION
This paper examines the relationship between two political science concepts that usually addressed separately, news articles' political ideology and personalization. Political ideology of an article can be predicted based on its content, publisher ideology, or authors leanings. Our main hypothesis is that by constructing intelligent models trained on politician centered articles will improve their performance in detecting articles' political ideologies. Personalization attributes such as politician visibility, personal traits, and reoccurring topics form a pattern that statistical models learn to distinguish personalized articles. articles' tags are used in building the dataset, which indicate that the politician is directly related to the topic covered in the article. In the Presidential Dataset (Section III), Obama was mentioned in 23.6% of the articles that were tagged with Trump. Despite that, our models were able to detect articles personalization and the ideology of personalized articles effectively. Nonetheless, introducing intelligent models to detect articles' ideology based on their personalization proved to advance their performance.
One would question the motivation of paper by pointing out that the readers could identify politicians mentioned in the article and be aware of the article's writer or publisher's political alignment at the same time. However, not all readers are attentive [1], and political leanings of news sources or writers are not always known. Also, detailed articles might have few mentions of a politician and not be personalized. Some readers do not go beyond initial information exposure of shared articles, or cropped news on a website and news feeds [2]. Also, websites' structure differs from one another, meaning not all news websites use web tags. Some websites' main page displays articles in their entirety; others show the articles' title and maybe a snippet of its first paragraph. News agencies share links to the news articles on social media networks. Readers might arrive at conclusions solely based on the articles' headlines or posts on character-limited social networks. Automated personalization detection increases the amount of information available to readers, even without reading the article. The pre-trained models can easily detect who is personalized in this article and notify the reader. Models can be trained on multi-labeled data to detect more than one politician's personalization.
The research's interdisciplinary nature contributes towards bringing artificial intelligence to political science, journalism, and communication. The proposed concept has practical applications for regular readers, news outlets, social networking sites, and politicians. The intelligent models will provide awareness to the reader about personalized articles' ideologies. Labeling the article based on its political ideology helps the reader identify which standpoint the article takes. Hence, the reader is encouraged to seek the other viewpoints to determine which one is more convincing to align themselves to it or take a specific position. For instance, if most of the articles exhibited to a reader were from one political side, the reader's awareness of being in a bubble would increase.
News Recommender Systems (NRS) aims to customize the news articles displayed to the readers based on criteria or techniques that are believed to capture the readers' interest. Researchers have proposed several expert systems to recommend the news from the web [3], [4], news agencies' tweets [5], and heterogeneous data tailored for journalists [6]. Moreover, social networks integrate news recommendation systems into their platform, such as Facebook news feed, to suggest news articles based on users' behavior, etc. [7]. Due to deep neural networks' ability to overcome some of the limitations in the traditional techniques, the incorporation of deep neural networks into news recommendation systems have been more frequent in recent years [8], [9], [10]. Regardless of the adopted methods to build the news recommendation systems, researchers pointed out that such systems increase pro-attitudinal selective exposure of political news [11], [12], [13]. Articles' personalization and ideology detection models can help the news recommendation systems mitigate proattitudinal selective exposure.
Deep transfer learning for texts enables knowledge sharing between a source domain with a sufficient amount of labeled data to target domains that suffer from labeled data insufficiency. The transfer could be achieved by different means, e.g., pre-trained word embedding [14], instance-based [15], and adversarial-based [16]. Because the Presidential Datasets are reconstructed to target articles, authors, and sources, transferring the DNN to multiple domains is possible. Personalization of politicians is transferable to other personalization types as CEOs' news media coverage [17]. Researchers pointed out that the media treats CEOs as brands and that preserving the CEO's image improves products and firms' value [18]. Personality prediction [19] and framing and agenda-setting detection [20] are other examples of transfer learning destinations. Other domains that are suitable for transfer learning from ideology detection models are emotion detection [21], top-specific opinion classification [22], and news bias identification [23].
In this work, a new approach is proposed to improve the performance of news political ideology detection models by building models with feature space extracted from politicians' personalized articles. Politicians' personalized-based models for political ideology detection were able to achieve higher or match the performance of other non-personalized political detection models, which trained on much more data. In addition, The experiments proved that it is possible to detect articles politicians' personalization automatically. The detection models were evaluated against news articles, authors, and media sources to examine the relations between the two political concepts. Finally, a statistical analysis of the presidential dataset from the political personalization perspective is provided.
The reminaing of this paper is structured as follows: Section II briefly reviews news personalization literature and describes how this paper's contribution can fit in this research field. We analyze the statistics related to articles' personalization in the Presidential data and its relation to political ideology in Section III. Description of research models and experimental setup provided in Section IV. Section V report and discuss results of articles' personalization and ideology detection. Finally, the paper is concluded in Section VI.

II. RELATED WORK
The related work of the automated texts' ideology detection is extensively reviewed in [24]; therefore, it will not be covered in this paper because. In this section, the literature of political personalization in the news media is reviewed.
Personalization in the literature comes in many shapes and forms. Personalization could mean delivering services [25], advertisements [26], or educational content [27] that best suited for a targeted individual. In law, personalization is substituting a uniform law for one tailored to an individual's preference, characteristics, or circumstances [28]. Other fields have several definitions for personalization as in marketing [29] and ecommerce [30], leading to confusion or ambiguity. Similarly, scholars in political science and communication view personalization from different perspectives. Researchers have examined the existence of personalization in various types of political institutions [31]. Others focused on studying personalization impact on the leaders' [32] or the public [33] political behavior. Numerous studies investigated the role of personalization in political campaigns and elections [34], [33]. Some of the political scientists debated that the rise of personalization is beneficial for modern democracies-the following are some of the observations that support this claim. Leaders will advocate the party's message and increase citizens' political engagement through direct online communication [35]. Voters' attachment to parties weaken due to increased political personalization; hence, voters would be more willing to vote for a different party in subsequent elections [36]. On the other hand, some will argue that personalization brings more harm than good to democracy [37]. For example, loosen the ties between voters and parties might move voters' and political parties' attention from local to national elections [36]. The literature on political personalization is extensive and diverse. This paper is closely related to papers that address presidential personalization in the online news media.
Peoples' political disagreements on the personal level manifest itself by voting for candidates who align with their political ideology as in representative democracy. The political parties mostly nominate their preferred candidates according to their set of criteria. These candidates roles revolves on advocating and implementing the party's program once they get in the government. Therefore, to some degree, the voter, candidate, and the party all have the same political ideology; hence, voters tend to stick with one party to help advance its policies. Mughan [38] stated that in the sixties, the United Kingdom and United States voters' interest shifted from the political parties to an individual politician's personalities, especially those in the high government positions. The media attention moves from the party loyalty to the particular politician's personalities at the top to lead, namely presidentialization [38], [39], [40].
The use of presidentialization as terminology to describe the UK's prime ministries nominees' influence over the electoral process and the elected prime minister rise in power over their cabinet members is debated [41]. Other political scientists prefer the term prime ministerialisation [42] or personalization [43]. Furthermore, individuals attribute populism mounting to personalized politics, where political leaders with compelling personalities appeal to a broader range of voters [44], [45]. Although the degree of political personalization differs depending on multiple variables such as the number of competing parties [46], it is common to find political personalization across western democracies [47], [48], [49], [36]. In her comprehensive book [47], Bittner classified the divergent research of political personalization into five categories: leaders' selection, leaders' traits, leaders' evaluation, leaders' impact on electoral outcomes, and information sources. The media is considered one of the primary information sources available to voters, and hence the criticality of the media's depiction of a political candidate is critical. The waning of the power of monolithic politics gave rise to the media coverage of individual politicians. Aelst et al. [50] developed a model to organize the political news personalization studies into two dimensions logically. The first dimension compares political news coverage of individual politicians and political institutions, leading to a dimension known as individualization. The second dimension emphasizes the change in politicians' media coverage as a government official to a private citizen; hence, this dimension is labeled privatization.
The individualization stems from two decentralized branches, which examine any or all politicians' media visibility regardless of their position [50], [51]. It also includes centralized, which study's the media's visibility regarding different political leaders and their characteristics [52], [53], [46]. Relativity different take on the distinctions between centralized and decentralized media personalization articulated in [54] defined centralized personalization as the media visibility of an upward shift towards politicians at the top, On the other hand, researchers described decentralized personalization as a downward shift towards politicians in lower positions or parties. Privatization consists of two sub-dimensions [50], [55], personal characteristics and personal life. Personal characteristics refer to increased media coverage of a politician's traits rather than his political elements. Personal characteristics make people aware of a politician's positive or negative aspects as those who focus on those aspects aim at attaining certain political goals. On the other hand, personal life, which addresses media coverage, shifts to politician personal activities and interest. Research in politicians' traits is inconclusive since the dissimilarities between personal and political traits are clouded [56].
Others argue that personal disclosures in the media could be politicized [50]. Now that personalization concepts laid out in the previous paragraphs, one cannot place personalized media detection into these dimensions and subdimensions. We are not aware of any paper that researched the problem of news media personalization detection. However, one can link this work to some of those subdimensions. In personalized media detection, the deep network models learn politicians' personalities and political traits with other attributes to form a pattern in which one quickly identifies personalized articles. This research paper also touches on presidentialization or centralized personalization by experimenting with personalized articles regarding two US presidents,, namely President Donald and Trump and Barrack Obama. The two presidents have massive information attributed to them in the media and different other websites. The information is mostly published to sensitize the public about their aspects or public aspects crucial in politics. Despite that, personalized media detection should be distinguished from other previously known personalization dimensions. However, this distinguishing aspect does not eliminate the possibility of incorporating personalized media detection in different types of news personalization. This paper is the first research paper that considered articles' political personalization as a dimension to detect ideologized text to the best of our knowledge. On top of that the ideology detection models' performance are evaluated in association with articles' authors and sources.

III. PERSONALIZATION IN THE PRESIDENTIAL DATASET
The articles in the Presidential dataset [57] were collected from multiple news sources aligned with extreme left and right on the political spectrum. A detailed description of the dataset and the methods used to collect the articles are provided in [24] and listed in Table I. The dataset is a collection of articles written about two U.S. presidents, Trump, and Obama. The two represent two different political ideologies and covered by all news agencies. The paper will focus on personalized articles in the dataset and its relation to the article's ideology, which were not explained in the previous publications. And examine how the dataset is balanced in terms of media attention to the politician and the ideology of media sources that published the articles.
Data imbalance is a common problem in text classification [58], and it hurts the performance of the detection models. As seen in Table (), the presidential dataset can be organized based on politician personalization, and political ideology. From personalization perspective Trump and Obama's articles represent about 42% and 58% of the entire corpus, respectively. On the other hand, 28% and 82% of the articles are labeled with Conservative and Liberal political ideologies, respectively. In comparison, personalized articles are more balanced than ideology articles. The proposed hypothesis assumes that constructing intelligent models trained on political personalized articles to detect political ideologies would improve the detection models performance. Knowing that personalized articles are more balanced than the ideology ones might contribute to this matter. However, one cannot be certain that the same could apply to the size of media coverage of other politicians. Politician serving times, position and other factors can generate more media attention. Table II lists detailed statistics of personalized corpora. More than 43% of the articles written about Trump are conservative, and only 17% are labeled as conservative in the Obama corpus. As can be seen in Fig. 1, articles labeled as Liberal are more significant than Conservative articles in the Obama and Trump datasets. Moreover, the gap between the size of Conservative and Liberal articles is much more evident for Obama's articles. Therefore, one can assume that intelligent models would be able to detect the ideology of articles covering Trump better than Obama. The reason behind the difference in size among personalized and ideology articles can be understood better by exploring the number of articles generated by each media source. Table III presents all the news media sources' political ideology and the number of articles written about Trump and Obama. A large portion of the Presidential dataset comprises of articles from the DailyKos, 68% to be exact.
The difference in coverage becomes apparent in the horizontal bar chart in Fig. 2. DailyKos, a liberal media outlet, represents 52.8 % and 79.19% of Trump and Obama datasets, respectively. The second and last liberal data source, WorldSocialist, is the only media source with consistent representation in the Presidential, Trump, and Obama datasets, which is, on average, 3.92%. The remaining data sources are conservative and mostly have more written articles about Trump than Obama. One can conclude from this plot that all conservative sources, except for National Review Online, have more articles about Trump than Obama. On the other hand, Obama received more attention in the liberal media sources.
Parts of some articles in the Presidential Dataset are in Table IV. These articles' snippets provide the information needed to determine the authors' standpoints on controversial issues such as Obamacare, Iran's nuclear deal, and climate change. For instance, the far-left news source DailyKos article covering an event that took place in the Senate to repeal Obamacare pointed out the failure of the Republicans in the Senate to take health coverage from 16 million people. Another article reporting on the same event but from the conservative point of view stated that the modest Obamacare repeal offered by the Senate Republicans was 'killed' by the Democrats. Other examples are seen in the table and throughout the dataset. The experiment section will discuss the detection models trained on Trump and Obama datasets independently to detect their articles' political ideologies. Also, separate sets of the detection models will be trained on the presidential training set to identify Trump and Obama's personalized articles.

IV. RESEARCH MODELS AND EXPERIMENTAL SETUP
Similar to [24], the following four deep neural network models are employed to detect news' articles politician personalization and political ideology. 1) FastText [59] models enable tasks to word representation fine tuning through averaging word vectors and updating embeddings in the training phase through back-propagation. The word embeddings are then fed to a fully-connected layer with Softmax activation to map articles representation to category labels. Articles word order is ignored during the construction of the text representation, which increase FastText classifiers speed and still achieve relatively good results. 2) Convolutional Neural Networks for the text classification (TextCNN) [60] use multiple convolution layers with different kernel sizes. In text classification, the convolution layers are effective in extracting features over multiple sliding windows from one dimensional inputs. The output of the convolution layers are max-pooled over the entire sequence to identify the most useful features and generate fixed-length vector. The features maps constructed from the max-pooling

07-14-2015 DailyKos
Climate Change Trump/Liberal Much has been made of the fact that Trump's withdrawal from the Paris Climate Agreement makes the United States an international pariah and a business disaster, that it will undermine national security, that his excuses were a series of flat-out lies, and that his real reason was the typical pettiness of his tiny, fragile ego, but the degree to which Trump is Making America Worst cannot be overstated.

06-02-2017 DailyKos
Trump/Conservative By withdrawing from the agreement, Trump could restore the Senate's constitutional power to advise on and consent to international treaties. 05-09-2017 NationalReview

Obama/Conservative
Wednesday's edition of the CBS Evening News chose to re-air portions of chief medical correspondent Dr. Jon LaPook's interview with President Obama on climate change supposedly threatening public health and included LaPook fretting at the end to anchor Scott Pelley that "climate change legislation has stalled in Congress."

04-08-2015 NewsBusters
Obama/Liberal Because it worked so well to scuttle the global agreement to prevent Iran from getting a nuclear weapon (not), Republicans are trying the same techniques to undermine the Paris talks to combat climate change.

09-13-2015 DailyKos
layers are stacked in the concatenation layer. The final layer is fully-connected, then a Softmax activation applied on the final layer output resulting in a class prediction. One drawback from this approach is losing the sequential order of texts, and not being able to model more sophisticated structures.

3) Recurrent Convolutional Neural Networks (RCNN)
[61] combines recurrent and convolution layers to take the advantages and mitigate the limitations of both layers. RNN captures contextual semantics by constructing local feature maps of text sentences. Three text representation, left context, right context, and standard word embedding are shared during training update with separate outputs. Forward RNN constructs the left side context, and the right side context is generated by a Reverse RNN. All three text representations are merged by a concatenation layer that fed to a convolution layer. Then a max-pooling layer extracts global most influential feature vectors. The final layer is a fully-connected that passes its output through a Softmax activation function for class prediction. 4) Hierarchical Attention Networks (HAN) [62] best suited for document classification due to its two levels attention mechanisms. Fixed-length of input words encoded by Long-short-term-memory (LSTM) layer. The LSTM itself is wrapped in Bidirectional RNN layer to perform backward RNN computation. The following layer is an attention that forms sentences from the most useful words. Time distributed layer wraps the bidirectional encoder and the attention layer. Another bidirectional RNN layer further encodes the processed sequences to construct a document from the most informative sentences; followed by an attention layer. Finally, a fully-connected layer passes its output to a Softmax activation function to compute the probability of document belonging to a class.
The same networks settings, learning configuration, and text prepossessing techniques depicted in [24] are used in this paper for fair comparison with earlier experiments. Prior to the learning phase, the texts are tokenized based on white space as delimiters. All letter cases are lowered, and punctuation removed from the tokenized texts. The remaining texts are sequenced and padded to 400 sequence length. The highest possible number of features is 35000 unigrams. Word embedding size is 50 with random initialization.
As for the neural network settings, Adaptive Moment Estimation (Adam) is the learning optimizer. The optimizer learning rate is set to 0.0001 and 0.9, 0.999 for the optimizer beta 1 and beta 2 decay parameters, respectively. Both politician penalization and political Ideology detection are single classification problem; therefore, Binary Cross-entropy is selected as a loss function. The model that achieved the best accuracy results on the validation set during training process www.ijacsa.thesai.org The harmonic mean of the Precision and Recall or the metric known as F1-score is a metric that overcomes some of the limitations found in other metrics. The F1-score is suitable or imbalanced data and it gives equal importance to Precision and Recall.

V. RESULTS AND DISCUSSION
Constructing ideology detection models trained on personalized set boosts or at least maintain ideology detection performance despite downsizing the training set size. Therefore, this work examines the deep network models' ability to detect articles' personalization. Attaining reasonably satisfactory results in distinguishing among articles centered around particular politician will further prove the existence of political personalization in news media coverage. The deep neural networks trained on articles tagged with politicians, namely Trump and Obama. This paper compares between the results obtained by ideology detection models reported in [24] and personalization detection models. In the subsection V-B, we test our hypothesis and see if personalized detection models are better at detected the ideology articles than non-personalized ones.

1) Detection Models' Validation Accuracy:
It is beneficial to examine the accuracy results of the validation set obtained from the training procedure. The same deep networks employed in the detection of articles' ideology is used, which will assist in observing network behavior trained on the same data but different classes. As depicted in Fig. 3, FastText, Fig.  3a, required 20 epochs before reaching the termination point, which is more than TextCNN 13 epochs, RCNN 5 epochs, and HAN 8 epochs, Fig. 3b, Fig. 3c, and Fig. 3d, respectively.
FastText is the fastest network among the four deep network models. The best accuracy of 93% on the validation set was achieved by HAN, which is a little bit shy from the training accuracy at its peak. On the other hand, TextCNN accuracy decreased in the last three epochs from 90% to around 88%. Finally, RCNN was able to recover from descent in epoch 4 to 92% at the fifth and final epoch. The accuracy results from the validation set do not necessarily reflect the model's performance on the testing set since the models' assessment is done on 15% of random non-stratified training data.
2) Politicians' Personalization in News Articles: This subsection compares the results of the four deep network models based on three metrics, Precision, Recall, and F1-Score. In Fig. 4, heatmap and bar charts display numerical and graphical www.ijacsa.thesai.org measurement values for detailed comparison. FastText, Fig. 4a, was the least accurate with 0.92 F1-Score for Obama, and 0.88 for Trump personalized articles.
All deep network models are better at detecting articles' personalization than ideology. TextCNN and HAN reported the same F1-Score for both classes, Fig. 4b  3) Politicians' Personalization in Media Sources: Observing news personalization detection percentage based on articles' sources will help identify news sources that maintain politician personalization characteristics across articles, see Fig. 5. It takes us one step further towards news framing and agenda settings detection. News politician personalization is notable in WorldSocialist as one of the far-left news media that might have a particular point of view about Trump and Obama. TextCNN, Fig. 5b, was able to accurately predict 100% of WorldSocialist's Trump and Obama articles as it has done with detecting articles' ideology. WorldSocialist received high personalization detection accuracy for both classes from the other three models with 100% for Obama and always above 92% for Trump. News article personalization does not have to be negative coverage of the politician of interest. Although National Review received non-favorable ideology detection results when labeled as Conservative, it showed that deep neural networks could identify their news articles personalization with more 90% detection accuracy. DailyKos articles have shown to be more prone to personalizing Obama articles than Trump, though that might be the result of data size skewed towards Obama articles. RCNN, HAN, and Fast-Text (see Fig. 5c, 5d, and 5a) predicted more than 85% of Trump class articles in the remaining four conservative news websites, namely, DailyWire, IloveMyFreedom, NewsBuster, and TheBlaze, while FastText detected between 82% and 90% of Trump articles for the conservative sources. However, Obama's article prediction accuracy originated from the four conservative websites was not as impressive as Trump's articles. HAN detection percentage of politician personalized articles is as low as 9% of articles personalized on Obama and published by the DailyWire, and 20% is detected by FastText. It is often believed that data imbalance played a role in this outcome due to having more Trump articles in the three conservative sources than Obama, see Table III. Data imbalance has the same impact on detecting Obama articles originated from IloveMyFreedom, yet to a lesser degree. The gap between Trump and Obama detection accuracy is lower for NewsBusters and the Blaze news media sources. Surprisingly, there are some cases where data imbalance has no significant impact on the personalization detection models outcome, such as the DailyKos and WorldSocialist. This led us to the question of whether the poor prediction accuracy was due to data imbalance.

4) Politicians' Personalization in Authors:
Authors personalize articles by shaping a persona that fits his or her point of view about the targeted politician. Unlike article ideologies, where authors compose articles that follow an ideology, news personalization is harder to define. Politically motivated authors will not easily alter their perception; hence, articles will consistently follow a pattern that might be identified. Some of the authors who had low ideology detection accuracy, got high detection accuracy for personalized articles, such as Jim Geraghty, see Fig. 6. This could mean the author has a fixated opinion about the politician in interest, but his point of view does not align with a specific ideology. The opposite is also possible where the author's articles' ideology is identified more accurately than its personalization as for TheBradBlog. Moreover, the third possible scenario where the prediction accuracy of articles' ideology and personalization of an author are both high as in Pooddogcomedy, Markos Moulitsas, and KOS. The author with the least personalized detection accuracy is Joseph Curl, with approximately 60% detection rate.

B. Detecting Articles' Political Ideology with Personalized-Based Models
Unlike conventional linear text classifiers such SVM, deep networks require a large sum of data to deliver on various tasks, including text detection. However, learning the model on personalized articles improves or maintains ideology detection models' performance, even though the personalized training sets are a subset of the Presidential training set.
The previous statement validity is verified by training the deep neural networks on the Presidential, Trump, and Obama articles separately. Then, test the ideology detection models on Presidential, Trump, and Obama testing sets. The results obtained by those experiments are compared to each other to identify which approach is more suitable for this problem. Fig. 7 and Fig. 8 illustrate the results of deep networks trained on the Presidential, Trump, and Obama training sets, and tested on the personalized sets only. Logically, one should expect that the accuracy of the ideology detection models will decrease when trained on a subset of the entire training set since the model will lose some information by removing a large chunk of training data. However, training on Trump set alone, Fig. 7, to detect the ideology of articles written about President Donald Trump resulted in better performance, despite removing 58% of the training set. All four deep network models scored higher on Precision, Recall, and F1-Score for Conservative and Liberal classes. Except for RCNN, Fig. 7c, that reported lower recall for the Liberal class when trained on Trump data, other metrics have increased. TextCNN, Fig. 7b, still the best ideology detection model with training on personalized data f1-score improved from 0.873 to 0.899 for the Conservative class and 0.904 to 0.924 for the Liberal class.
The experiment is extended to test out the ideology detection model performance when trained on Obama set to predict the ideology of articles in the Trump testing set. Although the Obama dataset is more significant in size than Trump, ideology models performed poorly compared to detection models trained on Trump or the Presidential training sets. Despite the fact these articles were collected from the same sources, the performance of models widely differs, which proved that news personalization has an impact on news article ideology detection.
Furthermore, all four deep networks retrained on Obama training set alone to predict the ideology of Obama's articles. Fig. 8a shows that FastText F1-Score slightly improved from 0.789 to 0.804 for Conservative and 0.960 to 0963 for Liberal. Other network models did not show any improvement, yet no severe decrease in their performance either. Relatively, the size of the data removed from the Presidential training set is still significant compared to information loss measure by detection model performance. Removing 42% from the entire training set did not have a severe impact on Obama's article ideology detection models. The model's performance drastically degraded when trained on Trump training set alone. The articles were collected from multiple sources with diverse topics and share a person of interest. Therefore, we believe that the results obtained from training models on the personalized sets are evidence that political personalization exists in news media articles. Reconstructing data based on personalization provides coherency and logical relation among the data, making it easier for deep networks to identify different ideological traits.

VI. CONCLUSION
We successfully implemented neural networks models that accurately detected politicians' personalization and political ( ideology in news articles, authors, and media sources. This work proved that some authors are consistent in their politicians' coverage style and more politically affiliated. Although with different degrees of bias, media sources exhibited patterns in selecting published articles. However, detecting politicians' personalization in news media is a new research topic that needs further examination. We are not aware of any research papers that studied the relation between more definitive influencing mechanisms and politicians' personalization, which will lead to new research directions that combine political science and artificial intelligence. One way to improve the work in this paper is by expanding the dataset to include more politicians or political ideologies and revaluating the detection models' performance on multiclass problems. Also, end-to-end deep neural networks can solve hierarchal problems to identify politicians' personalization and political ideology with a single network. Furthermore, other deep neural networks, such as BERT, and pre-trained networks, might achieve better results on the Presidential dataset.