{'fraction_non_alphanumeric': 0.034884767734965794, 'fraction_numerical': 0.011208138278718041, 'mean_word_length': 5.297335600907029, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 2, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Identification of drug compounds for keloids and hypertrophic scars: drug discovery based on text mining and DeepPurpose

Background Keloids (KL) and hypertrophic scars (HS) are forms of abnormal cutaneous scarring characterized by excessive deposition of extracellular matrix and fibroblast proliferation. Currently, the efficacy of drug therapies for KL and HS is limited. The present study aimed to investigate new drug therapies for KL and HS by using computational methods. Methods Text mining and GeneCodis were used to mine genes closely related to KL and HS. Protein-protein interaction analysis was performed using Search Tool for the Retrieval of Interacting Genes/Proteins (STRING) and Cytoscape. The selection of drugs targeting the genes closely related to KL and HS was carried out using Pharmaprojects. Drug-target interaction prediction was performed using DeepPurpose, through which candidate drugs with the highest predicted binding affinity were finally obtained. Results Our analysis using text mining identified 69 KL- and HS-related genes. Gene enrichment analysis generated 25 genes, representing 7 pathways and 130 targeting drugs. DeepPurpose recommended 14 drugs as the final drug list, including 2 phosphatidylinositol-4,5-bisphosphate 3-kinase (PI3K) inhibitors, 10 prostaglandin-endoperoxide synthase 2 (PTGS2) inhibitors and 2 vascular endothelial growth factor A (VEGFA) antagonists. Conclusions Drug discovery using in silico text mining and DeepPurpose may be a powerful and effective way to identify drugs targeting the genes related to KL and HS.


Introduction
Keloids (KL) and hypertrophic scars (HS) are fibroproliferative disorders caused by abnormal wound healing following dermal injury. These scars form due to fibroblast proliferation and are characterized by excessive collagen accumulation (1). There is great variation in the epidemiology of KL and HS depending on the study population; for instance, the incidence among injections can produce side effects such as skin atrophy and telangiectasia. Furthermore, the rate of recurrence among keloid patients treated with surgical excision combined with radiotherapy has been reported to be 21%, with none in craniofacial locations (4). Other therapies may also cause side effects and have unsatisfactory effectiveness (5). However, the molecular mechanism underlying scar formation still needs to be elucidated, and successful treatment of KL and HS remains a challenge.
It takes more than 10 years to discover and develop a new drug, at an average cost exceeding 2.6 billion US dollars. However, new therapeutic purposes for existing drugs may be discovered through drug repositioning (6,7). Drug-target interactions (DTIs) measure the binding affinity of drug molecules to protein targets (8). Therefore, computational methods that can obtain knowledge about the interaction between compounds and target proteins are important in drug research and discovery (R&D). Computer simulation methods can speed up the drug research and development process by systematically prioritizing the most effective compounds. Recently, deep learning (DL) technology has been demonstrated to have the potential to predict compound-protein interactions on a large scale by learning from limited data, and it has been successfully applied in the R&D of new drugs, in which it significantly shortened the time and cost (9,10).
Our previous studies demonstrated that drug discovery using in silico text mining and pathway analysis tools may be a method to explore candidate drugs targeting the genes and pathways associated with certain diseases. In this study, we utilized DeepPurpose, a powerful Python toolkit, which presented the most likely drug candidates based on our previous work. DeepPurpose processes the input target amino acid sequences and candidate drug codes by feeding the data into multiple latest deep learning models pretrained on DAVIS, BindingDB-Kd, and kinase inhibitor bioactivity (KIBA) datasets (11)(12)(13). The prediction results are then integrated by DeepPurpose to generate a ranked list, with the drug candidates with the highest predicted binding scores positioned at the top. The top-ranked drug candidates are considered to possess the potential for experimental verification.
DeepPurpose presents the DTI model as an encoderdecoder framework to predict drug-target interactions. Taking the simplified molecular-input line-entry system (SMILES) format of the drug and the target amino acid sequence pair as input, DeepPurpose outputs the score of the binding affinity between the drug and the molecule. For drug molecules, DeepPurpose provides 8 encoders: Morgan, PubChem, Daylight, RDKit 2D, convolutional neural network (CNN), convolutional recurrent neural network (CNN+RNN), Transformer encoders, and Message-Passing Neural Network (MPNN). For protein targets, DeepPurpose provides 7 encoders: amino acid composition (AAC), PseACC, Conjoint Triad, Quasi Sequence, CNN, CNN+RNN, and Transformer (14).
In this study, we investigated new drug therapies for KL and HS by employing computational methods. First, we performed text mining, biological process and pathway analysis, and protein-protein interaction (PPI) analysis to explore the target genes and pathways highly relevant to KL and HS. DTI analysis was then performed to obtain candidate drugs. Finally, DeepPurpose was used to predict the interaction of candidate drugs and gene targets, and the drugs with the highest predicted binding affinity from a ranked list were obtained.

Text mining
In this study, text mining, a process in which high-quality information is derived from biological literature, was performed using pubmed2ensembl (http://pubmed2ensembl. ls.manchester.ac.uk/) (15). The following terms were used as search input: "keloid", "hypertrophic scar", "hyperplastic scar", and "scar hypertrophy". We chose "Homo sapiens" as the species dataset, then selected "Ensembl Gene ID" and "Associated Gene Name" under GENE. "Search for PubMed IDs" and "filter on Entrez: PMID" drop-down menus were chosen in the search of every query. The intersection of the 4 derived gene lists was used for the next step. The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013).

Biological process and pathway analysis
GeneCodis (http://genecodis.cnb.csic.es/) was used to perform enrichment analysis on genes closely related to KL and HS (16). First, the genes identified through text mining were subjected to Gene Ontology (GO) biological process analysis. The most significantly enriched genes in biological processes were selected for Kyoto Encyclopedia of Genes and Genomes (KEGG) pathway analysis. The most significantly enriched KEGG pathways were selected, and genes associated with the selected pathways were used for further analysis.

Protein-protein interaction network
We used the STRING (Search Tool for the Retrieval of Interacting Genes/Proteins) database (http://string-db.org) to construct a protein-protein interaction (PPI) network in order to visualize the genes from the previous step (17). The genes were input under the "Multiple proteins" menu, and "Homo sapiens" was selected as the species dataset. To obtain the genes with strong interactions, we set a high confidence score of 0.700, and the PPI network of the target genes was generated. Then, the CentiScape plugin in Cytoscape was used to determine the centrality parameters of the PPI network (18). "Degree" and "Betweenness" were chosen as the parameters for the selection of key genes in this study. Degree represents the total number of edges incident to the node, and betweenness refers to the number of shortest paths through the node.

Drug-gene interactions
Drugs targeting the genes highly related to KL and HS were searched for using Pharmaprojects (https:// pharmaintelligence.informa.com/) (19). Each gene query returned a drug list detailing the global status, disease, mechanism of action, delivery route, target, chemical structure (SMILES format), and other information about drugs. Drugs with "launched", "phase I/II/III clinical trial", "pre-registration", or "registered" as the global status were screened out, and those with the delivery route of "oral" or "oral, swallowed" were also excluded. These criteria allowed us to obtain candidate drugs with targeting ability, quick onset of action, and few side effects. Drugs derived from the DTI analysis may be candidates for KL and HS treatment.

DeepPurpose
In order to utilize DeepPurpose, we first translated the target proteins into amino acid sequences and the potential drugs into SMILES fingerprints. Taking the sequences and fingerprints as input, we used the pre-trained models provided by DeepPurpose to predict the binding affinity between each paired drug molecule and protein target of interest. As DeepPurpose provides 15 pre-trained models, we predicted the binding affinity score for each pre-trained model individually and screened the potential drug-target interaction by setting appropriate thresholds. We validated the results using the validation set we collected. We also calculated aggregated binding affinity scores with the aggregation schema proposed by DeepPurpose. Finally, the differences in the predicted binding affinity scores obtained using single models and aggregate models were analyzed.

Statistical analysis
Statistical analyses were carried out using machine learning algorithm in DeepPurpose.

Results of text mining, biological process, and KEGG pathway analysis
Through the data mining process described in Figure 1, 135 genes relating to "scar hypertrophy", "keloid", "hypertrophic scar", and "hyperplastic scar" were found. After deleting the duplicates, we were left with 69 genes (Figure 2). In the analysis of enriched GO biological process Text mining concept: "scar hypertrophy","keloid", "hypertrophic scar"and "hyperplastic scar" (Pubmed2ensembl)

Drug-gene interaction (PharmaProjects)
Drug-gene interaction (DeepPurpose) Figure 1 Overall data mining process. Text mining and GeneCodis were used to identify genes related to keloids and hypertrophic scars (KL and HS). Protein-protein interaction analysis was performed in STRING and Cytoscape. Drugs targeting the genes highly related to KL and HS were selected using Pharmaprojects.
Based on the drug-target interaction analysis by DeepPurpose, candidate drugs with highest predicted binding affinity were finally derived.

Results of DeepPurpose analysis
DeepPurpose requires drug molecules to be in the SMILES format, so 34 pharmaceutical compounds with SMILES structure were selected for DeepPurpose analysis. Subsequently, each pre-trained model in DeepPurpose generated a ranked list showing the predicted binding affinity between the drugs and molecules ( Table 3). A threshold of pKd ≥7.0 was used for models based on the DAVIS and the BindingDB datasets, while for models based on the KIBA dataset, the threshold was set to 12.1.

Figure 3
The protein-protein interaction (confidence score, 0.700) network of the 25 targeted genes, generated using STRING.
Network nodes represent proteins, and edges represent proteinprotein interactions.

Figure 4
The protein-protein interaction network of the 25 targeted genes, generated by Cytoscape. Network nodes represent proteins and edges represent protein-protein interactions. DeepPurpose generated a ranked list demonstrating the predicted binding affinity between drugs and target genes. A threshold of pKd ≥7.0 was used for models based on the DAVIS and BindingDB datasets, while the threshold was set to 12.1 for models based on the KIBA dataset. The significant values based on the criteria are in bold. KIBA, kinase inhibitor bioactivity; CNN, convolutional neural network; MPNN, message-passing neural network; AAC, amino acid composition; FGF2, fibroblast growth factor 2; HGF, hematopoietic growth factor; PIK3CA, phosphatidylinositol-4,5-bisphosphate 3-kinase catalytic subunit alpha; PTGS2, prostaglandin-endoperoxide synthase 2; TGFB1, transforming growth factor beta 1; VEGFA, vascular endothelial growth factor A. Aggregated models generated a ranked list demonstrating the predicted binding affinity between the drug and the target gene. A threshold of pKd ≥7.0 was used for models based on the DAVIS and the BindingDB datasets, while the threshold was set to 12.1 for models based on KIBA dataset. The significant values based on the criteria were in bold. KIBA, kinase inhibitor bioactivity; AVE, average; MAX, maximum; FGF2, fibroblast growth factor 2; HGF, hematopoietic growth factor; PIK3CA, phosphatidylinositol-4,5-bisphosphate 3-kinase catalytic subunit alpha; PTGS2, prostaglandin-endoperoxide synthase 2; TGFB1, transforming growth factor beta 1; VEGFA, vascular endothelial growth factor A.  dermal fibroproliferative disorders, which place a burden on the health of individuals worldwide. However, the pathogeneses of KL and HS have not been elucidated, and current therapeutic approaches have limited effectiveness. Through gene set enrichment analysis, this study identified 25 genes closely related to the pathology of KL and HS, and a list of 14 drugs targeting 3 of the key genes was compiled using DeepPurpose. Potential drugs can be divided into PI3K inhibitors, PTGS2 inhibitors and VEGFA antagonists. Prostaglandin-endoperoxide synthase 2 encoded by the PTGS2 gene, also known as cyclooxygenase-2 (COX-2), is the rate-limiting enzyme of prostaglandin biosynthesis (20). The involvement of COX-2 in the pathogeneses of scar lesions has been evidenced. Studies have demonstrated that COX-2 is significantly overexpressed in KL and HS tissues, while down-regulation of COX-2 may reduce KL and HS formation (21)(22)(23)(24). After tissue injury, COX-derived prostaglandin E2 (PGE2) promotes the recruitment of inflammatory cells, which release TGF-β or platelet-derived growth factors; thereby, extracellular matrix and fibroblast activation is enhanced, leading to fibroblast proliferation and collagen production (25). The reduction of KL and HS formation in patients using nonsteroidal anti-inflammatory drugs and COX-2 inhibitors has suggested that COX-2 inhibitors may serve as a therapeutic strategy for KL and HS, which is consistent with our findings. Diprosalic, one of the PTGS2 inhibitors found to hold promise in this study, is a combination of betamethasone dipropionate and salicylic acid. It is currently used to treat psoriasis and inflammatory diseases like dermatitis and eczema, as well as to manage subacute and chronic hyperkeratotic and dry dermatoses that are responsive to corticosteroid therapy (26,27). Other COX-2 inhibitors include meloxicam, lornoxicam, piroxicam, mesalazine, parecoxib sodium, HTX-011, tiemonium noramidopyrine, and diclofenac epolamine, the indications for which are postoperative pain and arthritis. These drugs may represent promising treatments for KL and HS.
The involvement of the phosphatidylinositol-4,5bisphosphate 3-kinase (PI3K)/protein kinase B (Akt)/ mammalian target of rapamycin (mTOR) signaling pathway in the pathogeneses of KL and HS has been reported previously. Activation of the PI3K/Akt/mTOR pathway has been demonstrated to enhance the inflammation, angiogenesis, and deposition of extracellular matrix components in scar formation; thus, it is considered to be related to several fibrous diseases (28). CUDC-907, a dual inhibitor of the PI3K/Akt/mTOR pathway and histone deacetylase (HDAC), was found to reverse the pathological phenotype of KL fibroblasts (29). In this study, we found 2 PI3K inhibitors to have potential as drug therapies. Bimiralisib is a dual inhibitor of PI3K and the mammalian target of rapamycin (mTOR). It has been identified as a clinical candidate with potential antineoplastic activity, including in malignant lymphomas, primary central nervous system lymphoma (PCNSL), head and neck squamous cell carcinoma (HNSCC), advanced solid tumors, and metastatic breast cancer (30,31). Another PI3K inhibitor, SF-1126, which selectively inhibits all PI3K class IA isoforms as well as DNA-dependent protein kinase (DNA-PK) and mTOR, is the focus of current phase I clinical trials for chronic lymphocytic leukemia and advanced or metastatic solid tumors (32). In a phase I clinical trial, this drug showed considerable efficacy against B-cell malignancies and solid tumors with no dose-limiting toxicities or hepatotoxicities (33). However, the incorporation of novel PI3K inhibitors into treatment strategies for KL and HS still requires further experimental research and long-term trials to ascertain their tolerability, efficacy, and safety.
VEGF (or VEGFA, the most abundant VEGF isoform) has been implicated as a crucial participant in pathological wound healing (34). Multiple studies on KL and HS have reported an association of high VEGFA levels with scar formation (35)(36)(37)(38). Furthermore, there is experimental evidence that VEGF inhibition may be an approach to reducing deposition of scar tissue (37,(39)(40)(41). In this study, we identified 2 VEGF antagonists as potential drugs to treat KL and HS. Sunitinib malate, a dual inhibitor of VEGF and PDGF receptors, is a lead injectable sustained-release candidate used in the treatment of wet age-related macular degeneration (AMD) (42). It is also under development for the treatment of diabetic macular edema and retinal vein occlusion (43). Meanwhile, pegaptanib octasodium, a pegylated oligonucleotide aptamer, is a direct inhibitor of VEGF that is used as an anticancer agent and in AMD. However, clinical testing to determine whether VEGF inhibition is an effective anti-scarring strategy will need to be performed.
In this study, we used DeepPurpose to predict the interactions of candidate drugs and gene targets in order to select the drugs with the highest predicted binding scores. In the knowledge of the relevance between candidate drugs and target genes, the identification of interactions between them became our major objective. The potential of machine learning models to predict the binding affinity between new drug-target pairs has been demonstrated in various studies. Bagherian et al. (44) briefly reviewed drug-target interaction prediction by machine learning models. Recently, machine learning methods have been used to search for cures for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) (45-47), which has given direction for the promotion of new drug discovery. DeepPurpose, the toolkit we used in the current study, is built on the basis of an encoder-decoder framework. The encoders are generated from novel machine-learning approaches for drug-target interaction prediction to extract features from candidate drugs and target genes, while the decoder is a multi-layer perceptron that uses the extracted features to compute the binding affinity scores. With the 15 pre-trained models and 3 aggregation schemas provided by DeepPurpose, we finally obtained 24 different ranked lists of binding affinity score predictions. Though, we selected all potential drugs that meet the threshold criteria under each model, further analysis of pros and cons of the models may give a better guidance in drug screening with larger datasets. We built a validation set to evaluate these models. For each pair in the validation set, we collect the kinase dissociation constant ( d K ) and transformed it to logspace( d pK ) as d 10 9 pK log 10 which is used as the dependent variable in the models trained on DAVIS and BindingDB datasets. The mean squared error (MSE) of each model was calculated, and the results are shown in Table 6.
The results paved the way to obtaining the best drugtarget pair. Firstly, the MSEs showed that models trained on larger datasets outperformed those trained on smaller datasets. Three out of 5 models (DeepDTA, Morgan_CNN, MPNN_CNN, and Morgan_ACC) had a smaller MSE when trained on the BindingDB dataset than on the DAVIS dataset. This is often the case for machine learning models: those trained on a larger dataset have better generalizability, since the larger the training set is, the greater opportunity is for the model to learn global patterns. Moreover, by comparing the MSE of the single models and the aggregated models, we found that aggregated models do not always outperform single models, especially when aggregation is applied to models with a considerable variance in performance. However, for models trained on the DAVIS dataset, aggregated models performed better. The model with mean schema had a smaller MSE than most single models, while models with the max and the average of the mean and max schemas outperformed even the best single model. With the BindingDB dataset, however, the aggregated models did not perform as well as the best single model but did outperform most of the single models. This implies that although the use of aggregation schema can, to a certain extent, reduce the limitation and bias of single models, it can also introduce additional errors by aggregating the results of poor models.

Conclusions
Our study has demonstrated that drug discovery using in silico text mining and DeepPurpose may be a powerful and effective way to find drugs targeting the genes related to KL and HS. Therefore, our study could provide a theoretical basis for the development of novel targeted therapies for KL and HS. Ethical Statement: The authors are accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. The study was conducted in accordance with the Declaration of Helsinki (as revised in 2013).
Open Access Statement: This is an Open Access article distributed in accordance with the Creative Commons Attribution-NonCommercial-NoDerivs 4.0 International License (CC BY-NC-ND 4.0), which permits the noncommercial replication and distribution of the article with the strict proviso that no changes or edits are made and the original work is properly cited (including links to both the formal publication through the relevant DOI and the license). See: https://creativecommons.org/licenses/by-nc-nd/4.0/.