Figures
Abstract
Lysine acetylation is a major post-translational modification. It plays a vital role in numerous essential biological processes, such as gene expression and metabolism, and is related to some human diseases. To fully understand the regulatory mechanism of acetylation, identification of acetylation sites is first and most important. However, experimental identification of protein acetylation sites is often time consuming and expensive. Therefore, the alternative computational methods are necessary. Here, we developed a novel tool, KA-predictor, to predict species-specific lysine acetylation sites based on support vector machine (SVM) classifier. We incorporated different types of features and employed an efficient feature selection on each type to form the final optimal feature set for model learning. And our predictor was highly competitive for the majority of species when compared with other methods. Feature contribution analysis indicated that HSE features, which were firstly introduced for lysine acetylation prediction, significantly improved the predictive performance. Particularly, we constructed a high-accurate structure dataset of H.sapiens from PDB to analyze the structural properties around lysine acetylation sites. Our datasets and a user-friendly local tool of KA-predictor can be freely available at http://sourceforge.net/p/ka-predictor.
Citation: Wuyun Q, Zheng W, Zhang Y, Ruan J, Hu G (2016) Improved Species-Specific Lysine Acetylation Site Prediction Based on a Large Variety of Features Set. PLoS ONE 11(5): e0155370. https://doi.org/10.1371/journal.pone.0155370
Editor: Bin Liu, Harbin Institute of Technology Shenzhen Graduate School, CHINA
Received: January 29, 2016; Accepted: April 27, 2016; Published: May 16, 2016
Copyright: © 2016 Wuyun et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The authors' datasets and a user-friendly local tool of KA-predictor can be freely available at http://sourceforge.net/p/ka-predictor.
Funding: GH was supported by NSFC (grant number 11101226); WZ was supported by the Ph.D. Candidate Research Innovation Fund of Nankai University (no. 68150003).
Competing interests: The authors have declared that no competing interests exist.
Introduction
Acetylation is one of the most significant post-translational modifications of proteins, and plays an important role in various cellular processes [1–3], such as cytokine signaling, transcriptional regulation and apoptosis. Acetylation typically occurs on lysine residues describing a process of introducing an acetyl group (CH3CO-) into the side chain of an amino acid in a protein. This reaction is a reversible modification relying heavily on various enzymes. Lysine acetylation is catalyzed by histone acetyltransferases (HATs) or lysine acetyltransferases (KATs), which transfer the acetyl-group to the epsilon-amino group of a lysine residue (Fig 1D), while lysine deacetylation by histone deacetylases (HDACs) or lysine deacetylases (KDACs) that remove the acetyl-groups[4].
(A) Jak-STAT signaling pathway, including phosphorylation and acetylation. (B) The schematic diagram of HSE. An acetyl group (CH3CO-) from Ace-CoA replaces the hydrogen atom in the epsilon-amino group (-NH3+)(blue) of side chain (red) of lysine residue, and the side chain of Lys685 is located at the upper half sphere which contains Cβ atom. (C) DNA binds to STAT3 homo-dimer, and surface of STAT3 is colored by CHOPS[5] score, a convex measure of protein surface. (D) Lysine acetylation equation.
Acetylation has a considerable impact on gene expression and metabolism[6], and is also related to some human diseases[7,8]. For example, signal transducer and activator of transcription 3 (STAT3) is a transcription factor. The lysine acetylation of STAT3 is of key importance in the DNA-binding and the transcription for the oncogenic activity which is related to many cancers such as pancreatic cancer[9] (Fig 1). In addition, the level of acetylated STAT3 is relatively high in cancer cells[10]. Therefore, it may be a potential and promising strategy to target acetylated STAT3 in cancer therapy.
Since the acetylation plays an important role in the cell biology and diseases treatment, it is really essential to understand the regulatory mechanism of acetylation. Thus, the first step is to identify the acetylation sites. Various experimental methods have been developed to identify the potential lysine acetylation sites of a protein, such as radioactivity detection[11], mass spectrometry[12], and chromatin immunoprecipitation (ChIP)[13]. However, these experimental methods are usually time consuming and expensive. Therefore, the alternative computational methods are necessary for high-throughput identification of protein acetylation sites.
Currently, a large variety of computational methods have been proposed to predict acetylation sites based on the protein sequences. The majority of these methods are based on SVM classifier. For example, LysAcet [14], N-Ace [15], Ensemble-Pail [16], PLMLA [17], PSKAcePred [18], and BRABSB [19] which also combined bi-relative adapted binomial score Bayes. Additionally, the cluster based method, PredMod [20], combined experimental methods with sequences clustering analysis within histones. The logistic regression based method, LAceP [21], utilized logistic regression classifiers and integrated different biological features for lysine acetylation site prediction. The random forest based method, SSPKA [22], which firstly used functional features, was developed for species-specific lysine acetylation prediction. Particularly, Phosida [23,24] was firstly proposed as a well-known database containing various species-specific post-translational modification sites, and then developed into a high-accuracy species-specific acetylation site predictor.
Of note, there are several limitations in these methods. Firstly, for different species, the majority of existing methods just utilized an overall model to predict acetylation sites, without systematically discussing the differences of sequence and structure information among species. As we all known, different species may have different sequences or structures properties owing to different functional mechanism. Therefore, modelling based on different species may make improvements to acetylation prediction. Secondly, the methods in most of the papers only incorporated a small field of features, which would ignore some useful information, such as various predicted structural features. Finally, the sliding window strategy is often applied in feature extraction for obtaining the local information surrounding the lysine acetylation sites. Many studies only investigated a certain local sliding window in modeling. However, different sliding windows may have distinct prediction performances. Optimizing sliding window size is obviously helpful for selecting features and improving prediction performance.
Aiming at these limitations, we developed a novel tool to predict species-specific lysine acetylation sites named as KA-predictor (lysine (K) Acetylation predictor) based on a support vector machine (SVM) classifier. In this study, we incorporated a large variety of features consisting of sequence-based features, physicochemical and biochemical properties features, predicted structural features and evolutionary information features. Particularly, the HSE features, which belonged to predicted structural features, were firstly introduced for lysine acetylation prediction and turned out to be fundamentally important in improving the predictive performance. Our predictor was designed for four species, i.e., H. sapiens, M. musculus, E. coli, and S. typhimurium. In addition, a sliding window strategy was applied in our study and the optimization of the sliding window sizes was used for selecting features and improving prediction performance. Furthermore, the prediction performances of our approach were compared with the latest methods in independent test set. The results indicated that our predictor was highly competitive for the majority of species when compared with other existing methods. Particularly, we firstly constructed a high-accurate structure dataset of H.sapiens to analyze the structural properties around lysine acetylation sites. A user-friendly local tool of KA-predictor can be freely downloaded at http://sourceforge.net/p/ka-predictor for the wider scientific community. A flowchart of the KA-predictor approach was given in Fig 2.
Flowchart of training dataset is shown in grey arrow, and flowchart of test set is shown in black arrow. For training dataset, firstly, collecting 14 subtypes of features based on the training dataset by various tools, such as PSIBLAST and spider-HSE. Subsequently, ranking each type of features by the Pearson Correlation Coefficient (PCC) and conducting stepwise feature selection for each type. The 5-fold cross-validation was applied to feature selection by evaluating the performance on the training dataset. A support vector machine (SVM) classifier, LibSVM, was utilized to train parameters and build an accuracy prediction model. For independent test set or an input sequence for user, firstly conducting feature calculation and then selecting the same features as training dataset, finally utilizing the models trained on the training dataset to obtain the predicted output.
Materials and Methods
Datasets
In this study, we used the datasets from the study of SSPKA[22] which consisted of 1,936 non-redundant acetylation proteins with 3,956 acetylation sites of six species, i.e., H. sapiens, M. musculus, E. coli, S. typhimurium, S. cerevisiae and R. norvegicus, ranging from prokaryotes to eukaryotes. These datasets were extracted from multiple public resources including CPLA[25] (http://cpla.biocuckoo.org/), N-Ace[15] (http://N-Ace.mbc.NCTU.edu.tw/), Phosida[23] (http://www.phosida.com/), ASEB[26] (http://cmbi.bjmu.edu.cn/huac) and PhosphoSitePlus[27] (http://www.phosphosite.org). And these datasets had excluded the redundant sequences at the 30% identity level using CD-HIT[28] software. In order to consider the background proteins relative to acetylated proteins, SSPKA also provided a dataset of non-acetylated proteins (proteins that were not shown to be acetylated to date).
Here, we did not utilized the sequence data of non-acetylated proteins in SSPKA because the dataset contained some deleted or duplicated sequences and was of little reliability. Additionally, the data of S. cerevisiae and R. norvegicus was removed from our analysis because these two species had too few samples for training model (Table 1). Also, we discarded two protein sequences of A2ASS6 and Q8WZ42 in the training dataset since these two sequences are too long to run PSI-BLAST for calculating certain features such as PSSM. Finally, our dataset incorporated 1,870 of acetylation proteins with 3,790 acetylation sites of four species. In detail, the positive samples (i.e., acetylation sites) in the training dataset of our method were the same as the SSPKA method. To perform 5-fold cross-validation, the balanced negative samples (i.e., non-acetylation sites) were randomly extracted with the ratio of 1:1 of positive versus negative samples. (In fact, the amount of lysine acetylation sites is relatively small when compared with the amount of non-acetylated lysine residues in sequences.) For fair comparison, we used the identical positive and negative samples with SSPKA on independent test set. Since high similar data would lead to overestimate the accuracy of a method [29–32], we examined that the sequences in the training dataset were non-redundant with a threshold of 30% identity using the BlastClust tool. Furthermore, we examined that there were also non-redundancy between the sequences in training dataset and sequences in independent test set, so the independent test set was really independent from our training dataset. Table 1 showed the statistics of training dataset and independent test set among four species.
(The non-acetylated sites were selected at the ratio of 1:1 compared to acetylated sites.) Additionally, the statistics data of S. cerevisiae and R. norvegicus was marked with asterisk (*) which means that we removed them from our analysis because these two species had too few samples for training model.
Particularly, we constructed a high-accurate structure dataset of H.sapiens from Protein Data Bank (PDB) [33–35] to analyze the structural properties around lysine acetylation sites. For H. sapiens, we collected 592 PDB structure records corresponding to sequences in our training dataset and independent test set. Because the incomplete or inaccurate structures were poor for structural properties analysis, we selected a subset of these PDB structures if the length of the PDB structure was longer than the 90% of the true length of corresponding sequence and resolution of the structure was less than 3Å. Finally, we obtained 118 PDB structures and then eliminated noises by manually aligning these structures to the corresponding sequences. Our high-accurate H.sapiens structure dataset included 308 lysine acetylation sites from 118 PDB structures. The reason for not constructing structure dataset for other species is that the experimentally determined crystal structures for other species were much fewer than H.sapiens and insufficient dataset would reduce the reliability of the analysis of structural properties. The datasets can be downloaded at http://sourceforge.net/p/ka-predictor.
Features
In this study, we incorporated a large variety of features to predict acetylation sites. These features included four types: sequence-based features, physicochemical and biochemical properties features, predicted structural features and evolutionary information features. These can be further divided into 14 subtypes: LC, PWAA, EBGW, CKSAAP, KNN, ACC, PC-PseACC, AAindex, SS, RSA, Disorder, HSE, PSSM and HH (see below). Particularly, we firstly introduced the predicted half sphere exposure (HSE) as a type of features, which turns out to be fundamentally important in acetylation prediction. Additionally, we used a novel HMM-based tool, HHblits[36], to build protein multiple-sequence alignments (MSAs) for deriving position-specific scoring matrix and evolutionary conservation score, which is considered somewhat faster compared to PSI-BLAST[37]. A sliding window strategy was applied in feature extraction for obtaining the local information surrounding the lysine acetylation sites.
Sequence-based features.
Location Coding (LC). For the sites located in the N-terminal, C-terminal or the middle of a sequence, we used 3-bit binary to encode this terminal information, i.e. N-terminal for 100, C-terminal for 001, middle for 010.
Position Weight Amino Acid Composition (PWAA). Position weight amino acid composition (PWAA) [17,38] is designed to avoid losing the sequence-order information of amino acid residues around certain sites. The position information of an amino acid in the sliding window can be calculated by the following formula:
where L denotes the number of upstream residues or downstream residues from the central site in the sliding window, xi,j = 1 if ai is the j-th residue in the sliding window, otherwise xi,j = 0.
Encoding Based on Grouped Weight (EBGW). Encoding based on grouped weight (EBGW) [17,38,39] is an encoding scheme of the amino acid sequence based on the hydrophobicity and charged character of amino acid residues.
Firstly, 20 amino acid residues were divided into four different classes as follows: hydrophobic group C1 = {A,F,G,I,L,M,P,V,W}, polar group C2 = {C,N,Q,S,T,Y}, positively charged group C3 = {H,K,R}, and negatively charged group C4 = {D,E}. Then, we calculated three binary sequences of a certain sliding window:
where aj represents the j-th residue in the sliding window sequence.
For each binary sequence, we could calculate K feature values based on K sub-sequences increasing in length as follows:
Where the function sum(k) gives the number of 1 in the k-th sub-sequence, Int(N·k/K) denotes the length of the k-th sub-sequence, the Int() rounds a number to the nearest integer and N is the length of the sliding window sequence. Here, we made K = 5.
CKSAAP. The CKSAAP[40] encoding scheme means the composition of k-spaced residue pairs in the sliding window. In this study, we took k = 0. Therefore, there were 400 compositions of 0-spaced residue pairs, which could be calculated by
where the NTotal represents the total number of residue pairs in the sliding window, and the NXX is the number of the residue pair XX in the sliding window.
K Nearest Neighbors (KNN) Score. To take advantage of the cluster information of local sequence fragments for predicting acetylation sites, we took a K nearest neighbors (KNN) score algorithm [18,41].
Firstly, we found the K nearest neighbors of a residue in both positive and negative datasets (training dataset was used in this paper). In detail, the distance between two local sequence fragments S1 and S2 defined as:
where a and b are the two amino acid residues, M represents the substitution matrix of BLOSUM62[42], and the sliding window size is 2L+1.
After that, the corresponding KNN score was then extracted as follows: (i) Calculate the average distance from the sequence fragment S to the training dataset (contain the positive and negative datasets); (ii) Sort the neighbors by the distances and choose the K nearest neighbors; (iii) Calculate the percentage of positive neighbors in its K nearest neighbors as the KNN score.
Last, we chose five different K values, i.e., 1/2, 1/4, 1/8, 1/16 and 1/32 of the size of the training dataset.
Auto-cross covariance (ACC). Pse-in-One [43] is a recently constructed web server for users to generate all the possible pseudo components for DNA, RNA, and protein sequences, which combined different kinds of approaches [44–46]. In this paper, we used a combination of auto covariance and cross covariance measure based on the sliding window as features for lysine acetylation prediction.
Parallel correlation pseudo amino acid composition (PC-PseAAC). PC-PseAAC[47] is an approach incorporating the contiguous local sequence-order information and the global sequence-order information. Here, we calculated these features from Pse-in-One[43] as features for lysine acetylation prediction.
Physicochemical and biochemical properties features.
AAindex. AAindex database[48] provides numerical indices that describe various physicochemical and biochemical properties of amino acids. For each index, we could express the physicochemical and biochemical information in the sliding window with 2L+1amino acid residues by the following formula:
where pj is the index value of the j-th residue in the sliding window.
Additionally, Atchley et al.[49] summarized five highly representative indices, i.e., electrostatic charge, codon diversity, molecular volume, secondary structure and polarity, based on the AAindex database. We also used this information to encode each amino acid residue for determining the acetylation sites in this study.
Predicted structural features.
Predicted Secondary Structure (SS). PSIPRED[50] is a neural-network-based secondary structure prediction tool, which shares a relatively high accuracy. Its outputs have three kinds of secondary structures: H (alpha-helix), E (beta-strand) and C (coil). In this paper, we used 3-bit binary to encode these three types, i.e. H for 100, E for 001, C for 010.
Predicted Solvent Accessibility (RSA). SPINE-X[51] is an accurate multistep neural-network method which can predict secondary structure, solvent accessibility and backbone torsion angles. In this paper, we used the values of RSA, psi and phi as features for lysine acetylation prediction.
Predicted Disorder Scores. DISOPRED2 [52,53] is proposed for recognizing natively disordered regions based on amino acid sequence. Based on the predicted values of this method, each residue can be divided into two types: disordered and ordered. In this paper, we used 1-bit binary to encode the feature, i.e. disorder for 1 and order for 0.
Predicted Half Sphere Exposure (HSE). Half sphere exposure (HSE) is firstly introduced by Hamelryck[54] to measure the solvent exposure of a protein, which plays a fundamentally important role in predicting discontinuous B-cell epitopes[5,55]. The measure means the number of Cα atoms in two half spheres around a residue's Cα atom. On the one hand, HSE can be classified as HSEA and HSEB based on whether only the information about the Cα atoms is available. On the other hand, it can be also divided into HSE-up (HSEU) and HSE-down (HSED) depending on the selected Cα atoms is in an up half-sphere (U) or a down half-sphere (D). SPIDER-HSE[56] is a consistent performance method designed for predicting both HSEA and HSEB of each residue in a certain protein.
Here, we firstly introduced each type of predicted HSE (i.e., HSEAU, HSEAD, HSEBU and HSEBD) information in a sliding window to predict lysine acetylation sites, which turn out to be fundamentally important in acetylation prediction.
Evolutionary information features. Position-Specific Scoring Matrix (PSSM) by PSI-BLAST. Position-specific scoring matrix (PSSM) can be calculated from multiple sequence alignment containing the evolutionary information of protein sequences. In this part, the PSSM for each sequence was generated by PSI-BLAST[37] based on NR database. The PSI-BLAST program can generate two types of position-specific scoring matrices, conservation scores and probabilities of occurrences. We used both of them to encode for predicting lysine acetylation sites.
Additionally, we calculated the evolutionary conservation scores which is defined as:
Where pi,j represents the probability of amino acid j at position i of the sliding window (the sliding window size is 2L+1).
Position-Specific Scoring Matrix by HHblits (HH). HHblits[36] is an open-source, general-purpose tool that can build protein multiple-sequence alignments (MSAs) by profile hidden Markov models (HMMs), which is considered somewhat faster than PSI-BLAST. Here, we employed this novel tool to obtain the probabilities of occurrence, and then calculated the evolutionary conservation scores as mentioned above in prediction.
Support vector machine (SVM) classifier.
Support vector machine (SVM) classifier was widely used in the statistics and bioinformatics [57–63], especially for functional site prediction such as acetylation, phosphorylation, ubiquitination and methylation [14–20,64–68]. SVM is a supervised learning model for binary classification by mapping the input samples to a higher dimensional space and searching a hyper-plane to distinguish the samples. In this paper, we applied the widely used SVM classifier, LibSVM (https://www.csie.ntu.edu.tw/~cjlin/libsvm/), to train parameters and build an accuracy prediction model. The version 3.14 of LibSVM was utilized. A radial basis function (RBF) was used as the type of kernel function, and two parameters, cost and gamma, were trained based on the parameter selection tool grid.py in LibSVM. To select features and evaluate the performance of the models, 5-fold cross-validation was performed. In statistical prediction, the independent dataset test, subsampling or K-fold crossover test and jackknife test are the three cross-validation methods often used to check a predictor for its accuracy [69]. However, among the three test methods, the jackknife test is deemed the least arbitrary that can always yield a unique result for a given benchmark dataset [70]. Accordingly, the jackknife test has been increasingly used and widely recognized by investigators to examine the quality of various predictors [71–75]. However, for saving computational time, the 5-fold cross-validation was used in the study.
Feature selection method based on different type of features
As irrelevant or redundant features may lead to an adverse impact on prediction[76], we performed feature selection based on a large variety of features to remove redundant features and improve prediction performance. These features incorporated four types: sequence-based features, physicochemical and biochemical properties features, predicted structural features and evolutionary information features. These can be further divided into 14 subtypes: LC, PWAA, EBGW, CKSAAP, KNN, ACC, PC-PseACC, AAindex, SS, RSA, Disorder, HSE, PSSM and HH.
Firstly, we ranked each subtype of features by calculating the Pearson Correlation Coefficient (PCC) between each feature vector and the true classification index vector on training dataset. Pearson Correlation Coefficient (PCC) measures the linear correlation between two variables, giving a value between −1 and +1, where +1 represents total positive correlation, 0 represents no correlation, and −1 represents total negative correlation. It is widely used in the statistics and sciences. In this step, we obtained 14 PCC-ranked lists corresponding to 14 subtypes of features.
Then, for each subtype of features, we took a stepwise feature selection based on the support vector machine (SVM) classifier. At each round of stepwise feature selection, the next feature from the PCC-ranked list was added to the model if the accuracy of 5-fold cross-validation increased. After this step, we obtained the 14 optimal feature sets corresponding to 14 subtypes of features and then combined them to form the final selected features which were used to build model for predicting acetylation sites. The parameters of SVM classifier were trained based on the training dataset, using the grid selection tool in LibSVM.
This feature selection method based on different types of features, combining PCC ranking and stepwise feature selection, provides a practical approach for selecting a useful feature set.
Performance Evaluation
In this paper, we utilized the 5-fold cross-validation on the training dataset to select features and build prediction models by SVM classifier. Then, we compared our predictor with other existing methods on the independent test set. Matthews correlation coefficient (MCC), accuracy (ACC), sensitivity (SEN), specificity (SPE), precision (PRE) and area under the receiver operating characteristic curve (AUC) were applied to evaluate performance of our acetylation predictor on training dataset and independent test set. Among them, AUC is calculated by the area under the receiver-operating characteristic (ROC) curve which is the major performance to estimate a classifier or method. Others are defined as:
where TP, TN, FP and FN are defined as the numbers of true positives, true negatives, false positives and false negatives, respectively.
Results
Analysis of Compositional biases around acetylation sites
For different species, we adopted a web-based tool, Two Sample Logo[77], to present the compositional biases of sequences between acetylated and non-acetylated sites (Fig 3). Two Sample Logo is used to detect and visualize statistically significant differences in position-specific symbol composition between two sets of aligned samples of amino acids or nucleotides.
Only amino acid residues significantly enriched or depleted (t-test for p-value < 0.05) around lysine acetylation sites are shown.
As we can see from Fig 3, each logo contains 19 residue fragments with 9 upstream and 9 downstream, based on the total datasets and there were some significant differences among different species. For example, the hydrophobic residues glycine (G) was enriched for H. sapiens and M. musculus; while the negatively charged residues, glutamic acid (E) and aspartic acid (D), were depleted for these two species. Interestingly, the lysine (K) was enriched at upstream fragment and depleted at downstream fragment for H. sapiens and M. musculus; while it was enriched in both upstream and downstream fragment for S. typhimurium. The positively charged residue arginine (R) was enriched at upstream fragment for H. sapiens and M. musculus, while it was depleted at downstream fragment for H. sapiens, E. coli and S. typhimurium.
Generally, the enriched residues and depleted residues had distinctly differences between species. These observations suggested that lysine acetylation sites among different species have distinct location-specific differences. Therefore, building a species-specific predictor was necessary and significant.
Determination of the Sliding Window Sizes
Since different sliding windows may have distinct prediction performances, optimization of the sliding window sizes is required for selecting features and training models. On the one hand, if the sliding window was too long, a large amount of redundant information would be included. On the other hand, if the sliding window was too short, a lot of valuable information would lose. Thus, we took into account the window size varied from 11 to 19.
In this study, we used the predicted accuracy as index to evaluate the performance of the sliding windows with different sizes. Support vector machine (SVM) classifier and 5-fold cross-validation were carried out to build model and select feature based on each sliding window size.
Fig 4 showed the predicted accuracy of each model based on different window size. For S. typhimurium, the window size of 17 had the accuracy scores of 41.50%, while the accuracy score of the window size of 19 was 44.00%. The results showed these two window sizes were not stable. Therefore, we discarded the window sizes 17 and 19. The model with a window size of 13 had a relatively higher accuracy for most species than the window size of 11 and 15. Only for M. musculus, the predicted accuracy of window size of 13 was a little lower than the window size of 11 and 15. Compared with the window size of 11, the model trained using the window size of 13 improved 6.15%, 0.58% and 1.50% for E. coli, H. sapiens and S. typhimurium, respectively. And compared with the window size of 15, the window size of 13 improved 2.56%, 0.79% and 4.00% for E. coli, H. sapiens and S. typhimurium, respectively. According to these results, the optimal sliding window size was selected as 13 in our study.
Predictive Capability of Different Types of Features
We integrated 14 subtypes of features and selected useful features from each type by combining PCC ranking and stepwise feature selection. To evaluate the predictive capabilities of different subtypes of features, we used the predicted accuracy as index. Here, we built 14 models corresponding to 14 subtypes of features using support vector machine (SVM) classifier. And then, we evaluated the performance of each model on training dataset and independent test set.
Fig 5A and Fig 5B showed the predicted accuracy of different models for four species based on 14 subtypes of features. For sequence-based features, the model trained with KNN features outperformed all of the others for all four species on training dataset; while the performances of the IC features were relatively poor. Additionally, the AAindex features had relatively higher accuracy scores for H. sapiens, M. musculus and S. typhimurium on training dataset. For predicted structural features, the accuracy score of the model trained by HSE features was relatively higher on training dataset, especially for M. musculus. In contrast, the performances of SS features and disorder features were relatively poor for H. sapiens. These results indicated that the contributive features on the training dataset were predominantly KNN, AAindex, HSE and PSSM. For independent test set, the accuracy score of AAindex features was the best for M. musculus and S. typhimurium, while the accuracy score of KNN features was the best for E. coli and H. sapiens. In contrast, the KNN features performed relatively poor for S. typhimurium. For predicted structural features, the HSE features had a relatively high accuracy scores with > 50% for all species; while the disorder features performed relatively poor. Interestingly, PSSM features had slightly higher performance than HH features for H. sapiens, while PSSM features were inferior to HH features for M. musculus on training dataset, suggesting that HH features, enjoying the advantage of faster calculation, also played a significant role in improving prediction performance as PSSM features.
(A) Predicted accuracy of the models based on different types of features on training dataset for four species. (B) Predicted accuracy of the models based on different types of features on independent test set for four species. (C) The number of different types of features in the final selected featues set for four species. (D) Histograms and fitted density curves of HSEBU values between acetylation sites and non-acetylation sites on H. sapiens structure dataset. The histogram of acetylation sites is colored by pink and density curve is colored by red while the histogram of non-acetylation sites is colored by yellow and density curve is colored by black.
As observed from Fig 5C, the number of selected optimal features differed, depending on different species. For example, H. sapiens had the largest set of optimal features with a total of 151 features, while E. coli had the smallest set with 78 features used to build model. The evolutionary information features (PSSM and HH features) took a relatively large proportion for all of the four species. Also, different species had distinct biases toward a certain type of features. For H. sapiens, the number of AAindex features was the largest. In contrast, the LC and disorder features were the smallest in number. Additionally, the number of CKSAAP was relatively large for M. musculus and E. coli while it was relatively small for H. sapiens. These results indicated that the contributive features for different species showed some significant differences.
More importantly, the predicted HSE features showed an outstanding performance on both training dataset and independent test set. The accuracy scores on independent test set were >50% for all of the species. For training dataset, the accuracy scores were also >50%. To examine the statistical significance of the HSE features between acetylation sites and non-acetylation sites, we further performed Wilcoxon signed-rank test based on training dataset (Table 2). The results showed that the differences of the HSE features between acetylation sites and non-acetylation sites were statistically significant for most species.
The tests were based on the training dataset. (p-value < 0.05 by Wilcoxon signed-rank test)
Furthermore, we calculated real HSEU (HSE in the upper half sphere) values with a sphere radius of 13Å based on the structure dataset of H. sapiens to investigate the real differences of the HSE features between acetylation sites and non-acetylation sites. The average of HSEAU values for acetylation sites was 8.15, while for non-acetylation sites was 9.21. And the average of HSEBU values for acetylation sites (9.72) was also significantly less than non-acetylation sites (11.07) (p-value = 0.0027 by Wilcoxon signed-rank single side test). Some of the results were shown in Fig 5D. As mentioned before, acetylation is a process that an acetyl group (CH3CO-) from Ace-CoA replacing the hydrogen atom in the epsilon-amino group (-NH3+) of side chain of lysine residue, and the side chain of lysine residue is located at the upper half sphere which contains Cβ atom (Fig 1B). Therefore, we investigated the HSEU values in this part. The lower HSEU value meant less neighbor residues around lysine residue in the upper half sphere, which may result in more opportunity for the transferring an acetyl group (CH3CO-) to the epsilon-amino group (-NH3+) of lysine residue, i.e., improving the ability of acetylation. Therefore, as shown in Fig 5D, the HSEU values for acetylation sites were significantly lower. This may be why predicted HSE can be a potential type of features for predicting acetylation site.
Prediction Performance on Training Dataset
We evaluated the prediction performance of our models based on the final selected features. The 5-fold cross-validation was used to evaluate the performance on the training dataset. The predicted performances were presented in Table 3. SVM models for all four species displayed relatively good performance with AUC scores ranging from 0.723 to 0.787. Among these species, the performances of the models for E. coli were the best with AUC scores of 0. 787. And the AUC score of H. sapiens was 0.737, while the performance of M. musculus was a little poor, with the AUC scores of 0.723. M. musculus had the poorest MCC, ACC, SEN, SPE and PRE scores of 0.342, 0.671, 0.685, 0.657 and 0.667 respectively. These results indicated that our predictor provided a good predictive ability on the training dataset.
Independent test set and Comparison with Existing Methods
To further evaluate the performance of our predictor, we made comparison with the other existing methods on the independent test set. Here we put our independent test sets into 7 previously developed methods: LysAcet[14], ensemblePail[16], Phosida[23,24], PLMLA[17], PSKAcePred[18], BRABSB[19] and SSPKA[22]. As we utilized the same independent test set as SSPKA, the performance of other exiting methods were from SSPKA[22]. The comparison results of our predictor with other existing methods based on independent test set were shown in Table 4. As we can see, our predictor outperformed the majority of other methods for different species, such as M. musculus and E. coli. Particularly, our predictor achieved AUC score of 0.713 for M. musculus and 0.734 for E. coli, which was significantly higher than the others.
As we utilized the same independent test set as SSPKA, the performance of other exiting methods are from SSPKA[22].
However, our method performed slightly lower AUC score than PLMLA and lower ACC score than BRABSB on independent test set. The reason was that the independent test set used in this paper was not blind to the training dataset of these two methods. Also, in order to remove interference made by homologous sequences and avoid overestimation, different methods selected different cutoff from 25% to 40%. For example, our independent test set for H. sapiens had 190 acetylation proteins, however, 107 sequences among these had the identity of >30% with the training set of BRABSB and 116 for PLMLA. For fair comparison, we used the rest sequences (83 for BRABSB and 74 for PLMLA) to compare the prediction performance with PLMLA and BRABSB, respectively. As shown in Fig 6,, our predictor apparently outperformed these two methods. When compared to BRABSB, our predictor achieved a MCC score of 0.243 and an ACC score of 0.621 while 0.134 and 0.562 for BRABSB, respectively. For PLMLA, the MCC score of our predictor was 0.180 when compared to 0.096 for PLMLA, and the ACC score of our predictor was 0.590 when compared to 0.546 for PLMLA.
(A) Comparison of our predictor with PLMLA. (B) Comparison of our predictor with BRABSB.
In addition, the results of S. typhimurium were a little poor when compared with some methods. As mentioned above, different methods selected different samples as training dataset and independent test set. The training set of some existing methods may contain the information of our independent test set which results in the improvement of the performance for some methods.
These results have clearly indicated that our predictor was highly competitive when compared with other methods in predicting the acetylation sites for the majority of species.
Comparison of different feature selection methods
Max-Relevance-Max-Distance (MRMD) [78] is a feature ranking method, which includes two main part of the decision: measuring the relevance between features in a subset by Pearson’s correlation coefficient (PCC), and calculating the redundancy among features in a subset through Euclidean distance, Cosine distance and Tanimoto. Minimum Redundancy Maximum Relevance (mRMR) was proposed for processing microarray data and then applied into other field [79,80]. The approach selects the features having minimal redundancy which means a new selected feature should have least redundancy in the remaining of features, as well as the maximal relevance which means selected feature should have the strongest relevance to the target type. The mutual information (MI), well known in probability theory and information theory, is a measure of the mutual dependence between the two variables.
As already described in the above, we ranked different type of features by calculating the Pearson Correlation Coefficient (PCC) between each feature and the true classification on training dataset. In order to understand the influence of different feature selection methods for prediction, we compared the performances of models built based on different feature selection methods on independent test set (Table 5). The PCC method performed excellently on most of the species, especially for H. sapiens and M. musculus. The MRMD had the best MCC score of 0.394 for E. coli and the best AUC score of 0.561 for S. typhimurium, while it performed worst for H. sapiens. The models based on the mRMR method performed worst for S. typhimurium, and MI method had relatively poor performance for E. coli. These results indicated that ranking features based on PCC can be helpful to selecting essential features for lysine acetylation prediction and improving the accuracy of predicting lysine acetylation sites.
Comparison of different classifiers
In this paper, we used the LibSVM classifier to predicting lysine acetylation sites. However, ensemble classifier was generally considered to outperform a simple classifier. So I compared the performance with a latest ensemble classifier, libD3C[81] employing two types of selective ensemble techniques, which are a combination of the ensemble pruning based on k-means clustering and dynamic selection and circulating combination. We applied the LibD3C to select features and build prediction model by the same methods as LibSVM. The comparison results of the LibSVM and LibD3C classifier based on independent test set were shown in Table 6. The performance of these two classifiers is pretty close. And LibSVM performed relatively better than LibD3C in H. sapiens, E. coli and S. typhimurium. For M. musculus, the LibD3C classifier shared a comparable performance with LibSVM.
Conclusion and Discussion
In this study, we developed a novel predictor, KA-predictor, which has significantly improved the prediction performance of species-specific lysine acetylation sites across four different species, i.e., H. sapiens, M. musculus, S. typhimurium and E. coli, by combining a variety of features. We incorporated different types of features and employed an efficient feature selection on each type to form the final optimal feature set for model learning. We evaluated the prediction performance of our models based on the final selected features. The training dataset showed a relatively good performance based on the 5-fold cross-validation. Additionally, the results on the independent test set indicated that KA-predictor was able to perform competitively, compared with existing tools. Feature contribution analysis indicated that HSE features, firstly introduced for lysine acetylation prediction, significantly improve the predictive performance. In addition, we compared different kinds of feature selection methods and different classifiers with ours. The results indicated that ranking features based on PCC and utilizing LibSVM classifier can be helpful to improving the accuracy of predicting lysine acetylation sites. Particularly, we constructed a high-accurate structure dataset of H.sapiens from PDB to analyze the structural properties around lysine acetylation sites. Moreover, a user-friendly tool was freely available at http://sourceforge.net/p/ka-predictor.
Although our predictor can perform accurately according to the above results, some issues must still be addressed in future work. Firstly, the number of negative samples (i.e. non-acetylation sites) was much larger than that of positive samples (i.e. acetylation sites) resulting in the problem of imbalanced learning. We randomly sampled a subset from the negative samples with a ratio of 1:1 of positive versus negative samples to form a relatively balanced training dataset. However, the information loss brought by random under-sampling will weaken the prediction performance. Ensemble learning method to reduce the impact of under-sampling is crucial for improving the prediction performance. Secondly, we used datasets from SSPKA[22] proposed about 2 years ago. There may have some new data in different databases. Also, the independent test set used in this paper was really blind to the training dataset, but may not be independent to other existing predictors. Hence, making full use of new data and constructing a test set that is truly independent to each predictor are important. Finally, a lot of other amino acid residues can be also acetylated such as, Alanine (A), Glycine (G), Methionine (M), Serine (S) and Threonine (T). In the future work, we can take into account the prediction of acetylation of these amino acids.
Author Contributions
Conceived and designed the experiments: GH QW. Performed the experiments: QW. Analyzed the data: QW WZ. Contributed reagents/materials/analysis tools: JR YZ. Wrote the paper: QW GH.
References
- 1. Glozak MA, Sengupta N, Zhang X, Seto E. Acetylation and deacetylation of non-histone proteins. Gene. 2005; 363:15–23. pmid:16289629
- 2. Kurdistani SK, Grunstein M. Histone acetylation and deacetylation in yeast. Nat Rev Mol Cell Biol. 2003; 4(4):276–84. pmid:12671650
- 3. Hwang C-S, Shemorry A, Varshavsky A. N-Terminal Acetylation of Cellular Proteins Creates Specific Degradation Signals. Science. 2010; 327(5968):973–7. pmid:20110468
- 4. Sadoul K, Wang J, Diagouraga B, Khochbin S. The Tale of Protein Lysine Acetylation in the Cytoplasm. Journal of Biomedicine and Biotechnology. 2011; 2011: 970382. pmid:21151618
- 5. Zheng W, Ruan J, Hu G, Wang K, Hanlon M, Gao J. Analysis of Conformational B-Cell Epitopes in the Antibody-Antigen Complex Using the Depth Function and the Convex Hull. PLoS ONE. 2015; 10(8):e0134835. pmid:26244562
- 6. Zhao S, Xu W, Jiang W, Yu W, Lin Y, Zhang T, et al. Regulation of Cellular Metabolism by Protein Lysine Acetylation. Science. 2010; 327(5968):1000–4. pmid:20167786
- 7. Kalvik TV, Arnesen T. Protein N-terminal acetyltransferases in cancer. Oncogene. 2013; 32(3):269–76. pmid:22391571
- 8. Yu M, Gong J, Ma M, Yang H, Lai J, Wu H, et al. Immunohistochemical analysis of human arrest-defective-1 expressed in cancers in vivo. Oncology Reports. 2009; 21:909–15. pmid:19287988
- 9. Wei D, Le X, Zheng L, Wang L, Frey JA, Gao AC, et al. Stat3 activation regulates the expression of vascular endothelial growth factor and human pancreatic cancer angiogenesis and metastasis. Oncogene. 2003; 22(3):319–29. pmid:12545153
- 10. Yuan Z-l, Guan Y-j, Chatterjee D, Chin YE. Stat3 Dimerization Regulated by Reversible Acetylation of a Single Lysine Residue. Science. 2005; 307(5707):269–73. pmid:15653507
- 11. Welsch D, Nelsestuen G. Amino-terminal alanine functions in a calcium-specific process essential for membrane binding by prothrombin fragment 1. Biochemistry. 1988; 27:4939–45. pmid:3167022
- 12.
Zhou H, Boyle R, Aebersold R. Quantitative Protein Analysis by Solid Phase Isotope Tagging and Mass Spectrometry. In: Fu H, editor. Protein-Protein Interactions. Methods in Molecular Biology. 261: Humana Press; 2004. p. 511–8.
- 13.
Umlauf D, Goto Y, Feil R. Site-Specific Analysis of Histone Methylation and Acetylation. In: Tollefsbol T, editor. Epigenetics Protocols. Methods in Molecular Biology?. 287: Humana Press; 2004. p. 99–120.
- 14. Li S, Li H, Li M, Shyr Y, Xie L, Li Y. Improved prediction of lysine acetylation by support vector machines. Protein Peptide Lett. 2009; 16(8):977–983.
- 15. Lee TY, Hsu JB, Lin FM, Chang WC, Hsu PC, HD. H . N-Ace: using solvent accessibility and physicochemical properties to identify protein N-acetylation sites. J Comput Chem. 2010; 31(15):2759–71. pmid:20839302
- 16. Xu Y, Wang X-B, Ding J, Wu L-Y, Deng N-Y. Lysine acetylation sites prediction using an ensemble of support vector machine classifiers. Journal of Theoretical Biology. 2010; 264(1):130–5. pmid:20085770
- 17. Shi S-P, Qiu J-D, Sun X-Y, Suo S-B, Huang S-Y, Liang R-P. PLMLA: prediction of lysine methylation and lysine acetylation by combining multiple features. Molecular BioSystems. 2012; 8(5):1520–7. pmid:22402705
- 18. Suo S-B, Qiu J-D, Shi S-P, Sun X-Y, Huang S-Y, Chen X, et al. Position-Specific Analysis and Prediction for Protein Lysine Acetylation Based on Multiple Features. PLoS ONE. 2012; 7(11):e49108. pmid:23173045
- 19. Shao J, Xu D, Hu L, Kwan Y-W, Wang Y, Kong X, et al. Systematic analysis of human lysine acetylation proteins and accurate prediction of human lysine acetylation through bi-relative adapted binomial score Bayes feature representation. Molecular BioSystems. 2012; 8(11):2964–73. pmid:22936054
- 20. Amrita B, Rose KL, Zhang J, Beavis RC, Ueberheide B, Garcia BA, et al. Proteome-wide prediction of acetylation substrates. Proc Natl Acad Sci USA. 2009; 106(33):13785–90. pmid:19666589
- 21. Hou T, Zheng G, Zhang P, Jia J, Li J, Xie L, et al. LAceP: Lysine Acetylation Site Prediction Using Logistic Regression Classifiers. PLoS ONE. 2014; 9(2):e89575. pmid:24586884
- 22. Li Y, Wang M, Wang H, Tan H, Zhang Z, Webb GI, et al. Accurate in silico identification of species-specific acetylation sites by integrating protein sequence-derived and functional features. Scientific Reports. 2014; 4:5765. pmid:25042424
- 23. Florian G, Jeremy G, Matthias M. PHOSIDA 2011: the posttranslational modification database. Nucleic Acids Res. 2011; 39:D253–60. pmid:21081558
- 24. Gnad F, Ren S, Choudhary C, Cox J, Mann M. Predicting post-translational lysine acetylation using support vector machines. Bioinformatics. 2010; 26(13):1666–8. pmid:20505001
- 25. Liu Z, Cao J, Gao X, Zhou Y, Wen L, Yang X, et al. CPLA 1.0: an integrated database of protein lysine acetylation. Nucleic Acids Research. 2011; 39:D1029–D34. pmid:21059677
- 26. Wang L, Du Y, Lu M, Li T. ASEB: a web server for KAT-specific acetylation site prediction. Nucleic Acids Research. 2012; 40:W376–W9. pmid:22600735
- 27. Hornbeck PV, Kornhauser JM, Tkachev S, Zhang B, Skrzypek E, Murray B, et al. PhosphoSitePlus: a comprehensive resource for investigating the structure and function of experimentally determined post-translational modifications in man and mouse. Nucleic Acids Research. 2011; 40:D261–70. pmid:22135298
- 28. Huang Y, Niu B, Gao Y, Fu L, Li W. CD-HIT Suite: a web server for clustering and comparing biological sequences. Bioinformatics. 2010; 26(5):680–2. pmid:20053844
- 29. Lin H, Ding H, Guo Fb, Zhang Ay, Huang J. Predicting subcellular localization of mycobacterial proteins by using Chou's pseudo amino acid composition. Protein Pept Lett. 2008; 15(7):739–44. pmid:18782071
- 30. Lin H, Chen W, Ding H. AcalPred: A Sequence-Based Tool for Discriminating between Acidic and Alkaline Enzymes. PLoS One. 2013; 8(10): e75726. pmid:24130738
- 31. Zhu P-P, Li W-C, Zhong Z-J, Deng E-Z, Ding H, Chen W, et al. Predicting the subcellular localization of mycobacterial proteins by incorporating the optimal tripeptides into the general form of pseudo amino acid composition. Molecular BioSystems. 2015; 11(2):558–63. pmid:25437899
- 32. Lin H, Liu W-X, He J, Liu X-H, Ding H, Chen W. Predicting cancerlectins by the optimal g-gap dipeptides. Scientific Reports. 2015; 5:16964. pmid:26648527
- 33. Berman H. The Protein Data Bank: a historical perspective. Acta Crystallogr A. 2008; 64 (1):88–95.
- 34. Meyer E. The first years of the Protein Data Bank. Protein Science. 1997; 6(7):1591–7. pmid:9232661
- 35. Berman HM, Westbrook J, Feng Z, Gilliland G, Bhat TN, Weissig H, et al. The Protein Data Bank. Nucleic Acids Research. 2000; 28(1):235–42. pmid:10592235
- 36. Remmert M, Biegert A, Hauser A, Soding J. HHblits: lightning-fast iterative protein sequence searching by HMM-HMM alignment. Nat Meth. 2012; 9(2):173–5.
- 37. Altschul S F, Madden T L, Schaffer A A, Zhang J, Zhang Z, Miller W, et al. Gapped BLAST and PSI-BLAST: a new generation of protein database search programs. Nucleic Acids Res. 1997; 25(17):3389–402. pmid:9254694
- 38. Shi S-P, Qiu J-D, Sun X-Y, Suo S-B, Huang S-Y, Liang R-P. PMeS: Prediction of Methylation Sites Based on Enhanced Feature Encoding Scheme. PLoS ONE. 2012; 7(6):e38772. pmid:22719939
- 39. Zhang Z-H, Wang Z-H, Zhang Z-R, Wang Y-X. A novel method for apoptosis protein subcellular localization prediction combining encoding based on grouped weight and support vector machine. FEBS Letters. 2006; 580(26):6169–74. pmid:17069811
- 40. Chen Z, Chen Y-Z, Wang X-F, Wang C, Yan R-X, Zhang Z. Prediction of Ubiquitination Sites by Using the Composition of k-Spaced Amino Acid Pairs. PLoS ONE. 2011; 6(7):e22930. pmid:21829559
- 41. Chen X, Qiu J-D, Shi S-P, Suo S-B, Huang S-Y, Liang R-P. Incorporating key position and amino acid residue features to identify general and species-specific Ubiquitin conjugation sites. Bioinformatics. 2013; 29(13):1614–22. pmid:23626001
- 42. Henikoff S, JG. H . Amino acid substitution matrices from protein blocks. Proc Natl Acad Sci USA. 1992; 89:10915–9. pmid:1438297
- 43. Liu B, Liu F, Wang X, Chen J, Fang L, Chou K-C. Pse-in-One: a web server for generating various modes of pseudo components of DNA, RNA, and protein sequences. Nucleic Acids Research. 2015; 43:W65–W71. pmid:25958395
- 44. Lin C, Zou Y, Qin J, Liu X, Jiang Y, Ke C, et al. Hierarchical Classification of Protein Folds Using a Novel Ensemble Classifier. PLoS ONE. 2013; 8(2):e56499. pmid:23437146
- 45. Liu B, Chen J, Wang X. Protein remote homology detection by combining Chou's distance-pair pseudo amino acid composition and principal component analysis. Mol Genet Genomics. 2015; 290(5):1919–31. pmid:25896721
- 46. Wei L, Liao M, Gao X, Zou Q. An Improved Protein Structural Classes Prediction Method by Incorporating Both Sequence and Structure Information. IEEE Transactions on NanoBioscience. 2015; 14(4):339–49.
- 47. Chou K-C. Prediction of protein cellular attributes using pseudo-amino acid composition. Proteins: Structure, Function, and Bioinformatics. 2001; 43(3):246–55.
- 48. Kawashima S, Pokarowski P, Pokarowska M, Kolinski A, Katayama T, Kanehisa M. AAindex: amino acid index database, progress report 2008. Nucleic Acids Research. 2008; 36:D202–D5. pmid:17998252
- 49. Atchey WR, Zhao J, Fernandes AD, Druke T. Solving the protein sequence metric problem. Proc Natl Acad Sci USA. 2005; 102:6395–400. pmid:15851683
- 50. McGuffin LJ, Bryson K, Jones DT. The PSIPRED protein structure prediction server. Bioinformatics. 2000; 16(4):404–5. pmid:10869041
- 51. Faraggi E., Zhang T., Yang Y., Kurgan L, Zhou Y. SPINE X: Improving protein secondary structure prediction by multi-step learning coupled with prediction of solvent accessible surface area and backbone torsion angles. J Comput Chem. 2002; 33:259–67.
- 52. Ward JJ, McGuffin LJ, Bryson K, Buxton BF, Jones DT. The DISOPRED server for the prediction of protein disorder. Bioinformatics. 2004; 20(13):2138–9. pmid:15044227
- 53. Ward JJ, Sodhi JS, McGuffin LJ, Buxton BF, DT. J . Prediction and functional analysis of native disorder in proteins from the three kingdoms of life. J Mol Biol. 2004; 337(3):635–45. pmid:15019783
- 54. Hamelryck T. An amino acid has two sides: a new 2D measure provides a different view of solvent exposure. Proteins. 2005; 59(1):38–48. pmid:15688434
- 55. Sweredoski MJ, Baldi P. PEPITO: improved discontinuous B-cell epitope prediction using multiple distance thresholds and half sphere exposure. Bioinformatics. 2008; 24(12):1459–60. pmid:18443018
- 56. Heffernan R, Dehzangi A, Lyons J, Paliwal K, Sharma A, Wang J, et al. Highly accurate sequence-based prediction of half-sphere exposures of amino acid residues in proteins. Bioinformatics. 2015.
- 57. Chen W, Feng P-M, Lin H, Chou K-C. iRSpot-PseDNC: identify recombination spots with pseudo dinucleotide composition. Nucleic Acids Research. 2013; 41(6):e68–e. pmid:23303794
- 58. Guo S-H, Deng E-Z, Xu L-Q, Ding H, Lin H, Chen W, et al. iNuc-PseKNC: a sequence-based predictor for predicting nucleosome positioning in genomes with pseudo k-tuple nucleotide composition. Bioinformatics. 2014; 30(11):1522–9. pmid:24504871
- 59. Lin H, Deng E-Z, Ding H, Chen W, Chou K-C. iPro54-PseKNC: a sequence-based predictor for identifying sigma-54 promoters in prokaryote with pseudo k-tuple nucleotide composition. Nucleic Acids Research. 2014; 42(21):12961–72. pmid:25361964
- 60. Ding H, Liu L Fau—Guo F-B, Guo Fb Fau—Huang J, Huang J Fau—Lin H, Lin H. Identify Golgi protein types with modified Mahalanobis discriminant algorithm and pseudo amino acid composition. Protein Pept Lett. 2011; 18(1):58–63. pmid:20955168
- 61. Ding H, Deng E-Z, Yuan L-F, Liu L, Lin H, Chen W, et al. iCTX-Type: A Sequence-Based Predictor for Identifying the Types of Conotoxins in Targeting Ion Channels. BioMed Research International. 2014; 2014:10.
- 62. Ding H, Feng P-M, Chen W, Lin H. Identification of bacteriophage virion proteins by the ANOVA feature selection and analysis. Molecular BioSystems. 2014; 10(8):2229–35. pmid:24931825
- 63. Ding H, Lin H, Chen W, Li Z-Q, Guo F-B, Huang J, et al. Prediction of protein structural classes based on feature selection technique. Interdisciplinary Sciences: Computational Life Sciences. 2014; 6(3):235–40.
- 64. Chen Z, Zhou Y, Song J, Zhang Z. hCKSAAP_UbSite: Improved prediction of human ubiquitination sites by exploiting amino acid pattern and properties. Biochimica et Biophysica Acta (BBA)—Proteins and Proteomics. 2013; 1834(8):1461–7.
- 65. Jianlin S, Dong X, Sau-Na T, Yifei W, Sai-Ming N. Computational Identification of Protein Methylation Sites through Bi-Profile Bayes Feature Extraction. PLoS ONE. 2009; 4(3):e4920. pmid:19290060
- 66. Shien D, Lee T, Chang W, Hsu J, Horng J, Hsu P, et al. Incorporating structural characteristics for identification of protein methylation sites. J Comput Chem. 2009; 30(9):1532–43. pmid:19263424
- 67. Dou Y, Yao B, Zhang C. PhosphoSVM: prediction of phosphorylation sites by integrating various protein sequence attributes with a support vector machine. Amino Acids. 2014; 46(6):1459–69. pmid:24623121
- 68. Zheng W, Zhang C, Hanlon M, Ruan J, Gao J. An ensemble method for prediction of conformational B-cell epitopes from antigen sequences. Computational Biology and Chemistry. 2014; 49:51–8. pmid:24607818
- 69. Chou K-C, Zhang C-T. Prediction of Protein Structural Classes. Critical Reviews in Biochemistry and Molecular Biology. 1995; 30(4):275–349. pmid:7587280
- 70. Chou K-C. Some remarks on protein attribute prediction and pseudo amino acid composition. Journal of Theoretical Biology. 2011; 273(1):236–47. pmid:21168420
- 71. Ding H, Luo L, Lin H. Prediction of Cell Wall Lytic Enzymes Using Chou's Amphiphilic Pseudo Amino Acid Composition. Protein and Peptide Letters. 2009; 16(4):351–5. pmid:19356130
- 72. Lin H, Ding H. Predicting ion channels and their types by the dipeptide mode of pseudo amino acid composition. Journal of Theoretical Biology. 2011; 269(1):64–9. pmid:20969879
- 73. Ding C, Yuan L-F, Guo S-H, Lin H, Chen W. Identification of mycobacterial membrane proteins and their types using over-represented tripeptide compositions. Journal of Proteomics. 2012; 77:321–8. pmid:23000219
- 74. Yuan L-F, Ding C, Guo S-H, Ding H, Chen W, Lin H. Prediction of the types of ion channel-targeted conotoxins based on radial basis function network. Toxicology in Vitro. 2013; 27(2):852–6. pmid:23280100
- 75. Lin H, Ding C, Song Q, Yang P, Ding H, Deng K-J, et al. The prediction of protein structural class using averaged chemical shifts. Journal of Biomolecular Structure and Dynamics. 2012; 29(6):1147–53.
- 76. Saeys Y, Inza I, Larra?aga P. A review of feature selection techniques in bioinformatics. Bioinformatics. 2007; 23(19):2507–17. pmid:17720704
- 77. Vacic V, Iakoucheva LM, Radivojac P. Two Sample Logo: a graphical representation of the differences between two sets of sequence alignments. Bioinformatics. 2006; 22(12):1536–7. pmid:16632492
- 78. Zou Q, Zeng J, Cao L, Ji R. A novel features ranking metric with application to scalable visual and bioinformatics data classification. Neurocomputing. 2016; 173, Part 2:346–54.
- 79. Ding C, Peng H. Minimum redundancy feature selection from microarray gene expression data. Journal of Bioinformatics and Computational Biology. 2005; 03(02):185–205.
- 80. Hanchuan P, Fuhui L, Ding C. Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2005; 27(8):1226–38. pmid:16119262
- 81. Lin C, Chen W, Qiu C, Wu Y, Krishnan S, Zou Q. LibD3C: Ensemble classifiers with a clustering and dynamic selection strategy. Neurocomputing. 2014; 123:424–35.