Text Authorship Identified Using the Dynamics of Word Co-Occurrence Networks

Camilo Akimushkin; Diego Raphael Amancio; Osvaldo Novais Oliveira Jr.

doi:10.1371/journal.pone.0170527

Abstract

Automatic identification of authorship in disputed documents has benefited from complex network theory as this approach does not require human expertise or detailed semantic knowledge. Networks modeling entire books can be used to discriminate texts from different sources and understand network growth mechanisms, but only a few studies have probed the suitability of networks in modeling small chunks of text to grasp stylistic features. In this study, we introduce a methodology based on the dynamics of word co-occurrence networks representing written texts to classify a corpus of 80 texts by 8 authors. The texts were divided into sections with equal number of linguistic tokens, from which time series were created for 12 topological metrics. Since 73% of all series were stationary (ARIMA(p, 0, q)) and the remaining were integrable of first order (ARIMA(p, 1, q)), probability distributions could be obtained for the global network metrics. The metrics exhibit bell-shaped non-Gaussian distributions, and therefore distribution moments were used as learning attributes. With an optimized supervised learning procedure based on a nonlinear transformation performed by Isomap, 71 out of 80 texts were correctly classified using the K-nearest neighbors algorithm, i.e. a remarkable 88.75% author matching success rate was achieved. Hence, purely dynamic fluctuations in network metrics can characterize authorship, thus paving the way for a robust description of large texts in terms of small evolving networks.

Citation: Akimushkin C, Amancio DR, Oliveira ON Jr (2017) Text Authorship Identified Using the Dynamics of Word Co-Occurrence Networks. PLoS ONE 12(1): e0170527. https://doi.org/10.1371/journal.pone.0170527

Editor: Zhong-Ke Gao, Tianjin University, CHINA

Received: November 7, 2016; Accepted: December 24, 2016; Published: January 26, 2017

Copyright: © 2017 Akimushkin et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All relevant data are within the paper and its Supporting Information files.

Funding: The authors acknowledge the financial support from CNPq (Brazil). DRA acknowledges financial support from São Paulo Research Foundation (FAPESP grant no. 2014/20830-0 and 2016/19069-9) (www.fapesp.br). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

1 Introduction

Statistical methods have long been applied to analyze many complex systems [1–5], including written texts and language patterns [6], which now include network representations of text to investigate linguistic phenomena [7–14]. Networks generated from text share several features with other complex systems, e.g. information and transportation networks [15, 16], biological systems [17, 18], and social interactions [19]. Examples of language-related networks include phonological networks with modular or cut-off power-law behaviors [20–23], semantic similarity networks with small-world and scale-free properties [24], syntactic dependency networks with hierarchical and small-world organization [25, 26] and collocation networks, which also display small-world and scale-free properties [8]. The ubiquity of specific patterns in language networks is believed to account for an easy navigation and acquisition in semantic and syntactic networks [27]. Of particular relevance to this study, word co-occurrence networks are a special case of collocation networks where two words (nodes) are linked if they appear close to each other in a text. Co-occurrence networks are convenient because they do not require prior linguistic knowledge, apart from that needed to filter relevant information. Since most of the syntactic relations occur between adjacent words, co-occurrence networks can be seen as simplified versions of syntactic networks [26]. Several patterns have been identified in co-occurrence networks formed from large corpora, such as the power-law regimes for degrees distribution [7] and core-periphery structure [28] resulting from the complex organization of the lexicon. The overall structure and dynamics of networks representing texts have been modeled to describe their mechanism of growth and attachment [29, 30], while nuances in the topology of real networks were exploited in practical problems, including natural language processing [31–34]. In this study, we use the co-occurrence representation to probe how the variation of network topology along a text is able to identify author’s style.

Writing style is more subjective than other text characteristics (e.g. topic), making authorship recognition one of the most challenging text mining tasks [35, 36]. It is crucial for practical applications such as text classification [34], copyright resolution [37], identification of terrorist messages [38] and of plagiarism [35]. Early studies using stylometry were conducted by Mosteller and Wallace to identify authorship of the Federalist Papers [39]. A myriad of methods to tackle the problem have been developed since then, typically using statistical properties of words (e.g. mean length, frequency, burstiness and vocabulary richness) and characters (e.g. character counts and long-range correlations), in addition to syntactic and semantic information, and text format [35]. Methods from statistical physics have also been used for authorship recognition [40, 41], which in recent years included text modeling with co-occurrence networks [42–47]. The adequacy of co-occurrence networks for the task was confirmed for the first time with the correlation between network topology and authors’ styles [34]. Despite this relative success, some issues concerning the applicability of network methods remain unsolved.

A major issue in network representation is that regular patterns among concepts only emerge when large pieces of text are available. Furthermore, rigorous network-based similarity estimators usually assume that the networks comprise the same number of nodes and edges, since most measurements are affected by the network size [48]. Unfortunately, such strong assumption often does not hold for written texts ranging from small tales to long novels, which may hinder the applicability of models to real situations. Additionally, since characterization of networks hinges on a precise statistical analysis, a large number of networks with similar characteristics need to be analyzed. As we shall show, the method presented here obviates these issues with a simple approach based on network dynamics.

2 Methods

The modelling of real systems using a time series approach plays a prominent role in many applications [49–53]. Written texts were represented as sets of co-occurrence networks, from which network dynamics measurements were obtained. These measurements were used as attributes in pattern recognition methods in order to identify the author of a given text. The construction and analysis of the measurements are described in detail in the following subsections.

Modeling texts as co-occurrence networks

The texts used for classification come from a collection of novels and tales in English whose details are provided in the Supporting Information (S1 File). The collection comprising 8 authors with 10 texts per author was selected to simulate a real case where the text lengths are varied in a range from 2,853 to 267,012 tokens with an average of 53,532 tokens.

The approach requires a pre-processing step before transforming texts into networks, which consists of the removal of stopwords, and lemmatization: because we are mostly interested in the relationship between content words, stopwords such as function words conveying low semantic information were removed as in many studies of this type [54]. The remaining words were lemmatized so that nouns and verbs were mapped to their singular and infinitive forms, and therefore words related to the same concept were mapped into the same node (also referred to as one single token). Since lemmatization requires part-of-speech (POS) tagging, we used the maximum-entropy approach described in [55]. The co-occurrence networks were constructed with each distinct word becoming a node and two words being linked if they were adjacent in the pre-processed text [34]. The link is directed from the word appearing first to the second word and is weighted by the number of times the pair is found in the text. To illustrate the process of creating a word adjacency network, we show in Fig 1 a network obtained from a short text.

Download:

Fig 1. Example of co-occurrence network.

The network was obtained for the text “It was the best of times; it was the worst of times; it was the age of wisdom; it was the age of foolishness”, which is an extract from the book “A Tale of Two Cities”, by Charles Dickens. Note that, after the removal of stopwords (such as “it” and “was”) and lemmatization process (“times” is mapped to “time”), the remaining words are linked if they are adjacent.

https://doi.org/10.1371/journal.pone.0170527.g001

Characterization of written texts via network dynamics

The proposed method for authorship attribution is based on the evolution of the topology of networks, i.e. we exploit the network dynamics [56]. Therefore, unlike previous approaches (see e.g. [8, 57]), we do not construct one single network from the whole book. Instead, a book is divided into shorter pieces of text comprising the same number of tokens. Then, a co-occurrence network is constructed for each part, which generates a series of independent networks for each book. The last partition is removed from the series because it is shorter than the previous ones. Since distinct books have different numbers of tokens, the series length varies from book to book. This construction guarantees that the remaining networks have the same weight on their edges while the amount of text removed from each book is negligible. Note that we use the same number of tokens in each partition because some network measurements are sensitive to network size. As a consequence, extract comprising different amount of tokens could generate a noise, which would hamper the performance of the classifiers. Note that, in many similar studies where comparing network topology is need, a similar procedure is followed.

Each partition is described by the following topological network measurements: clustering coefficient C_i, which gives the fraction of possible triangles that exist for a particular node; network diameter D, which is the largest of all longest paths (max{D_ij}); network radius R, which is the smallest of all longest paths (min{D_ij}); number of cliques (complete subgraphs) C_q; load centrality L_i, similar to betweenness centrality but considering weights on edges; network transitivity T, which measures the fraction of all connected triples which are in fact triangles, T = 3 × triangles/triads; betweenness centrality B_i, which measures how many shortest paths pass through a given node; shortest path length S_ij, which is the smallest number of edges between two nodes; degree K_i or connectivity (number of edges) of a node; intermittency I_i, which measures how periodically a word is repeated [58]; total number of nodes N (i.e. vocabulary size); and total number of edges E. Even though intermittency is not a traditional network measurement, we considered it because of its strong relationship with the concept of cycle length in networks. Moreover, this measurement has been proven useful for analyzing text styles [34]. The metrics D, R, C_q, T, N and E are scalar values for a network, while the other measurements are computed for each node individually. In order to have an overall picture of each partition, we computed the average values of C_i, L_i, B_i, S_ij, K_i and I_i. As such, each partition is characterized by a set of twelve global topological measurements.

The total number of tokens W (equal to the total weight on links), in each partition, was selected in a simple optimization procedure, with a compromise between having a long but noisy series (many small networks) and a shorter, more stable one (few large networks). We found that with W = 200 tokens one ensures a series length with T_s = 268 elements on average while keeping the number of nodes over N = 100 for all networks.

Time series were constructed by extracting the twelve global metrics defined above for each of the networks from a book, as illustrated in Fig 2. Fig 3 shows the series for Moby Dick by Herman Melville, from which one may note that they oscillate steadily around fixed values along the text. Indeed, the analysis is facilitated if the series are stationary. Strong stationarity requires the expected values to be constant throughout while weak stationarity implies that the mean (and possibly the variance) is constant. We confirmed that the time series are stationary, i.e. characterized by low values of autocorrelation. Correlation of a time series with itself shifted by a certain gap measures how much a value in the series depends on the previous ones, implying that autocorrelation must be almost null for all but the first few values of the gap as shown in Fig 4(a). In order to assess series stationarity, we implemented Kwiatkowski-Phillips-Schmidt-Shin (KPSS), augmented Dickey-Fuller, Phillips-Perron, and MacKinnon (finite-sample and asymptotic) tests [59–62]. The null hypothesis of KPSS test is trend stationarity, which for our series was not rejected with 95% confidence (p_value > 0.05) for all metrics. The other tests evaluate the presence of a unit root in the series characteristic equation which is closely related to stationarity; results for these tests are presented in the Supporting Information (S1 File). A standard description of a time series is the fitting into the ARIMA(p, d, q) model. An ARIMA process is described by the relation (1) where Lx_t = x_t−1 is the lag operator, implying that if the series is derived d times, it becomes stationary and the realization x_t of the series depends on the p previous realizations and on the q previous independent random variables ε (with t > p + d and t > q). Remarkably, out of the 12 × 80 = 960 time series extracted from the collection, 698 were stationary (d = 0) while the remaining series were integrated of first order (d = 1), showing that stationarity is a common feature among these series and their derivatives. As for the lag parameters, the maximum order was found for one load centrality series fitted as an ARIMA(5, 0, 4) process (see S1 File).

Download:

Fig 2. Methodology used to characterize a documents as a set of time series.

In the first step, the document is splitted into shorter pieces of equal length. For each subtext, a network is formed. Then, the sequence of networks yield a sequence of complex network measurements. The features extracted from the times series are finally used to identify authorship.

https://doi.org/10.1371/journal.pone.0170527.g002

Download:

Fig 3. Time series for Moby Dick by Herman Melville.

The horizontal axis denotes the index of realizations, and the vertical axis brings the base 10 logarithm of the metrics identified in the inset.

https://doi.org/10.1371/journal.pone.0170527.g003

Download:

Fig 4. Autocorrelation and histograms for Moby Dick.

(a) Autocorrelation for the series of clustering coefficient of Moby Dick by Herman Melville. Dashed lines mark the 5% threshold which is surpassed only by chance. (b) Histograms for time series of degree K (connectivity) from all books on the collection grouped by author. The distributions have characteristic moments for each author.

https://doi.org/10.1371/journal.pone.0170527.g004

The finding that the series can be considered stationary allows one to compare estimated values for sample statistics from series of different lengths. The distributions of the series were found to display bell-shaped skewed forms (shown in Fig 4(b)); therefore we propose the first four moments of the series distributions as the dynamical measurements, i.e. (2) where 1 < i ≤ 4 and μ₁ is the average of the measurements in the series. Since there are twelve time series, we obtain 48 dynamical measurements to characterize a book. Note that the distributions in Fig 4(b) are the probability densities of the network global measures which does not contradict the central limit theorem, which states that the sum of independent identically distributed random variables tends to a normal distribution. In other words, with this method the underlying distributions can be determined which would otherwise be lost if the book structure were considered as a whole.

Data analysis

The moments of the network metrics are used to characterize a book. In the terminology of machine learning these are the attributes (also called features) for the algorithms, while individual books are the instances and the author of a book corresponds to the instance class. A 80 × 48 data matrix is constructed where each row corresponds to an instance and each column corresponds to an attribute. In order to account for the different scales of the attributes (see Fig 3), each column in the data matrix is normalized between zero and one. From the data matrix, the author of each book is inferred using standard supervised learning (classification) algorithms [63].

There is a dimensionality reduction stage prior to the classification. Dimensionality reduction is achieved through either feature selection or feature extraction. Feature selection consists of removing attributes which do not satisfy a given condition, thus leaving a subset or combination of the total number of features. On the other hand, feature extraction blends the original attributes together in order to create a set of, usually fewer, new attributes. Feature selection was implemented using variance threshold and scoring criteria. Variance threshold selection imposes a minimum variance among the realizations of an attribute, for example, if an attribute has the same value for all instances its variance is zero and can be safely removed because it does not contribute to the classification process. We also implemented feature selection based on score. The huge number of combinations of attributes prohibits an exhaustive search of the combination(s) with the highest score. Instead, we start by testing all subsets obtained by removing one attribute from the whole set. In the next step we test all subsets obtained by removing one attribute from the subsets with the highest score in the previous step, and the process is iterated. Dimensionality reduction through feature extraction was implemented using the well-known Principal Component Analysis (PCA) and Isomap [64, 65] techniques. Isomap analyzes data points in a high-dimensional space that are implicitly located in a curved manifold of smaller dimensionality. Dimensionality reduction is then achieved by unwrapping the manifold and getting rid of the extra dimensions. As will be shown, both feature selection and extraction improve the classification success score.

Since there are many supervised learning algorithms, we have selected some to cover the most distinct classification paradigms: ZeroR (0R), which arbitrarily labels all instances as belonging to the most prevalent class; OneR (1R), which ranks attributes according to their error rate and only uses the highest ranked attribute; J48, which organizes the patterns in a tree-like structure; K-nearest neighbors (KNN), where the class of an instance is inferred by a voting process over the nearest neighbors in the training dataset; Naive Bayes (NB), which assumes independence among attributes; and Radial Basis Function Network (RBFN) where a learning network with an input, a processing, and an output layer is used. Due to their simplicity, 0R and 1R are only used for comparison. In all methods, the parameters were set to their default configuration (for KNN K = 2 and for RBFN n_clusters = 8) [66] and the classification is calculated for a 10–fold stratified cross-validation [67–70]. A detailed description of classification algorithms can be found in [63].

The performance of algorithms can be evaluated with two standard scores: precision and recall. Both are real values ranging from zero to one, being specific for a given class c. Precision (P_c) is defined as (3) where τ_c is the number of instances belonging to class c that were correctly classified (i.e. the number of true positives), and ϵ_c is the number of instances of other classes that were wrongly classified as belonging to class c (i.e. number of false positives). The Recall R_c for class c is computed as (4) where γ_c is the number of instances of class c that were incorrectly classified (i.e. the number of false negatives). The precision and recall scores defined above refer to a single class. To obtain a single value from the dataset, one may use micro- and macro-averaging. Micro-averaging weights the scores of each class by the number of instances while the macro-average score is the arithmetic mean of the scores of all classes. Note that the micro-averaged recall is equivalent to the success rate, that is, the quotient between the number of instances correctly classified and the total number of instances. For the present collection, having the same number of instances per class, micro- and macro-averaging are equivalent.

3 Results and Discussion

The authorship signature is captured by the measures proposed, which reveals the relationship between style and changes in network structure. Success scores greatly surpass the threshold in a blind classification obtained with ZeroR algorithm, which for our collection is 1/8 = 12.5%. Unmodified data from the 48 original measures were classified with success rates in the range from 45% to 62.5% as shown in Table 1. The simple OneR algorithm had lower performance, with 35% score. Dimensionality reduction using either feature extraction or feature selection increased the success rates for all algorithms. The results of feature selection are shown in Fig 5 for both variance threshold and score-based selection. In both cases the best results are obtained with an intermediate number of metrics: we begin by removing misleading attributes, therefore improving classification; however, at the end of the process most of the attributes that carry important information are removed and the classification scores drop. In Fig 5(a) and 5(b) success scores are presented, with the maximum value for each curve marked with a circle. If there is more than one maximum (e.g. J48 and NB for variance threshold and J48 and KNN for score-based selection), we only consider the combinations with the fewest number of attributes, located at the rightmost positions.

Download:

Table 1. Summary of success scores for the original set of 48 attributes and data after feature selection and feature extraction.

https://doi.org/10.1371/journal.pone.0170527.t001

Download:

Fig 5. Success scores and combinations of attributes using the variance threshold and score-based feature selection.

In (a), (b) the maximum values with minimum number of attributes are marked with circles. In (c), (d) for each network metric (represented by a label in the horizontal axis) the four first moments are presented in increasing order from left to right. A black cell indicates that the attribute is present in the combination. For the variance threshold feature selection, there is a unique combination for every threshold denoted by the vertical axis in (c). For instance, thresholds for the four maximum scores in (a) are marked in (c) by the four dashed horizontal lines. For the score-based feature selection there can be multiple combinations of attributes with the same number of attributes and the same score. Only the combinations with maximum scores and marked with circles in (b) are presented in (d); for KNN algorithm there were two combinations with maximum score.

https://doi.org/10.1371/journal.pone.0170527.g005

The results of feature selection using a variance threshold are shown in Fig 5(a) and 5(c). There is a single subset (combination) of attributes for each variance threshold level. At the lowest threshold in Fig 5(c) all attributes are present and all cells of the highest row are colored black. As the threshold is gradually increased, attributes are successively removed until there are no attributes left and all the cells in the lowest row are colored white. Remarkably, the first and the last attributes removed were respectively the fourth and the third moments of the number of cliques C_q. Note also that for nine of the twelve network metrics, either the third or the fourth moment had the smallest variance. The maximum scores are marked with circles in Fig 5(a) and listed in Table 1. The thresholds for maximum scores marked in Fig 5(a) are located in a narrow range and are represented in Fig 5(c) as dashed lines.

The results of feature selection based on score are shown in Fig 5(b) and 5(d). We start with all the attributes in the left end of Fig 5(b). As we explore the combinations obtained by removing one attribute at a time the scores increase (monotonically for J48 and KNN) until a maximum value is reached, after which the scores rapidly decrease reaching ZeroR score when there are zero attributes. The maximum scores are marked with circles in Fig 5(b) and listed in Table 1. It must be noted that the maximum scores can be reached with a few attributes, at most 16 in the case of KNN. The combinations of attributes giving the maximum scores marked are presented in detail in Fig 5(d). For KNN two combinations of attributes reached the highest score. Again, the four moments of a given network metric are grouped together. The best scoring combinations for some algorithms did not include any of the four moments from some network metrics. In particular, load centrality L was not used by any algorithm (having therefore a blank column for L in Fig 5(d)). One should highlight the betweenness centrality B, which was extensively used by KNN, NB and RBFN even though its mean value (i.e. first moment, and the leftmost column under the B label on Fig 5(d)) was not used by these algorithms.

Two last combinations of attributes were considered (see 5th and 6th rows of Table 1). The first moments μ₁ represent the static metrics previously studied (see e.g. [34, 71]) and define a subset of 12 attributes. The complementary subset of 36 second, third, and fourth moments represent the dynamical aspects of networks since they describe the extent of variation around the mean value throughout a text. Classification was applied to these two subsets without further dimensionality reduction. The results are listed in the fourth and fifth rows of Table 1 showing that purely dynamical metrics provide better overall performance when compared to the static counterparts, while both subsets score similarly to the whole set of 48 attributes.

Another dimensionality reduction technique implemented was feature extraction, using both linear PCA and nonlinear Isomap. The latter uses geodesic distances in an embedded manifold instead of high-dimensional Euclidean distances. There is a free parameter in Isomap: the number of neighbors n_neighbors. The distance between two instances considered neighbors is the traditional Euclidean distance while the distance between two other instances is the geodesic distance for a path inside the manifold [64]. The results for Isomap depend on n_neighbors and on the reduced number of dimensions n_comps; we varied both parameters from 2 to 15 and found similar results for most cases (see S1 File). The best scores reported below (see Fig 6) were obtained for n_neighbors = 10 and n_comps = 10.

Download:

Fig 6. Validation and visualization of complex network measurements.

(a) Validation of the classification without dimensionality reduction (red), and with feature extraction using PCA (green) and Isomap (blue). (b) Reduction to two-dimensional attribute space using Isomap. Each point represents a book and each color represents an author.

https://doi.org/10.1371/journal.pone.0170527.g006

Fig 6(a) shows precision (defined by Eq 3) and recall (success score, defined by Eq 4) for original (without dimensionality reduction), PCA-, and Isomap-treated attributes (see also Table 1). Dimensionality reduction through PCA leads to lower precision and recall, while Isomap enhances the classification efficacy of the algorithms. The best performance is reached with KNN for which the authorship of 71 out of the 80 texts in the collection is correctly identified, thus reaching 88.75% success score (recall) and 0.891 precision. To our knowledge, this is the best performance obtained with a technique based solely on topological properties of complex networks. This is also the first time that Isomap has shown to be useful to improve the performance of the classification of this type of data. In fact, while the original Isomap may not be adequate for classification tasks owing to the use of the reconstruction principle [72], extended versions of this visualization technique may provide a better discrimination of the original data [72, 73]. This performance is robust among algorithms since both precision and recall surpass 80% using KNN, NB and RBFN. For visualization purposes Isomap was also applied to reduce the number of attributes to a two-dimensional space using the Projection Explorer software [65] as shown in Fig 6(b). For some authors the texts are clearly grouped and separated from the rest (e.g. texts from A. C. Doyle and B. Shaw) while for other authors the separation is not as clear. A common trend exists nevertheless, with texts by the same author located in preferential regions in the attribute space. However, a much better separation could be obtained if higher dimensions were considered, as confirmed by the high accuracy rate obtained with the Isomap projection.

Even though a direct comparison to related works requires using the same texts collection, two examples using collections with similar characteristics which use static network metrics are worth mentioning. A similar study for the same task [34] analyzed 40 texts from 8 authors in English reaching a success score of 65%. In another work, 28 out of 36 Persian books from 5 authors were correctly classified [71]. A myriad of other features for authorship identification have been proposed. Argamon and Juola [74] collected the results of the PAN 2011 competition where 3001 electronic messages from 26 authors were classified using diverse features for which the best micro-averaged recall (i.e. success score) was 0.717. These collections have characteristics different to ours such as the number of texts, authors, and the sizes of messages compared to books. To our knowledge, ours is the best performance achieved to date using only topological features of co-occurrence networks.

4 Conclusion

Network sample statistics could be used for classifying texts in a straightforward manner owing to the stationarity of the series obtained with the network metrics; as a bonus, problems faced in applying networks to real-life situations were solved. For instance, texts of different sizes could be compared, and indeed, the smallest book of the collection (from A. C. Doyle) was correctly classified repeatedly regardless of the small size of its series. It is possible to compare texts of dissimilar sizes because the size of a book is reflected on the length of the corresponding time series rather than on the sizes of the networks. Also, the finite-size effects of typical networks from language are avoided by considering only the mean values over a whole network. The typical sizes of the networks were slightly more than 100 nodes, which are usually considered small; however, our approach succeeds because it collects only global metrics, i.e. averages that are still reliable, in contrast to distributions over all nodes. This trading of the microscopic description of each node of a network for the sample statistics of the global metrics resulted in a fair description of the latter as shown in Fig 4(b) owing to the length of the series. It remains to be shown to which extent the microscopic distributions over the nodes depend on the global averages and on the growth mechanisms as it has been claimed using theoretical models [29, 30].

Even though the primary goal of the work was not to compete with other approaches in authorship recognition, but rather to contribute to understanding the influence of authorship on the statistical properties of co-occurrence networks, the method proposed has proven reliable for authorship identification. Success scores reached 88.75% (KNN+Isomap), which is outstanding for a collection with this particular number of books and authors. Indeed, our method is among the most successful authorship recognition approaches according to the literature [74]. For instance, the attributes proposed are more difficult to be attacked because they depend on text structure instead of text formatting or simple frequency statistics [75, 76] making them hard to forge. Also, network methods are in general less sensitive to topic and are therefore more suitable to study writing styles [33, 34, 71]. Computational complexity is much lower than that of traditional frequency-based methods as the method is less demanding for the learning algorithms; it is also less computationally expensive than previous network-based methods because the complexity of calculation of most network metrics scales faster than linearly with the number of nodes. The present method is flexible to include other network features for optimizing classification and to find hidden relations among measures. The robustness of results with various classification algorithms supports the reliability of the measures proposed and opens the prospect of finding optimal algorithms and parameter values that further improves classification.

With regard to the failures in classification, we noted that small books in the collection are not the source of wrong classification. We conclude that the mistakes are caused by the variability of style of authors among their books: while for some authors texts are clearly concentrated in a small region of attribute space, the texts from others are scattered. This reflects that some authors use well-defined structures while others change their narrative resources from one text to another. Dimensionality reduction through non-linear feature extraction helped to raise the success rates in classification while linear feature extraction scored worse reflecting the non-trivial relations among the network metrics and the irregular distribution of instances in the attribute space.

Converting networks structural information to series of measures allows one to apply time series analysis to the study of the evolution of network topologies, and in particular, to the way an author uses the structures offered by the language in his/her narrative. Purely dynamical measures, i.e. higher moments of the time series, revealed an aspect hitherto unknown of the close relation between style and network dynamics. An author controls not only the macroscopic structure of the whole text but also the extent to which different metrics can be modified independently, reflecting the richness of language use in terms of co-occurrence networks.

Supporting Information

S1 File. List of books employed in the experiments.

https://doi.org/10.1371/journal.pone.0170527.s001

(PDF)

Acknowledgments

This work was supported by CNPq (Brazil). DRA acknowledges financial support from São Paulo Research Foundation (FAPESP grant no. 2014/20830-0 and 2016/19069-9).

Author Contributions

Conceptualization: CA DRA ONO.
Data curation: CA DRA ONO.
Formal analysis: CA DRA ONO.
Funding acquisition: CA DRA ONO.
Investigation: CA DRA ONO.
Methodology: CA DRA ONO.
Project administration: CA DRA ONO.
Resources: CA DRA ONO.
Software: CA.
Supervision: DRA ONO.
Validation: CA DRA ONO.
Visualization: CA.
Writing – original draft: CA DRA ONO.
Writing – review & editing: CA DRA ONO.

References

1. Xia C, Wang Z, Sanz J, Meloni S, Moreno Y. Effects of delayed recovery and nonuniform transmission on the spreading of diseases in complex networks. Physica A. 2013;392(7):1577–1585.
- View Article
- Google Scholar
2. Xia C, Wang L, Sun S, Wang J. An SIR model with infection delay and propagation vector in complex networks. Nonlinear Dynamics. 2012;69(3):927–934.
- View Article
- Google Scholar
3. Chen M, Wang L, Wang J, Sun S, Xia C. Impact of individual response strategy on the spatial public goods game within mobile agents. Applied Mathematics and Computation. 2015;251:192–202.
- View Article
- Google Scholar
4. Chen M, Wang L, Sun S, Wang J, Xia C. Evolution of cooperation in the spatial public goods game with adaptive reputation assortment. Physics Letters A. 2016;380(1–2):40–47.
- View Article
- Google Scholar
5. Sun S, Wu Y, Ma Y, Wang L, Gao Z, Xia C. Impact of Degree Heterogeneity on Attack Vulnerability of Interdependent Networks. Scientific Reports. 2016;6:32983. pmid:27609483
- View Article
- PubMed/NCBI
- Google Scholar
6. Zipf GK. The psycho-biology of language. Houghton, Mifflin; 1935.
7. Ferrer-i Cancho R, Solé RV. Two Regimes in the Frequency of Words and the Origins of Complex Lexicons: Zipf’s Law Revisited. Journal of Quantitative Linguistics. 2001;8(3):165–173.
- View Article
- Google Scholar
8. Ferrer-i Cancho R, Solé RV. The small world of human language. Proceedings of the Royal Society of London B: Biological Sciences. 2001;268(1482):2261–2265.
- View Article
- Google Scholar
9. Amancio DR, Nunes MGV, Oliveira ON Jr, Costa LF. Using complex networks concepts to assess approaches for citations in scientific papers. Scientometrics. 2012;91(3):827–842.
- View Article
- Google Scholar
10. Amancio DR. A complex network approach to stylometry. PLoS One. 2015;10(8):e0136076. pmid:26313921
- View Article
- PubMed/NCBI
- Google Scholar
11. Masucci A, Kalampokis A, Eguíluz V, Hernández-García E. Extracting directed information flow networks: an application to genetics and semantics. Physical Review E. 2011;83(2):026103.
- View Article
- Google Scholar
12. Masucci AP, Kalampokis A, Eguíluz VM, Hernández-García E. Wikipedia information flow analysis reveals the scale-free architecture of the semantic space. PLoS One. 2011;6(2):e17333. pmid:21407801
- View Article
- PubMed/NCBI
- Google Scholar
13. Kulig A, Drożdż S, Kwapień J, Oświȩcimka P. Modeling the average shortest-path length in growth of word-adjacency networks. Physical Review E. 2015;91(3):032810.
- View Article
- Google Scholar
14. Liang W, Shi Y, Huang Q. Modeling the Chinese language as an evolving network. Physica A: Statistical Mechanics and its Applications. 2014;393:268–276.
- View Article
- Google Scholar
15. Barabási AL, Albert R, Jeong H. Scale-free characteristics of random networks: the topology of the world-wide web. Physica A: Statistical Mechanics and its Applications. 2000;281(1):69–77.
- View Article
- Google Scholar
16. Masucci AP, Stanilov K, Batty M. Limited urban growth: London’s street network dynamics since the 18th century. PLoS One. 2013;8(8):e69469. pmid:23950895
- View Article
- PubMed/NCBI
- Google Scholar
17. Wang P, Lü J, Yu X. Identification of important nodes in directed biological networks: A network motif approach. PLoS One. 2014;9(8):e106132. pmid:25170616
- View Article
- PubMed/NCBI
- Google Scholar
18. Kaiser M, Goerner M, Hilgetag CC. Criticality of spreading dynamics in hierarchical cluster networks without inhibition. New Journal of Physics. 2007;9(5):110.
- View Article
- Google Scholar
19. Newman ME, Park J. Why social networks are different from other types of networks. Physical Review E. 2003;68(3):036122.
- View Article
- Google Scholar
20. Kapatsinski V. Sound similarity relations in the mental lexicon: Modeling the lexicon as a complex network. Speech research Lab Progress Report. 2006;27:133–152.
- View Article
- Google Scholar
21. Mukherjee A, Choudhury M, Basu A, Ganguly N. Modeling the co-occurrence principles of the consonant inventories: A complex network approach. International Journal of Modern Physics C. 2007;18(02):281–295.
- View Article
- Google Scholar
22. Mukherjee A, Choudhury M, Basu A, Ganguly N. Self-organization of the Sound Inventories: Analysis and Synthesis of the Occurrence and Co-occurrence Networks of Consonants. Journal of Quantitative Linguistics. 2009;16(2):157–184.
- View Article
- Google Scholar
23. Li J, Zhou J. Chinese character structure analysis based on complex networks. Physica A: Statistical Mechanics and its Applications. 2007;380:629–638.
- View Article
- Google Scholar
24. Sigman M, Cecchi GA. Global organization of the Wordnet lexicon. Proceedings of the National Academy of Sciences. 2002;99(3):1742–1747.
- View Article
- Google Scholar
25. Ferrer-i Cancho R. A stronger null hypothesis for crossing dependencies. EPL (Europhysics Letters). 2014;108(5):58003.
- View Article
- Google Scholar
26. Ferrer-i Cancho R, Solé RV, Köhler R. Patterns in syntactic dependency networks. Physical Review E. 2004;69(5):051915.
- View Article
- Google Scholar
27. Corominas-Murtra B, Valverde S, Sole R. The ontogeny of scale-free syntax networks: phase transitions in early language acquisition. Advances in Complex Systems. 2009;12(03):371–392.
- View Article
- Google Scholar
28. Choudhury M, Chatterjee D, Mukherjee A. Global topology of word co-occurrence networks: Beyond the two-regime power-law. In: Proceedings of the 23rd International Conference on Computational Linguistics: Posters. Association for Computational Linguistics; 2010. p. 162–170.
29. Barabási AL, Albert R. Emergence of scaling in random networks. science. 1999;286(5439):509–512. pmid:10521342
- View Article
- PubMed/NCBI
- Google Scholar
30. Dorogovtsev SN, Mendes JFF. Language as an evolving word web. Proceedings of the Royal Society of London B: Biological Sciences. 2001;268(1485):2603–2606.
- View Article
- Google Scholar
31. Biemann C, Quasthoff U. Networks generated from natural language text. In: Dynamics on and of Complex Networks. Springer; 2009. p. 167–185.
32. Gao Y, Liang W, Shi Y, Huang Q. Comparison of directed and weighted co-occurrence networks of six languages. Physica A: Statistical Mechanics and its Applications. 2014;393:579–589.
- View Article
- Google Scholar
33. Amancio DR. Authorship recognition via fluctuation analysis of network topology and word intermittency. Journal of Statistical Mechanics: Theory and Experiment. 2015;(3):P03005.
- View Article
- Google Scholar
34. Amancio DR, Altmann EG, Oliveira ON Jr, da Fontoura Costa L. Comparing intermittency and network measurements of words and their dependence on authorship. New Journal of Physics. 2011;13(12):123024.
- View Article
- Google Scholar
35. Stamatatos E. A survey of modern authorship attribution methods. Journal of the American Society for information Science and Technology. 2009;60(3):538–556.
- View Article
- Google Scholar
36. Basile C, Benedetto D, Caglioti E, Degli Esposti M. An example of mathematical authorship attribution. Journal of Mathematical Physics. 2008;49(12):125211.
- View Article
- Google Scholar
37. Chaski CE. Who’s at the keyboard? Authorship attribution in digital evidence investigations. International journal of digital evidence. 2005;4(1):1–13.
- View Article
- Google Scholar
38. Abbasi A, Chen H. Applying authorship analysis to extremist-group web forum messages. IEEE Intelligent Systems. 2005;20(5):67–75.
- View Article
- Google Scholar
39. Mosteller F, Wallace D. Inference and disputed authorship: The Federalist. Addison-Wesley; 1964.
40. Havlin S. The distance between Zipf plots. Physica A: Statistical Mechanics and its Applications. 1995;216(1):148–150.
- View Article
- Google Scholar
41. Pomi A, Mizraji E. Semantic graphs and associative memories. Physical review E. 2004;70(6):066136.
- View Article
- Google Scholar
42. Liang W, Shi Y, Chi KT, Liu J, Wang Y, Cui X. Comparison of co-occurrence networks of the Chinese and English languages. Physica A: Statistical Mechanics and its Applications. 2009;388(23):4901–4909.
- View Article
- Google Scholar
43. Amancio DR, Aluisio SM, Oliveira ON Jr, Costa LF. Complex networks analysis of language complexity. EPL (Europhysics Letters). 2012;100(5):58002.
- View Article
- Google Scholar
44. Martinez-Romo J, Araujo L, Borge-Holthoefer J, Arenas A, Capitán JA, Cuesta JA. Disentangling categorical relationships through a graph of co-occurrences. Physical Review E. 2011;84(4):046108.
- View Article
- Google Scholar
45. Liu H, Cong J. Language clustering with word co-occurrence networks based on parallel texts. Chinese Science Bulletin. 2013;58(10):1139–1144.
- View Article
- Google Scholar
46. Segarra S, Eisen M, Ribeiro A. Authorship attribution using function words adjacency networks. In: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE; 2013. p. 5563–5567.
47. Amancio DR, Oliveira ON Jr, Costa LF. Three-feature model to reproduce the topology of citation networks and the effects from authors’ visibility on their h-index. Journal of Informetrics. 2012;6(3):427–434.
- View Article
- Google Scholar
48. Newman M. Networks: an introduction. Oxford University Press; 2010.
49. Gao ZK, Cai Q, Yang YX, Dang WD, Zhang SS. Multiscale limited penetrable horizontal visibility graph for analyzing nonlinear time series. Scientific Reports. 2016;6:35622. pmid:27759088
- View Article
- PubMed/NCBI
- Google Scholar
50. Gao ZK, Yang YX, Fang PC, Zou Y, Xia CY, Du M. Multiscale complex network for analyzing experimental multivariate time series. EPL (Europhysics Letters). 2015;109(3):30005.
- View Article
- Google Scholar
51. Gao ZK, Fang PC, Ding MS, Jin ND. Multivariate weighted complex network analysis for characterizing nonlinear dynamic behavior in two-phase flow. Experimental Thermal and Fluid Science. 2015;60:157–164.
- View Article
- Google Scholar
52. Gao ZK, Jin ND. A directed weighted complex network for characterizing chaotic dynamics from time series. Nonlinear Analysis: Real World Applications. 2012;13(2):947–952.
- View Article
- Google Scholar
53. Ghanbarnejad F, Gerlach M, Miotto JM, Altmann EG. Extracting information from S-curves of language change. Journal of The Royal Society Interface. 2014;11(101).
- View Article
- Google Scholar
54. Cong J, Liu H. Approaching human language with complex networks. Physics of life reviews. 2014;11(4):598–618. pmid:24794524
- View Article
- PubMed/NCBI
- Google Scholar
55. Greene BB, Rubin GM. Automatic grammatical tagging of English. Department of Linguistics, Brown University; 1971.
56. Viana MP, Amancio DR, Costa LF. On time-varying collaboration networks. Journal of Informetrics. 2013;7(2):371–378.
- View Article
- Google Scholar
57. Roxas RM, Tapang G. Prose and poetry classification and boundary detection using word adjacency network analysis. International Journal of Modern Physics C. 2010;21(04):503–512.
- View Article
- Google Scholar
58. Berryman M, Allison A, Abbott D. Statistical techniques for text classification based on word recurrence intervals. Fluctuation and Noise Letters. 2003;3(01):L1–L10.
- View Article
- Google Scholar
59. Kwiatkowski D, Phillips PC, Schmidt P, Shin Y. Testing the null hypothesis of stationarity against the alternative of a unit root: How sure are we that economic time series have a unit root? Journal of econometrics. 1992;54(1–3):159–178.
- View Article
- Google Scholar
60. Said SE, Dickey DA. Testing for unit roots in autoregressive-moving average models of unknown order. Biometrika. 1984;71(3):599–607.
- View Article
- Google Scholar
61. Phillips PC, Perron P. Testing for a unit root in time series regression. Biometrika. 1988;75(2):335–346.
- View Article
- Google Scholar
62. MacKinnon JG. Numerical distribution functions for unit root and cointegration tests. Journal of applied econometrics. 1996; p. 601–618.
- View Article
- Google Scholar
63. Witten IH, Frank E. Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann; 2005.
64. Tenenbaum JB, De Silva V, Langford JC. A global geometric framework for nonlinear dimensionality reduction. science. 2000;290(5500):2319–2323. pmid:11125149
- View Article
- PubMed/NCBI
- Google Scholar
65. Paulovich FV, Oliveira MCF, Minghim R. The projection explorer: A flexible tool for projection-based multidimensional visualization. In: Computer Graphics and Image Processing, 2007. SIBGRAPI 2007. XX Brazilian Symposium on. IEEE; 2007. p. 27–36.
66. Amancio DR, Comin CH, Casanova D, Travieso G, Bruno OM, Rodrigues FA, et al. A systematic comparison of supervised classifiers. PLoS One. 2014;9(4):e94137. pmid:24763312
- View Article
- PubMed/NCBI
- Google Scholar
67. Gao ZK, Cai Q, Yang YX, Dong N, Zhang SS. Visibility Graph from Adaptive Optimal Kernel Time-Frequency Representation for Classification of Epileptiform EEG. International Journal of Neural Systems. 2017; p. 1750005.
- View Article
- Google Scholar
68. Wong TT. Performance evaluation of classification algorithms by k-fold and leave-one-out cross validation. Pattern Recognition. 2015;48(9):2839–2846.
- View Article
- Google Scholar
69. Silva TC, Amancio DR. Word sense disambiguation via high order of learning in complex networks. EPL (Europhysics Letters). 2012;98(5):58001.
- View Article
- Google Scholar
70. Li Q, Salman R, Test E, Strack R, Kecman V. Parallel multitask cross validation for Support Vector Machine using {GPU}. Journal of Parallel and Distributed Computing. 2013;73(3):293–302.
- View Article
- Google Scholar
71. Mehri A, Darooneh AH, Shariati A. The complex networks approach for authorship attribution of books. Physica A: Statistical Mechanics and its Applications. 2012;391(7):2429–2437.
- View Article
- Google Scholar
72. Yang MH. Extended Isomap for Pattern Classification. In: Eighteenth National Conference on Artificial Intelligence. Menlo Park, CA, USA: American Association for Artificial Intelligence; 2002. p. 224–229.
73. Samko O, Marshall AD, Rosin PL. Selection of the Optimal Parameter Value for the Isomap Algorithm. Pattern Recogn Lett. 2006;27(9):968–979.
- View Article
- Google Scholar
74. Argamon S, Juola P. Overview of the International Authorship Identification Competition at PAN-2011. In: CLEF (Notebook Papers/Labs/Workshop); 2011.
75. Brennan MR, Greenstadt R. Practical Attacks Against Authorship Recognition Techniques. In: IAAI. AAAI; 2009.
76. Juola P, Vescovi D. In: Analyzing Stylometric Approaches to Author Obfuscation. Berlin, Heidelberg: Springer Berlin Heidelberg; 2011. p. 115–125.

[ref1] 1. Xia C, Wang Z, Sanz J, Meloni S, Moreno Y. Effects of delayed recovery and nonuniform transmission on the spreading of diseases in complex networks. Physica A. 2013;392(7):1577–1585.
View Article
Google Scholar

[2] View Article

[3] Google Scholar

[ref2] 2. Xia C, Wang L, Sun S, Wang J. An SIR model with infection delay and propagation vector in complex networks. Nonlinear Dynamics. 2012;69(3):927–934.
View Article
Google Scholar

[5] View Article

[6] Google Scholar

[ref3] 3. Chen M, Wang L, Wang J, Sun S, Xia C. Impact of individual response strategy on the spatial public goods game within mobile agents. Applied Mathematics and Computation. 2015;251:192–202.
View Article
Google Scholar

[8] View Article

[9] Google Scholar

[ref4] 4. Chen M, Wang L, Sun S, Wang J, Xia C. Evolution of cooperation in the spatial public goods game with adaptive reputation assortment. Physics Letters A. 2016;380(1–2):40–47.
View Article
Google Scholar

[11] View Article

[12] Google Scholar

[ref5] 5. Sun S, Wu Y, Ma Y, Wang L, Gao Z, Xia C. Impact of Degree Heterogeneity on Attack Vulnerability of Interdependent Networks. Scientific Reports. 2016;6:32983. pmid:27609483
View Article
PubMed/NCBI
Google Scholar

[14] View Article

[15] PubMed/NCBI

[16] Google Scholar

[ref6] 6. Zipf GK. The psycho-biology of language. Houghton, Mifflin; 1935.

[ref7] 7. Ferrer-i Cancho R, Solé RV. Two Regimes in the Frequency of Words and the Origins of Complex Lexicons: Zipf’s Law Revisited. Journal of Quantitative Linguistics. 2001;8(3):165–173.
View Article
Google Scholar

[19] View Article

[20] Google Scholar

[ref8] 8. Ferrer-i Cancho R, Solé RV. The small world of human language. Proceedings of the Royal Society of London B: Biological Sciences. 2001;268(1482):2261–2265.
View Article
Google Scholar

[22] View Article

[23] Google Scholar

[ref9] 9. Amancio DR, Nunes MGV, Oliveira ON Jr, Costa LF. Using complex networks concepts to assess approaches for citations in scientific papers. Scientometrics. 2012;91(3):827–842.
View Article
Google Scholar

[25] View Article

[26] Google Scholar

[ref10] 10. Amancio DR. A complex network approach to stylometry. PLoS One. 2015;10(8):e0136076. pmid:26313921
View Article
PubMed/NCBI
Google Scholar

[28] View Article

[29] PubMed/NCBI

[30] Google Scholar

[ref11] 11. Masucci A, Kalampokis A, Eguíluz V, Hernández-García E. Extracting directed information flow networks: an application to genetics and semantics. Physical Review E. 2011;83(2):026103.
View Article
Google Scholar

[32] View Article

[33] Google Scholar

[ref12] 12. Masucci AP, Kalampokis A, Eguíluz VM, Hernández-García E. Wikipedia information flow analysis reveals the scale-free architecture of the semantic space. PLoS One. 2011;6(2):e17333. pmid:21407801
View Article
PubMed/NCBI
Google Scholar

[35] View Article

[36] PubMed/NCBI

[37] Google Scholar

[ref13] 13. Kulig A, Drożdż S, Kwapień J, Oświȩcimka P. Modeling the average shortest-path length in growth of word-adjacency networks. Physical Review E. 2015;91(3):032810.
View Article
Google Scholar

[39] View Article

[40] Google Scholar

[ref14] 14. Liang W, Shi Y, Huang Q. Modeling the Chinese language as an evolving network. Physica A: Statistical Mechanics and its Applications. 2014;393:268–276.
View Article
Google Scholar

[42] View Article

[43] Google Scholar

[ref15] 15. Barabási AL, Albert R, Jeong H. Scale-free characteristics of random networks: the topology of the world-wide web. Physica A: Statistical Mechanics and its Applications. 2000;281(1):69–77.
View Article
Google Scholar

[45] View Article

[46] Google Scholar

[ref16] 16. Masucci AP, Stanilov K, Batty M. Limited urban growth: London’s street network dynamics since the 18th century. PLoS One. 2013;8(8):e69469. pmid:23950895
View Article
PubMed/NCBI
Google Scholar

[48] View Article

[49] PubMed/NCBI

[50] Google Scholar

[ref17] 17. Wang P, Lü J, Yu X. Identification of important nodes in directed biological networks: A network motif approach. PLoS One. 2014;9(8):e106132. pmid:25170616
View Article
PubMed/NCBI
Google Scholar

[52] View Article

[53] PubMed/NCBI

[54] Google Scholar

[ref18] 18. Kaiser M, Goerner M, Hilgetag CC. Criticality of spreading dynamics in hierarchical cluster networks without inhibition. New Journal of Physics. 2007;9(5):110.
View Article
Google Scholar

[56] View Article

[57] Google Scholar

[ref19] 19. Newman ME, Park J. Why social networks are different from other types of networks. Physical Review E. 2003;68(3):036122.
View Article
Google Scholar

[59] View Article

[60] Google Scholar

[ref20] 20. Kapatsinski V. Sound similarity relations in the mental lexicon: Modeling the lexicon as a complex network. Speech research Lab Progress Report. 2006;27:133–152.
View Article
Google Scholar

[62] View Article

[63] Google Scholar

[ref21] 21. Mukherjee A, Choudhury M, Basu A, Ganguly N. Modeling the co-occurrence principles of the consonant inventories: A complex network approach. International Journal of Modern Physics C. 2007;18(02):281–295.
View Article
Google Scholar

[65] View Article

[66] Google Scholar

[ref22] 22. Mukherjee A, Choudhury M, Basu A, Ganguly N. Self-organization of the Sound Inventories: Analysis and Synthesis of the Occurrence and Co-occurrence Networks of Consonants. Journal of Quantitative Linguistics. 2009;16(2):157–184.
View Article
Google Scholar

[68] View Article

[69] Google Scholar

[ref23] 23. Li J, Zhou J. Chinese character structure analysis based on complex networks. Physica A: Statistical Mechanics and its Applications. 2007;380:629–638.
View Article
Google Scholar

[71] View Article

[72] Google Scholar

[ref24] 24. Sigman M, Cecchi GA. Global organization of the Wordnet lexicon. Proceedings of the National Academy of Sciences. 2002;99(3):1742–1747.
View Article
Google Scholar

[74] View Article

[75] Google Scholar

[ref25] 25. Ferrer-i Cancho R. A stronger null hypothesis for crossing dependencies. EPL (Europhysics Letters). 2014;108(5):58003.
View Article
Google Scholar

[77] View Article

[78] Google Scholar

[ref26] 26. Ferrer-i Cancho R, Solé RV, Köhler R. Patterns in syntactic dependency networks. Physical Review E. 2004;69(5):051915.
View Article
Google Scholar

[80] View Article

[81] Google Scholar

[ref27] 27. Corominas-Murtra B, Valverde S, Sole R. The ontogeny of scale-free syntax networks: phase transitions in early language acquisition. Advances in Complex Systems. 2009;12(03):371–392.
View Article
Google Scholar

[83] View Article

[84] Google Scholar

[ref28] 28. Choudhury M, Chatterjee D, Mukherjee A. Global topology of word co-occurrence networks: Beyond the two-regime power-law. In: Proceedings of the 23rd International Conference on Computational Linguistics: Posters. Association for Computational Linguistics; 2010. p. 162–170.

[ref29] 29. Barabási AL, Albert R. Emergence of scaling in random networks. science. 1999;286(5439):509–512. pmid:10521342
View Article
PubMed/NCBI
Google Scholar

[87] View Article

[88] PubMed/NCBI

[89] Google Scholar

[ref30] 30. Dorogovtsev SN, Mendes JFF. Language as an evolving word web. Proceedings of the Royal Society of London B: Biological Sciences. 2001;268(1485):2603–2606.
View Article
Google Scholar

[91] View Article

[92] Google Scholar

[ref31] 31. Biemann C, Quasthoff U. Networks generated from natural language text. In: Dynamics on and of Complex Networks. Springer; 2009. p. 167–185.

[ref32] 32. Gao Y, Liang W, Shi Y, Huang Q. Comparison of directed and weighted co-occurrence networks of six languages. Physica A: Statistical Mechanics and its Applications. 2014;393:579–589.
View Article
Google Scholar

[95] View Article

[96] Google Scholar

[ref33] 33. Amancio DR. Authorship recognition via fluctuation analysis of network topology and word intermittency. Journal of Statistical Mechanics: Theory and Experiment. 2015;(3):P03005.
View Article
Google Scholar

[98] View Article

[99] Google Scholar

[ref34] 34. Amancio DR, Altmann EG, Oliveira ON Jr, da Fontoura Costa L. Comparing intermittency and network measurements of words and their dependence on authorship. New Journal of Physics. 2011;13(12):123024.
View Article
Google Scholar

[101] View Article

[102] Google Scholar

[ref35] 35. Stamatatos E. A survey of modern authorship attribution methods. Journal of the American Society for information Science and Technology. 2009;60(3):538–556.
View Article
Google Scholar

[104] View Article

[105] Google Scholar

[ref36] 36. Basile C, Benedetto D, Caglioti E, Degli Esposti M. An example of mathematical authorship attribution. Journal of Mathematical Physics. 2008;49(12):125211.
View Article
Google Scholar

[107] View Article

[108] Google Scholar

[ref37] 37. Chaski CE. Who’s at the keyboard? Authorship attribution in digital evidence investigations. International journal of digital evidence. 2005;4(1):1–13.
View Article
Google Scholar

[110] View Article

[111] Google Scholar

[ref38] 38. Abbasi A, Chen H. Applying authorship analysis to extremist-group web forum messages. IEEE Intelligent Systems. 2005;20(5):67–75.
View Article
Google Scholar

[113] View Article

[114] Google Scholar

[ref39] 39. Mosteller F, Wallace D. Inference and disputed authorship: The Federalist. Addison-Wesley; 1964.

[ref40] 40. Havlin S. The distance between Zipf plots. Physica A: Statistical Mechanics and its Applications. 1995;216(1):148–150.
View Article
Google Scholar

[117] View Article

[118] Google Scholar

[ref41] 41. Pomi A, Mizraji E. Semantic graphs and associative memories. Physical review E. 2004;70(6):066136.
View Article
Google Scholar

[120] View Article

[121] Google Scholar

[ref42] 42. Liang W, Shi Y, Chi KT, Liu J, Wang Y, Cui X. Comparison of co-occurrence networks of the Chinese and English languages. Physica A: Statistical Mechanics and its Applications. 2009;388(23):4901–4909.
View Article
Google Scholar

[123] View Article

[124] Google Scholar

[ref43] 43. Amancio DR, Aluisio SM, Oliveira ON Jr, Costa LF. Complex networks analysis of language complexity. EPL (Europhysics Letters). 2012;100(5):58002.
View Article
Google Scholar

[126] View Article

[127] Google Scholar

[ref44] 44. Martinez-Romo J, Araujo L, Borge-Holthoefer J, Arenas A, Capitán JA, Cuesta JA. Disentangling categorical relationships through a graph of co-occurrences. Physical Review E. 2011;84(4):046108.
View Article
Google Scholar

[129] View Article

[130] Google Scholar

[ref45] 45. Liu H, Cong J. Language clustering with word co-occurrence networks based on parallel texts. Chinese Science Bulletin. 2013;58(10):1139–1144.
View Article
Google Scholar

[132] View Article

[133] Google Scholar

[ref46] 46. Segarra S, Eisen M, Ribeiro A. Authorship attribution using function words adjacency networks. In: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing. IEEE; 2013. p. 5563–5567.

[ref47] 47. Amancio DR, Oliveira ON Jr, Costa LF. Three-feature model to reproduce the topology of citation networks and the effects from authors’ visibility on their h-index. Journal of Informetrics. 2012;6(3):427–434.
View Article
Google Scholar

[136] View Article

[137] Google Scholar

[ref48] 48. Newman M. Networks: an introduction. Oxford University Press; 2010.

[ref49] 49. Gao ZK, Cai Q, Yang YX, Dang WD, Zhang SS. Multiscale limited penetrable horizontal visibility graph for analyzing nonlinear time series. Scientific Reports. 2016;6:35622. pmid:27759088
View Article
PubMed/NCBI
Google Scholar

[140] View Article

[141] PubMed/NCBI

[142] Google Scholar

[ref50] 50. Gao ZK, Yang YX, Fang PC, Zou Y, Xia CY, Du M. Multiscale complex network for analyzing experimental multivariate time series. EPL (Europhysics Letters). 2015;109(3):30005.
View Article
Google Scholar

[144] View Article

[145] Google Scholar

[ref51] 51. Gao ZK, Fang PC, Ding MS, Jin ND. Multivariate weighted complex network analysis for characterizing nonlinear dynamic behavior in two-phase flow. Experimental Thermal and Fluid Science. 2015;60:157–164.
View Article
Google Scholar

[147] View Article

[148] Google Scholar

[ref52] 52. Gao ZK, Jin ND. A directed weighted complex network for characterizing chaotic dynamics from time series. Nonlinear Analysis: Real World Applications. 2012;13(2):947–952.
View Article
Google Scholar

[150] View Article

[151] Google Scholar

[ref53] 53. Ghanbarnejad F, Gerlach M, Miotto JM, Altmann EG. Extracting information from S-curves of language change. Journal of The Royal Society Interface. 2014;11(101).
View Article
Google Scholar

[153] View Article

[154] Google Scholar

[ref54] 54. Cong J, Liu H. Approaching human language with complex networks. Physics of life reviews. 2014;11(4):598–618. pmid:24794524
View Article
PubMed/NCBI
Google Scholar

[156] View Article

[157] PubMed/NCBI

[158] Google Scholar

[ref55] 55. Greene BB, Rubin GM. Automatic grammatical tagging of English. Department of Linguistics, Brown University; 1971.

[ref56] 56. Viana MP, Amancio DR, Costa LF. On time-varying collaboration networks. Journal of Informetrics. 2013;7(2):371–378.
View Article
Google Scholar

[161] View Article

[162] Google Scholar

[ref57] 57. Roxas RM, Tapang G. Prose and poetry classification and boundary detection using word adjacency network analysis. International Journal of Modern Physics C. 2010;21(04):503–512.
View Article
Google Scholar

[164] View Article

[165] Google Scholar

[ref58] 58. Berryman M, Allison A, Abbott D. Statistical techniques for text classification based on word recurrence intervals. Fluctuation and Noise Letters. 2003;3(01):L1–L10.
View Article
Google Scholar

[167] View Article

[168] Google Scholar

[ref59] 59. Kwiatkowski D, Phillips PC, Schmidt P, Shin Y. Testing the null hypothesis of stationarity against the alternative of a unit root: How sure are we that economic time series have a unit root? Journal of econometrics. 1992;54(1–3):159–178.
View Article
Google Scholar

[170] View Article

[171] Google Scholar

[ref60] 60. Said SE, Dickey DA. Testing for unit roots in autoregressive-moving average models of unknown order. Biometrika. 1984;71(3):599–607.
View Article
Google Scholar

[173] View Article

[174] Google Scholar

[ref61] 61. Phillips PC, Perron P. Testing for a unit root in time series regression. Biometrika. 1988;75(2):335–346.
View Article
Google Scholar

[176] View Article

[177] Google Scholar

[ref62] 62. MacKinnon JG. Numerical distribution functions for unit root and cointegration tests. Journal of applied econometrics. 1996; p. 601–618.
View Article
Google Scholar

[179] View Article

[180] Google Scholar

[ref63] 63. Witten IH, Frank E. Data Mining: Practical machine learning tools and techniques. Morgan Kaufmann; 2005.

[ref64] 64. Tenenbaum JB, De Silva V, Langford JC. A global geometric framework for nonlinear dimensionality reduction. science. 2000;290(5500):2319–2323. pmid:11125149
View Article
PubMed/NCBI
Google Scholar

[183] View Article

[184] PubMed/NCBI

[185] Google Scholar

[ref65] 65. Paulovich FV, Oliveira MCF, Minghim R. The projection explorer: A flexible tool for projection-based multidimensional visualization. In: Computer Graphics and Image Processing, 2007. SIBGRAPI 2007. XX Brazilian Symposium on. IEEE; 2007. p. 27–36.

[ref66] 66. Amancio DR, Comin CH, Casanova D, Travieso G, Bruno OM, Rodrigues FA, et al. A systematic comparison of supervised classifiers. PLoS One. 2014;9(4):e94137. pmid:24763312
View Article
PubMed/NCBI
Google Scholar

[188] View Article

[189] PubMed/NCBI

[190] Google Scholar

[ref67] 67. Gao ZK, Cai Q, Yang YX, Dong N, Zhang SS. Visibility Graph from Adaptive Optimal Kernel Time-Frequency Representation for Classification of Epileptiform EEG. International Journal of Neural Systems. 2017; p. 1750005.
View Article
Google Scholar

[192] View Article

[193] Google Scholar

[ref68] 68. Wong TT. Performance evaluation of classification algorithms by k-fold and leave-one-out cross validation. Pattern Recognition. 2015;48(9):2839–2846.
View Article
Google Scholar

[195] View Article

[196] Google Scholar

[ref69] 69. Silva TC, Amancio DR. Word sense disambiguation via high order of learning in complex networks. EPL (Europhysics Letters). 2012;98(5):58001.
View Article
Google Scholar

[198] View Article

[199] Google Scholar

[ref70] 70. Li Q, Salman R, Test E, Strack R, Kecman V. Parallel multitask cross validation for Support Vector Machine using {GPU}. Journal of Parallel and Distributed Computing. 2013;73(3):293–302.
View Article
Google Scholar

[201] View Article

[202] Google Scholar

[ref71] 71. Mehri A, Darooneh AH, Shariati A. The complex networks approach for authorship attribution of books. Physica A: Statistical Mechanics and its Applications. 2012;391(7):2429–2437.
View Article
Google Scholar

[204] View Article

[205] Google Scholar

[ref72] 72. Yang MH. Extended Isomap for Pattern Classification. In: Eighteenth National Conference on Artificial Intelligence. Menlo Park, CA, USA: American Association for Artificial Intelligence; 2002. p. 224–229.

[ref73] 73. Samko O, Marshall AD, Rosin PL. Selection of the Optimal Parameter Value for the Isomap Algorithm. Pattern Recogn Lett. 2006;27(9):968–979.
View Article
Google Scholar

[208] View Article

[209] Google Scholar

[ref74] 74. Argamon S, Juola P. Overview of the International Authorship Identification Competition at PAN-2011. In: CLEF (Notebook Papers/Labs/Workshop); 2011.

[ref75] 75. Brennan MR, Greenstadt R. Practical Attacks Against Authorship Recognition Techniques. In: IAAI. AAAI; 2009.

[ref76] 76. Juola P, Vescovi D. In: Analyzing Stylometric Approaches to Author Obfuscation. Berlin, Heidelberg: Springer Berlin Heidelberg; 2011. p. 115–125.

Figures

Abstract

1 Introduction

2 Methods

Modeling texts as co-occurrence networks

Characterization of written texts via network dynamics

Data analysis

3 Results and Discussion

4 Conclusion

Supporting Information

S1 File. List of books employed in the experiments.

Acknowledgments

Author Contributions

References