Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Morphometric approach to 3D soft-tissue craniofacial analysis and classification of ethnicity, sex, and age

  • Olalekan Agbolade,

    Roles Conceptualization, Methodology, Visualization, Writing – original draft

    Affiliation Department of Computer Science, Faculty of Computer Science & IT, Universiti Putra Malaysia, Seri Kembangan, Selangor, Malaysia

  • Azree Nazri ,

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Supervision, Writing – review & editing

    azree@upm.edu.my

    Affiliation Department of Computer Science, Faculty of Computer Science & IT, Universiti Putra Malaysia, Seri Kembangan, Selangor, Malaysia

  • Razali Yaakob,

    Roles Investigation, Supervision, Writing – review & editing

    Affiliation Department of Computer Science, Faculty of Computer Science & IT, Universiti Putra Malaysia, Seri Kembangan, Selangor, Malaysia

  • Abdul Azim Ghani,

    Roles Formal analysis, Supervision, Writing – review & editing

    Affiliation Department of Software Engineering, Faculty of Computer Science & IT, Universiti Putra Malaysia, Seri Kembangan, Selangor, Malaysia

  • Yoke Kqueen Cheah

    Roles Investigation, Supervision, Validation

    Affiliation Department of Biomedical Science, Faculty of Medicine and Health Sciences, Universiti Putra Malaysia, Seri Kembangan, Selangor, Malaysia

Abstract

Background

The application of three-dimensional scan models offers a useful resource for studying craniofacial variation. The complex mathematical analysis for facial point acquisition in three-dimensional models has made many craniofacial assessments laborious.

Method

This study investigates three-dimensional (3D) soft-tissue craniofacial variation, with relation to ethnicity, sex and age variables in British and Irish white Europeans. This utilizes a geometric morphometric approach on a subsampled dataset comprising 292 scans, taken from a Liverpool-York Head Model database. Shape variation and analysis of each variable are tested using 20 anchor anatomical landmarks and 480 sliding semi-landmarks.

Results

Significant ethnicity, sex, and age differences are observed for measurement covering major aspects of the craniofacial shape. The ethnicity shows subtle significant differences compared to sex and age; even though it presents the lowest classification accuracy. The magnitude of dimorphism in sex is revealed in the facial, nasal and crania measurement. Significant shape differences are also seen at each age group, with some distinct dimorphic features present in the age groups.

Conclusions

The patterns of shape variation show that white British individuals have a more rounded head shape, whereas white Irish individuals have a narrower head shape. White British persons also demonstrate higher classification accuracy. Regarding sex patterns, males are relatively larger than females, especially in the mouth and nasal regions. Females presented with higher classification accuracy than males. The differences in the chin, mouth, nose, crania, and forehead emerge from different growth rates between the groups. Classification accuracy is best for children and senior adult age groups.

Introduction

Morphometrics is the study of shape variation and its covariation with other variables [1,2]. According to Dean et al. [3], morphometrics was traditionally the application of multivariate statistical analyses to a set of quantitative variables such as length, width, height and, angle. But advances in morphometrics have shifted focus to the Cartesian coordinates of anatomical points that might be used to define more traditional measurements. Morphometrics examines shape variation, group differences in shape, the central tendency of shape, and associations of shape with extrinsic factors [4]. The latest approach to shape analyses is geometric morphometric. This is directly based on the digitized x,y,z-coordinate positions of landmarks, points representing the spatial positions of putatively homologous structures in two- or three-dimensions; whereas conventional morphometric studies utilize distances as variables [1,2,5].

A flexible and mathematically rigorous interpolation technique of D’Arcy Thompson’s transformation grids [6], called thin plate-spline (TPS), was brought into morphometrics. This ensures that the corresponding points of the starting and target form appear precisely in corresponding positions in relation to the transformed and untransformed grids [7]. With the application of iterative closest point (ICP) method, landmark correspondence can iteratively be registered in the vicinity of a landmark with a re-weighted error function. This computes the amount of deformation between two shape configurations as quantified by TPS function through the integral of the squared second derivatives of that deformation [8]. The use of three-dimensional head and face images in morphometrics does not only give room to cover a wider area of the human craniofacial region but also retains all the geometric information of the object descriptors [9,10].

Craniofacial measurement traditionally has reliance on simple distances and angles between anatomical landmarks. These give only a limited representation of the surface under study [11]. Advances in three-dimensional image analysis have now achieved rapid, automatic measurement of the entire outer surface of the craniofacial soft-tissue [12,13].

Characterizing human craniofacial shape for ethnicity classification, sex dimorphism, and age estimation is of interest to numerous fields, including forensics [14], anthropology [15,16], cognitive science [17,18], and orthodontics [19,20]. Study of adult face shape in population samples with mixed West African and European ancestry from three locations by [21] estimated ethnicity for only 9.6% of shape variation, while sex differences accounted for 12.9% of shape variation among individuals. This multifactorial craniofacial shape differences result from a combination of hormonal influences and inherent genetic factors [22]. An ethnicity classification was applied in public health by [23] to subdivide populations into groups of common origin. They presented a positive predicted value between 0.70 and 0.96, and a negative predicted value between 0.96 and 1. Ethnicity and gender identifications were investigated using multimodal Asian and Non-Asian faces by [24],exploring two modalities of human faces: intensity and range. The range provided an effective capability for the classification. Asides ancestry or ethnicity classification, many studies have been carried out involving sexual dimorphism in the craniofacial soft tissue of children [11,25], young adults [19,26,27] and adults [18,21,28]. The consensus from the studies is that male faces are larger and characterized by more prominent nasal, chin, and forehead regions.

However, there is a limitation of amalgamated data from mixed ages to create a single classification model or a single pair of prototypes [11]. Age estimation is usually approached as a classification or regression problem by prediction of age or age group from an image in computer vision [11]. Prediction of age and other traits from 3D shape was done by [29], by systematically adjusting the input image until its predicted age matched a target age. Also, simulated 3D facial ageing by caricaturing was carried out by [30,31].

However, since a big part of biological variability cannot be assessed by using only anatomical landmarks [32], in order to quantify complex shapes, sliding semi-landmarks were developed which could be placed on surfaces [33] or curves [1,33]. This approach generates landmarks that are spatially homologous after sliding [34], which can be optimized by minimizing the bending energy [35,36] or the Procrustes distance [37,38]. As the human face hosts features that act as a central interface for identification, more landmarks are needed to characterize biological shape variation [32]. Due to this, we have characterized biological shape variation for ethnicity, sex, and age using a total of 500 three dimensional landmarks, which incorporate sliding semi-landmarks to promote a computationally efficient workflow.

The aim of this study was to first extend the computational deformation process by [7]. Surface semi-landmarks were projected from the template object to the target object. As an alternative to the complex workflow demonstrated by [32], a simpler workflow was presented using Viewbox 4.0, which iteratively slid the semi-landmark to a relaxed point. Secondly, the landmark data acquired was further analysed to independently investigate the shape and size of variation between ethnicity, sex, and age groups using principal component analysis (PCA) for dimensionality reduction and features selection. Thirdly, anthropometric measurement was further performed using Euclidean Distance Matrix Analysis (EDMA) to measure the length of the line segment connecting selected anatomical points and localize the site of major variations in the sample groups. Fourthly, allometry was examined for each group separately to investigate effect of size unto shape. Lastly, the features selected were further used for classification using discriminant analysis.

Materials and methods

For ethics approval, the use of human subjects was approved by the committee in charge of the Liverpool-York Head Model in Alder Hey Craniofacial Unit, Liverpool, UK. Therefore, there is no institutional review board approval required to use the public dataset, asides the user license agreement signed between the two parties. Regarding the use of subjects, we have contacted the head of data access committee of the dataset for more clarifications. He clarified that there is no restriction on the use of any or all the subjects under the CC-BY license and also that all subjects signed forms with consent to publish.

Dataset and description

This study used a randomly selected sub-sample of 292 (white British = 234, white Irish = 58) craniofacial images from the Headspace dataset. Only white British and white Irish descent, all of whom are wearing tight-fitting latex caps [39] are sub-sampled. A 3dMD five-camera system was used to create a 3D triangular surface for each subject composed of typically 180K vertices and 360K triangles acquired at Alder Hey Hospital, Liverpool. The dataset metadata is comprised of ethnicity, sex, age, eye color, and any craniofacial surgery/trauma condition. This is the first public shape and texture 3D morphable model of the full human head called Liverpool-York Head Model (LYHM) [39]. These particular ethnicities’ demographics are chosen because of their morphological characteristics. The two populations selected also have the highest sample sizes which could be used to morphometrically characterise shape variation. Table 1 presents the full details of the demographic information of the sub-sample dataset. The age class in years is sub-divided into five categories: children (below 13 years), teenagers (13–19 years), young adults (20–29 years), adults (30–49 years), and senior adults (50 years and above).

thumbnail
Table 1. Demographic information of the sub-sample dataset.

https://doi.org/10.1371/journal.pone.0228402.t001

Creating template mesh

A 3D mesh template was created by manually locating twenty anatomical points on a 3D head and face (Fig 1) according to facial landmark standards [4042] (for more detail, see Table 2). The 20 anchor anatomical landmarks were not subjected to sliding but were used to establish the warping fields that would be used for minimizing the bending energy. Due to its easy of detection and pose correction [43] and its invariance to the facial expression of nose tip [44], the pronasale has been selected as the most robust and prominent landmark point. The sliding points begin to spread across the craniofacial surface from the nose tip. Using this anchor point (the pronasale), 480 semi-landmarks were automatically generated with the overlapping on the pronasale shown blue. These were first randomly placed on the craniofacial mesh before being uniformly distributed on the selected craniofacial surface using the locational positions of the anchor anatomical points with a 1.5mm radius to accommodate all the 500 points (see S1 Data) (Fig 2). To quantify the morphological for the complex, three-dimensional traits of both reference and target shapes, we used geometric morphometric tools based on previously reported landmark-based methodologies in [4551] and the method was fully implemented in Viewbox 4.0 [49].

thumbnail
Fig 1. A three-dimensional mesh template of frontal, lateralregions.

The 20 anchor anatomical landmarks are shown in red. The blue are on the pronasale indicates the point where the semi-landmarks begin the sliding process.

https://doi.org/10.1371/journal.pone.0228402.g001

thumbnail
Fig 2. A three-dimensional mesh template of the reference model with 500 landmarks.

Showing 20 anchor anatomical points (red color) and 480 semi-landmarks (blue color) with 1.5 mm radius: (A) Frontal view. (B) Lateral view.

https://doi.org/10.1371/journal.pone.0228402.g002

Multi-point warping

The geometry of curves and surfaces is easier in 2D or 3D but it is less easy to define semi-landmarks for non-planar surfaces in 3D [52], as they are not guaranteed to be homologous after first placement. However, this could be achieved by subjecting the semi-landmarks to sliding in the direction that reduces shape variance, thus closely positioning the points at the same locations in the 3D space. The sliding step is important, as it places the landmarks in positions where they correspond better to each other between individuals [37]. These semi-landmarks were allowed to slide on the curves and the surface mesh of each target using TPS warping of the template, which positioned the reference points on the target craniofacial mesh by minimizing the bending energy.

According to Bookstein [7], physical steel takes a bending form with a small displacement. This is because the function (x,y,z) is the configuration of the lowest physical bending energy which is consistent with the given constraints. In this 3D head and face deformation, the transformation of TPS was done mathematically by interpolation of smooth mapping of h from . This is a selected set of corresponding points {PRi,PTi}, i = 1,…,N on the faces of the reference object and target that minimizes the bending energy function E(h) using the following interpolation conditions [1,7,53]: (1) where PTi is the target object, PRi is the reference object for the sets of corresponding points, and h is the bending energy function that minimizes the non-negative quantity of the interpolation of the integral bending norm or the integral quadratic variation E(h). The TPS method now decomposes each component into affine and non-affine components, such that (2) where Ph are the homogeneous coordinate points on the target 3D surface, and Ψ(Ph) = (Ψ1(Ph),Ψ2(Ph),…,ΨM(Ph)) is a 1 × M kernel vector of TPS of the form: (3) K is a M × 4 non-affine warping coefficient matrix, and Γ is a homogeneous affine transformation of a 4x4 matrix. The energy function is minimized to find the optimum solution to Eq 4, if the interpolation condition in Eq 1 is not met.

(4)

The interpolation conditions in Eq 1 are satisfied if the smoothing regularization term β is zero; Γ and K are TPS parameters obtained by solving the linear equation: (5) Ψ is a M×M matrix with components Ψwl = ‖PTw−PTland PR is a M×4 matrix in which each row is the homogeneous coordinate of the point PRi, i = 1,…,M. Using Eq 2, the target craniofacial mesh PTi is deformed to the reference mesh PRi. The bending energy was applied, and the process was iterated for six cycles to have optimum sliding of the points on the craniofacial surface which gives points relaxed. This changed the bending energy from the initial value Ei to the final value Ef after six complete iterations. This means that the semi-landmarks can be treated in the same way as homologous landmarks in downstream analyses. Since warping may result in points that do not lie directly on the craniofacial surface on the target mesh, the transferred points were projected onto the closest point on the mesh surface. This was done using the ICP method [43], which aims to iteratively minimize the mean square error between two point sets. If the distance between the two points is within the acceptable threshold, then the closest point is determined as the corresponding point [54]. The homologous landmark warping HKΓ after six complete iterations is, therefore: (6) where (7) is the linear TPS equation obtained during the surface deformation of the target mesh to the reference mesh before convergence was finally reached and Ef−i = EfEi of six complete iterations. The first iteration showed a partial distribution of sliding points on the target surface mesh (Fig 3A). This was automatically repeated until the optimum homologous result was achieved using an exponential decay sliding step of a hundred to five percent. During the relaxation of the spline, the semi-landmarks were slid along the surface and the curve tangent structures, rather than on the surfaces or the curves which reduced the computational effort. This makes the minimization problem become linear, since sliding along the tangents let the semi-landmarks slip off the data [33]. The target surface mesh is now treated as a set of homologous points (Fig 3B). Note that we did not construct a new deformable mathematical equation from scratch but simply extended the standard deformable method that has been established by [1].

thumbnail
Fig 3. Sliding semi-landmark warped on target facial surface and distance measurement.

(A) Partial sliding on target mesh–first iteration. (B) Complete and homologous warping on target mesh–sixth iteration. (C) Approximate location of selected distance measurement for six regions redacted from [41]. Showing face (facial width, facial height, and forehead height); eye (intercanthal width and biocular width); nose (nasal height and nasal bridge length); mouth (lip height and lip width); chin/jaw (chin height and jaw length); and cranial (cranial length).

https://doi.org/10.1371/journal.pone.0228402.g003

The steps in this algorithm can be summarised as follows:

  1. Anatomical fixed points (20) were identified and digitized on the template craniofacial mesh and a prominent point (the pronasale) was identified.
  2. Semi-landmarks (480) were automatically generated and placed along the curves located at a uniform distance along each curve for sliding in step (5).
  3. These semi-landmarks were first randomly placed and then uniformly distributed on the selected reference surface mesh, starting from the selected prominent point.
  4. The reference facial model was warped to each target mesh configuration using a TPS transformation, and the surface semi-landmark was projected from the reference facial mesh to the target facial mesh.
  5. The surface and curve semi-landmarks were then slid together in the direction that minimized the bending energy between each target configuration and the reference object. This was done iteratively in six complete cycles, in order to ensure convergence and optimum smoothness. This gave a homologous representation of the reference mesh.
  6. A Generalized Procrustes analysis (GPA) of the landmark data was performed and an error assessment was computed using a Procrustes ANOVA in MorphoJ.

PCA and distance analysis

Principal Components Analysis (PCA) is used for dimensionality reduction. The total principal components (PCs) computed during the reduction process is 300PCs. Among these, only 180PCs which have been observed to have the highest ranking eigenvectors are selected for further analyses. This is based on the eigenvalues from random data of the principal components (see S2 Data).

Shape differences among the groups are studied using the aligned coordinates to perform a PCA to describe major trends in shape; between white British and white Irish, between males and females, and among the age classes. The PCs obtained from these variables are known as relative warps [5]. The difference from mean shape as expressed by variation along the relative warp axes are the intuitive deformation grid diagrams [55]. To visualise ethnicity, sex, and age differences; graphical representations of shape differences are generated as deformation grids of the mean group shape relative to the reference configuration (i.e. consensus configuration). To visualise how shape changes among the groups, we plot lollipop graphs which show the shifts of landmark positions with straight lines. The length and direction of the line indicate the movement of the respective landmark in the mean shape.

Due to the visual interpretation of lollipop graph, we further employed the method of Euclidean Distance Matrix Analysis (EDMA) [56,57] to measure the length of the line segment connecting the selected anatomical points (Fig 3C) [41] using PAST version 2.17 (see S3 Data) and we take the log of all distances. EDMA first calculates all the possible Euclidean distances between the selected anchor landmarks, computed on the mean shape of each group. It does not only provide an objective measurement of shape differences but also localizes the sites of major variations by suggesting which of the landmarks are more involved in the form difference [58].

Error assessment

The process of landmark coordinate extraction is always associated with some degree of measurement error. This can be as a result of non-coplanarity of landmarks, inconsistent of specimens relative to the plane of digitization, or difficulty in pinpointing the landmark locus [59]. Landmark measurement error can be minimized by careful landmark selection, but can never be totally eliminated. In assessing measurement error, thirty randomly selected images from both ethnicities were taken and digitized each image twice by the same operator following the method in [6062]. These were done for both manual and sliding semi-landmarks, followed by Procrustes superimposition on the landmark data using three partitions: fixed anatomical landmarks, sliding semi-landmarks, and overall landmarks; after the specified effects have been included [60]. Procrustes ANOVA was assessed to quantify the relative amounts of variation of shape and measurement error among soft-tissue craniofacial and population [60]. Although several other error measurement methods were suggested by Fruciano [63], the measurement error for this study was assessed using a Procrustes ANOVA. This technique [60,64] was implemented in morphometrics to analyze measurement errors [6567] using MorphoJ, which was achieved through the minimization of the squared sum of the distances of all objects and the consensus configuration [63]. It is crucial that the factors are accurately specified because of their hierarchical model, and therefore the order of the effects (first ethnicity, second sex, third age, followed by the individual) is important.

DA, CVA and allometry

Analyses for discrimination and allometric patterns are conducted on data averaged for ethnicity, sex, and age. Canonical variate analysis (CVA) and discriminant analysis (DA) are used to test group differences, to plot their differences, and to predict group classification. Using MorphoJ, CVA was performed to test group differences. Furthermore, using PAST, DA was performed by computing cross-validated classification tables to find a set of axes that grants the greatest ability possible to discriminate between two or more groups [68]. Its main purpose is to achieve a predictive classification of each group by estimating the discriminant functions that best discriminate between groups, and computing their classification scores. The accuracy of the classifications was finally evaluated using a cross-validation analysis. The significance of discriminant functions is tested using Wilks’ lambda and F value.

Using Procrustes distance with 10,000 permutations, we assess the statistical significance of the pairwise difference in mean shape; this comes along with Mahalanobis distance but not considered in this study. Because there may be an interaction between the size and shape in craniofacial morphology due to changes in shape associated with size differences [64], we assessed allometry. Through allometry, we tested the statistical significant proportion of morphological variation in the symmetric components using a multivariate regression of shape onto centroid size. Due to the fact that their allometric trajectories could have group-specific slopes or intercepts, we examined allometry for each group separately. Subsequently, by computing non-parametric multivariate analysis of variance (MANOVA), differences in effects and size are examined and the effect of size on shape was corrected. In addition, they are processed by means of principal components analysis to reduce the number of variables. Out of the entire set of principal components, subsets were selected that account for 99.98% of the total variance.

A full MANOVA with ethnicity as groups, the size as covariate and the ethnicity-by-size interaction term included was performed. We further applied the same on sex and age using the size as covariate to test their interaction. The allometric trajectories are parallel if there is no significance [69], which indicates a similar pattern in the allometry across groups [45]. Lastly, the MANOVA was recomputed after removing the nonsignificant interaction term (ethnicity × size), and the ethnicity effect tested differences in regression intercepts. This is useful for the verification of whether differences in shape are the result of size variation only [69]. The aim is to test each group after removing the variance in shape accounted for by the covariate size. In so doing, we may verify if the differences in shape are actually as a result of size variation only. This increases statistical power and makes explanatory simpler models by controlling one factor while testing for another. Furthermore, a pooled within-group regression was performed in MorphoJ, resulting in a sample of ‘size corrected’ shapes according to group-specific parallel allometric trajectories [70].

Experiment results

After the step-by-step methods in facial surface deformation of semi-landmarks in Viewbox 4.0, the analysis, visualisation and classification of the experiment are performed using MorphoJ 1.06d [71], and PAST 3.0 [72].

PCA results

From the scatter plot of PC1 and PC2 scores (Fig 4), white British females and white Irish females separate along the positive axis of PC1 and PC2; whereas white British males and white Irish males separate along the negative axes of PC1 and PC2. The white British take the upper dimension while the white Irish take the lower dimension. Indeed, from the study of PCA, white British males are sparingly separated from white Irish males with some overlapping. This is as a result of the small sample size in Irish samples. Generally, PC1 accounted for 43.68% while PC2 accounted for 13.94% of the total variance. The relative warp deformations showed shape variation along PC1 and PC2. The PC1 and PC2 of white British males accounted for 54.29% and 11.24%, respectively; PC1 and PC2 of white British females accounted for 35.56% and 16.21%, respectively; PC1 and PC2 of white Irish males accounted for 32.74% and 17.07%, respectively; and PC1 and PC2 of white Irish females accounted for 31.26% and 18.26%, respectively.

thumbnail
Fig 4. Shape variation (PC1 vs PC2) and corresponding relative warps.

Centre: Showing the first two principal components of the shape variation. The ellipses represent 95% confidence intervals. Sides: Craniofacial deformation representing variation along first two PCs (Upper: white British males, Lower: white British females, Right: white Irish males, Left: white Irish females).

https://doi.org/10.1371/journal.pone.0228402.g004

Procrustes ANOVA

The results for shape are reported in Table 3 and the effects are significant (all with p < 0.0001). For manual landmarks, the main effect of ethnicity is statistically significant and explains only 4.71% of the total variance. In addition, differences in craniofacial shape between sex, age, and among individuals are significant; and explained 1.30%, 8.04%, and 85.51%, respectively. The digitizing error accounted for 0.45% of the total variance. For sliding semi-landmarks, the main effect of ethnicity is statistically significant and explained only 3.07% of the total variance. In addition, differences in craniofacial shape between sex, age, and among individuals are significant; and explained 1.75%, 8.72%, and 86.13%, respectively. The digitizing error accounted for 0.33% of the total variance. For overall landmarks, the main effect of ethnicity is statistically significant and explained only 3.12% of the total variance. In addition, differences in craniofacial shape between sex, age, and among individuals are significant; and explained 1.72%, 8.69%, and 86.13%, respectively. The digitizing error accounted for 0.33% of the total variance.

thumbnail
Table 3. Procrustes ANOVAs for craniofacial shape with digitization error.

https://doi.org/10.1371/journal.pone.0228402.t003

CVA/DA results

Discrimination among groups is analysed independently on the averaged ethnicity, sex, and age; both CVA (plots not shown) and DA indicate that each studied taxon is clearly distinct from one another when pooled within-group variation. Procrustes distance among ethnicity (white British vs. white Irish) is 0.0324, p < 0.0001; Procrustes distance among sex (male vs. female) is 0.02, p < 0.0001. The Procrustes distance among age is shown in Table 4 due to its matrix representation. All in 10,000 pairwise permutation tests between taxa. All permutation tests indicate that the mean shapes differed significantly among taxa.

thumbnail
Table 4. Procrustes distances matrix (lower) and P-values (upper) of age groups.

https://doi.org/10.1371/journal.pone.0228402.t004

From DA in Fig 5, the cross-validation highlights the greater differences in craniofacial shape among the groups. For the comparison between the groups, the percentage of ethnicity correctly classified is 97.67%; the percentage of sex correctly classified is 99.67%, and the percentage of age correctly classified is 98.67%. We further present the confusion matrix of each group classification in Table 5.

thumbnail
Fig 5. Discriminant analysis of ethnicity, sex, and age using soft-tissue crania shape after averaging.

A. Between ethnicity (white British and white Irish). B. Between sex (Male and Female). C. Scatter plots of canonical variate analysis among the age classes: children (below 13 years), teenagers (13–19 years), young adults (20–29 years), adult (30–49 years), and senior adults (50 years and above); at 95% confidence ellipse.

https://doi.org/10.1371/journal.pone.0228402.g005

thumbnail
Table 5. Confusion matrix of percentage classification of ethnicity, sex, and age.

https://doi.org/10.1371/journal.pone.0228402.t005

Allometry, regression and shape variation

All specimens are scaled to unit centroid size (CS). Rotation and translation parameters are estimated to minimize the sum of squared distances between each soft-tissue craniofacial landmark and those of an iteratively computed mean configuration. Allometry is tested for symmetric components of the averaged groups. In detail, for ethnicity, sex, and age; significant allometric patterns of symmetric variation are detected, with 9.35%, 9.95%, and 2.87%, respectively, all with p < 0.0001. The results of the linear regression of centroid size showed statistically significant patterns (Fig 6). The change in the centroid size demonstrated that simple allometry explains the changes observed in each group.

thumbnail
Fig 6. Scatter plot obtained by regression of shape onto the size.

A. Between white British and white Irish. B. Between Males and Females. C. Among the Age classes: children (below 13 years), teenagers (13–19 years), young adults (20–29 years), adults (30–49 years), and senior adults (50 years and above).

https://doi.org/10.1371/journal.pone.0228402.g006

Furthermore, the total variation of each dependent variable is partitioned by the regression model into a component of variations. These components are computed for each variable separately. The residual and predicted components are expressed as a percentage of the total variation, which is intuitively useful to quantify the relative importance of allometry for the shape variation in each sub-divided dataset [37,73]. The results of the percentage predicted and significant level are shown in Table 6. All demonstrate statistically significant shape variation except the young adult age category of the age group (percentage predicted = 2.124%, p = 0.1121) which is not statistically significant and predicts the smallest percentage of shape variation.

thumbnail
Table 6. Regression results showing percentage predicted and p-values for each group.

https://doi.org/10.1371/journal.pone.0228402.t006

MANOVA results

CS and resulting shape variables are used in subsequent multivariate analyses. Using the PCA scores, multivariate analysis (MANOVA) is performed to test the significant effect of ethnicity and size on the shape of sex and age. A MANOVA is applied to the symmetric component of the ethnicity to test for differences in significant allometric trajectories of ethnicity, sex, and age with regard to two features: slopes (ethnicity × CS effect, sex x CS effect, and age x CS effect) of the regression lines and their intercepts [70].

The MANOVA results are presented in Table 7. The MANOVA procedure detects significant intercept and slope interaction on all tested variables. Size does have a significant effect on shape in ethnicity, sex, and age; for both intercept and slope. This suggests that smaller and larger individuals with the same ethnicity and sex are not similar in shape. More so, the results demonstrate that age classes are not similar in shape.

Discussions

Procrustes ANOVA

In this study, soft-tissue craniofacial variability is investigated for two ethnicities of a subset of white Europeans. In this study, 292 soft-tissue craniofacial landmarks are analysed morphometrically and classified. The primary focus is on the analyses of shape symmetry and the allometric relationships between each ethnic group, but the differences between sex and age groups are also analysed. Using a Procrustes ANOVA [71], the significance and percentage of variability are explained. Size results show that the three effects analysed (ethnicity, sex, and age) are statistically significant (p < 0.0001); and moreover, age explains largest part of the size variability. The percentage of variability relative to the digitization error is always negligible, in the three partitions. Small measurement errors (manual landmarks = 0.0113, sliding semi-landmarks = 0.0056, and Overall = 0.0057) showed that the landmarks can be annotated with precision using the proposed method (p < 0.0001). The sliding semi-landmarks demonstrate better performance in terms of digitization over manually placed landmarks. This could be as a result of the difficulty in pinpointing the landmark locus [59]. Overall, the results of the Procrustes ANOVA indicate significant craniofacial shape differences among ethnicity, sex, and age.

Shape variability, allometry and MANOVA

In order to investigate the overall variation for the entire selected sample, Principal components analysis is performed on all specimens. These analyses are carried out at different levels and the symmetric were analysed. For all computed PCs, PC1 explained almost half of the total variation, which indicates that shape variation is concentrated in a single dimension of the shape space [66]. To visualize the affected region of shape variability among ethnicity, sex and age groups, the first PC of each group is analysed more critically as presented in Fig 7. In the lollipop graphs, each of those blue circles is the average position of the landmarks we selected and the red color represents the number of each landmark. The length of the sticks tells us which way things change along the principal components [6]. Due to interpretation challenge in the lollipop graph, we further analysed the distance measurement of all selected anatomical points using EDMA and we present the results in Tables 8 and 9.

thumbnail
Fig 7. Lollipop graph of shape variability.

Morphological differences between the average of each group (ethnicity, sex, and age) and average estimated 3D faces using PCA.

https://doi.org/10.1371/journal.pone.0228402.g007

thumbnail
Table 8. Anthropometric linear distances of selected craniofacial landmarks for sex group.

https://doi.org/10.1371/journal.pone.0228402.t008

thumbnail
Table 9. Anthropometric linear distances of selected craniofacial landmarks for age group.

https://doi.org/10.1371/journal.pone.0228402.t009

Influence on shape is looked into under the three effects. Regarding the ethnicity, white British shows a narrow cranium, whereas white Irish shows a round cranium; and there is more protrusion in the British frontal face than in Irish. Though, no distance measurement was taken on ethnicity group. But regarding the sex influence on shape, a clear effect is identified in the analysis. Based on the centroid size and distances measured of the cranium and face in sex, males show a relatively larger size and sexual dimorphic in mouth width (chelion left-chelion right), mouth height (labiale superius-labiale inferius), nasal height (nasion-pronasale), and nasal bridge length (alare left-alare right), intercanthal width (endocanthion—endocanthion), biocular width (exocanthion-exocanthion), chin length (labiale inferius-gnathion), jaw height (tragion—gnathion), cranial width (metopion-Opisthocranion). It is demonstrated that nasal region increases anteriorly and posteriorly in males than in females. These results indicate that most soft-tissue features of the human head and face show strong evidence of sexual dimorphism which is in alignment with most previously published studies of craniofacial sex differences [11,18,41,74,75]. These included minimum frontal width, nasal protrusion, nasal bridge length, labial fissure width, and measures of mouth height, in white Europeans and other populations.

Regarding the age influence on shape, there is an identification of a clear effect in the analysis. The results demonstrate a slightly increase in size among the age classes. More so, the statistically significant difference among age groups is found when the entire cranium size is compared per age group and in the distances measured. The craniofacial features possess consistently larger intra-class variance due to, among others, the cranium changes relative to the increase in body size [76].

In the children group, males show a slightly larger cranial width. No difference in forehead height but males show longer facial height and wider facial width. The intercanthal width and biocular width in males are slightly longer than those of females. There is no difference in the nasal bridge but the nasal height in males is longer than females. Both mouth width and mouth height are longer in males than in females. There is no difference in the chin length but the jaw length is longer in males.

In the teenagers group, unlike in the children, there is no difference in the cranial width. But facial width, facial height, and forehead length are larger in males. There is no difference in intercanthal width but females biocular width is slightly wider. The nasal bridge length is longer in males than in females but the nasal height is longer in females than in males. Both mouth width and mouth height are larger in females than in males and both the jaw length and chin height are longer in males than in females.

In the young adults group, cranial width is longer in males. Facial width, facial height, and forehead length are larger in males than in females. The intercanthal width and biocular width are slightly wider in males than in females. The nasal bridge length and nasal height are longer in males than in females. Both mouth width and mouth height are larger in males than in females; both jaw length and chin length are longer in males than in females.

In the adults group, like in young adults group, cranial width is longer in males. Facial width, facial height, and forehead length are larger in males than in females. The intercanthal width and biocular width are slightly wider in males than in females. The nasal bridge length and nasal height are longer in males than in females. Both mouth width and mouth height are larger in males than in females; both jaw length and chin length are longer in males than in females.

In the senior adults group, the variations follow that same pattern as in adults group. Except in the mouth width where no difference is observed and also females show a longer jaw length than males. These correspond with previous studies in [19,74,77,78].

Generally, cranial width is longer in adults; facial width is longer in senior adults; facial height is longer in young adults and senior adults, and the forehead is longer in young adults. The intercanthal width is longer and equal in young adults, adults and senior adults; whereas biocular width is longer only in senior adults. Nasal bridge and nasal height are both longer in senior adults. Mouth width is longer in senior adults and mouth height is longer in young adults. Lastly, both jaw length and chin height are longer in senior adults.

It is examined in this study that allometry has a heterogeneous effect on the soft-tissue craniofacial morphology and that variation occurs in specific regions due to changes in the pattern of growth and development [79]. The results of the analysis show that the changes in craniofacial morphology over time are not associated with changes in centroid size. However, there is a statistically significant difference in craniofacial shape in both ethnicities and when traced among sex groups (p < 0.0001). Also, there is a significant difference when the size of the head shape is compared between males and females per age group (p < 0.0001). Though, the study has not examined separately the lower face and the whole cranium, which are the regions most affected by age-related morphological changes [80]. The reason why the current study did not explore these areas separately is that it aims to examine whether different age groups should be pooled. It is also clear that there is a considerable overlap in regional shape present between age groups which indicates that craniofacial aging is not simply a soft tissue phenomenon, but involves alteration in the underlying soft-tissue crania architecture [81].

Centroid size is not log-transformed, as the transformation makes no appreciable difference in the results (not shown). Regressions of shape onto size of each group are performed at a time and are statistically significant except in young adults (p = 0.1121). This is an indication of negligible allometry. Further statistical analysis is performed to be more confident in the results. In this study, we run MANOVA, which is a simple way to test the effect of size on shape when various groups are compared. Subsequently, the characteristics (i.e. slope and intercept) of the allometric trajectories of each group are tested using MANOVA, which explains significant portions of the overall variation. Regarding the allometric trajectories of ethnicity, the interaction term (test for slopes) is statistically significant (p < 0.000). When the size effect is removed (test for intercepts) and the MANOVA is repeated, the result is still statistically significant (p < 0.000). This suggests that the effect of size on shape is strong, and not similar in the two ethnicities. A significant test for intercepts means that there is support for ethnicity differences using the available samples when the effect of size on shape variation is held constant.

Regarding the allometric trajectories of sex, the interaction term is statistically significant (p < 0.000). When the size effect is removed and the MANOVA is repeated, the result is still statistically significant (p < 0.000). This suggests that the effect of size on shape is strong and not similar in the sex group. For the allometric trajectories of age class, the interaction term is statistically significant (p < 0.000). When the size effect is removed and the MANOVA is repeated, the result is still statistically significant (p < 0.000). This suggests that the effect of size on shape is strong and not similar in the age group. As it is expected since age class has larger phenotypic variations, the allometric trajectories are largely aligned with the vector of mean shape differences.

Discriminant analysis

While the MANOVA and contrast tests detect significant shape differences in each group, DA is further employed to classify each group with moderate cross-validation rates. For ethnicity, the results show that allometric variation is negligible with respect to the ethnicity differentiation; indeed, the sample of white British are correctly classified with 99.14% and white Irish with 92.54%. For sex, 99.25% of males are correctly classified while 100% of females are correctly classified, which shows negligibility in allometric variation with respect to sex. Subsequently, the age group data followed no trend wherein the highest correct classification rates are found in children (100%) and senior adults (100%), followed by young adult (98.59%), then adults (97.67%), and finally teenagers (96.29%). The children and the senior adults age groups are found to exhibit the most variance of the five examined age groups.

The discrimination we observed in the children and adult groups is as a result of the variation in the chin, nose, forehead and crania between the age groups because of biological reasons and activity patterns. Tome et al. [82] proposed that the best facial region with the high variability power in face recognition are the forehead and nose. Though, the variability superimposition of soft-tissue is more debatable in age-related subjects than those of the hard tissue due to the changes in the surfaces [78]. Consequently, the foreheads in children proposed in [11] protrude forward and become more retro-positioned as they get older until their foreheads actually slopes posteriorly. This variation also reflects in the anterior protrusion of chin and nose as the age increases. According to Nikita [80], the cranium is one of the highly discriminative regions among age-related subjects. From our investigation, the crania size is larger in the adult age group and smaller in the children age group with more than two millimetres increase; which apparently increases the chance of discrimination between the groups.

Conclusions

The study led to the following conclusions relating to soft-tissue craniofacial shape and size variation with ethnicity, sex, and age. Craniofacial size, expressed as centroid size, is less affected by ethnicity. But has a great impact on sex and age. Both craniofacial shape and size are significantly sexually dimorphic, which results in statistically significant differences between males and females; though not considered in different age groups. Attention should, therefore, be given to over-classification problems when DA is applied on the craniofacial shape, when captured by multiple landmarks. However, due to the uncertainty of biological reality reflection, the assigned sliding semi-landmarks may not adequately reflect the shape of the entire head and face under study. This may also have a negative impact on biological variability within the sample related to ethnicity, sex, or age. Furthermore, we face some discrepancy challenges in the dataset used. This is because the dataset comes from various ethnicities and countries with white British having the highest number of sample, followed by white Irish. Other ethnicities are insignificant for analysis consideration due to their infinitesimal sample size. More so, no subject is found in the white Irish males of teenagers (13–19 years) age group. These discrepancies consequently have effect on the interpretation of our results, especially the principal component analysis. While further study is recommended for clarification on the aforementioned issues, this study, nonetheless, combines pragmatic solutions to configure an optimized pipeline for high-throughput multi-point craniofacial signature in 3D to the investigation of ethnicity, sex, and age related variation in craniofacial morphology. Thus, this study is limited to white Europeans descents (British and Irish), therefore the generalizability of these results to other populations cannot be assumed.

Acknowledgments

We acknowledge Department of Computer Science, University of York, UK (Liverpool -York Head Model) for prompt agreement to use their dataset, and the Computer Laboratory of the Faculty of Computer Science & Information Technology, Universiti Putra Malaysia.

References

  1. 1. Fred LB (1997) Landmark methods for forms without landmarks- morphometrics of group differences in outline shape. Medical Image Analysis 1.
  2. 2. Dryden IL, Mardia KV (1998) Statistical Shape Analysis. Chichester: Wiley.
  3. 3. Dean A, James RF, E SD (2004) Geometric morphometrics: Ten years of progress following the ‘revolution’. Italian Journal of Zoology 71: 5–16.
  4. 4. Slice DE (2007) Geometric Morphometrics. Annual Review of Anthropology 36: 261–281.
  5. 5. Rohlf FJ (1993) Relative warp analysis and an example of its application to mosquito. Contributions to morphometrics 8: 131.
  6. 6. Klingenberg CP (2013) Visualizations in geometric morphometrics: how to read and how to make graphs showing shape changes. Hystrix, the Italian Journal of Mammalogy 24.
  7. 7. Bookstein FL (1989) Principal warps: Thin-plate splines and the decomposition of deformations. IEEE Transactions on pattern analysis and machine intelligence 11: 567–585.
  8. 8. Mitteroecker P, Gunz P (2009) Advances in Geometric Morphometrics. Evolutionary Biology 36: 235–247.
  9. 9. Bookstein FL (1997) Morphometric tools for landmark data: geometry and biology: Cambridge University Press.
  10. 10. David D (1996) Three-dimensional data capture and visualization. Advances in morphometrics: Springer. pp. 53–69.
  11. 11. Matthews H, Penington T, Saey I, Halliday J, Muggli E, et al. (2016) Spatially dense morphometrics of craniofacial sexual dimorphism in 1‐year‐olds. Journal of anatomy 229: 549–559. pmid:27338586
  12. 12. Claes P, Walters M, Clement J (2012) Improved facial outcome assessment using a 3D anthropometric mask. International journal of oral and maxillofacial surgery 41: 324–330. pmid:22103995
  13. 13. Snyders J, Claes P, Vandermeulen D, Suetens P (2014) Development and comparison of non-rigid surface registration algorithms and extensions. Technical report KUL/ESAT/PSI/1401, KU Leuven, ESAT, Leuven, Belgium.
  14. 14. Kimmerle EH, Ross A, Slice D (2008) Sexual dimorphism in America: geometric morphometric analysis of the craniofacial region. Journal of forensic sciences 53: 54–57. pmid:18279240
  15. 15. Rosas A, Bastir M (2002) Thin‐plate spline analysis of allometry and sexual dimorphism in the human craniofacial complex. American Journal of Physical Anthropology 117: 236–245. pmid:11842403
  16. 16. Bigoni L, Velemínská J, Brůžek J (2010) Three-dimensional geometric morphometric analysis of cranio-facial sexual dimorphism in a Central European sample of known sex. Homo 61: 16–32. pmid:20152969
  17. 17. Samal A, Subramani V, Marx D (2007) Analysis of sexual dimorphism in human face. Journal of Visual Communication and Image Representation 18: 453–463.
  18. 18. Hennessy RJ, McLearie S, Kinsella A, Waddington JL (2005) Facial surface analysis by 3D laser scanning and geometric morphometrics in relation to sexual dimorphism in cerebral–craniofacial morphogenesis and cognitive function. Journal of anatomy 207: 283–295. pmid:16185253
  19. 19. Genecov JS, Sinclair PM, Dechow PC (1990) Development of the nose and soft tissue profile. The Angle Orthodontist 60: 191–198. pmid:2389851
  20. 20. Gaži-Čoklica V, Muretić Ž, Brčić R, Kern J, Miličić A (1997) Craniofacial parameters during growth from the deciduous to permanent dentition—a longitudinal study. European journal of orthodontics 19: 681–689. pmid:9458601
  21. 21. Peter Claes DKL, Daniels Katleen, Matthes Rosana Kerri, Quillen Ellen E., Pearson BM Laurel N., Bauchet Marc, et al. (2014) Modeling 3D Facial Shape from DNA. PLOS Genetics 10.
  22. 22. Weinberg S, Parsons T, Raffensperger Z, Marazita M (2015) Prenatal sex hormones, digit ratio, and face shape in adult males. Orthodontics & craniofacial research 18: 21–26.
  23. 23. Mateos P (2007) A review of name‐based ethnicity classification methods and their potential in population studies. Population, Space and Place 13: 243–263.
  24. 24. Lu X, Chen H, Jain AK. Multimodal facial gender and ethnicity identification; 2006. Springer. pp. 554–561.
  25. 25. Ferrario VF, Sforza C, Poggio CE, Schmitz JH (1999) Soft-tissue facial morphometry from 6 years to adulthood: a three-dimensional growth study using a new modeling. Plastic and reconstructive surgery 103: 768–778. pmid:10077065
  26. 26. Ursi WJ, Trotman C-A, McNamara JA Jr, Behrents RG (1993) Sexual dimorphism in normal craniofacial growth. The Angle Orthodontist 63: 47–56. pmid:8507031
  27. 27. Ferrario VF, Sforza C, Colombo A, Schmitz JH, Serrao G (2001) Morphometry of the orbital region: a soft-tissue study from adolescence to mid-adulthood. Plastic and Reconstructive Surgery 108: 285–292; discussion 293. pmid:11496164
  28. 28. Ferrario VF, Sforza C, Pizzini G, Vogel G, Miani A (1993) Sexual dimorphism in the human face assessed by euclidean distance matrix analysis. Journal of Anatomy 183: 593. pmid:8300436
  29. 29. Paysan P (2010) Statistical modeling of facial aging based on 3D scans: University_of_Basel.
  30. 30. O'toole AJ, Vetter T, Volz H, Salter EM (1997) Three-dimensional caricatures of human heads: distinctiveness and the perception of facial age. Perception 26: 719–732. pmid:9474342
  31. 31. O'Toole AJ, Price T, Vetter T, Bartlett JC, Blanz V (1999) 3D shape and 2D surface textures of human faces: the role of “averages” in attractiveness and age. Image and Vision Computing 18: 9–19.
  32. 32. Botton-Divet L, Houssaye A, Herrel A, Fabre A-C, Cornette R (2015) Tools for quantitative form description; an evaluation of different software packages for semi-landmark analysis. PeerJ 3: e1417. pmid:26618086
  33. 33. Gunz P, Mitteroecker P, Bookstein FL (2005) Semilandmarks in three dimensions. Modern morphometrics in physical anthropology: Springer. pp. 73–98.
  34. 34. Parr W, Wroe S, Chamoli U, Richards H, McCurry M, et al. (2012) Toward integration of geometric morphometrics and computational biomechanics: new methods for 3D virtual reconstruction and quantitative analysis of Finite Element Models. Journal of Theoretical Biology 301: 1–14. pmid:22342680
  35. 35. Cornette R, Baylac M, Souter T, Herrel A (2013) Does shape co‐variation between the skull and the mandible have functional consequences? A 3D approach for a 3D problem. Journal of Anatomy 223: 329–336. pmid:23964811
  36. 36. Fabre AC, Goswami A, Peigné S, Cornette R (2014) Morphological integration in the forelimb of musteloid carnivorans. Journal of Anatomy 225: 19–30. pmid:24836555
  37. 37. Philipp Mitteroecker PG, Windhagerc Sonja, Schaefer Katrin (2013) A brief review of shape, form, and allometry in geometric morphometrics, with applications to human facial morphology. Hystrix, the Italian Journal of Mammalogy.
  38. 38. Perez SI, Bernal V, Gonzalez PN (2006) Differences between sliding semi‐landmark methods in geometric morphometrics, with an application to human craniofacial and dental variation. Journal of anatomy 208: 769–784. pmid:16761977
  39. 39. Dai H, Pears N, Smith WA, Duncan C. A 3d morphable model of craniofacial shape and texture variation; 2017. pp. 3085–3093.
  40. 40. Caple J, Stephan CN (2016) A standardized nomenclature for craniofacial and facial anthropometry. International journal of legal medicine 130: 863–879. pmid:26662189
  41. 41. Kesterke MJ, Raffensperger ZD, Heike CL, Cunningham ML, Hecht JT, et al. (2016) Using the 3D Facial Norms Database to investigate craniofacial sexual dimorphism in healthy children, adolescents, and adults. Biology of sex differences 7: 23. pmid:27110347
  42. 42. Farkas LG (1994) Anthropometry of the Head and Face: Raven Pr.
  43. 43. Creusot C, Pears N, Austin J. 3D face landmark labelling; 2010. ACM. pp. 27–32.
  44. 44. Colombo A, Cusano C, Schettini R (2006) 3D face detection using curvature analysis. Pattern Recognition 39: 444–455.
  45. 45. Zelditch ML, Swiderski DL, Sheets HD (2012) Geometric morphometrics for biologists: a primer: Academic Press.
  46. 46. Klingenberg CP, Zaklan SD (2000) Morphological integration between developmental compartments in the Drosophila wing. Evolution 54: 1273–1285. pmid:11005294
  47. 47. Kouli A, Papagiannis A, Konstantoni N, Halazonetis DJ, Konstantonis D (2018) A geometric morphometric evaluation of hard and soft tissue profile changes in borderline extraction versus non-extraction patients. European journal of orthodontics.
  48. 48. Yong R, Ranjitkar S, Lekkas D, Halazonetis D, Evans A, et al. (2018) Three‐dimensional (3D) geometric morphometric analysis of human premolars to assess sexual dimorphism and biological ancestry in Australian populations. American journal of physical anthropology.
  49. 49. Halazonetis D (2014) Viewbox 4—Cephalometric Software. Greece: Dhal.
  50. 50. Agbolade O, Nazri A, Yaakob R, Ghani AA, Cheah YK (2019) 3-Dimensional facial expression recognition in human using multi-points warping. BMC bioinformatics 20: 619. pmid:31791234
  51. 51. Agbolade O, Nazri A, Yaakob R, Ghani AA, Cheah YK. Homologous Multi-Points Warping: An Algorithm for Automatic 3D Facial Landmark; 2019. IEEE. pp. 79–84.
  52. 52. Huanca Ghislanzoni L, Lione R, Cozza P, Franchi L (2017) Measuring 3D shape in orthodontics through geometric morphometrics. Prog Orthod 18: 38. pmid:29192356
  53. 53. Corner BD, Lele S, Richtsmeier JT (1992) Measuring precision of three-dimensional landmark data. J Quant Anthropol 3: 347–359.
  54. 54. Mian AS, Bennamoun M, Owens R (2008) Keypoint detection and local feature matching for textured 3D face recognition. International Journal of Computer Vision 79: 1–12.
  55. 55. Gonzalez P, Bernal V, Perez S (2011) Analysis of sexual dimorphism of craniofacial traits using geometric morphometric techniques. International Journal of Osteoarchaeology 21: 82–91.
  56. 56. Vezzetti E, Marcolin F (2012) Geometrical descriptors for human face morphological analysis and recognition. Robotics and Autonomous Systems 60: 928–939.
  57. 57. Lele S (1993) Euclidean distance matrix analysis (EDMA): estimation of mean form and mean form difference. Mathematical Geology 25: 573–602.
  58. 58. Lele S, Richtsmeier JT (1991) Euclidean distance matrix analysis: A coordinate‐free approach for comparing biological shapes using landmark data. American Journal of Physical Anthropology 86: 415–427. pmid:1746646
  59. 59. Webster M, Sheets HD (2010) A practical introduction to landmark-based geometric morphometrics. The Paleontological Society Papers 16: 163–188.
  60. 60. Klingenberg CP, Barluenga M, Meyer A (2002) Shape analysis of symmetric structures: quantifying variation among individuals and asymmetry. Evolution 56: 1909–1920. pmid:12449478
  61. 61. O'Higgins P, Jones N (1998) Facial growth in Cercocebus torquatus: an application of three-dimensional geometric morphometric techniques to the study of morphological variation. The Journal of Anatomy 193: 251–272. pmid:9827641
  62. 62. Robinson C, Terhune CE (2017) Error in geometric morphometric data collection: Combining data from multiple sources. American journal of physical anthropology 164: 62–75. pmid:28573732
  63. 63. Fruciano C (2016) Measurement error in geometric morphometrics. Development Genes and Evolution 226: 139–158. pmid:27038025
  64. 64. Klingenberg CP, McIntyre GS (1998) Geometric morphometrics of developmental instability: analyzing patterns of fluctuating asymmetry with Procrustes methods. Evolution 52: 1363–1375. pmid:28565401
  65. 65. Leamy LJK, Christian Peter; Sherratt Emma; Wolf Jason B; Cheverud James M. (2015) The Genetic Architecture of Fluctuating Asymmetry of Mandible Size and Shape in a Population of Mice: Another Look. Symmetry 7: 146–163.
  66. 66. Singh N, Harvati K, Hublin J-J, Klingenberg CP (2012) Morphological evolution through integration: a quantitative study of cranial integration in Homo, Pan, Gorilla and Pongo. Journal of Human Evolution 62: 155–164. pmid:22178399
  67. 67. Klingenberg C, Wetherill L, Rogers J, Moore E, Ward R, et al. (2010) Prenatal alcohol exposure alters the patterns of facial asymmetry. Alcohol 44: 649–657. pmid:20060678
  68. 68. Manly BF, Alberto JAN (2016) Multivariate statistical methods: a primer: Chapman and Hall/CRC.
  69. 69. Viscosi V (2015) Geometric morphometrics and leaf phenotypic plasticity: assessing fluctuating asymmetry and allometry in European white oaks (Quercus). Botanical Journal of the Linnean Society 179: 335–348.
  70. 70. Viscosi V, Cardini A (2011) Leaf morphology, taxonomy and geometric morphometrics: a simplified protocol for beginners. PloS one 6: e25630. pmid:21991324
  71. 71. Christian K (2011) MorphoJ: an integrated software package for geometric morphometrics. Molecular Ecology Resources 11: 353–357. pmid:21429143
  72. 72. Hammer Ø, Harper D, Ryan P (2001) Paleontological statistics software: package for education and data analysis. Palaeontologia Electronica.
  73. 73. Drake AG, Klingenberg CP (2007) The pace of morphological change: historical transformation of skull shape in St Bernard dogs. Proceedings of the Royal Society B: Biological Sciences 275: 71–76.
  74. 74. Toma AM, Zhurov A, Playle R, Richmond S (2008) A three‐dimensional look for facial differences between males and females in a British‐Caucasian sample aged 15½ years old. Orthodontics & craniofacial research 11: 180–185.
  75. 75. Liu Y, Xi P, Joseph M, Zhuang Z, Shu C, et al. (2015) Variations in head-and-face shape of Chinese civilian workers. Annals of Occupational Hygiene 59: 932–944. pmid:25858431
  76. 76. Ferková Z, Urbanová P, Černý D, Žuži M, Matula P (2018) Age and gender-based human face reconstruction from single frontal image. Multimedia Tools and Applications: 1–26.
  77. 77. Koudelová J, Dupej J, Brůžek J, Sedlak P, Velemínská J (2015) Modelling of facial growth in Czech children based on longitudinal data: Age progression from 12 to 15 years using 3D surface models. Forensic science international 248: 33–40. pmid:25576677
  78. 78. Kau CH, Richmond S (2008) Three-dimensional analysis of facial morphology surface changes in untreated children from 12 to 14 years of age. American Journal of Orthodontics and Dentofacial Orthopedics 134: 751–760. pmid:19061801
  79. 79. Weisensee KE, Jantz RL (2011) Secular changes in craniofacial morphology of the Portuguese using geometric morphometrics. American journal of physical anthropology 145: 548–559. pmid:21541933
  80. 80. Nikita E (2014) Αge‐associated variation and sexual dimorphism in adult cranial morphology: Implications in anthropological studies. International Journal of Osteoarchaeology 24: 557–569.
  81. 81. Williams SE, Slice DE (2010) Regional shape change in adult facial bone curvature with age. American journal of physical anthropology 143: 437–447. pmid:20949614
  82. 82. Tome P, Fierrez J, Vera-Rodriguez R, Ramos D (2013) Identification using face regions: Application and assessment in forensic scenarios. Forensic science international 233: 75–83. pmid:24314504