Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Direct Comparisons of 2D and 3D Dental Microwear Proxies in Extant Herbivorous and Carnivorous Mammals

  • Larisa R. G. DeSantis ,

    larisa.desantis@vanderbilt.edu

    Affiliation Department of Earth and Environmental Sciences, Vanderbilt University, Nashville, Tennessee, United States of America

  • Jessica R. Scott,

    Affiliation Department of Sociology and Anthropology, University of Arkansas at Little Rock, Little Rock, Arkansas, United States of America

  • Blaine W. Schubert,

    Affiliation Center of Excellence in Paleontology and Department of Geosciences, East Tennessee State University, Johnson City, Tennessee, United States of America

  • Shelly L. Donohue,

    Affiliation Department of Earth and Environmental Sciences, Vanderbilt University, Nashville, Tennessee, United States of America

  • Brian M. McCray,

    Affiliation Department of Anthropology, Vanderbilt University, Nashville, Tennessee, United States of America

  • Courtney A. Van Stolk,

    Affiliation Department of Earth and Environmental Sciences, Vanderbilt University, Nashville, Tennessee, United States of America

  • Amanda A. Winburn,

    Affiliation Department of Anthropology, Vanderbilt University, Nashville, Tennessee, United States of America

  • Michael A. Greshko,

    Affiliation Department of Earth and Environmental Sciences, Vanderbilt University, Nashville, Tennessee, United States of America

  • Mackie C. O’Hara

    Affiliation Department of Sociology and Anthropology, University of Arkansas at Little Rock, Little Rock, Arkansas, United States of America

Abstract

The analysis of dental microwear is commonly used by paleontologists and anthropologists to clarify the diets of extinct species, including herbivorous and carnivorous mammals. Currently, there are numerous methods employed to quantify dental microwear, varying in the types of microscopes used, magnifications, and the characterization of wear in both two dimensions and three dimensions. Results from dental microwear studies utilizing different methods are not directly comparable and human quantification of wear features (e.g., pits and scratches) introduces interobserver error, with higher error being produced by less experienced individuals. Dental microwear texture analysis (DMTA), which analyzes microwear features in three dimensions, alleviates some of the problems surrounding two-dimensional microwear methods by reducing observer bias. Here, we assess the accuracy and comparability within and between 2D and 3D dental microwear analyses in herbivorous and carnivorous mammals at the same magnification. Specifically, we compare observer-generated 2D microwear data from photosimulations of the identical scanned areas of DMTA in extant African bovids and carnivorans using a scanning white light confocal microscope at 100x magnification. Using this magnification, dental microwear features quantified in 2D were able to separate grazing and frugivorous bovids using scratch frequency; however, DMTA variables were better able to discriminate between disparate dietary niches in both carnivorous and herbivorous mammals. Further, results demonstrate significant interobserver differences in 2D microwear data, with the microwear index remaining the least variable between experienced observers, consistent with prior research. Overall, our results highlight the importance of reducing observer error and analyzing dental microwear in three dimensions in order to consistently interpret diets accurately.

Introduction

Dental microwear, the microscopic wear patterns resulting from food processing, is among the most frequently used and effective proxies to infer diet in extant and extinct animals, including humans and their ancestors. As dental microwear records food consumption during the last few days to weeks of an animal’s life, it can be used to clarify ancient diets and assess dietary responses to changing climates and environments. While microwear has been commonly used by anthropologists and paleontologists since the late 1970s (e.g., [13]), the methodologies used to quantify tooth surfaces are highly variable and still debated among researchers, and results generated between and within methods are not directly comparable [47].

The pioneering microwear studies of the 1970s and 1980s used scanning electron microscopy (SEM) to document the correlation between size, shape, and orientation of wear features and dietary habits of extant taxa (e.g., [1,2]). These studies standardized methods related to data collection including the type of wear facet analyzed [8], analysis of homologous facets across studied taxa [3,9], specimen coating material and thickness, and beam settings of individual SEM machines [10]. However, the analysis and subsequent interpretation of microwear features assessed via SEM relies on observers counting individual pits and scratches from two-dimensional SEM micrographs [8]. Typically, in herbivorous taxa, a high incidence of scratches relative to pits is interpreted to indicate the consumption of tougher food items, potentially with higher silica or grit content; in contrast, a greater frequency of pits indicates the consumption of more brittle objects and the potential processing of seeds and/or fruit pits [1,2,8].

Microwear studies utilizing low-magnification light microscopy follow similar methods as those applied during SEM analysis, with the added benefit of being able to analyze a surface quickly with a low-cost stereo light microscope at magnifications ranging from 35x in large animals (e.g., [11]) to 100x in small animals (e.g., [12]). Here, observers can either directly count wear features through the microscope lens [11], or they can take digital photomicrographs of specimens and thus keep a record of their counts by tracing wear features using imaging software [13,14]. Biplots of pits and scratches yield a ‘trophic triangle’ where, for example, herbivorous browsing taxa have a high number of pits and low number of scratches, grazing taxa have a high number of scratches and low number of pits, and frugivores/hard object feeders fall in-between these end members [11,15]. Further, the addition of features including scratch texture, cross scratches, large pits, and gouges can further parse out dietary information [11].

Observer identification and quantification of individual wear features, whether from an SEM micrograph or using light microscopy, is prone to high observer biases, particularly between observers of different experience levels [4,5,7,16]. Grine and co-authors [4] found a 9% error in measurements between observers while Galbany and co-authors [5] found a 6% error in observers with five or more years of experience when quantifying SEM micrographs. Most recently, Mihlbachler and colleagues [7] documented a 45% interobserver error among experienced and inexperienced individuals, which was reduced to 8-12% in experienced individuals after multiple iterations. While experienced observers yielded similarly shaped trophic triangles consistent with prior work [11], inexperienced microwear observers failed to generate a trophic triangle using light microscopy [7]. Further biases can arise from viewing microwear features at different resolutions [17], in addition to data loss from the analysis of three-dimensional microwear features in two dimensions [6,18]

Dental microwear texture analysis (DMTA), the analysis of dental microwear in three dimensions using a scanning white light confocal microscope and scale sensitive fractal analysis, alleviates some of the problems surrounding traditional microwear methods by essentially eliminating observer bias through a quantitative, repeatable method, and by analyzing wear features in three dimensions [1820]. While some observer biases may still be present (e.g., area of wear facet chosen for analysis by individual observers), DMTA has been shown to distinguish between disparate diets in mammals including bovids [21], carnivorans [22,23], marsupials [24], primates [18,19], and xenarthrans [25]. Specifically, greater values in features such as complexity (i.e., surface roughness at varying scales) occur in taxa consuming brittle food items, such as frugivores and bone consumers, while greater anisotropy (i.e., the orientation of wear features of similar depth) occurs in grazers and carnivores that avoid bone. In contrast, Beatty and Mihlbachler [26] found that low-magnification microwear methods were better able to discriminate between species than DMTA, although neither method discriminated diet well. However, the Beatty and Mihlbachler [26] study was limited in sample size (total of 15 specimens from four species) and could not compare identical surface areas on each specimen due to methodological constraints.

Here, we directly compare 2D and 3D dental microwear features of herbivorous and carnivorous mammals at 100x magnification (Figure 1). Specifically, we compared DMTA data with generated 2D microwear data from photosimulations of the identical scanned areas of previously published DMTA 3D point clouds of extant African bovids (4 species [21]) and carnivorans (3 species [23]). Photosimulations avoid the pitfalls of SEM and stereo light microscopy methods, which can be subject to the issue of depth distorting the visibility of microwear features due to differences in coating thickness, SEM beam angle, or angle of incoming light, among other factors. The view settings for photosimulations can be manipulated to alter the direction of light and photo contrast to maximize feature visibility, while still preserving "observer-perceived depth" via feature shadows. Conducting 2D microwear analysis on DMTA-produced photosimulations is the only method that ensures direct comparisons of 2D and 3D methods between identical scanned areas. Analyzing the identical tooth area using a confocal microscope to generate 3D data and an SEM or stereo light microscope to generate 2D data is virtually impossible and would introduce additional sources of differences. Thus, we analyzed taxa with similar dental morphology (within each group) representing distinct dietary niches, to address the following questions: (i) do two-dimensional and three-dimensional microwear studies produce accurate and comparable dietary interpretations of extant taxa with known feeding behavior, (ii) how does the inclusion of depth alter or improve dental microwear interpretations, and (iii) can different observers generate comparable data using two-dimensional wear feature counting methods in herbivorous and carnivorous mammals? Understanding how 2D and 3D dental microwear data compare in a diversity of mammals with disparate diets is critical to advancing our understanding of dietary behavior in the prehistoric and historic past, globally.

thumbnail
Figure 1. Dental microwear photosimulations in 2D and 3D.

Example of photosimulations in two dimensions (A–D) and three dimensions (E–H) of the browser Sylvicapra grimmia. Scans are from four adjacent areas (totaling ~204 x 276 µm2, with each scan representing and area of ~102 x 138µm2).

https://doi.org/10.1371/journal.pone.0071428.g001

Results

Dietary Comparisons

Results are presented in Tables 1-2 and illustrated in Figure 2. All primary data are noted in Tables S1-S4 and the supplemental Appendix Data File. As carnivoran and bovid dietary comparisons are the focus of prior studies [21,23], we instead specify how DMTA data compares to 2D metrics at the same resolution. In the 2D analysis the number of pits and coarse pits are not statistically distinct between carnivorans (Kruskal-Wallis tests, p=0.078 and 0.626, respectively). A greater number of scratches (p=0.017) and coarse scratches (p=0.004) distinguishes Acinonyx jubatus from Crocuta crocuta, with Panthera leo also having statistically greater coarse scratches than C. crocuta. DMTA attributes instead yield significantly greater parallel elongated wear features (mean anisotropy or epLsar) in A. jubatus than in all extant taxa (Table 1, Kruskal-Wallis tests, p<0.0001). In contrast, mean complexity and textural fill volume are smallest in A. jubatus, followed by P. leo, and C. crocuta (Table 1), consistent with degree of durophagous activity in these carnivorans (Kruskal-Wallis tests, p<0.01).

TaxonStatisticnAsfcepLsarSmcTfvHAsfc(3x3)HAsfc(9x9)
Acinonyx jubatusMean91.5900.00490.28650710.5891.348
(extant carnivoran)Median1.7670.00470.20925810.5121.032
Standard Deviation0.7370.00110.15453720.2780.895
Skewness (Fisher)0.424-0.1251.120.7490.9871.464
p for normality (Shapiro-Wilk)0.1650.7640.0850.1470.0690.039
Panthera leoMean154.6160.00311.013104130.4710.895
(extant carnivoran)Median4.6900.00330.150113580.4420.799
Standard Deviation1.7290.00172.59640740.1560.314
Skewness (Fisher)-0.0800.9813.566-0.6640.671.449
p for normality (Shapiro-Wilk)0.6110.211<0.00010.0420.4430.032
Crocuta crocutaMean129.3150.00310.151123200.4620.836
(extant carnivoran)Median7.0700.00340.151141420.4150.700
Standard Deviation6.7080.00110.00156660.180.333
Skewness (Fisher)1.2150.0350.504-0.8230.7250.802
p for normality (Shapiro-Wilk)0.0460.6660.1510.3260.2730.072
Damaliscus lunatusMean100.9840.00681.35520270.4440.658
(extant bovid)Median0.9220.00661.30516660.4510.672
Standard Deviation0.2600.00090.3639810.0730.072
Skewness (Fisher)0.4181.0451.1490.952-0.144-0.161
p for normality (Shapiro-Wilk)0.2390.1870.3230.0410.9660.621
Antidorcas marsupialisMean101.9370.00370.36657090.5270.769
(extant bovid)Median1.7440.00370.30554760.4920.799
Standard Deviation0.4740.00120.18711890.1490.147
Skewness (Fisher)0.6340.4211.7091.2911.082-0.397
p for normality (Shapiro-Wilk)0.4180.6180.0300.1880.3610.750
Sylvicapra grimmiaMean103.3180.00270.681126220.7780.895
(extant bovid)Median3.4770.00280.510123570.6110.882
Standard Deviation0.9000.00080.32728340.3540.181
Skewness (Fisher)-0.840-0.1490.987-0.1780.6740.917
p for normality (Shapiro-Wilk)0.4200.5230.0010.3410.0440.198
Cephalophus sylvicultorMean104.9400.00270.257129970.4660.820
(extant bovid)Median4.7100.00250.265136710.4660.828
Standard Deviation1.4590.00110.02719730.0500.056
Skewness (Fisher)0.1650.138-0.623-0.9010.841-1.484
p for normality (Shapiro-Wilk)0.2520.1540.4700.0620.0890.055

Table 1. Descriptive statistics for each DMTA variable by species.

n, number of individuals sampled; Asfc, area-scale fractal complexity; epLsar, anisotropy; Smc, scale of maximum complexity; Tfv, textural fill volume; HAsfc(3x3), HAsfc(9x9) heterogeneity of complexity in a 3x3 and 9x9 grid, respectively. All carnivoran data and all descriptive statistics are taken from Ref. [23]. Bovid descriptive statistics are not published in this form; however, all specimens were previously analyzed in Ref. [21].
CSV
Download CSV
TaxonStatisticnPitsCPScratchesCSMI
Acinonyx jubatusMean927.434.1917.611.750.782
(extant carnivoran)Median27.883.5017.251.750.609
Standard Deviation6.931.537.240.700.687
Skewness (Fisher)2.6351.8110.514-1.0106.248
p for normality (Shapiro-Wilk)0.3380.0660.9180.5920.002
Panthera leoMean1530.614.1812.191.2080.414
(extant carnivoran)Median29.754.759.381.1250.344
Standard Deviation6.191.045.640.6140.228
Skewness (Fisher)-1.152-1.182-0.499-0.8993.274
p for normality (Shapiro-Wilk)0.1890.0540.0410.4300.007
Crocuta crocutaMean1225.233.779.200.6250.354
(extant carnivoran)Median25.313.567.810.3130.296
Standard Deviation2.790.825.170.6120.183
Skewness (Fisher)-0.947-0.1760.221-1.9781.163
p for normality (Shapiro-Wilk)0.2970.0250.5210.0140.209
Damaliscus lunatusMean1039.113.6122.042.090.972
(extant bovid)Median39.943.0021.752.190.774
Standard Deviation15.322.054.630.820.527
Skewness (Fisher)0.0171.3200.1710.1322.500
p for normality (Shapiro-Wilk)0.2940.2150.3170.790<0.001
Antidorcas marsupialisMean1033.716.8414.390.960.654
(extant bovid)Median32.316.514.440.880.519
Standard Deviation8.343.355.210.870.368
Skewness (Fisher)-0.1390.3520.1091.4541.004
p for normality (Shapiro-Wilk)0.7860.7630.4430.1430.068
Sylvicapra grimmiaMean1023.953.6420.192.581.334
(extant bovid)Median23.063.3120.062.501.285
Standard Deviation5.490.863.691.400.657
Skewness (Fisher)1.3960.469-0.1310.0510.839
p for normality (Shapiro-Wilk)0.1240.0890.6010.6460.684
Cephalophus sylvicultorMean1031.893.092.050.110.204
(extant bovid)Median34.382.631.750.060.172
Standard Deviation10.751.630.980.140.134
Skewness (Fisher)-0.9661.2500.6190.8631.824
p for normality (Shapiro-Wilk)0.1260.1390.1610.0190.022

Table 2. Descriptive statistics for each 2D dental microwear variable by species.

n, number of individuals sampled; Pits, number of pits of all size categories; CP, number of coarse pits as defined by Ref. [11]; Scratches, number of scratches of all size categories; CS, number of coarse scratches as defined by Ref. [11]; MI, microwear index as defined by the number of scratches/number of pits, Ref. [36]. All 2D dental microwear features are averages of median values taken from four photosimulations per specimen (see Materials and Methods).
CSV
Download CSV
thumbnail
Figure 2. Bivariate plots of dental microwear 2D and 3D data of carnivorans and bovids.

Bivariate plots of number of scratches and number of pits from 2D photosimulations of (A) carnivorans, and (C) bovids. Dental microwear texture data (Asfc, complexity; epLsar, anisotropy) of (B) carnivorans, and (D) bovids, from Refs. 21,23, respectively.

https://doi.org/10.1371/journal.pone.0071428.g002

Mean number of pits (ANOVA, p=0.025) is statistically distinct between bovids in the 2D study, with the grazer Damaliscus lunatus having greater pits than the browser Sylvicapra grimmia. The number of coarse pits is instead greatest in the grazer-browser Antidorcas marsupialis as compared to the frugivore Cephalophus sylvicultor (ANOVA, p=0.002). Although pits can distinguish between some extant bovids, these trends are contrary to expectations of greater pits and coarse pits in browsers and frugivores, in comparison to grazers and generalists, respectively. Mean number of scratches is distinct in bovids (ANOVA, p<0.0001). Predictably, fewer scratches occur in the frugivore C. sylvicultor, as compared to all other extant bovids analyzed (p<0.0001 for all Tukey HSD tests). Further, A. marsupialis has fewer scratches than D. lunatus and S. grimmia (p=0.001 and 0.012, respectively, Tukey HSD tests).

Although scratch frequency can clearly discriminate between frugivores and grazers consistent with observed diets (i.e., grazers having a greater number of scratches), DMTA variables are better able to discriminate between disparate dietary niches (Figure 2). Specifically, the grazer D. lunatus has greater anisotropy than all other bovids (Fisher LSD and Tukey HSD tests, p<0.0001), while the intermediate grazer-browser A. marsupialis has greater anisotropy than C. sylvicultor and S. grimmia (Fisher LSD tests, p<0.05). Similarly, the frugivore C. sylvicultor has the greatest complexity (followed by the browser S. grimmia, mixed feeder A. marsupialis, and grazer D. lunatus), significantly greater than all other bovids sampled (Fisher LSD and Tukey HSD tests, p≤0.001). The browser S. grimmia also has greater complexity than A. marsupialis and D. lunatus (Fisher LSD and Tukey HSD tests, p<0.01), while D. lunatus has lower complexity than A. marsupialis (Fisher LSD tests, p<0.05). Similarly, features such as textural fill volume can be used to distinguish between grazing/mixed feeding (i.e., D. lunatus and A. marsupialis) as compared to browsing/frugivory (i.e., S. grimmia and C. sylvicultor; Kruskal-Wallis test, p<0.0001).

While DMTA provides greater resolution between disparate dietary groups in both herbivorous and carnivorous taxa, there is also congruence between DMTA variables and traditional dental microwear variables (Spearman’s rank correlations). Most notably, anisotropy and total number of scratches and coarse scratches are positively correlated (ρ=0.31, p<0.01; ρ=0.30, p<0.01, respectively). The same is true for scale of maximum complexity (ρ=0.38, p<0.001; ρ=0.36, p<0.01, respectively). Further, scratch counts and coarse scratch counts are negatively correlated with complexity (ρ=-0.59, p<0.0001; ρ=-0.49, p<0.0001, respectively) and textural fill volume (ρ=-0.40, p<0.001; ρ=-0.32, p<0.01, respectively). Pit counts and coarse pit counts are not significantly correlated with DMTA characters, with the exception of a negative relationship between total pit count and textural fill volume (ρ=-0.27, p=0.02). Microwear index values are positively correlated with anisotropy (ρ=0.33, p<0.01) and scale of maximum complexity (ρ=0.45, p<0.0001), and negatively correlated with complexity (ρ=-0.55, p<0.0001) and textural fill volume (ρ=-0.33, p<0.01). Although DMTA variables measure different textural attributes, complexity is positively correlated with textural fill volume (ρ=0.71, p<0.0001) and negatively correlated with anisotropy (ρ=-0.51, p<0.0001) and scale of maximum complexity (ρ=-0.59, p<0.0001). Anisotropy is positively correlated with scale of maximum complexity (ρ=0.33, p<0.01) and negatively correlated with textural fill volume (ρ=-0.36, p<0.01), while scale of maximum complexity is negative correlated with textural fill volume (ρ=-0.23, p=0.046). Heterogeneity measurements do not here reveal dietary differences and are only correlated with each other (ρ=0.73, p<0.0001).

Observer Differences

Results are presented in Tables 3-4 and illustrated in Figure 3. As DMTA attributes are calculated using scale sensitive fractal analysis, microwear data do not vary between observers. In contrast, mean interobserver error of 2D features varies in carnivorans from 30.4% to 463% (mean of 169%) in pit frequency and 12.4% to 98.9% (mean of 60.5%) in scratch frequency. Mean interobserver error for coarse pits and coarse scratches instead range from 33.3% to 166.7% (mean 82%) and from 16.7% to 200% (mean 81.5%), respectively. Bovids instead have significantly lower mean interobserver errors of 49.4% (range of 9.1% to 102%) and 45.4% (range of 6.5% to 150%) in pits and scratches, respectively (p<0.0001, Mann-Whitney tests). Coarse scratches have error percentages of 65.6% (ranging from 0% to 150%), significantly lower (p=0.0002, Mann-Whitney tests) than carnivorans despite the tendency for observers to have highly variable feature counts. Interobserver error of mean coarse pits is 78.2% (ranging from 4.8% to 150%).

Dietary GroupTaxonnPitsCPScratchesCSMI
carnivore, avoids bone processingAcinonyx jubatus9p<0.001*p<0.0001*p=0.291p<0.0001*p=0.014*
carnivore, generalized degree of durophagyPanthera leo15p<0.0001*p<0.0001*p=0.068p<0.0001*p=0.059
carnivore, high degree of durophagyCrocuta crocuta12p<0.0001*p<0.0001*p=0.066p<0.001*p=0.068
herbivore, grazerDamaliscus lunatus10p<0.0001*p<0.0001*p<0.001*p<0.001*p<0.0001*
herbivore, grazer-browserAntidorcas marsupialis10p<0.0001*p<0.001*p=0.009*p<0.001*p=0.001*
herbivore, browserSylvicapra grimmia10p<0.0001*p<0.0001*p=0.002*p<0.001*p<0.001*
herbivore, frugivoreCephalophus sylvicultor10p<0.001*p<0.001*p<0.0001*p=0.004*p<0.001*

Table 3. Summary of comparisons using Dunn’s procedure of observer differences between all extant taxa analyzed.

* Significant values (p<0.05). n, number of individuals sampled; Pits, number of pits of all size categories; CP, number of coarse pits as defined by Ref. [11]; Scratches, number of scratches of all size categories; CS, number of coarse scratches as defined by Ref. [11]; MI, microwear index as defined by the number of scratches/number of pits, Ref. [36]. All 2D dental microwear features analyzed are averages of median values taken from four photosimulations per specimen per observer (see Materials and Methods)
CSV
Download CSV
TaxaStatistical TestsPitsCPScratchesCSMI
Bovids
  1. Wilcoxon signed-rank test
  2. (mean values, n=40)
p=0.468p=0.002*p=0.023*p=0.256p=0.900
Student’s t-test (if appropriate)p=0.703N/Ap=0.039*N/AN/A
  1. Wilcoxon signed-rank test
  2. (all scans, n=120)
p=0.161p<0.001*p<0.010*p=0.112p=0.875
Carnivorans
  1. Wilcoxon signed-rank test
  2. (mean values, n=40)
p=0.001*p<0.0001*p<0.0001*p=0.078p=0.119
Student’s t-test (if appropriate)p=0.001*N/Ap<0.0001*N/AN/A
  1. Wilcoxon signed-rank test
  2. (all scans, n=120)
p<0.0001*p<0.0001*p<0.0001*p=0.029*p=0.383

Table 4. Paired comparisons of the two most highly trained observers (1 and 2) for all carnivorous and herbivorous taxa analyzed.

* Significant values (p<0.05). Pits, number of pits of all size categories; CP, number of coarse pits as defined by Ref. [11]; Scratches, number of scratches of all size categories; CS, number of coarse scratches as defined by Ref. [11]; MI, microwear index as defined by the number of scratches/number of pits, Ref. [36].
CSV
Download CSV
thumbnail
Figure 3. Bivariate plots of number of scratches and number of pits of carnivorans and bovids.

Mean values of all four observers +/- 1 standard deviation are noted in black. Individual observer mean values are noted for each observer (1, orange; 2, green; 3, blue; 4, red) for carnivorans (A) and bovids (B). Colored dashed triangles correspond with each individual observer and mean values, connecting all carnivorans (A) and the three dietary categories of grazers, browsers, and frugivores in bovids (B). Carnivoran symbols include: A. jubatus, diamond; P. leo, triangle; and, C. crucuta, square. Bovid symbols include: D. lunatus, diamond; A. marsupialis, triangle; S. grimmia, circle; and, C. sylvicultor, square.

https://doi.org/10.1371/journal.pone.0071428.g003

Two-dimensional dental microwear data are highly variable, and observer differences are significant in all features of all species, except scratches in carnivorans and microwear index in P. leo and C. crocuta (Table 3). However, when all scans are compared between observers, differences are significant in all but A. jubatus scratches, which approaches significance (p=0.052; Table S5). While observer differences are apparent, observers maintain consistency in regard to the relative amount of pits and scratches assigned. For example, all observers attribute the greatest mean number of scratches to A. jubatus, followed by the generalist P. leo and scavenger C. crucuta (Figure 3). In contrast, pit assignments are more variable, although mean pits are consistently greater in P. leo as compared to C. crucuta (Figure 3). Observers are similarly consistent when characterizing scratches, and typically assign the greatest mean number of scratches to either D. lunatus or S. grimmia, with A. marsupialis having more scratches than C. sylvicultor (Figure 3). Similar to carnivorans, pit assignments are highly variable and not consistent in relative rank order between observers.

Observers 1 and 2 are the most highly trained and have 2D microwear variables most similar to mean values (Figure 3); thus, these observers were compared to one another across all dietary categories. In carnivorans, observer assignments were different in all but coarse scratches and microwear index values (Table 4). In bovids, only coarse pits and scratches were different between observers (Table 4). However, mean interobserver error of observers 1 and 2 is lowest in scratches (24.6%), followed by coarse scratches (26.2%), pits (27.3%), and coarse pits (66.3%) in carnivorans. In bovids, mean interobserver error of observers 1 and 2 is lowest in coarse scratches (25.2%), followed by pits (29.4%), scratches (34.3%), and coarse pits (44.8%).

Discussion

Dietary Comparisons

Previous studies of carnivoran 2D microwear differentiate between distinct diets based on foraging behavior [27,28]. Van Valkenburgh and coauthors demonstrated that analysis of scanning electron microscope images of dental microwear (250x) differentiates consumers of large bones such as the spotted hyena (Crocuta crocuta), from other carnivorans, based on the number of pits present on their teeth [28]. Subsequent studies further confirmed these results and suggest that the consumption of large bones can be determined by low resolution (63x) two-dimensional microwear analysis [27]. Specifically, spotted hyenas are statistically distinct from folivores, frugivores, insectivores, malacophages, omnivores, piscivores, and larvae and worm eaters via pit frequency [27]. Contrary to expectations, our two-dimensional microwear results actually demonstrate the absence of statistical distinctions between C. crocuta and other carnivorans sampled, based on number of pits or coarse pits (Table 2). It is possible that our sampled C. crocuta differed from expectations based on a difference in diet caused by seasonal or regional variation, or that C. crocuta has ‘fallback’ resources of bone that are not always utilized [22]. In contrast, our 2D analysis of scratch frequency does differentiate between bone-avoiders and those engaging in greater durophagy, as suggested by prior work [28]. Thus, our results imply that 2D analysis can be successful at distinguishing bone-avoiders, such as A. jubatus, from bone consumers; however, DMTA analysis of extinct and extant carnivorans demonstrates the ability to infer degree of carcass utilization absent of observer biases and potentially with greater discrimination at the individual specimen level [22,23].

The more extensive literature concerning herbivore microwear suggests that 2D analysis of ungulate molars can distinguish between grazers and browsers, with frugivores and mixed feeders falling in-between [15]. Many studies have sought to characterize past environments based on bovid microwear [29,30]. A comparison of extant and extinct African bovids showed that these herbivores could be reliably identified as browsers or grazers [31]. As many paleoecological studies analyze bovid microwear to assess the presence of open grasslands, being able to identify grazers using microwear is fairly reliable via scratch counts, both here and in prior work [3133].

Observer-generated 2D microwear features can distinguish extreme dietary categories, such as between frugivores and non-frugivorous bovids, based on number of scratches (Figure 2). Contrary to expectations, we recorded higher numbers of pits for the obligate grazer D. lunatus than for the browser S. grimmia. ‘Prism plucking’, wherein small, prism-sized pits are removed from the enamel surface, can result from parallel food processing of tough foods such as grass blades that require shearing or grinding [34,35]. Previous researchers hypothesized that this phenomena caused pits in the teeth of grazers, and thus may have caused the higher number of pits observed for D. lunatus relative to S. grimmia. Our findings suggest that coarse designations (e.g., between grazers and frugivores) may be possible using 2D microwear; however, distinguishing between distinct dietary niches in herbivorous taxa such as bovids, requires the inclusion of three-dimensional data. For example, 3D microwear studies have shown that DMTA attributes accurately separated obligate grazers, generalists, browser-grazer intermediates, frugivores, and browsers in extant African bovids [21]. The DMTA analysis of bovids described here derives from the same dataset and demonstrates how increased complexity (Asfc) and decreasing anisotropy (epLsar) occurs with the predictable consumption of harder and/or less abrasive food items. Lastly, the convergence of similar DMTA results across disparate taxonomic groups (e.g., bovids, macropods, primates, xenarthrans) [18,19,2125] contributes to greater comparability amongst diverse organisms.

Dental microwear texture analysis attributes record diet in a similar, but more discerning manner, as some traditional dental microwear variables (i.e., scratches and microwear index values). Specifically, photosimulations with greater scratch and coarse scratch frequencies also had higher anisotropy, as expected (i.e., anisotropy is greater when features of similar depth are oriented in similar directions, akin to scratches). In contrast, photosimulations with high numbers of scratches and coarse scratches also had lower complexity and textural fill volume. While anisotropy and complexity are representative of different textural attributes, high anisotropy is usually accompanied with low complexity and vice versa (relationships between these two variables are significant). Number of pits is typically unrelated to most DMTA variables, as individuals consuming hard objects may have fewer but deeper pits while others may have lots of smaller pits; however, individuals with higher textural fill volume (likely containing fewer but larger and/or deeper pits) have significantly fewer pits. As pit counts of like surfaces are highly variable and inconsistent between observers, pits may be harder for observers to discern and less informative. Thus, the use of 3D DMTA data can better differentiate between disparate dietary groups in both herbivorous and carnivorous taxa, likely due to the inclusion of quantitative depth data.

Observer Comparisons

Overall, highly significant differences were observed between observers in either pits and/or scratches in all taxa. This is consistent with prior methodological studies [47,16] and poses a concern for comparing data between observers. Even highly trained observers lack consistency in at least one major feature (i.e., pits or scratches) in both herbivorous and carnivorous mammals (Table 4). Although observer differences in herbivorous taxa are slightly higher than other studies [47,16], they are consistent with ranges from these studies when also accounting for the number of observers (which increases the potential for greater observer differences) and when comparing the most highly trained observers. However, as there are no published studies that have calculated interobserver error of microwear features in carnivores, future work is necessary to determine if carnivore microwear counts are consistently highly variable. While observer discrepancies in microwear feature counts raise concern, ratios such as the microwear index may be useful in reducing observer differences in highly trained individuals, as previously suggested [5,7]. For example, an individual who counts more features may have a similar microwear index as another observer if both pit and scratch counts are proportionally inflated.

The rough structure of herbivore 'trophic triangles' is preserved in the most experienced observers and is consistent with prior work [7,15]. While carnivorous 'trophic triangles' are apparent and relatively consistent between the most highly trained observers, pit counts are highly variable and inconsistent (as compared to mean scratches which maintain the same rank order between all observers, Figure 3). Nevertheless, the overall lack of consistency between observers (all mean interobserver error rates are greater than 45%) calls to question the repeatability and comparability of two-dimensional microwear data that is determined by a human observer, particularly in the case of carnivorous mammals (with mean observer errors exceeding 60%).

Concluding Remarks

Previous studies have indicated that two-dimensional low-resolution microwear analysis provides a fast, cost-effective method for determining gross dietary differences within taxa, such as the difference between grazers and frugivores [11,15], or the difference between bone-avoiders and bone consumers [27]. DMTA, however, is able to distinguish between more subtle dietary niches than two-dimensional high-resolution microwear analysis for both bovids and carnivorans. Further, 2D analyses are highly variable between observers, even those who are highly trained. Collectively, we suggest that quantifying dental microwear in 3D has the potential to distinguish between diverse diets with less variability than 2D methods. The identification of coarse dietary categories using 2D methods (at 100x magnification) may still be possible; however, caution should be taken in comparing data between different observers.

Materials and Methods

Materials

Carnivorans included in this study consist of the following extant species: Acinonyx jubatus (cheetah, n=9), Panthera leo (African lion, n=15), and Crocuta crocuta (spotted hyena, n=12). All extant carnivoran data including descriptive statistics are reported in Ref. [23]. Bovids included in this study are from Scott [21] and consist of the following extant species: Antidorcas marsupialis (springbok, n=10), Cephalophus sylvicultor (yellow-backed duiker, n=10), Damiliscus lunatus (common tsessebe, n=10), and Sylvicapra grimmia (common duiker, n=10). All specimens examined in this study are housed in publicly accessible collections and were examined and molded while visiting respective museums (permission to mold and study all included specimens was granted by all listed museums), including the American Museum of Natural History (AMNH), Field Museum of Natural History (FMNH), National Museum of Natural History (NMNH), Iziko South African Museum (SAM), and, Royal Museum for Central Africa (RMCA). All dental microwear texture data were previously analyzed and published [21,23]; however, the photosimulations of prior analyses are here measured for 2D dental microwear features.

Dental Microwear

The enamel region of the lower carnassial shearing facet of the M1 trigonid was examined on all carnivoran specimens [23], and on all bovid specimens the disto-buccal enamel band of the mesial cuspoid of the M2 was examined [21]. All analyzed facets were first cleaned with cotton swabs soaked in acetone to remove preservative (e.g., Butvar). Once the tooth was dry, a mold was made using polyvinylsiloxane dental impression material (President’s Jet regular body, Coltène-Whaledent Corp., Cuyahoga Falls, OH, USA). Tooth casts were then prepared using Epotek 301 epoxy resin and hardener (Epoxy Technologies Corp., Billerica, MA, USA).

Dental microwear texture analysis (DMTA) was performed on all casts that preserved ante mortem microwear using white-light confocal profilometry and scale-sensitive fractal analysis (SSFA) [1823]. All specimens were scanned in three dimensions in four adjacent fields of view at 100x magnification, for a total sampled area of 204 x 276 µm2. These scans, labeled a-d, were converted to photosimulation bitmap images for 2D dental microwear analysis via Solarmap Universal software (Solarius Development, Inc.). At the magnification and total sampling area mentioned above, features ≥2 µm are likely to be well resolved. All bitmaps were renamed with a randomly assigned number and made accessible to all observers for counting. Four observers counted each a-d scan of all taxa per dietary group, for a total of 144 carnivoran and 160 bovid scans. None of the observers were aware of what taxa were being studied or the identification of individual scans, when collecting data. All photosimulations were saved at 28.35 dots per cm (dpcm) and viewed on computer monitor screens with resolutions of ≥ 35.43 dpcm. Observers counted the number of pits, coarse pits, scratches, and coarse scratches in each bitmap (as defined by [11]), with microwear index calculated from scratch and pit counts (number of scratches/number of pits) [36]. As Ref. [11] is the most commonly employed method by those primarily studying non-primate herbivorous and carnivorous mammals, we have quantified 2D microwear using this method (in contrast to other similar microwear methods, including those that use imaging or microwear software). Median dental microwear variables were calculated per specimen per observer (as is done with DMTA attributes) and subsequently analyzed, except when explicitly noted. All image files are available upon request.

Tooth surfaces were analyzed for DMTA attributes including: complexity, scale of maximum complexity, anisotropy, heterogeneity, and textural fill volume. Complexity (Asfc) distinguishes taxa that consume brittle foods from taxa that consume softer and/or tougher ones, by assessing the change in surface roughness across changing scale of observation [19,20]. Organisms that consume harder and/or more brittle food items have higher complexity [1925]. Scale of maximum complexity (Smc) measures the fine-scale limits of the Asfc with greater Smc surface values associated with fewer small features [20]. Anisotropy (epLsar) represents the degree that features of similar depth share a similar orientation (e.g., lots of parallel striations yield more anisotropic surfaces) [19,20]. Grazers or flesh consumers typically have higher anisotropy due to the presence of many parallel scratches of similar depth [1925]. Heterogeneity (HAsfc(3x3) and HAsfc(9x9)), the degree of texture complexity variation, is measured by calculating Asfc variation among subdivided samples (a 3x3 and 9x9 grid, totaling 9 to 81 subsamples, respectively) [19,20]. Thus, surfaces with high heterogeneity have greater disparity in complexity values between subdivided samples and the entire surface. Lastly, textural fill volume (Tfv) measures the volume filled by large (10 µm diameter) and small (2 µm diameter) square cuboids, with high Tfy values indicating potentially deeper and/or larger features [2025]. Scale sensitive fractal analysis software (ToothFrax and SFrax, Surfract Corp., www.surfrait.com) was used to analyze all scans and characterize tooth surfaces.

Statistical Analysis

Normality tests (Shapiro-Wilk tests, Tables 1, 2) were run on all 2D and 3D variables. However, as the majority of dental microwear variables are not normally distributed we used non-parametric statistical tests (Kruskal-Wallis) to compare differences among all taxa and between observers, except when noted. Carnivorous and herbivorous mammals were analyzed separately. We used Dunn’s procedure [37] and equivalent parametric tests (i.e., Fisher LSD and Tukey HSD tests) when appropriate to conduct multiple comparisons between taxa within like dietary groups (i.e., herbivores-carnivores). Additionally, we compared the two most experienced microwear counters per dietary group, using paired Wilcoxon signed-rank tests and Student’s t-tests (when normally distributed). When comparing observer differences, median microwear values were compared between different individuals (however, comparisons of all individual scans were also made and noted in the results and Table S5). We calculated interobserver error based on Ref. [4] using 2D microwear attributes for all photosimulations analyzed per dietary group (i.e., 144 in carnivorans, 160 in bovids), including all four observers and the two most trained observers. Note, when comparing only two observers, interobserver error can never exceed 100%, mathematically. Correlations between DMTA feature attributes and traditional dental microwear characters (e.g., pit and scratch frequency) were analyzed using Spearman’s rank correlation coefficients (ρ).

Supporting Information

Appendix S1.

All observer counts for all scans of all extant taxa included in this study.

https://doi.org/10.1371/journal.pone.0071428.s001

(XLS)

Table S1.

All carnivoran specimens examined and 3D dental microwear texture attributes.

https://doi.org/10.1371/journal.pone.0071428.s002

(DOC)

Table S2.

All bovid specimens examined and 3D dental microwear texture attributes.

https://doi.org/10.1371/journal.pone.0071428.s003

(DOC)

Table S3.

All carnivoran specimens examined and 2D dental microwear character averages between four observers.

https://doi.org/10.1371/journal.pone.0071428.s004

(DOC)

Table S4.

All bovid specimens examined and 2D dental microwear character averages between four observers.

https://doi.org/10.1371/journal.pone.0071428.s005

(DOC)

Table S5.

Summary of comparisons using Dunn’s procedure of observer differences between all individual scans of all extant carnivorans analyzed.

https://doi.org/10.1371/journal.pone.0071428.s006

(DOC)

Acknowledgments

For access to publicly accessible collections we thank curators and collections managers from the American Museum of Natural History (AMNH), Field Museum of Natural History (FMNH), National Museum of Natural History (NMNH), Iziko South African Museum (SAM), and, Royal Museum for Central Africa (RMCA). We are grateful to L. Loffredo and three anonymous reviewers for comments on an earlier version of this manuscript.

Author Contributions

Conceived and designed the experiments: LRGD. Performed the experiments: LRGD JRS BWS SLD BMM CAV AAW MAG MCO. Analyzed the data: LRGD. Contributed reagents/materials/analysis tools: LRGD JRS BWS. Wrote the manuscript: LRGD SLD BMM CAV AAW.

References

  1. 1. Walker A, Hoeck HN, Perez L (1978) Microwear of mammalian teeth as an indicator of diet. Science 201: 908–910. doi:https://doi.org/10.1126/science.684415. PubMed: 684415.
  2. 2. Grine FE (1981) Trophic differences between “gracile” and “robust” Australopithecines: a scanning electron microscope analysis of occlusal events. S Afr J Sci 77: 203–230.
  3. 3. Gordon KD (1982) A study of microwear on chimpanzee molars: implications for dental microwear analysis. Am J Phys Anthropol 59: 195–215. doi:https://doi.org/10.1002/ajpa.1330590208. PubMed: 7149017.
  4. 4. Grine FE, Ungar PS, Teaford MF (2002) Error rates in dental microwear quantification using scanning electron microscopy. Scanning 24: 144–153. PubMed: 12074496.
  5. 5. Galbany J, Martínez LM, López-Amor HM, Espurz V, Hiraldo O et al. (2005) Error rates in buccal-dental microwear quantification using scanning electron microscopy. Scanning 27: 23–29. PubMed: 15712754.
  6. 6. Ungar PS, Scott RS, Scott JR, Teaford MF (2008) Dental microwear analysis: historical perspectives and new approaches. In: JD IrishGC Nelson. Technique and Application in Dental Anthropology, Vol. 53, Vol. 53, Vol. 53. Cambridge: Cambridge University Press. pp. 389–425.
  7. 7. Mihlbachler MC, Beatty BL, Caldera-Siu A, Chan D, Lee R (2012) Error rates and observer bias in dental microwear analysis using light microscopy. Paleontol Electronica 15(1): 12A.
  8. 8. Teaford MF, Walker A (1984) Quantitative differences in dental microwear between primate species with different diets and a comment on the presumed diet of Sivapithecus. Am J Phys Anthropol 64: 191–200. doi:https://doi.org/10.1002/ajpa.1330640213. PubMed: 6380302.
  9. 9. Gordon KD (1984) Orientation of occlusal contacts in the chimpanzee, Pan troglodytes verus, deduced from scanning electron microscopic analysis of dental microwear patterns. Arch Oral Biol 29: 783–787. doi:https://doi.org/10.1016/0003-9969(84)90007-4. PubMed: 6594090.
  10. 10. Gordon KD (1988) A review of methodology and quantification in dental microwear analysis. Scan Microsc 2: 1139–1147.
  11. 11. Solounias N, Semprebon G (2002) Advances in the reconstruction of ungulate ecomorphology with application to early fossil equids. Am Mus Novit: 1–49.
  12. 12. Rodrigues HG, Merceron G, Viriot L (2009) Dental microwear patterns of extant and extinct Muridae (Rodentia, Mammalia): ecological implications. Naturwissenschaften 96: 537–542. doi:https://doi.org/10.1007/s00114-008-0501-x. PubMed: 19127354.
  13. 13. Merceron G, Blondel C, Brunet M, Sen S, Solounias N et al. (2004) The Late Miocene paleoenvironment of Afghanistan as inferred from dental microwear in artiodactyls. Palaeogeogr Palaeoclimatol Palaeoecol 207: 143–163. doi:https://doi.org/10.1016/j.palaeo.2004.02.008.
  14. 14. Merceron G, Blondel C, De Bonis L, Koufos GD, Viriot L (2005) A new method of dental microwear analysis: application to extant primates and Ouranopithecus macedoniensis (Late Miocene of Greece). Palaios 20: 551–561. doi:https://doi.org/10.2110/palo.2004.p04-17.
  15. 15. Semprebon GM, Godfrey LR, Solounias N, Sutherland MR, Jungers WL (2004) Can low-magnification stereomicroscopy reveal diet? J Hum Evol 47: 115-144. doi:https://doi.org/10.1016/j.jhevol.2004.06.004. PubMed: 15337412.
  16. 16. Scott R, Schubert B, Grine F, Teaford M (2008) Low magnification microwear: questions of precision and repeatability. J Vert Paleontol 28 (3): 139A.
  17. 17. Mihlbachler MC, Beatty BL (2012) Magnification and resolution in dental microwear analysis using light microscopy. Paleontol Electronica 15(3): 25A.
  18. 18. Ungar PS, Brown CA, Bergstrom TS, Walkers A (2003) Quantification of dental microwear by tandem scanning confocal microscopy and scale-sensitive fractal analyses. Scanning 25: 185–193. PubMed: 12926610.
  19. 19. Scott RS, Ungar PS, Bergstrom TS, Brown CA, Grine FE et al. (2005) Dental microwear texture analysis shows within-species diet variability in fossil hominins. Nature 436: 693–695. doi:https://doi.org/10.1038/nature03822. PubMed: 16079844.
  20. 20. Scott RS, Ungar PS, Bergstrom TS, Brown CA, Childs BE et al. (2006) Dental microwear texture analysis: technical considerations. J Hum Evol 51: 339–349. doi:https://doi.org/10.1016/j.jhevol.2006.04.006. PubMed: 16908052.
  21. 21. Scott JR (2012) Dental microwear texture analysis of extant African Bovidae. Mammalia 76: 157–174.
  22. 22. Schubert BW, Ungar PS, DeSantis LRG (2010) Carnassial microwear and dietary behaviour in large carnivorans. J Zool 280: 257–263. doi:https://doi.org/10.1111/j.1469-7998.2009.00656.x.
  23. 23. DeSantis LRG, Schubert BW, Scott JR, Ungar PS (2012) Implications of diet for the extinction of saber-toothed cats and American lions. PLOS ONE 7(12): e52453. doi:https://doi.org/10.1371/journal.pone.0052453. PubMed: 23300674.
  24. 24. Prideaux GJ, Ayliffe LK, Desantis LRG, Schubert BW, Murray PF et al. (2009) Extinction implications of a chenopod browse diet for a giant Pleistocene kangaroo. Proc Natl Acad Sci U S A 106: 11646–11650. doi:https://doi.org/10.1073/pnas.0900956106. PubMed: 19556539.
  25. 25. Haupt RJ, DeSantis LRG, Green JL, Ungar PS (2013) Dental microwear texture as a proxy for diet in xenarthrans. J Mammal (In press). http://dx.doi.org/10.1644/12-MAMM-A-204.1.
  26. 26. Beatty BL, Mihlbachler MC (2012) Comparison of light microscopy-based dental microwear and dental microwear texture analysis: implications for testing hypotheses of feeding ecology in extinct vertebrates. J Vert Paleontol 32: 61A–62A.
  27. 27. Goillot C, Blondel C, Peigné S (2009) Relationships between dental microwear and diet in Carnivora (Mammalia) - Implications for the reconstruction of the diet of extinct taxa. Palaeogeogr Palaeoclimatol Palaeoecol 271: 13–23. doi:https://doi.org/10.1016/j.palaeo.2008.09.004.
  28. 28. Van Valkenburgh B, Teaford MF, Walker A (1990) Molar microwear and diet in large carnivores: inferences concerning diet in the sabretooth cat, Smilodon fatalis. J Zool 222: 319–340. doi:https://doi.org/10.1111/j.1469-7998.1990.tb05680.x.
  29. 29. Merceron G, de Bonis L, Viriot L, Blondel C (2005) Dental microwear of fossil bovids from northern Greece: paleoenvironmental conditions in the eastern Mediterranean during the Messinian. Palaeogeogr Palaeoclimatol Palaeoecol 217: 173-185. doi:https://doi.org/10.1016/j.palaeo.2004.11.019.
  30. 30. Gagnon M, Chew AE (2000) Dietary preferences in extant African Bovidae. J Mammal 81: 490–511. doi:https://doi.org/10.1644/1545-1542(2000)081.
  31. 31. Schubert BW, Ungar PS, Sponheimer M, Reed KE (2006) Microwear evidence for Plio-Pleistocene bovid diets from Makapansgat Limeworks Cave, South Africa. Palaeogeogr Palaeoclimatol Palaeoecol 241: 301–319. doi:https://doi.org/10.1016/j.palaeo.2006.04.004.
  32. 32. Solounias N, Rivals F, Semprebon GM (2010) Dietary interpretation and paleoecology of herbivores from Pikermi and Samos (late Miocene of Greece). Paleobiology 36: 113–136. doi:https://doi.org/10.1666/0094-8373-36.1.113.
  33. 33. Fraser D, Theodor JM (2011) Comparing ungulate dietary proxies using discriminant function analysis. J Morphol 272: 1513–1526. doi:https://doi.org/10.1002/jmor.11001. PubMed: 21915893.
  34. 34. Walker A (1984) Mechanisms of honing in the male baboon canine. Am J Phys Anthropol 65: 47–60. doi:https://doi.org/10.1002/ajpa.1330650108. PubMed: 6541880.
  35. 35. Teaford MF, Runestad JA (1992) Dental microwear and diet in Venezuelan primates. Am J Phys Anthropol 88: 347–364. doi:https://doi.org/10.1002/ajpa.1330880308. PubMed: 1642321.
  36. 36. MacFadden BJ, Solounias N, Cerling TE (1999) Ancient diets, ecology, and extinction of 5-million-year-old horses from Florida. Science 283: 824-827. doi:https://doi.org/10.1126/science.283.5403.824. PubMed: 9933161.
  37. 37. Dunn OJ (1964) Multiple comparisons using rank sums. Technometrics 6: 241-252. doi:https://doi.org/10.1080/00401706.1964.10490181.