http://orcid.org/0000-0003-2636-9546
Figures
Abstract
We used a gas chromatography-mass spectrometry (GC-MS) based metabolomics approach to obtain the metabolic profiling of unexplained male infertility (UMI), and identified seminal plasma biomarkers associated with UMI by a two-stage population study. A robust OPLS-DA model based on these identified metabolites was able to distinguish 82% of the UMI patients from health controls with a specificity of 92%. In this model, 44 metabolites were found differentially expressed in UMI subjects compared with health controls. By pathway enrichment analysis, we identified several major changed metabolic pathways related to UMI. Our findings provide new perspective for the diagnosis of UMI.
Citation: Qiao S, Wu W, Chen M, Tang Q, Xia Y, Jia W, et al. (2017) Seminal plasma metabolomics approach for the diagnosis of unexplained male infertility. PLoS ONE 12(8): e0181115. https://doi.org/10.1371/journal.pone.0181115
Editor: Joël R. Drevet, Universite Blaise Pascal, FRANCE
Received: February 19, 2017; Accepted: June 25, 2017; Published: August 10, 2017
Copyright: © 2017 Qiao et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper.
Funding: This work was supported by the National Natural Science Foundation of China and Priority Academic Program for the Development of Jiangsu Higher Education Institutions. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Declines in fertility have become a serious concern in recent years, and have been accompanied by increasing requirements for infertility treatment [1]. Infertility is clinically defined as failure of a couple to conceive after one year of regular sexual intercourse. An estimated 4–17% of couples seek medical treatment in order to rectify their infertility. It is reasonable to assume that there are many more cases of infertility that are unreported [2]. About 50% infertile cases are attributed to male factor. Despite considerable efforts to identify the pathophysiology of the disease, the underlying mechanisms of approximately half of infertility cases are still unclear.
Unexplained male infertility (UMI) is a diagnosis reserved for men in whom routine semen analysis results are within normal values, and physical as well as endocrine abnormalities were ruled out. Currently, routine semen analysis remains the backbone of the evaluation of the UMI [3]. Technological developments in the field of metabolomics may bring robust and cost-effective clinical tools to fix the shortcomings of the routine semen analysis and provide new insights into UMI. Seminal plasma has long been used as a key source to investigate male infertility. It has been reported that infertile patients represent significant change at metabolome level compared to fertile men, based on metabolomics fingerprinting studying infertile patient seminal plasma [4]. Previous studies have shown that metabolic fingerprinting can be applied as a screening tool for male infertility problems [5].
Further tests are certainly required beyond routine semen analysis for evaluating subfertile men. Genomic [6–9] and proteomic [10–12] efforts were paid in diagnostic and mechanism study for male infertility. As metabolomics is a newly emerging technology which holds promise for diagnosis of disease and discovery of mechanisms linked to disease processes [13, 14], metabolomics approaches based on serum or urine samples have shown potential of establishing useful research tools for male infertility [15, 16]. Even though the metabolomics changes in seminal plasma, which is the most valuable sample type that mediates the chemical surrounding of sperm and the chemical function of the ejaculate, are still unclear. Seminal plasma is also a favorable noninvasive material which can provide the direct understanding of the dysregulated metabolism in reproductive organs, and may have great potential in the diagnosis of UMI.
In this study, we used a gas chromatography-mass spectrometry (GC-MS) based metabolomics approach to obtain the metabolic profiling, identified 153 seminal plasmatic metabolites from UMI patients. A robust OPLS-DA model based on these identified metabolites was able to distinguish 82% of the UMI patients from healthy controls with a specificity of 92%. In this model, 44 metabolites were found differentially expressed in UMI subjects. Our finding provides new perspective for diagnosis of UMI.
Materials and methods
Study population
The study was conducted in full compliance with government policies and the Helsinki Declaration, and the procedures were approved by institutional ethics committee of Nanjing Medical University. The subjects were the volunteers sequentially recruited from affiliated hospitals of Nanjing Medical University (NJMU). Every participant was fully informed about the purpose of this research, and written consent was obtained from each participant. All participants were ethnically Han Chinese. A questionnaire was used to collect information including personal background, lifestyle factors, occupational and environmental exposures, genetic risk factors, sexual and reproduction status, medical history, and physical activity. Cases included in this study were UMI with normal semen quality in accordance with WHO guidelines and normal physical as well as endocrine status. They were husbands of couples who attended the affiliated hospitals of NJMU because of conception failure for at least 12 months. Their wives had undergone a series of clinical tests and their reproductive function was evaluated as normal. The men had undergone complete historical and physical examinations and measurement of hormones as well as routine semen analysis; their partners had undergone complete historical and physical examinations, including conventional gynecological examination, serum hormone level measurements, tubal assessment, ovarian function testing, hysteroscopy, β-ultrasonic examination, immunologic test, microbial inspection, and karyotype analysis. Fertile controls (FC) in the present study were fertile men recruited and sampled at the same period as the UMI cases. They were from the early pregnancy registry of the same hospitals who were in the third month following a successful pregnancy. They were healthy men with normal reproductive function, prospectively confirmed by them fathering healthy babies 6~8 months later. Eighty UMI cases and 80 matched FCs were randomly included in training set; 50 UMI cases and 50 matched FC were randomly included in the validation set.
Semen collection, analysis and storage
Semen samples were obtained in private by masturbation into a sterile wide-mouth and metal-free glass container after an at least 3-day abstinence. Routine semen analyses were performed using a computer aided semen analyzer (CASA) (WLJY 9000, Weili New Century Science and Tech Dev., China), while referring to guidelines in the fourth edition World Health Organization (WHO) Laboratory Manual for the Examination of Human Semen. After collection, the semen was liquefied at 37°C for 30 min and then analyzed in accordance with WHO guidelines; variables examined included semen volume, concentration, number per ejaculum, motility, vitality, progression, and motion parameters. Strict quality control measures were enforced throughout the entire study. Semen samples were assessed twice, and the counting procedure was automatic and performed by two technicians according to WHO recommendations. CASA results were compared directly with manual assessments using an improved Neubauer hemocytometer over a wide range of sperm concentrations. For sperm motility analysis, we used prepared videotapes to ensure that all motile spermatozoa were being identified using the current and consistent setup parameters.
After CASA analysis, each semen sample was prepared by Percoll gradient methods for separating viable spermatozoa and seminal plasma in the laboratory. Then all samples were stored at -80°C prior to GC-MS metabolic analysis.
Sample preparation and metabolic profiling
The metabolic analysis and data processing were performed basically according to previous report [17]. Briefly, a 25 μl mixture of chloroform, methanol, and water (2:5:2) was added into 25 μl of seminal plasma and the samples were vortexed for 1 min. The samples were placed at -20°C for 20 min to extract metabolites, followed by centrifugation at 12,000 rpm for 10 min, and the liquid layer was transferred into a new tube. The residue was extracted with 50 μl of methanol using the homogenizer for 10 min followed by centrifugation at 12,000 rpm for 10 min. The supernatant was then combined with the previous extraction. After vortexing, a volume of 100 μl mixture was transferred to a glass vial spiked with internal standards (10 μl heptadecanoic acid at 1 mg/ml and 4-chlorophenylalanine at 0.3 mg/ml). Then the samples were vacuum dried at room temperature. The residue was chemically derivatized with a two-step procedure and then analyzed with Pegasus HT system (Leco Corporation, St Joseph, USA) coupled with an Agilent 6890N gas chromatography. Briefly, a 1 μl derivate was injected in splitless mode at 270°C. Helium was used as carrier gas; the flow rate was 1.0 ml/min. The transfer interface and ion source were set to 270°C and 220°C respectively. The oven temperature was set as a program which started at 80°C for 2 min, and then ramped to 180°C at a rate of 10°C/min, to 230°C with a rate of 6°C/min, finally to 295°C with a rate of 40°C/min and held for 8 min. MS data were acquired with m/z range of 30–600 at an acquisition rate of 20 spectrum/second. Compound identification for GC-TOFMS was performed by comparing the mass fragments with NIST Standard mass spectral databases using ChromaTOF software with a similarity of more than 70% and verified by available reference compounds.
Quality control
An aliquot of 5 μl of each seminal plasma sample was pooled as the quality control sample. The QC samples were stored at -80°C and prepared once for each batch, and were injected every 10 samples in the GC-MS sequence. Responses of internal standards were used for creating a QC chart, those samples where deviation of internal standards were over control limit of 3 times of relative standard deviation (RSD) were re-analyzed. RSD of compounds in each QC sample were calculated; compounds that possessed an RSD over 30% were obsoleted.
Statistical analysis
Fisher's exact test was used to analyze the differences of categorical variables such as drinking and smoking status between cases and controls. T-test was used to analyze for differences in continuous variables such as age and body mass index (BMI). Student-T tests were engaged to identify the differential seminal plasma metabolites between cases and controls, the data were log-transformed when appropriate. To obtain statistically robust results, the Bonferroni method was employed for correcting for multiple comparisons.
Those statistical methods above mentioned were all carried out within R programming language. Principal component analysis (PCA) and orthogonal partial least squares discriminant analysis (OPLS-DA) models were performed with SIMCA-P+ 13.5 (Umetrics, Umea, Sweden).
Results
Characteristics of the study population
As shown in Table 1, cases and controls were well matched for age, BMI, drinking status, and smoking status. No significant difference was observed between the two groups (Table 1).
Seminal plastic metabolomics profile
A total of 333 metabolites were obtained from metabolic profiling of seminal plasma. 153 metabolites were identified by library matching, and 96 of those were validated by local standards. After application of QC criteria, 136 metabolites were found with RSD < 0.3. Ninety compounds of those were identified, and 70 were confirmed by local standards. A PCA model was created with a learning set using the 136 metabolites. PCA score plots (Fig 1) showed the separation trend between UMI and FS groups.
Comparison of OPLS-DA models created with metabolomics data and seminal quality parameter data
Subsequently, OPLS-DA models were established and demonstrated satisfactory modeling and predictive abilities with 1 predictive component and 2 orthogonal components (R2Xcum = 0.333, R2Ycum = 0.833, Q2cum = 0.634) with metabolic profiling data (Fig 2A). As a comparison, quality parameters of seminal plasma, including semen volume, concentration, number per ejaculum, motility, vitality, progression, and motion parameters, were used for constructing another OPLS-DA model (R2Xcum = 0.360, R2Ycum = 0.423, Q2cum = 0.331). The score plot showed a poorer discriminate efficiency (a sensitivity of 82% and specificity of 92%) than that created with metabolomics data (a sensitivity of 98% and specificity of 95%) (Fig 2B).
A. Generated with metabolomic profiling data; B. Generated with quality parameter of seminal plasma data.
OPLS-DA model was validated by an independent sample set
Furthermore, an independent set of samples were profiled as the validation set which consisted of 50 UMI and 50 FC. Profiling data from the validation set were used to test the prediction ability of the established OPLS-DA model. In the Y prediction scores plot, 41 out of 50 UMI samples and 46 out of 50 control samples in validation groups were correctly assigned to proper class, using a cutoff value of 0.5 (Fig 3, the Y value was set at 1 for UMI, and 0 for controls in the learning group). This result showed the ability of the OPLA model to predict the unknown samples to the right groups with a sensitivity of 82% and specificity of 92%. As all these UMI were diagnosed as fertile male under current WHO seminal plasmatic parameter standards, the OPLS-DA model is of great significance in the diagnosis of UMI.
A. training set; B. validation set.
Seminal plastic biomarkers of UMI
Significantly altered metabolites in seminal plasma with a VIP threshold (VIP > 1) in above mentioned OPLS-DA model, as well as the Mann-Whitney U test between UMI and FC, were selected and summarized in Table 2. Among these 44 differential metabolites, 37 were confirmed by reference standards as shown in Table 2. Variations of these differential metabolites were described by fold changes where UMI subjected to FC. P-values and fold changes in validation group were also listed, and coincided well with those in the training set.
Correlations between seminal plasmatic metabolites and quality parameters of seminal plasma
Pearson correlation coefficient was calculated with metabolic profiling data and quality parameters of seminal plasmatic, including semen volume, concentration, number per ejaculum, motility, vitality, progression, and motion parameters. Significant correlated metabolites and quality parameters were listed in Table 3.
Discussion
UMI is considered a complicated disease with a genetic, proteomic, and metabolic basis. Several causes of UMI are still unknown. Previous studies have shown that metabolic fingerprinting can be applied as a screening tool for male infertility problems. In our present study, using a GC-MS-based metabolite profiling platform, a robust OPLS-DA model was able to distinguish 82% of the UMI patients from FC, from which 44 metabolites were identified differentially expressed in UMI subjects. This finding was validated with the validation set, confirming the result was robust. Pearson correlation coefficient analysis found that the relationships between the concentrations of seminal plasmatic metabolites and seminal quality parameters, indicating the result was biologically relevant.
Metabolomics has been proven to be a promising tool in disease diagnosis. The applications of metabolic-based approaches in discriminate asthenozoospermia or oligoasthenozoospermia using seminal plasma and urine have been emerging recently, confirming metabolic approach has great potential in aiding in the routine diagnosis of male infertility. However, asthenozoospermia or oligoasthenozoospermia can be identified by rountine semen analysis, there is a great need to apply metabolic approach in the identification of biomarkers related to UMI and further diagnosis of this disease. A robust OPLS-DA model based on these identified metabolites was built which was able to distinguish 82% of the UMI patients from healthy controls, from which the concentration of 44 metabolites were found aberrantly expressed in UMI subjects. Our findings, which enable the diagnostic of UMI using merely seminal plasmatic specimen, indicating our finding has great clinical significance, and will be a possible tool for identify UMI for couples that decide to conceive a baby.
The biomarkers identified in metabolomics may be related to the pathogenesis of disease, and may provide novel therapeutic targets of disease [19, 20]. Autoimmune infertility and deficient sperm function such as reactive oxygen species and fertilization defects were considered to be the causes of UMI, but the metabolic causes of UMI are still unknown [3]. Fig 4 was built based on the major findings of pathway enrichment revealed in Table 3. A notable metabolic feature of UMI patients was the remarkably disturbed amino acid metabolism. Various amino acids, including tryptophan, phenylalanine, glycine, serine, threonine, isoleucine, proline, and valine significantly decreased in seminal plasma of UMI, indicating a possible increased consumption of these amino acids. Notably, they all can be converted to glutamic acid by transamination, which can further produce ammonia. In the UMI seminal plasma, we even found decreased glutamic acid, indicating the potential ammonia burden in UMI. The human body controls the ammonia concentration in an accepted level by consumption of ammonia to generate glutamine and urea. Urea is eliminated from body by urination, and glutamine is not toxic. Interestingly, among the numerous decreased metabolites in the enriched pathways related to amino acid metabolism in UMI, we found urea and glutamine increased significantly in UMI seminal plasma, indicating the major metabolic signature of UMI seminal plasma is the increased catabolism of various amino acids. Furthermore, these changed amino acids might play roles in male reproduction. Aminoacyl-tRNAs are substrates for translation and are pivotal in determining how the genetic code is interpreted as amino acids. Some of these amino acids such as tryptophan, serine, and glycine can form aminoacyl-tRNAs. We also found the concentrations of tryptophan, phenylalanine, glycine, serine, threonine, isoleucine, proline, and valine all showed positive relationships with sperm counts, while the concentration of their deamination product urea was negatively related to sperm counts.
In this study, 4-hydroxyphenylacetic acid was identified as a key metabolite in differentiating the UMI and controls, and its concentration in seminal plasma was positively related to sperm counts. Imbalance between the oxidant burden and antioxidant defense system has aroused great attention on UMI, because it exerts a critical pathological effect on sperm function through sperm DNA damage in the nucleus and mitochondria as well as by inducing lipid peroxidation in the sperm plasma membrane [21]. A natural antioxidant defense system consists of radical scavengers, chain breaking antioxidants, and ROS-metabolizing enzymes offering protection against ROS. Vitamin C, uric acid, tryptophan, and taurine are accepted radical scavengers [22]. The lack of radical scavengers in seminal plasma contributes to UMI. Notably, it is widely reported that 4-hydroxyphenylacetic acid and related phenolic compounds exert an anti-oxidant effect [23–25]. Therefore, one reasonable mechanism underlying the involvement of 4-hydroxyphenylacetic acid in UMI is the lack of this anti-oxidant chemical for radical clearage. 4-hydroxyphenylacetic acid is an oxidative deaminated metabolite of p-tyramine and also a metabolite of tyrosine via enteric bacteria. However, this metabolite is not only endogenous, it can also be supplemented directly from foods such as olive oil [22, 23]. Therefore, there may be a convenient therapeutic intervention for UMI by nutrition, which needs further investigation.
Strengths of the present study include its sample size and the two-stage population study design, as well as the use of well-validated metabolic approach which can provide reliable and accurate metabolic data. Future studies need to verify the metabolic changes in this study and their effects on male fertility both in in vitro and in vivo and to elucidate the underlying mechanism. The application of metabolomics in discriminating more clinical types of male reproductive abnormalities is also needed in the future.
In conclusion, using a GC-MS-based metabolite profiling platform, a robust OPLS-DA model was established for distinguishing UMI patients from FC. From the differentially expressed metabolites in UMI subjects, we identified the metabolic signature of UMI. Our findings provide new potential diagnosis biomarker and treatment target of UMI and may improve the current treatment and future clinical practice of assisted reproductive technology. With further study of linkage between metabolic pattern and other environmental risk factors, such as diet pattern, oxidative stress, etc., it may prompt new couples how to increase chances to have a baby.
References
- 1. Leridon H, Slama R. The impact of a decline in fecundity and of pregnancy postponement on final number of children and demand for assisted reproduction technology. Hum Reprod. 2008;23(6):1312–9. Epub 2008/04/05. den106 [pii]. pmid:18387960.
- 2. Gnoth C, Godehardt E, Frank-Herrmann P, Friol K, Tigges J, Freundl G. Definition and prevalence of subfertility and infertility. Hum Reprod. 2005;20(5):1144–7. Epub 2005/04/02. deh870 [pii] pmid:15802321.
- 3. Hamada A, Esteves SC, Nizza M, Agarwal A. Unexplained male infertility: diagnosis and management. Int Braz J Urol. 2012;38(5):576–94. Epub 2012/11/08. IBJUv38n5a1 [pii]. pmid:23131516.
- 4. De Iuliis GN, Wingate JK, Koppers AJ, McLaughlin EA, Aitken RJ. Definitive evidence for the nonmitochondrial production of superoxide anion by human spermatozoa. J Clin Endocrinol Metab. 2006;91(5):1968–75. Epub 2006/03/02. jc.2005-2711 [pii] pmid:16507629.
- 5. Jafarzadeh N, Mani-Varnosfaderani A, Minai-Tehrani A, Savadi-Shiraz E, Sadeghi MR, Gilany K. Metabolomics fingerprinting of seminal plasma from unexplained infertile men: a need for novel diagnostic biomarkers. Mol Reprod Dev. 2015;82(3):150. Epub 2015/02/14. pmid:25676838.
- 6. Com E, Melaine N, Chalmel F, Pineau C. Proteomics and integrative genomics for unraveling the mysteries of spermatogenesis: the strategies of a team. J Proteomics. 2014;107:128–43. Epub 2014/04/23. S1874-3919(14)00180-8 [pii]. pmid:24751586.
- 7. Kovac JR, Lamb DJ. Male infertility biomarkers and genomic aberrations in azoospermia. Fertil Steril. 2014;101(5):e31. Epub 2014/04/01. S0015-0282(14)00182-4 [pii]. pmid:24680367.
- 8. Hotaling JM. Genetics of male infertility. Urol Clin North Am. 2014;41(1):1–17. Epub 2013/11/30. S0094-0143(13)00086-4 [pii]. pmid:24286764.
- 9. Song R, Walentek P, Sponer N, Klimke A, Lee JS, Dixon G, et al. miR-34/449 miRNAs are required for motile ciliogenesis by repressing cp110. Nature. 2014;510(7503):115–20. Epub 2014/06/06. nature13413 [pii]. pmid:24899310; PubMed Central PMCID: PMC4119886.
- 10. Amaral A, Castillo J, Ramalho-Santos J, Oliva R. The combined human sperm proteome: cellular pathways and implications for basic and clinical science. Hum Reprod Update. 2014;20(1):40–62. Epub 2013/10/02. dmt046 [pii]. pmid:24082039.
- 11. Agarwal A, Durairajanayagam D, Halabi J, Peng J, Vazquez-Levin M. Proteomics, oxidative stress and male infertility. Reprod Biomed Online. 2014;29(1):32–58. Epub 2014/05/13. S1472-6483(14)00130-8 [pii]. pmid:24813754.
- 12. Amaral A, Paiva C, Attardo Parrinello C, Estanyol JM, Ballesca JL, Ramalho-Santos J, et al. Identification of proteins involved in human sperm motility using high-throughput differential proteomics. J Proteome Res. 2014;13(12):5670–84. Epub 2014/09/25. pmid:25250979.
- 13. Suhre K, Shin SY, Petersen AK, Mohney RP, Meredith D, Wagele B, et al. Human metabolic individuality in biomedical and pharmaceutical research. Nature. 2011;477(7362):54–60. Epub 2011/09/03. nature10354 [pii]. pmid:21886157; PubMed Central PMCID: PMC3832838.
- 14. Wang TJ, Larson MG, Vasan RS, Cheng S, Rhee EP, McCabe E, et al. Metabolite profiles and the risk of developing diabetes. Nat Med. 2011;17(4):448–53. Epub 2011/03/23. nm.2307 [pii]. pmid:21423183; PubMed Central PMCID: PMC3126616.
- 15. Courant F, Antignac JP, Monteau F, Le Bizec B. Metabolomics as a potential new approach for investigating human reproductive disorders. J Proteome Res. 2013;12(6):2914–20. Epub 2013/05/09. pmid:23651426.
- 16. Zhang J, Huang Z, Chen M, Xia Y, Martin FL, Hang W, et al. Urinary metabolome identifies signatures of oligozoospermic infertile men. Fertil Steril. 2014;102(1):44–53 e12. Epub 2014/04/22. S0015-0282(14)00288-X [pii]. pmid:24746742.
- 17. Qiu Y, Cai G, Su M, Chen T, Zheng X, Xu Y, et al. Serum metabolite profiling of human colorectal cancer using GC-TOFMS and UPLC-QTOFMS. J Proteome Res. 2009;8(10):4844–50. Epub 2009/08/15. pmid:19678709.
- 18. Xia J, Mandal R, Sinelnikov IV, Broadhurst D, Wishart DS. MetaboAnalyst 2.0—a comprehensive server for metabolomic data analysis. Nucleic Acids Res. 2012;40(Web Server issue):W127–33. Epub 2012/05/04. gks374 [pii]. pmid:22553367; PubMed Central PMCID: PMC3394314.
- 19. Wang Z, Klipfell E, Bennett BJ, Koeth R, Levison BS, Dugar B, et al. Gut flora metabolism of phosphatidylcholine promotes cardiovascular disease. Nature. 2011;472(7341):57–63. Epub 2011/04/09. nature09922 [pii]. pmid:21475195; PubMed Central PMCID: PMC3086762.
- 20. Zhang Y, Dai Y, Wen J, Zhang W, Grenz A, Sun H, et al. Detrimental effects of adenosine signaling in sickle cell disease. Nat Med. 2011;17(1):79–86. Epub 2010/12/21. nm.2280 [pii]. pmid:21170046; PubMed Central PMCID: PMC4838392.
- 21. Aitken RJ, Clarkson JS, Fishel S. Generation of reactive oxygen species, lipid peroxidation, and human sperm function. Biol Reprod. 1989;41(1):183–97. Epub 1989/07/01. pmid:2553141.
- 22. Rhemrev JP, van Overveld FW, Haenen GR, Teerlink T, Bast A, Vermeiden JP. Quantification of the nonenzymatic fast and slow TRAP in a postaddition assay in human seminal plasma and the antioxidant contributions of various seminal compounds. J Androl. 2000;21(6):913–20. Epub 2000/12/06. pmid:11105918.
- 23. Servili M, Esposto S, Fabiani R, Urbani S, Taticchi A, Mariucci F, et al. Phenolic compounds in olive oil: antioxidant, health and organoleptic activities according to their chemical structure. Inflammopharmacology. 2009;17(2):76–84. Epub 2009/02/24. pmid:19234678.
- 24. Sroka Z, Cisowski W. Hydrogen peroxide scavenging, antioxidant and anti-radical activity of some phenolic acids. Food Chem Toxicol. 2003;41(6):753–8. Epub 2003/05/10. S0278691502003290 [pii]. pmid:12738180.
- 25. Scoditti E, Nestola A, Massaro M, Calabriso N, Storelli C, De Caterina R, et al. Hydroxytyrosol suppresses MMP-9 and COX-2 activity and expression in activated human monocytes via PKCalpha and PKCbeta1 inhibition. Atherosclerosis. 2014;232(1):17–24. Epub 2014/01/10. S0021-9150(13)00617-5 [pii]. pmid:24401212.