http://orcid.org/0000-0003-1173-2920
Figures
Abstract
Objective
Acupuncture has become popular and widely practiced in many countries around the world. Despite the large amount of acupuncture-related literature that has been published, broader trends in the prevalence and scope of acupuncture research remain underexplored. The current study quantitatively analyzes trends in acupuncture research publications in the past 20 years.
Methods
A bibliometric approach was used to search PubMed for all acupuncture-related research articles including clinical and animal studies. Inclusion criteria were articles published between 1995 and 2014 with sufficient information for bibliometric analyses. Rates and patterns of acupuncture publication within the 20 year observational period were estimated, and compared with broader publication rates in biomedicine. Identified eligible publications were further analyzed with respect to study type/design, clinical condition addressed, country of origin, and journal impact factor.
Results
A total of 13,320 acupuncture-related publications were identified using our search strategy and eligibility criteria. Regression analyses indicated an exponential growth in publications over the past two decades, with a mean annual growth rate of 10.7%. This compares to a mean annual growth rate of 4.5% in biomedicine. A striking trend was an observed increase in the proportion of randomized clinical trials (RCTs), from 7.4% in 1995 to 20.3% in 2014, exceeding the 4.5% proportional growth of RCTs in biomedicine. Over the 20 year period, pain was consistently the most common focus of acupuncture research (37.9% of publications). Other top rankings with respect to medical focus were arthritis, neoplasms/cancer, pregnancy or labor, mood disorders, stroke, nausea/vomiting, sleep, and paralysis/palsy. Acupuncture research was conducted in 60 countries, with the top 3 contributors being China (47.4%), United States (17.5%), and United Kingdom (8.2%). Retrieved articles were published mostly in complementary and alternative medicine (CAM) journals with impact factors ranging between 0.7 and 2.8 in the top 20 journals, followed by journals specializing in neuroscience, pain, anesthesia/analgesia, internal medicine and comprehensive fields.
Conclusion
Acupuncture research has grown markedly in the past two decades, with a 2-fold higher growth rate than for biomedical research overall. Both the increases in the proportion of RCTs and the impact factor of journals support that the quality of published research has improved. While pain was a consistently dominant research focus, other topics gained more attention during this time period. These findings provide a context for analyzing strengths and gaps in the current state of acupuncture research, and for informing a comprehensive strategy for further advancing the field.
Citation: Ma Y, Dong M, Zhou K, Mita C, Liu J, Wayne PM (2016) Publication Trends in Acupuncture Research: A 20-Year Bibliometric Analysis Based on PubMed. PLoS ONE 11(12): e0168123. https://doi.org/10.1371/journal.pone.0168123
Editor: Christopher J. Lortie, York University, CANADA
Received: May 19, 2016; Accepted: November 23, 2016; Published: December 14, 2016
Copyright: © 2016 Ma et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The authors received no specific funding for this work. IBM provided support in the form of salaries for author (Ming Dong), but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.
Competing interests: We have the following interests: Ming Dong is employed by IBM. There are no patents, products in development or marketed products to declare. This does not alter our adherence to all the PLOS ONE policies on sharing data and materials, as detailed online in the guide for authors.
1. Introduction
The term “acupuncture” describes a family of procedures involving the stimulation of points on the body using a variety of techniques, with the goal of achieving therapeutic effects [1]. Acupuncture has been practiced widely in China, for thousands of years, as an integral part of traditional Chinese medicine (TCM). In recent decades, the practice of acupuncture has become increasingly prevalent world-wide, including being administered in leading academic medical centers [2–4]. In spite of this, the credibility and specific therapeutic applications for acupuncture are still highly debated in the medical community [1, 5–8]. The quantity, quality, origin, and nature of existing acupuncture research evidence play a central role in informing this debate.
To summarize the state of evidence in acupuncture efficacy and safety, inform clinical practice, and elucidate underlying mechanisms, a large number of systematic reviews and meta-analyses have been published in recent years. These reviews have addressed the evidence base for a range of conditions including back and neck pain [9–11], osteoarthritis [12, 13], nausea [14, 15], dental pain [16], menstrual cramps [17], and infertility [18, 19], among others. However, less is known at a broader scale regarding gross tends in research efforts. Since the quantity of academic publications within a given discipline, at least in part, reflects underlying strategies and priorities [20–22], it is valuable to objectively characterize publication trends and to compare them with other related disciplines [23–25]. Bibliometrics is a set of methods used to quantitatively analyze academic literature [21], and indicates productivity, quality (or "performance") and structural trends of researchers, organizations, or specific academic fields. As a simple form of big data analysis, it is useful in revealing historical development [20], quantifying existing trends [24], and predicting the future in a given research domain. Bibliometric methods have been applied to medical related topics [26–32] including complementary and alternative medicine [33–35]. The results of these findings can be used as context for analyzing broad scale strengths and gaps in the current state of evidence in a field, and for informing a comprehensive strategic plan for further advancing the field.
To date, little effort has been devoted to summarizing worldwide trends in acupuncture research publications. The present study aimed to quantitatively analyze trends in acupuncture publications over the past 20 years, including rates and patterns of acupuncture publication, study types/designs, clinical conditions addressed, countries of origin, and types and impact factors of journals.
2. Methods and Materials
This bibliometric study does not involve a research protocol requiring approval by an institutional review board or ethics committee.
2.1 Search tools
We used PubMed as a search engine to query the MEDLINE database. PubMed was chosen because it is a recognized primary tool for scholars in the medical field [36, 37], and it remains the optimal tool in biomedical electronic research [38]. PubMed was developed and is managed by the National Center for Biotechnology Information (NCBI), at the U.S. National Library of Medicine (NLM), located at the National Institutes of Health (NIH). A free resource, PubMed comprises over 24 million citations for biomedical literature [39], and provides daily access to millions of users. Almost 5 million queries are issued to PubMed each day by users around the world [37], who rely on frequent access to keep updated in biomedicine and make discoveries in their own fields [36].
PubMed/MEDLINE makes use of a controlled subject vocabulary, Medical Subject Heading (MeSH), which are assigned to records by subject specialist indexers who read the associated articles. Applying the MeSH vocabulary ensures that articles are uniformly and systemically indexed by research topic, regardless of the words used by the authors [40]. This makes it possible to analyze publication trends and changes in focus over time.
2.2 Search strategy
An online literature search was conducted using MeSH terms, title words, and author key words in PubMed/MEDLINE, with specified publication dates from 1995/01/01 to 2014/12/31. MeSH terms included Acupuncture; Acupuncture Therapy (not exploded); Acupuncture Analgesia; Acupuncture, Ear; Electroacupuncture; and Moxibustion. In addition, we searched acupuncture and electroacupuncture as title words and author key words for articles appearing in PubMed without MeSH for this time period. Manual checks were performed of retrieved articles for relevance. Inclusion criteria for identified citations were articles related to acupuncture research, including clinical trials, observational studies, basic human physiology studies, animal studies, theory and methods papers, systematic reviews/meta-analyses, case studies, and clinical practice guidelines. Exclusion criteria were 1) publication before 1995 or after 2014, and 2) publications indexed by MEDLINE but with insufficient data for screening, classification and analysis. Two authors (Y.M and M.D) extracted data independently. The total numbers of publications in each year were recorded during these targeted periods. Retrieval results were then further analyzed with respect to study types using PubMed filters. For the purpose of comparison, a blank search with specified publication dates from 1995/01/01 to 2014/12/31 was performed to retrieve general publications in biomedicine. To simplify analyses, articles retrieved over the 20 year inclusion period were grouped in 5-year increments. The annual growth rate (AGR) of publications was calculated as (Current Year Total–Previous Year Total)/Previous Year Total. A productivity index was calculated to compare the individual growth trend according to its baseline at year 1995, defined as (Current Year Total– 1995 Total)/1995 Total.
2.3 Journal analysis and impact factors
Journal Citation Reports (JCR) releases impact factor (IF), the most frequently used tool for evaluating journal performance within its field. Journal impact factor (JIF) is defined as the year’s average number of citations per paper published in a specific journal during the preceding 2 years [41]. In this study, JIF data were obtained from the JCR from Thomson Reuters. Articles were assigned the impact factor of their publishing journal in the year of publication, from which the JIF values of all publications were calculated.
2.4 Data analyses
Retrieved data was downloaded using PubMed's XML export function. Targeted information was extracted from original data (by Y.M and M.D), including MeSH terms, titles of articles, years of publication, article types, languages, journals and their ISO abbreviations, authors’ affiliations, country within which research took place. The XML file was processed using customized program (Automation of Internet Data Analysis), and all results were manually checked by the authors. The top 20 journals ranked by the total numbers of acupuncture-related publications over the entire observation period were identified. By defining the studied age groups in the filter, analyses on age-related publication trends were also performed. For demographic analyses of participants in clinical studies, age classes were defined as child (under 12 yr), adolescent (13–18 yr), adult (19–44 yr), middle aged (45–64 yr) and aged (65 yr and above).
2.5 Statistical analyses
SPSS 19.0 (IBM SPSS Statistics) was used for statistical analyses. Descriptive statistics were presented as means ± standard deviations. Differences in publication numbers across 5-year segments were assessed by one-way analysis of variance (ANOVA). Publication trends were assessed by exponential regression. A p-value <0.05 was considered statistically significant in ANOVA and regression models.
3. Results
3.1 Quantity of acupuncture publications
A total of 13,320 citations were identified via PubMed as acupuncture research articles published during the targeted period of time (S1 File). Temporal analysis indicated an exponential growth in publications over the two decades evaluated, with a mean annual growth rate of 10.7%. This compares to a mean annual growth rate of 4.5% in biomedicine during the same period of time (Fig 1A). Thus, in biomedicine, the number of publications has doubled in the past two decades, while the number of acupuncture publications has increased more than four-fold.
(a) Biomedicine vs. complementary and alternative medicine (CAM) overall vs. acupuncture alone. The productivity index was calculated to compare the individual growth trend according to its baseline at year 1995, defined as (Current Year Total– 1995 Total)/1995 Total. (b) Exponential growing trends of some major types of acupuncture publications. The Y-axis is in log format.
3.2 Study types
Among all 13,320 publications, 12,339 (92.6%) were identified as journal articles (Table 1). Among journal articles, case reports comprised 7.3% of all articles (n = 895), non-randomized clinical studies 27.2% (n = 3351), randomized clinical trials 22.5% (n = 2771), narrative reviews 13.7% (n = 1686), systematic reviews 7.7% (n = 952) and meta-analyses 2.0% (n = 246). Among retrieved citations, 10,329 were human studies and 2,487 were animal studies (e.g. rats, mice, rabbits, etc.). Analyses showed that for each article type, the number of publications increased significantly in each 5-year period (Table 1). Among article types, randomized controlled trials have been increasing in numbers at the greatest rate, and along with other clinical studies, are now the most dominant acupuncture publication type (Fig 1B).
3.3 Main health conditions addressed
The top 30 health conditions addressed among retrieved publications are listed in Table 2. Pain was the most commonly studied topic, accounting for approximately one-third of all identified publications. Other key areas of focus, listed in order of publication number, included cancer, arthritis, cerebrovascular diseases, pregnancy, inflammation, paralysis or palsy, mood disorders, and sleep disorders. A closer look at publication patterns comparing the first 10 years (1995–2004) with the last 10 years (2005–2014) reveals that the percentage of pain-related articles dropped slightly in the most recent 10 years, while other areas of research, namely arthritis, stroke, brain ischemia, fatigue, menopause, hot flashes, and irritable bowel syndrome, increased. Research evaluating acupuncture for pregnancy, mood disorders, sleep, and diabetes remained stable between the two 10-year time periods. Other less commonly studied health issues include edema, herpes zoster, temporomandibular joint dysfunction syndrome, hyperlipidemia, dyspepsia, tinnitus, vertigo, and dizziness.
3.4 Countries from which publications originated
Our retrieved articles represented publications originating from 60 countries. The top 3 contributors of acupuncture-related publications were China (47.4%), United States (17.5%), and United Kingdom (8.2%), followed by South Korea (5.3%), Japan (2.8%), Germany (3.6%), Australia (1.8%), Canada (1.2%), Brazil (1.3%) and Italy (1.1%) (Table 3). Globally, total annual publication output increased from 230 in 1995 to 1261 in 2013. The top 3 countries in acupuncture publications remained relatively consistent over time, while Italy, South Korea, Germany and Australia exhibited higher annual growth rates in recent years.
3.5 Journal type and impact factors
Name and category of journals as well as their impact factors, were recorded for all included acupuncture articles. Publications were retrieved from 1618 unique journals spanning 25 languages. Among English language journals, the top 20 titles with respect to total numbers of acupuncture publication are listed in Table 4. Twelve of the top 20 journals specialize in complementary and alternative medicine (CAM) or traditional Chinese medicine, with impact factors ranging between 0.7 and 2.8 (average = 1.5). The remaining 8 of the 20 most published in journals listed in Table 4 are biomedically oriented, and include periodicals with both broad (e.g. PLoS One, British Medical Journal) as well as specialized (e.g. Pain, Brain Research) medical themes. Impact factors for these journals were higher, ranging from 2.2 to 16.8 (average = 5.4). The number of journals publishing acupuncture papers has increased over the years, especially SCI-indexed journals and non-English journals (Fig 2A). When using the JIF to represent the impact of an article that was published in that year, an increasing trend over time in the average impact factors was observed.
(a) The number of publications in journals with and without impact factors at the time of publication. (b) The mean and stand error of impact factors of journals that acupuncture publications published each year. Note that non-JCR included non-English journals were not included in the calculation of means.
3.6 Demographic characteristics of the clinical acupuncture studies
In order to analyze demographics of populations included in clinical acupuncture studies, we used PubMed customized filter settings, and chose five age groups across the lifespan. Articles that involved subjects from more than one age group were categorized in all corresponding age groups. Adult (19–44 yr) and middle-aged (45–64 yr) populations were studied the most with 4,249 and 3,749 articles respectively, followed by the aged (65 yr and above; 2,294), adolescents (13–18 yr; 1,106), and children under 12 years of age (619).
4. Discussion
Acupuncture is one of the most commonly used CAM therapies worldwide [42, 43]. In the Western world, its widespread use and growing integration into academic medical centers is due, in part, to early research demonstrating both potential clinical efficacy for a hand full of medical conditions, as well as plausible physiological mechanisms that explain clinical outcomes [6, 44]. However, despite significant effort, the evidence base for acupuncture for most medical conditions is still incomplete and debated [45, 46], and few attempts have been made to systematically map out trends in how research efforts to date have been focused.
Our bibliometric study of acupuncture research publications from 1995–2014 indicates an exponential growth in published evidence, with an average annual growth rate of 10.7%. This compares to a mean annual growth rate of 4.5% in biomedicine. The growth in acupuncture research publications parallels the increasing popularity of CAM therapies in general. Over the past decades, consumers’ demand for CAM, including acupuncture and related traditional Chinese medicine therapies, has increased [47, 48].
Paralleling the growth in absolute numbers of articles in the field of acupuncture research has been a trend towards more rigorous study designs and higher quality publications as reflected in journal impact factor scores. A striking trend our analyses revealed was an observed increase in the proportion of randomized clinical trials (RCTs), from 7.4% in 1995 to 20.3% in 2014. This increase in RCTs exceeded a more general background increase (4.5%) in the proportion of RCTs in biomedicine. These trends concur with more focused systematic reviews of acupuncture that report methodological quality of more recent trials has improved. This improvement, in part, may be linked to an increased demand by journals that they comply with Standards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA) guidelines [49].
Over the 20 year period we evaluated, pain was consistently the most common focus of acupuncture research (37.9% of publications). This focus includes both clinical and basic studies (3509 human studies versus 1092 animal studies), and encompasses a broad range of pain conditions. A number of systematic review and meta-analyses for chronic back pain [50–52] and headache [53–55] support the potential of acupuncture for treating pain-related symptoms, but the evidence of other pain conditions such as cancer-related pain [56, 57], fibromyalgia [58–60], and labor pain [61, 62] is mixed or negative. Regardless, pain management remains one of the primary indications for use of acupuncture by patients in the US and worldwide [4, 63]. Interestingly, compared to the overall growth in acupuncture research, the numbers of studies focused on pain did not increase between the first vs. second 10 years of our period of observation. Rather the overall increase in publications reflect a growing research interest in other conditions, including arthritis, neoplasms/cancer, pregnancy or labor, mood disorders, stroke, nausea/vomiting, sleep, and paralysis/palsy. Given clinical use of acupuncture for these and other conditions, future research should continue to target these areas.
Although our analyses revealed that acupuncture research was conducted in 60 countries, China, US, and UK were the top 3 contributors to the evidence base, contributing 47.4%, 17.5%, and 8.2%, respectively. These contributions remained fairly stable over time. However, a closer looks at contributions of higher quality studies (using RCTs as an indicator), reveals that higher quality studies were contributed mainly by the US and the UK in the first 10 years (1995–2004), while China did not have any RCTs in the record. However, in the second 10 years (2005–2014), the numbers of RCTs from China increased significantly more rapidly (yearly growth rate 56.2%) than the US (yearly growth rate 17.9%) and the UK (yearly growth rate 21.2%). Other countries, including Italy, South Korea, Germany and Australia, demonstrated a considerable trend in growth rates of publications, but absolute contributions were relatively small.
Limitations
As with other publication analyses, some limitations are unavoidable. Exclusion of articles that were most recently published, not indexed by NLM, or not included in PubMed, make it impossible to trace all sources. In addition, although MEDLINE is the most authoritative international biomedical literature database, the number of medical journals from various countries is still limited. Other databases are also available for bibliometric studies, such as Web of Science, Scopus, Embase, PsychNet, and CINAHL. Another limitation is lack of granularity afforded by NLM filters, making it difficult to systematically classify publications as basic vs. clinical, or further classify basic research with respect to scope of research (e.g. immunology, neuroimaging, connective tissue physiology).
Conclusion
Acupuncture research has grown markedly in the past two decades, with a 2-fold higher growth rate than biomedical research overall. Both the increase in the proportion of RCTs as well as the impact factor of journals published in support that the quality of published research has also improved. While pain was a consistent dominant research focus, other topics gained more attention during this time period. These findings provide a context for analyzing strengths and gaps in the current state of acupuncture research, and for informing a comprehensive strategy for further advancing the field.
Supporting Information
S1 File. Raw data file.
Citations identified via PubMed during 1995–2014.
https://doi.org/10.1371/journal.pone.0168123.s001
(7Z)
Acknowledgments
The authors would like to thank National Library of Medicine (NLM) Customer Service for their response with detailed explanations and advice for the literature search on PubMed.
Yan Ma and Ming Dong collaborated in the development of the program (Automation of Internet Data Analysis) used in this study.
Author Contributions
- Conceptualization: YM.
- Data curation: YM MD.
- Formal analysis: YM MD.
- Investigation: YM.
- Methodology: YM MD CM.
- Project administration: YM.
- Resources: YM MD CM.
- Software: YM MD.
- Supervision: YM.
- Validation: CM KZ.
- Visualization: YM.
- Writing – original draft: YM CM KZ.
- Writing – review & editing: YM JL PW.
References
- 1. Langevin HM, Wayne PM, Macpherson H, Schnyer R, Milley RM, Napadow V, et al. Paradoxes in acupuncture research: strategies for moving forward. Evidence-based complementary and alternative medicine: eCAM. 2011;2011:180805. Epub 2010/10/27. PubMed Central PMCID: PMCPMC2957136.
- 2. Highfield ES, Kaptchuk TJ, Ott MJ, Barnes L, Kemper KJ. Availability of acupuncture in the hospitals of a major academic medical center: a pilot study. Complementary therapies in medicine. 2003;11(3):177–83. Epub 2003/12/09. pmid:14659382
- 3. Kim KH, Kim YR, Noh SH, Kang KW, Kim JK, Yang GY, et al. Use of acupuncture for pain management in an academic Korean medicine hospital: a retrospective review of electronic medical records. Acupuncture in medicine: journal of the British Medical Acupuncture Society. 2013;31(2):228–34. Epub 2013/03/02.
- 4. Bauer BA. Chinese medicine and integrative medicine in the United States. Chinese journal of integrative medicine. 2015;21(8):569–70. Epub 2015/08/01. pmid:26224281
- 5. Schnyer R, Lao L, Hammerschlag R, Wayne P, Langevin HM, Napadow V, et al. Society for Acupuncture Research: 2007 conference report: "The status and future of acupuncture research: 10 years post-NIH Consensus Conference". Journal of alternative and complementary medicine (New York, NY). 2008;14(7):859–60. Epub 2008/09/23. PubMed Central PMCID: PMCPMC3155094.
- 6. NIH Consensus Conference. Acupuncture. Jama. 1998;280(17):1518–24. Epub 1998/11/11. pmid:9809733
- 7. Zhou K, Ma Y, Brogan MS. Dry needling versus acupuncture: the ongoing debate. Acupuncture in medicine: journal of the British Medical Acupuncture Society. 2015;33(6):485–90. Epub 2015/11/08.
- 8. Salehi A, Marzban M, Imanieh MH. The Evaluation of Curative Effect of Acupuncture: A Review of Systematic and Meta-Analysis Studies. Journal of evidence-based complementary & alternative medicine. 2015. Epub 2015/08/12.
- 9. Chou R, Qaseem A, Snow V, Casey D, Cross JT Jr., Shekelle P, et al. Diagnosis and treatment of low back pain: a joint clinical practice guideline from the American College of Physicians and the American Pain Society. Annals of internal medicine. 2007;147(7):478–91. Epub 2007/10/03. pmid:17909209
- 10. Ernst E, White AR. Acupuncture for back pain: a meta-analysis of randomized controlled trials. Archives of internal medicine. 1998;158(20):2235–41. Epub 1998/11/18. pmid:9818803
- 11. Manheimer E, White A, Berman B, Forys K, Ernst E. Meta-analysis: acupuncture for low back pain. Annals of internal medicine. 2005;142(8):651–63. Epub 2005/04/20. pmid:15838072
- 12. Macfarlane GJ, Paudyal P, Doherty M, Ernst E, Lewith G, MacPherson H, et al. A systematic review of evidence for the effectiveness of practitioner-based complementary and alternative therapies in the management of rheumatic diseases: osteoarthritis. Rheumatology (Oxford, England). 2012;51(12):2224–33. Epub 2012/08/28.
- 13. Manheimer E, Linde K, Lao L, Bouter LM, Berman BM. Meta-analysis: acupuncture for osteoarthritis of the knee. Annals of internal medicine. 2007;146(12):868–77. Epub 2007/06/20. pmid:17577006
- 14. Ezzo J, Richardson MA, Vickers A, Allen C, Dibble S, Issell BF, et al. WITHDRAWN: Acupuncture-point stimulation for chemotherapy-induced nausea or vomiting. The Cochrane database of systematic reviews. 2014;11:CD002285. Epub 2014/11/22.
- 15. Shin HC, Kim JS, Lee SK, Kwon SH, Kim MS, Lee EJ, et al. The effect of acupuncture on postoperative nausea and vomiting after pediatric tonsillectomy: A meta-analysis and systematic review. The Laryngoscope. 2016. Epub 2016/02/13.
- 16. Ernst E, Pittler MH. The effectiveness of acupuncture in treating acute dental pain: a systematic review. British dental journal. 1998;184(9):443–7. Epub 1998/06/09. pmid:9617000
- 17. Abaraogu UO, Tabansi-Ochuogu CS. As Acupressure Decreases Pain, Acupuncture May Improve Some Aspects of Quality of Life for Women with Primary Dysmenorrhea: A Systematic Review with Meta-Analysis. Journal of acupuncture and meridian studies. 2015;8(5):220–8. Epub 2015/10/05. pmid:26433798
- 18. Huang DM, Huang GY, Lu FE, Stefan D, Andreas N, Robert G. Acupuncture for infertility: is it an effective therapy? Chinese journal of integrative medicine. 2011;17(5):386–95. Epub 2011/05/26. pmid:21611904
- 19. Stener-Victorin E, Humaidan P. Use of acupuncture in female infertility and a summary of recent acupuncture studies related to embryo transfer. Acupuncture in medicine: journal of the British Medical Acupuncture Society. 2006;24(4):157–63. Epub 2007/02/01.
- 20.
Young H, Belanger T. The ALA glossary of library and information science: Ediciones Díaz de Santos; 1983.
- 21.
De Bellis N. Bibliometrics and citation analysis: from the science citation index to cybermetrics: Scarecrow Press; 2009.
- 22. Deshazo JP, Lavallie DL, Wolf FM. Publication trends in the medical informatics literature: 20 years of "Medical Informatics" in MeSH. BMC medical informatics and decision making. 2009;9:7. Epub 2009/01/23. PubMed Central PMCID: PMCPMC2652453. pmid:19159472
- 23. Garfield E. Citation indexing for studying science. Nature. 1970;227(5259):669–71. Epub 1970/08/15. pmid:4914589
- 24. Durieux V, Gevenois PA. Bibliometric indicators: quality measurements of scientific publication. Radiology. 2010;255(2):342–51. Epub 2010/04/24. pmid:20413749
- 25. Glanville J, Kendrick T, McNally R, Campbell J, Hobbs FD. Research output on primary care in Australia, Canada, Germany, the Netherlands, the United Kingdom, and the United States: bibliometric analysis. BMJ (Clinical research ed). 2011;342:d1028. Epub 2011/03/10. PubMed Central PMCID: PMCPMC3050436.
- 26. Bould MD, Boet S, Riem N, Kasanda C, Sossou A, Bruppacher HR. National representation in the anaesthesia literature: a bibliometric analysis of highly cited anaesthesia journals. Anaesthesia. 2010;65(8):799–804. Epub 2010/07/01. pmid:20586744
- 27. Hunter PR. Bibliometrics, research quality, and neglected tropical diseases. Lancet. 2009;373(9664):630–1. Epub 2009/02/24.
- 28. Michalopoulos A, Falagas ME. A bibliometric analysis of global research production in respiratory medicine. Chest. 2005;128(6):3993–8. Epub 2005/12/16. pmid:16354871
- 29. Quinn N, Hensey O, McDowell DT. A historical perspective of pediatric publications: a bibliometric analysis. Pediatrics. 2013;132(3):406–12. Epub 2013/08/28. pmid:23979085
- 30. Shuaib W, Khan MS, Shahid H, Valdes EA, Alweis R. Bibliometric analysis of the top 100 cited cardiovascular articles. The American journal of cardiology. 2015;115(7):972–81. Epub 2015/02/12. pmid:25670637
- 31. Weightman AL, Butler CC. Using bibliometrics to define the quality of primary care research. BMJ (Clinical research ed). 2011;342:d1083. Epub 2011/03/10.
- 32. Ma Y, Dong M, Mita C, Sun S, Peng C-K, Yang AC. Publication analysis on insomnia: how much has been done in the past two decades? Sleep Medicine. 2015.
- 33. Wieland LS, Manheimer E, Sampson M, Barnabas JP, Bouter LM, Cho K, et al. Bibliometric and content analysis of the Cochrane Complementary Medicine Field specialized register of controlled trials. Systematic reviews. 2013;2:51. Epub 2013/07/06. PubMed Central PMCID: PMCPMC3704678. pmid:23826877
- 34. Yang GY, Wang LQ, Ren J, Zhang Y, Li ML, Zhu YT, et al. Evidence base of clinical studies on Tai Chi: a bibliometric analysis. PloS one. 2015;10(3):e0120655. Epub 2015/03/17. PubMed Central PMCID: PMCPMC4361587. pmid:25775125
- 35. Han JS, Ho YS. Global trends and performances of acupuncture research. Neuroscience and biobehavioral reviews. 2011;35(3):680–7. Epub 2010/08/31. pmid:20800613
- 36. Lu Z. PubMed and beyond: a survey of web tools for searching biomedical literature. Database: the journal of biological databases and curation. 2011;2011:baq036. Epub 2011/01/20. PubMed Central PMCID: PMCPMC3025693. pmid:21245076
- 37. Islamaj Dogan R, Murray GC, Neveol A, Lu Z. Understanding PubMed user search behavior through log analysis. Database: the journal of biological databases and curation. 2009;2009:bap018. Epub 2010/02/17. PubMed Central PMCID: PMCPMC2797455. pmid:20157491
- 38. Falagas ME, Pitsouni EI, Malietzis GA, Pappas G. Comparison of PubMed, Scopus, Web of Science, and Google Scholar: strengths and weaknesses. FASEB journal: official publication of the Federation of American Societies for Experimental Biology. 2008;22(2):338–42. Epub 2007/09/22.
- 39.
MEDLINE®/PubMed® Resources Guide: U.S. National Library of Medicine; 2014. Available from: http://www.ncbi.nlm.nih.gov/pubmed.
- 40.
PubMed Help [Internet], NCBI Help Manual. 2015. Available from: http://www.ncbi.nlm.nih.gov/books/NBK3827/.
- 41. Garfield E. The history and meaning of the journal impact factor. Jama. 2006;295(1):90–3. Epub 2006/01/05. pmid:16391221
- 42. Xu H, Chen KJ. Acupuncture: a paradigm of worldwide cross-cultural communication. Chinese journal of integrative medicine. 2011;17(3):163–5. Epub 2011/03/02. pmid:21359915
- 43.
McKenzie B. How popular is acupuncture?: Science-Based Medicine; 2011. Available from: https://www.sciencebasedmedicine.org/how-popular-is-acupuncture/.
- 44. Ma Y, McCraty R. Heart rate variability in mind-body interventions. Complementary therapies in medicine. 2016;29:A1–A2. Epub A2. pmid:27912965
- 45. Ma Y, Zhou K, Fan J, Sun S. Traditional Chinese medicine: potential approaches from modern dynamical complexity theories. Frontiers of medicine. 2016;10(1):28–32. Epub 2016/01/27. pmid:26809465
- 46. Ma Y, Sun S, Peng CK. Applications of dynamical complexity theory in traditional Chinese medicine. Frontiers of medicine. 2014;8(3):279–84. Epub 2014/09/11. pmid:25204292
- 47. Clarke TC, Black LI, Stussman BJ, Barnes PM, Nahin RL. Trends in the use of complementary health approaches among adults: United States, 2002–2012. National health statistics reports. 2015;(79):1–16. Epub 2015/02/12. PubMed Central PMCID: PMCPMC4573565. pmid:25671660
- 48. Barnes PM, Bloom B, Nahin RL. Complementary and alternative medicine use among adults and children: United States, 2007. National health statistics reports. 2008;(12):1–23. Epub 2009/04/14. pmid:19361005
- 49. MacPherson H, Altman DG, Hammerschlag R, Youping L, Taixiang W, White A, et al. Revised STandards for Reporting Interventions in Clinical Trials of Acupuncture (STRICTA): extending the CONSORT statement. PLoS medicine. 2010;7(6):e1000261. Epub 2010/06/15. PubMed Central PMCID: PMCPMC2882429. pmid:20543992
- 50. Berman BM, Langevin HM, Witt CM, Dubner R. Acupuncture for chronic low back pain. The New England journal of medicine. 2010;363(5):454–61. Epub 2010/09/08. pmid:20818865
- 51. Lee JH, Choi TY, Lee MS, Lee H, Shin BC, Lee H. Acupuncture for acute low back pain: a systematic review. The Clinical journal of pain. 2013;29(2):172–85. Epub 2012/12/28. pmid:23269281
- 52. Liu L, Skinner M, McDonough S, Mabire L, Baxter GD. Acupuncture for low back pain: an overview of systematic reviews. Evidence-based complementary and alternative medicine: eCAM. 2015;2015:328196. Epub 2015/03/31. PubMed Central PMCID: PMCPMC4364128.
- 53. Sun Y, Gan TJ. Acupuncture for the management of chronic headache: a systematic review. Anesthesia and analgesia. 2008;107(6):2038–47. Epub 2008/11/21. pmid:19020156
- 54. Linde K, Allais G, Brinkhaus B, Manheimer E, Vickers A, White AR. Acupuncture for tension-type headache. The Cochrane database of systematic reviews. 2009;(1):CD007587. Epub 2009/01/23. PubMed Central PMCID: PMCPMC3099266. pmid:19160338
- 55. Zhao L, Guo Y, Wang W, Yan LJ. Systematic review on randomized controlled clinical trials of acupuncture therapy for neurovascular headache. Chinese journal of integrative medicine. 2011;17(8):580–6. Epub 2011/04/29. pmid:21526365
- 56. Paley CA, Johnson MI, Tashani OA, Bagnall AM. Acupuncture for cancer pain in adults. The Cochrane database of systematic reviews. 2015;10:CD007753. Epub 2015/10/16.
- 57. Chiu HY, Hsieh YJ, Tsai PS. Systematic review and meta-analysis of acupuncture to reduce cancer-related pain. European journal of cancer care. 2016. Epub 2016/02/09.
- 58. Mayhew E, Ernst E. Acupuncture for fibromyalgia—a systematic review of randomized clinical trials. Rheumatology (Oxford, England). 2007;46(5):801–4. Epub 2006/12/26.
- 59. Deare JC, Zheng Z, Xue CC, Liu JP, Shang J, Scott SW, et al. Acupuncture for treating fibromyalgia. The Cochrane database of systematic reviews. 2013;5:CD007070. Epub 2013/06/04. PubMed Central PMCID: PMCPMC4105202.
- 60. Lundeberg T, Lund I. Are reviews based on sham acupuncture procedures in fibromyalgia syndrome (FMS) valid? Acupuncture in medicine: journal of the British Medical Acupuncture Society. 2007;25(3):100–6. Epub 2007/10/02.
- 61. Lee H, Ernst E. Acupuncture for labor pain management: A systematic review. American journal of obstetrics and gynecology. 2004;191(5):1573–9. Epub 2004/11/18. pmid:15547526
- 62. Cho SH, Lee H, Ernst E. Acupuncture for pain relief in labour: a systematic review and meta-analysis. BJOG: an international journal of obstetrics and gynaecology. 2010;117(8):907–20. Epub 2010/05/05.
- 63. Harris CS, Lifshitz M, Raz A. Acupuncture for chronic pain? Clinical wisdom undecided despite over 4000 years of practice. The American journal of medicine. 2015;128(4):331–3. Epub 2014/12/03. pmid:25460530