Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

A challenge for healthcare but just another opportunity for illegitimate online sellers: Dubious market of shortage oncology drugs

  • András Fittler ,

    Contributed equally to this work with: András Fittler, Róbert György Vida, Valter Rádics, Lajos Botz

    Roles Conceptualization, Investigation, Project administration, Visualization, Writing – original draft, Writing – review & editing

    fittler.andras@pte.hu

    Affiliation Department of Pharmaceutics and Central Clinical Pharmacy, Faculty of Pharmacy, University of Pécs, Pécs, Hungary

  • Róbert György Vida ,

    Contributed equally to this work with: András Fittler, Róbert György Vida, Valter Rádics, Lajos Botz

    Roles Conceptualization, Data curation, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Pharmaceutics and Central Clinical Pharmacy, Faculty of Pharmacy, University of Pécs, Pécs, Hungary

  • Valter Rádics ,

    Contributed equally to this work with: András Fittler, Róbert György Vida, Valter Rádics, Lajos Botz

    Roles Data curation, Investigation

    Affiliation Department of Pharmaceutics and Central Clinical Pharmacy, Faculty of Pharmacy, University of Pécs, Pécs, Hungary

  • Lajos Botz

    Contributed equally to this work with: András Fittler, Róbert György Vida, Valter Rádics, Lajos Botz

    Roles Conceptualization, Funding acquisition, Methodology, Supervision, Writing – original draft

    Affiliation Department of Pharmaceutics and Central Clinical Pharmacy, Faculty of Pharmacy, University of Pécs, Pécs, Hungary

Abstract

Introduction

Drug shortages mean a challenge to healthcare systems. Exposed patients or health care providers may seek alternative resources for these products online. The purpose of our study was to analyze the online availability of oncology shortage drugs at national and at international levels in 2014 and 2016.

Methods

We tested the online accessibility of oncology shortage drugs by simulating the Internet search method of patients. Search results were evaluated according to operational, distributional, and patient safety characteristics.

Results

In 2014 and 2016 all (100%) antineoplastic agents affected by shortages were available on the Internet without medical prescription. The number of relevant websites among search engine results has decreased from 112 to 98, while online vendors actually offering oncology shortage drugs for sale has risen from 66.1% to 80.6% within relevant websites in the two evaluated years. None of the online sellers were classified as legitimate or accredited by LegitScript and VIPPS online pharmacy verification databases.

Conclusion

According to our findings shortage oncology drugs are widely available online. To manage shortages and illegal Internet trade national and international standardized shortage reporting and information systems, regularly updated Internet pharmacy verification databases are needed. As well, institutional procurement and medication use review policies are required.

Introduction

Drug shortages

Drug shortages induce a complex global public health crisis [15] and have a great impact on provision of healthcare services from the early 2000s [6] as they are posing a challenge to ensure medication and patient safety [7]. Although there are different approaches in defining drug shortages all definitions emphasize a critical drug supply issue requiring change and affecting patient care [2, 5, 810].

Although health systems all over the World are troubled by with the short supply of medicines, the literature still lacks robust data. In the United States the number of annual new shortage was the highest in 2011 with 257 entities and decreased to 136 by 2015. However, the total number of shortages (new and ongoing) in these years was nearly the same (441 and 427). Alternatively, in Europe and Australia only surveys are available [11].

European hospital pharmacy surveys (Pauwels 2013, EAHP 2014) showed that lifesaving medications (oncology, emergency, infectology) were regularly affected by shortages and almost every hospital was facing the problem in the 2013–2014 years, similarly to the United States [1, 12]. Also, it is well known that shortages unevenly impact sterile, generic injectable medications and are less likely to affect branded oral tablets [12, 13].

The main difference between the U.S. and European drug supply issues is that the generic/originator ratio of drugs being in shortage is much higher in the United States comparing to the European countries [11, 14].Causes and contributing factors of drug shortages may vary in countries and show a multidimensional nature both on the supply and demand side. Despite the variation there are similarities in the primary drivers, such as manufacturing problems, economic and health policy decisions [2, 15, 1622] In Europe the leading cause of drug shortages can be linked to manufacturing and GMP compliance problems [23].

Shortages can result in compromised quality, safety and efficacy in the supply chain, with numerous negative therapeutic and financial consequences on patient care. In the United States fifteen deaths happened due to shortages between 2010 and 2011 [2, 24, 2527].

Managing drug supply problems can lead to additional expenses (purchasing cost, labor cost, and cost of under-treatment) and higher workloads as well. The latter may decrease direct patient care activities which can lead to an increasing number of medication errors [2, 3, 24, 25, 28, 29]. Furthermore, other consequences not necessarily involved in the traditional supply chain also exist, such as the acquisition of unapproved or falsified medication from alternative sources [3032].

Injectable oncology drug shortages are widespread, recurrent and persistent with a significant impact on patient care [16, 3339]. In the United States anti-infective and oncology drugs are the most affected therapeutic areas in the past five years. In Europe, antimicrobials, oncology, and emergency medicines are most commonly in shortage, showing similarities with other parts of the world according to the survey of the EAHP [4043].

However, we do not have exact data on the extent of the problem. According to recent estimates, annually over 500,000 oncologic patients are affected by drug shortages in the United States [44, 45]. In Europe the 2014 EAHP survey found that 55% of more than 500 hospital pharmacist respondents from 36 countries have experienced oncology drug shortage in 2013 [12].

Illegal Internet trade of pharmaceuticals

Despite a growing number of legitimate Internet pharmacies are offering their services, a vast number of illegitimate vendors overwhelm the market of online pharmaceuticals [4650]. The patient safety risk attached to the online purchasing of shortage drugs involves questionable sourcing, poor quality, falsification, improper storage and transportation [5052]. Further, there are not only medical but also financial consequences associated with procuring medications from the web as the price of online drugs is documented to be much higher than offered by traditional brick and mortar pharmacies [5355].

It has been proven in the literature that countless medications can be ordered online and uninformed consumers are unlikely to be able to differentiate legitimate websites from illegitimate actors [40, 56]. Unregulated online pharmacies are willing to supply prescription only drugs without valid medical prescriptions, use falsified verification logos and conceal their contact details [32, 40, 46, 57]. In addition, professional aspects of safe medication use are deteriorated by unethical marketing practices [55], absence of product information or valid live contact with healthcare professionals (pharmacist or physician) [53, 56, 58].

Previous studies showed that drugs in shortage (vaccines and oncology drugs) are available on the Internet from NABP not recommended vendors, a detailed and follow up analysis of the availability of shortage oncology drugs via the Internet has not been carried out so far [52, 59].

Objectives

The objective of our current study was to analyze the online availability of oncology medications affected by national and international drug shortages in 2014 and 2016. By the evaluation of Internet search results and vendor websites the illegitimate accessibility of such specific and explicitly life threatening medications can be highlighted. Online availability of shortage drugs—in general—has been documented earlier by Liang BA [47], however mainly focusing on Food and Drug Administration (FDA) shortage-listed drugs and not evaluating European and international shortage issues and the survivability of Internet pharmacy websites.

Materials and methods

We tested how easily patients could access out-of-stock oncology drugs via the Internet by simulating the Internet search method of patients. Search engine results, all relevant links, web pages and drug vendor sites (Internet pharmacies) were assessed in a descriptive study performed in 2014 and 2016. Researchers assessed websites anonymously and did not complete any purchases during the study, therefore no ethical approval was considered necessary.

Identification of national and international drug shortages

The 2014 EAHP survey on drug shortages was the starting point to identify drug shortage information sources. We accessed these publicly available shortage databases. Inclusion criteria were: relevant shortage information on oncology medications and date of shortage events (2014 and 2016) of shortage event. Publicly available databases with Hungarian or English language were preferred [12]. See Table A in S1 Table.

Seven European and 4 Non-European drug shortage information sources (list, database) were included.

The query of shortage antineoplastic agents in the databases was performed by ATC code (L01) or the name of the Active Pharmaceutical Ingredient (API) from July 01. to September 30. (Q3) in 2014 and 2016. If a database only contained brand name of a drug product then the national authority’s pharmaceutical product database was searched to determine the API or the therapeutic class (ATC code). ATC L01 Active Pharmaceutical Ingredients were identified according to the WHO Collaborating Centre for Drug Statistics Methodology website (https://www.whocc.no/).

An active ingredient was considered to be an internationally significant shortage problem if it was represented in at least one accessible European database (aside from the Hungarian) and in addition in at least one Non-European shortage database [12, 6070]. See Table B in S1 Table

Obtaining search engine results

We searched Google (www.google.hu) for the English and Hungarian terms of antineoplastic agents (ATC L01 class drugs) affected by shortages in July-September (the third quarter of the calendar year, Q3) both in 2014 and 2016. The name of the active pharmaceutical ingredient (API—according to the WHO terminology) and the term “buy” were used as specific search key words (e.g.: “buy bleomycin”). Web browser Firefox was used with standard security setting, with no user signed in any account during searches. By documenting the first 50 references appearing in Google for national (Hungarian) and English language search terms, we could simulate what patients can easily find and what websites they most likely would visit when searching for shortage oncology drugs. No Hungarian websites were identified, consequently only websites operating in English were included in our study. No direct searches were performed on social media sites such as Facebook, Twitter, etc..

A search engine result was classified as relevant if the title and/or short description (so called title- and meta-description tags) indicated possible purchase option for the given active pharmaceutical ingredient. Accessed websites were categorized as Internet pharmacies (direct online sellers), intermediary sites (websites that were not direct vendors but acted as sources of information to purchase drugs), social media sites (blogs and forums); research only sites (companies offering active ingredients for research), and the remaining as others (e.g.: wholesalers) similarly to previously published studies [40, 47, 53]. Only Internet pharmacies were included in our study for detailed evaluation, while vendors offering non-finished products, raw materials or chemicals for scientific use were excluded.

Evaluation of Internet pharmacy websites

The identified direct online drug sellers were assessed according to the following characteristics: Operational characteristics (website category, year of accessibility, oncology specific domain name: a domain name containing expressions related to oncology e.g.: cancercurepharmacy.com, contact information: address/location, telephone number), Distributional characteristics (drug availability, price, quantity limit), and Patient safety characteristics (requirement for a medical prescription, possibility of information exchange with healthcare professionals, LegitScript [71] and VIPPS [7274] legitimacy certifications). Data was documented according to previously defined methodology by the authors. Websites were identified by domain name. The domain name was used during survivability and legitimacy evaluations. The authors assessed the possibility of purchasing products by placing an order for an oncology shortage medication and aiming to proceed to the checkout page, but no product purchase was made due to financial, ethical and safety concerns.

Statistical analysis

The data was summarized by descriptive analysis. Mann-Whitney test and Chi-Square test were used to evaluate correlations.

Results

Online access to shortage oncology drugs

All evaluated oncology drugs affected by shortages were available on the Internet as each API included in our study (100%) was offered by online pharmacies both in 2014 and 2016. As can be seen from Fig 1., numerous search engine results (13.8% and 12.1% in 2014 and 2016) contained relevant information about purchasing shortage oncology medications. Of these relevant links 221 led to 112 individual websites in 2014, while 230 to 98 websites in 2016. The average number of websites per API somewhat decreased from 7 (2014) to 5.15 (2016). The ratio of online pharmacy sites actually offering finished products for sale within all relevant websites has risen from 66.1% (2014) to 80.6% (2016) (p<0,001).

thumbnail
Fig 1. Flowchart illustrating methodology and main results regarding online availability of and prescription requirement for shortage oncology active pharmaceutical ingredients.

Letters indicate geographical localization of evaluated databases N: national, I: international; numbers indicate year of evaluation 14 (2014), 16 (2016); third quarter of the calendar year is labelled as Q3.

https://doi.org/10.1371/journal.pone.0203185.g001

About every fourth online vendor (n = 14) was listed within the first fifty search engine results in both years of our study. Consequently, these sites were active, relatively easy to access and continuously available for patients in the past two years. In one case, a different domain extension was used for the same domain name (e.g.: buy-pharma.com & buy-pharma.co), indicating multiple (bulk) domain name operation. The accessibility of all Internet pharmacy websites (n = 74) identified in 2014 was evaluated two years later and one fourth (n = 19. 25.5%) were functioning in both years which is a clear sign of continuous operation. An online pharmacy was considered to be an active/functional vendor if payment options were displayed on the website (e.g. credit card information was requested) as the final step of purchase during the checkout procedure. Sixty-four (86.5%) Internet pharmacies in 2014, while seventy-seven (97.5%) in 2016 vendors were active/functional.

Online vendors generally did not require medical prescriptions as 78.4% (58/74) internet pharmacies in 2014 and 73.4% (57/79) in 2016 offered oncology medications without the necessity of such medical documentation (p = 0.474). One Internet pharmacy found in 2016 emphasized “no prescription required” access on its website, while of the websites used this marketing message in 2014. Eight (10.8%) Internet pharmacy websites have used oncology specific domain names containing the terms e.g. “cancer” or “oncology” in 2014, down to five (6.3%) in 2016 (p = 0.320).

The shortage oncology portfolio of websites was similar in both evaluated years. The maximum number of shortage drugs offered per website has somewhat increased from 12 to 13, while the average number of shortage oncology medications offered per website was similar: 2.12 (±2.293) and 2.15 (±2.602) in 2014 and 2016 respectively (mean±standard deviation; Man-Whitney U test p = 0.784). Most of the evaluated active ingredients became available on a larger number of Internet pharmacies. A notable decrease was observed for others: number of carboplatin (p<0.05) and methotrexate (p<0,001) products offered has significantly decreased by 2016.

In accordance with previous studies we have also documented that numerous vendors have not displayed any physical address or telephone number on their websites (20.3% in 2014 and 27.8% in 2016). Furthermore, no healthcare professionals–pharmacist or medical doctor–were accessible on most Internet pharmacies (90.5% in 2014 and 91.1% in 2016). The majority (86.5%) of the identified vendors in 2014 and all (100%) in 2016 offered shipment to European countries. There was generally no limitation by the majority (91.9% in 2014 and 97.45% in 2016) of the Internet pharmacies on the amount of medication that could be ordered.

Verification according to LegitScript and VIPPS

LegitScript is a private company monitoring Internet pharmacies, supplement sellers and other online merchants. The company maintains a uniquely large database of more than eighty thousand Internet pharmacies. To evaluate whether online pharmacy websites included in our study were definitely fraudulent, we checked each domain name within the LegitScript database in Q3 2014 and Q3 2016. Internet pharmacy websites are classified by LegitScript into four categories: legitimate, unverified, unapproved, and rogue. “Legitimate” Internet pharmacies have passed LegitScript certification criteria and meet the standards of the National Association of Boards of Pharmacy (a US independent and international association that assists its member boards for the purpose of protecting the public health). “Unverified” websites appear eligible for certification, but have not been subjected to LegitScript’s certification or voluntary monitoring program. “Unapproved” sites have problems with regulatory compliance or risk and do not comply with LegitScript’s verification standards or applicable laws or regulations but do not meet the definition of being rogue. “Rogue” Internet pharmacies are illegitimate websites. Their primary purpose is to engage in some sort of illegal, unsafe, or misleading activity, like selling prescription drugs without requiring a prescription, defrauding customers, or selling counterfeit goods [40, 45, 71]. Websites that are not evaluated by the organization are labeled as “Not available in the database”.

In the United States, the NABP operates VIPPS, a voluntary accreditation program. “Accredited” websites address a customer’s right to privacy, authentication and security of prescription orders, adherence to a recognized quality assurance policy, and provision of meaningful consultation between customers and pharmacists. “Not recommended” vendors appear to be out of compliance with state and federal laws or NABP patient safety and pharmacy practice standards [40, 72, 73, 74].

Website legitimacy is most often evaluated by the LegitScript and the VIPPS Internet pharmacy verification databases in relevant literature. In our samples obtained during the two evaluated years none (0%) of the identified Internet pharmacies were classified as “Legitimate” or “Accredited” by these verification databases, and a notable number of definitely unregulated websites offered products amongst the search engine results. There is a significant difference in the categorization of websites in case of the databases between the two evaluated years (see Table 1). However, a realignment can be observed between the definitely unregulated participants and ones that are not available in the databases. Seemingly the ratio of illegal actors somewhat increased and the completeness of databases has simultaneously slightly improved. The legitimacy of online pharmacies was assessed in 2014 Q3 and 2016 Q3 (July-September) within 2 weeks after the identification of the online pharmacies in google searches.

thumbnail
Table 1. Website legitimacy according to LegitScript and VIPPS Internet pharmacy verification databases.

https://doi.org/10.1371/journal.pone.0203185.t001

We must mention that LegitScript website only allows the limited number of five pharmacy verifications per day, which seems to be a disadvantage from the aspect of patients seeking safe online sellers. Also, an important limitation of the VIPPS website was noticed. The online tool was not able to identify explicit illegal websites that are otherwise listed among “Not Recommended Sites” by the NABP itself [71, 72]. The EU common logo for legally operating online pharmacies/retailers in the EU Member States was introduced by the Falsified Medicines Directive (2011/62/EU) and operates since the 1st of July 2015. This logo is another opportunity to recognize website legitimacy. However, the authors did not document the presence of this seal as it was not obligatory when the study was initiated in 2014 [75].

Comparison of the national and international shortage situation

The authors aimed to evaluate if their findings based on national shortage conditions could be generalized and if the results could characterize a global phenomenon. Internationally significant active ingredients were identified based on methods described earlier and key findings of the study were correlated with results based on the national drug shortage lists. With the assessment of the Non-European shortage lists, and the seven accessible European national shortage databases, we have identified nine oncologic drugs that were in shortage globally in 2014 (bleomycin, carboplatin, carmustine, cisplatin, fluorouracil, gemcitabine, irinotecan, methotrexate, mitomycin) and four (bleomycin, carboplatin, cisplatin, etoposide) in 2016 (see also Fig 1.). See Table B in S1 Table

As it can be seen in Table 2, the main evaluated parameters show similarity for national and international shortage products. Therefore the key findings of our study are supported by data obtained based on internationally significant drug shortages.

thumbnail
Table 2. Comparison of key findings of national shortage list APIs and internationally significant shortages.

https://doi.org/10.1371/journal.pone.0203185.t002

Discussion

Drug shortage information sources and databases

Due to this relatively novel and serious global pharmaceutical market issue publicly available drug shortage information is needed to handle and manage product supply disruptions and their consequences [5, 76, 77]. National online shortage catalogues can provide valuable information for healthcare personnel and policy makers on the extent and nature of the problem at a country level [1]. Additionally, available shortage information may also prevent patients from “gray market” suppliers and buying counterfeit and illicit medications through the Internet [77].

In 2011, President Obama issued an Executive Order emphasizing the importance of notification in helping Food And Drug Administration (FDA) to prevent drug shortages [78], while international recommendations by the International Pharmaceutical Federation (FIP) and the European Association of Hospital Pharmacists (EAHP) also highlighted the establishment of publicly accessible information resources on medicine shortages [2, 12]. By this time almost every health authority and medicine agency has taken steps to collect information proactively from the manufacturers and to provide shortage information on their websites. Extensive databases are available in the United States, Canada and Australia [1, 70, 79]. According to the 2014 survey of the EAHP shortage information or catalogues are also available in most European countries as well [2]. Although there is a centralized database collecting information about drug shortages in Europe that is maintained by the European Medicines Agency (EMA), unfortunately it only contains data that has been assessed by the Agency [1, 23, 66].

Following the analysis of eleven drug shortage databases, thirty seven active pharmaceutical ingredients (20% of 178 L01 ATC) were identified by the authors in 2014 and 2016 (Table B and C in S1 Table). We wanted to highlight the time pattern of oncology drug shortages during the two evaluated years. As it can be seen in Fig 2, the total number of documented shortage events (active pharmaceutical ingredient on a shortage list) are nearly the same in 2014 (n = 61) and 2016 (n = 60) and represent a wide range of fourth level chemical ATC subgroups [80]. However, it is important to note that the shortage status and pattern of active ingredients changed over time. We believe that systematic data collection and the analysis of shortage patterns over time supports better understanding of shortage issues.

thumbnail
Fig 2. The pattern of identified oncology shortage active ingredients in 2014 and 2016.

https://doi.org/10.1371/journal.pone.0203185.g002

Drug shortages and the Internet

Drug shortages turned into a global healthcare problem affecting safe and cost-effective patient care in most countries. Managing medication shortages requires a multi-disciplinary approach that integrates medical doctors, pharmacists and policy makers.

In order to combat product supply disruptions, regularly updated and publicly available drug shortage information is essential. Oncology is one of the most commonly affected therapeutic areas concerning shortages in most developed countries [36]. The limited access to pharmaceuticals is most likely a strong motivator for patients and healthcare professionals to obtain treatments outside the traditional drug-supply-chain.

Internet trade is among the most convenient alternative purchasing options for medications. Unfortunately, the online medication market is currently dominated by illegitimate vendors offering products without medical prescriptions and adequate professional supervision [40, 46, 81]. The chance of obtaining illegitimate, substandard or counterfeit dugs from the Internet is high as currently there is no effective international supervision and law enforcement of the online pharmaceutical market. For drugs in short supply, providers and hospitals search beyond conventional sources to obtain the medications. Thus, shortages of key medicines have created opportunities for illegitimate traders for price markups, while also increasing the chance of infiltration of counterfeits to the market [82, 83].

Online accessibility of oncology drugs

The authors aimed to evaluate the online accessibility of oncology drugs affected by drug shortages to highlight the dangers of the unregulated sale of possibly life threatening products. Oncology drugs affected by shortages were identified by evaluating national and international drug shortage databases, while online availability was evaluated by searching for these shortage antineoplastic agents with the popular search engine Google. Direct online drug sellers were assessed for operational, distributional and patient safety characteristics.

Oncology drugs affected by shortages were generally available on the Internet. Accordingly, it seems that these vendors do not differentiate between plentiful and shortage drugs, and can offer both categories for sale. Numerous Internet vendor sites (25.5%) operated in both evaluated years, indicating illegitimate sellers’ continuous service and broad product portfolio. Current findings are in line with our previously published results on long-term follow-up of Internet pharmacies [40].

Shortage oncology medications were accessible without medical prescription by the majority (73.4–78.4%) of websites. Similarly to previously published studies on Internet pharmacies the authors have documented that numerous (20.3% in 2014 and 27.8% in 2016) vendors have not displayed any contact information on their websites and in most cases (90.5% and 91.1% in 2014 and 2016 respectively) no healthcare professional was available for customers’ consultation. None of the evaluated websites were legitimate (approved or recommended) by the VIPPS or the LegitScript Internet pharmacy verification databases. Nearly one third of the websites (31.1%) were definitely unregulated (rogue)—thus explicitly dangerous—by the LegitScript database in the year 2014 and seemingly the ratio of illegal actors increased (60.8%) within two years. However, simultaneously the completeness of databases has improved.

The analysis of shortage catalogues showed that the drug shortages identified in Hungary are also represented internationally (Europe, North-America, Australia), although with somewhat different appearance and duration. However, the identified number of the internationally significant shortages can be considered low (9 and 4). The reason for this may originate from the lack of completely developed data collection and database structures in the field of shortage reporting. If we look at the result of surveys and the scientific literature, there is a greater number of oncology shortage drugs in Europe and United States as well [38, 39, 77, 84]. The authors believe that their findings illustrate a global phenomenon as the comparison of key findings of our study based on national shortage list were comparable with the search results based on internationally significant shortages.

It is highly likely that anyone searching online for drugs in shortage will encounter a suspect seller, even when only searching for product information rather than with the primary intention of buying a product. It should be emphasized and communicated to patients, healthcare professionals and policy makers that not only shortages but also the online sales of oncology drugs that are in short supply pose a global problem as shown in our study. It represents a high risk to the patient care as these products are not available through the closed drug supply chain, but are obtainable over the Internet.

A gray market of shortage oncology drugs has been identified by the current study. It seems that the limited access to pharmaceuticals within the traditional supply-chain is a challenge for healthcare while being just another opportunity for illegitimate online sellers.

A multidisciplinary approach—including law enforcement, regulatory agencies, manufacturers, and customs—is required to combat both drug shortage issues and the illegal Internet trade of medications. The problems and challenges can only be resolved with harmonized actions at international, national and local institutional levels [25, 40, 8589].

Strengths and limitations of the study

The main strengths of our study include: up-to-date information regarding the joint threat of oncologic drug shortages and illegal Internet pharmacies, deeper insight into the temporality and relationship of these two threats and their possible effects on healthcare systems compared to previous studies [47, 52, 59]. A representative number of eleven drug shortage databases and internationally significant drug shortages were identified and their Internet availability was assessed. Also an inadequate function of the NABP online verification page was discovered.

This study also has limitations which need to be pointed out. The main limitation is that the complete risk based safety mapping [53] of online pharmaceutical market was not carried out, as the medications were not purchased. Actual purchases of oncology products would have provided a more in depth analysis and could have pointed out further patient and medication safety risks. Evaluation of the transportation, storage, packaging, product and patient information leaflet contents, and the analysis of chemical and microbiological quality would have added further useful data. It should be noted that test purchase of oncology drugs raises several legal, ethical and safety issues. Among numerous factors, unfortunately geographic location and language of search terms can affect search engine results. The Authors aimed to perform standardized searches and exclude different sources of bias as described in Methods. Regional differences originating from geographic location and language can be minimized if English terms are used during searches and first five search engine result pages (fifty results) are all evaluated. Accordingly, regardless of geographical location, the most visited online pharmacy websites can be identified representing European setting.

The authors had to face a methodological limitation as the quality of shortage information presented in the databases is highly variable and unfortunately difficult to assess [90]. However, the authors think that currently the best method to describe this global phenomenon and tendencies is based on the assessment shortage databases.

Conclusion

Healthcare systems, institutions and patients are facing new challenges with the increasing number of shortage drugs [82, 84, 85, 91, 9298] and the possibilities of purchasing medicines outside the traditional drug-supply-chain [46]. Currently international legislation and national authorities cannot guarantee continuous drug supply in several therapeutic areas affected by shortages and also the effective measures assuring safe internet sale of pharmaceuticals are still lacking. However, these problems are strongly related as the unavailability of medications, especially in the case of life saving therapies, can be a driving factor to procure pharmaceuticals from online vendors [82, 86]. Health institutions, clinicians and pharmacists may not be aware that patients can buy drugs from uncertain and illegitimate sources and these products are likely to influence the success of therapies [51]. The most vulnerable group is the patients as they are unable to weigh the potential benefits and actual dangers of using medicines from illegitimate sources. To avoid the penetration of illegal, substandard and falsified products a holistic approach is needed in combining international and national preventive measures, local institutional policies and public awareness campaigns [56].

Supporting information

S1 Table.

Drug shortage databases and shortage drugs (Table A: Drug shortage databases 1.; Table B Drug shortage databases 2.; Table C: Shortage L01 ATC 3. and 4.).

https://doi.org/10.1371/journal.pone.0203185.s001

(XLSX)

Acknowledgments

The present scientific contribution is dedicated to the 650th anniversary of the foundation of the University of Pécs, Hungary.

References

  1. 1. Pauwels K, Huys I, Casteels M, Simoens S. Drug shortages in European countries: a trade-off between market attractiveness and cost containment? BMC Health Serv Res. 2014 Sep 26;14:438. pmid:25257912
  2. 2. International Pharmaceutical Federation FIP. Report of the International Summit on Medicines Shortage. Toronto, Canada 20–21 June 2013. [Internet] [cited 2016 November 14]. Available from: http://www.fip.org/files/fip/publications/FIP_Summit_on_Medicines_Shortage.pdf
  3. 3. McKeever AE, Bloch JR, Bratic A. Drug Shortages and the Burden of Access to Care: A critical issue affecting patients with cancer. Clin J Oncol Nurs. 2013 Oct;17(5):490–5. pmid:24080048
  4. 4. Gray A, Manasse HR Jr. Shortages of medicines: a complex global challenge. Bull World Health Organ. 2012 Mar 1;90(3):158–158A. pmid:22461706
  5. 5. De Weerdt E, Simoens S, Casteels M, Huys I. Toward a European definition for a drug shortage: a qualitative study. Front Pharmacol. 2015 Oct 30;6:253. pmid:26578963
  6. 6. McLaughlin M, Kotis D, Thomson K, Harrison M, Fennessy G, Postelnick M et al. Effects on patient care caused by drug shortages: a survey. J Manag Care Pharm. 2013 Nov-Dec;19(9):783–8. pmid:24156647
  7. 7. Institute for Safe Medication Practices (ISMP). Drug shortages: national survey reveals high level of frustration, low level of safety. ISMP Medication Safety Alert 2010 Sep 23;15(19):1–6. [Internet] [cited 2016 December 2]. Available from: https://www.ismp.org/newsletters/acutecare/articles/20100923.asp
  8. 8. Center for Drug Evaluation and Research, FDA. Manual of Policies and Procedures. Drug Shortage Management, Definitions and Acronyms, 09/26/2006. Page 2. [Internet] [cited 2016 December 14]. Available from: http://www.fda.gov/downloads/AboutFDA/CentersOffices/CDER/ManualofPoliciesProcedures/UCM079936.pdf
  9. 9. American Society of Health-System Pharmacists Expert Panel on Drug Product Shortage. Fox ER, Birt A, James KB, Kokko H, Salverson S, Soflin DL. ASHP Guidelines on Managing Drug Product Shortages in Hospitals and Health Systems. Am J Health Syst Pharm. 2009 Aug 1;66(15):1399–406. pmid:19635779
  10. 10. European Federation of Pharmaceutical Industries and Associations: EFPIA Good Practice–Revision 1, October 2014. Reducing Risk of Drug Product Shortages. [Internet] [cited 2016 December 14]. Available from: http://www.fdanews.com/ext/resources/files/11/11-12-13-EFPIA.pdf
  11. 11. United States Government Accountability Office: Drug shortages: Certain Factors Are Strongly Associated with This Persistent Public Health Challenge. July 2016. GAO-16-595. [Internet] [cited 2017 August 3]. Available from: http://www.gao.gov/assets/680/678281.pdf
  12. 12. European Association of Hospital Pharmacists. EAHP's 2014 survey of the medicines shortage problem: Medicines shortages in European hospitals. The evidence and case for action. October 2014. [Internet] [cited 2017 August 4] Available from: http://www.eahp.eu/practice-and-policy/medicines-shortages
  13. 13. Mazer-Amirshahi M, Goyal M, Umar SA, Fox ER, Zocchi M, Hawley KL, et al. U.S. drug shortages for medications used in adult critical care (2001–2016). J Crit Care. 2017 Jun 9;41:283–288. pmid:28622641
  14. 14. European Association of Hospital Pharmacists. Medicines shortages in European hospitals. Survey by the European Association of Hospital Pharmacists on medicines shortages, September 2012-February 2013. 6 June 2013. [Internet] [cited 2017 August 3]. Available from: http://www.eahp.eu/practice-and-policy/medicines-shortages
  15. 15. Iyengar S, Hedman L, Forte G, Hill S. Medicine shortages: a commentary on causes and mitigation strategies. BMC Med. 2016 Sep 29;14(1):124. pmid:27683105
  16. 16. International Pharmaceutical Federation. FIP calls attention to medicines shortages The Hague: International Pharmaceutical Federation; 2011. [Internet] [cited 2016 December 15]. Available from: http://www.fip.org/www/index.php?page=latest_news&news=newsitem&newsitem=118
  17. 17. IMS Institute for Healthcare Informatics. Drug Shortages: A Closer Look at Products, Suppliers and Volume Volatility. November 2011. [Internet] [cited 2016 December 10]. Available from: https://www.imshealth.com/files/web/IMSH%20Institute/Reports/Drug%20Shortages%20A%20closer%20look/IHII_Drug_Shortage_Report.pdf
  18. 18. International Society for Pharmaceutical Engineering. Report on the ISPE Drug Shortages Survey. June 2013. www.ispe.org [Internet] [cited 2016 December 10]. Available from: http://www.ispe.org/drugshortages/2013JuneReport
  19. 19. Gu Anna, Wertheimer Albert I., Brown Bernard, Shaya Fadia T. Drug Shortages in the US–Causes, Impact, and Strategies. Innovations in Pharmacy. 2011, Vol. 2, No. 4, Article 60. [Internet] [cited 2016 December 12] Available from: http://pubs.lib.umn.edu/cgi/viewcontent.cgi?article=1059&context=innovations
  20. 20. Woodcock J, Wosinska M. Economic and technological drivers of generic sterile injectable drug shortages. Clin Pharmacol Ther. 2013 Feb;93(2):170–6. pmid:23337525
  21. 21. Fox ER, Sweet BV, Jensen V. Drug shortages: a complex health care crisis. Mayo Clin Proc. 2014 Mar;89(3):361–73. pmid:24582195
  22. 22. Ridley DB, Bei X, Liebman EB. No Shot: US Vaccine Prices and Shortages. Health Aff (Millwood). 2016 Feb;35(2):235–41.
  23. 23. European Medicines Agency: Reflection paper on medicinal product supply shortages caused by manufacturing/Good Manufacturing Practice Compliance problems. 22 November 2012 EMA/590745/2012. [Internet] [cited 2016 December 13] Available from: http://www.ema.europa.eu/docs/en_GB/document_library/Other/2012/11/WC500135113.pdf
  24. 24. Caulder CR, Mehta B, Bookstaver PB, Sims LD, Stevenson B. Impact of Drug Shortages on Health System Pharmacies in the Southeastern United States. Hosp Pharm. 2015 Apr;50(4):279–86. pmid:26448658
  25. 25. György Vida Róbert, Bernadett Nyaka, Judit Krucsóné Hornyák, Lajos Botz. A gyógyszerhiányok intézményi költségekre kifejtett hatásainak értékelése. Journal of Hungarian Interdisciplinary Medicine (INFORMATIKA ÉS MENEDZSMENT AZ EGÉSZSÉGÜGYBEN) 15:(2) pp. 42–46. (2016). HUNGARIAN
  26. 26. Romito B, Stone J, Ning N, Yin C, Llano EM, Liu J, et al. How Drug Shortages Affect Clinical Care: The Case of the Surgical Anesthetic Propofol. Hosp Pharm. 2015 Oct;50(9):798–805. pmid:26912921
  27. 27. De Weerdt E, Simoens S, Casteels M, Huys I. Clinical, Economic and Policy Implications of Drug Shortages in the European Union. Appl Health Econ Health Policy. 2017 Aug;15(4):441–445. pmid:27480539
  28. 28. Pauwels K, Simoens S, Casteels M, Huys I. Insights into European drug shortages: a survey of hospital pharmacists. PLoS One. 2015 Mar 16;10(3):e0119322. pmid:25775406
  29. 29. Hughes KM, Goswami ES, Morris JL. Impact of a Drug Shortage on Medication Errors and Clinical Outcomes in the Pediatric Intensive Care Unit. J Pediatr Pharmacol Ther. 2015 Nov-Dec;20(6):453–61. pmid:26766934
  30. 30. Securing Industry. Phil Taylor. Drug shortages raising supply chain risk, says FDA. 17 Jan 2012. [Internet] [cited 2016 December 10]. Available from: http://www.securingpharma.com/drug-shortages-raising-supply-chain-risk-says-fda/s40/a1166/
  31. 31. European Association of Hospital Pharmacists. EAHP statement on medicines shortages July 2012. Available from: http://www.eahp.eu/practice-and-policy/medicines-shortages
  32. 32. Monteith S, Glenn T, Bauer R, Conell J, Bauer M. Availability of prescription drugs for bipolar disorder at online pharmacies. J Affect Disord. 2016 Mar 15;193:59–65. pmid:26766033
  33. 33. Schweitzer SO. How the US Food and Drug Administration can solve the prescription drug shortage problem. Am J Public Health. 2013 May;103(5):e10–4. pmid:23488502
  34. 34. Link MP, Hagerty K, Kantarjian HM. Chemotherapy drug shortages in the United States: genesis and potential solutions. J Clin Oncol. 2012 Mar 1;30(7):692–4. pmid:22291078
  35. 35. Valgus J, Singer EA, Berry SR, Rathmell WK. Ethical Challenges: Managing Oncology Drug Shortages. J Oncol Pract. 2013 Mar;9(2):e21–3. pmid:23814521
  36. 36. de Lemos ML, Waignein S, de Haan M. Evidence-based practice in times of drug shortage. J Oncol Pharm Pract. 2016 Jun;22(3):566–70. pmid:26044588
  37. 37. Kehl KL, Gray SW, Kim B, Kahn KL, Haggstrom D, Roudier M et al. Oncologists' experiences with drug shortages. J Oncol Pract. 2015 Mar;11(2):e154–62. pmid:25549653
  38. 38. Parsons HM, Schmidt S, Karnad AB, Liang Y, Pugh MJ, Fox ER. Association Between the Number of Suppliers for Critical Antineoplastics and Drug Shortages: Implications for Future Drug Shortages and Treatment. J Oncol Pract. 2016 Mar;12(3):e289–98, 249–50. pmid:26837565
  39. 39. Goldsack JC, Reilly C, Bush C, McElligott S, Bristol MN, Motanya UN et al. Impact of shortages of injectable oncology drugs on patient care. Am J Health Syst Pharm. 2014 Apr 1;71(7):571–8. pmid:24644117
  40. 40. Fittler A, Bősze G, Botz L. Evaluating aspects of online medication safety in long-term follow-up of 136 Internet pharmacies: illegal rogue online pharmacies flourish and are long-lived. J Med Internet Res. 2013 Sep 10;15(9):e199. pmid:24021777
  41. 41. Gatesman ML, Smith TJ. The shortage of essential chemotherapy drugs in the United States. N Engl J Med. 2011 Nov 3;365(18):1653–5. pmid:22040130
  42. 42. McLaughlin MM, Pentoney Z, Skoglund E, Scheetz MH. Projections for antiinfective drug shortages and time to actual resolution. Am J Health Syst Pharm. 2014 Dec 1;71(23):2074–8. pmid:25404600
  43. 43. Hawley KL, Mazer-Amirshahi M, Zocchi MS, Fox ER, Pines JM. Longitudinal Trends in U.S. Drug Shortages for Medications Used in Emergency Departments (2001–2014). Acad Emerg Med. 2016 Jan;23(1):63–9. pmid:26715487
  44. 44. Cancer medicines shortages in Europe. Policy recommendations to prevent and manage shortages. A report by The Economist Intelligence Unit Supported by the European Society for Medical Oncology. 2017. [Internet] [cited 2017 August 3]. Available from: http://www.eiu.com//graphics/marketing/pdf/ESMO-Cancer-medicines-shortages.pdf
  45. 45. Bauters T, Claus BO, Norga K, Huys I, Simoens S, Laureys G. Chemotherapy drug shortages in paediatric oncology: A 14-year single-centre experience in Belgium. J Oncol Pharm Pract. 2016 Dec;22(6):766–770. pmid:26447099
  46. 46. Mackey TK, Nayyar G. Digital danger: a review of the global public health, patient safety and cybersecurity threats posed by illicit online pharmacies. Br Med Bull. 2016 Jun;118(1):110–26. pmid:27151957
  47. 47. Liang BA, Mackey TK. Online availability and safety of drugs in shortage: a descriptive study of internet vendor characteristics. J Med Internet Res. 2012 Feb 9;14(1):e27. pmid:22321731
  48. 48. Liang BA, Mackey T. Searching for safety: addressing search engine, website, and provider accountability for illicit online drug sales. Am J Law Med. 2009;35(1):125–84. pmid:19534258
  49. 49. Liang BA, Mackey TK. Sexual medicine: Online risks to health—the problem of counterfeit drugs. Nat Rev Urol. 2012 Sep;9(9):480–2. pmid:22824776
  50. 50. Alwon BM, Solomon G, Hussain F, Wright DJ. A detailed analysis of online pharmacy characteristics to inform safe usage by patients. Int J Clin Pharm. 2015 Feb;37(1):148–58. pmid:25564180
  51. 51. Gabay M. Regulation of Internet Pharmacies: A Continuing Challenge. Hosp Pharm. 2015 Sep;50(8):681–2. pmid:26823617
  52. 52. Liang BA, Mackey TK. Vaccine shortages and suspect online pharmacy sellers. Vaccine. 2012 Jan 5;30(2):105–8. pmid:22094281
  53. 53. Vida RG, Fittler A, Mikulka I, Ábrahám E, Sándor V, Kilár F, Botz L. Availability and quality of illegitimate somatropin products obtained from the Internet. Int J Clin Pharm. 2017 Feb;39(1):78–87. pmid:27888454
  54. 54. Levaggi R, Orizio G, Domenighini S, Bressanelli M, Schulz PJ, Zani C et al. Marketing and pricing strategies of online pharmacies. Health Policy. 2009 Oct;92(2–3):187–96. pmid:19394104
  55. 55. Levaggi R, Marcantoni C, Filippucci L, Gelatti U. Not a good buy: value for money of prescription drugs sold on the internet. Health Policy. 2012 Aug;106(3):241–5. pmid:22694971
  56. 56. Orizio G, Merla A, Schulz PJ, Gelatti U. Quality of online pharmacies and websites selling prescription drugs: a systematic review. J Med Internet Res. 2011 Sep 30;13(3):e74. pmid:21965220
  57. 57. Lagan BM, Dolk H, White B, Uges DR, Sinclair M. Assessing the availability of the teratogenic drug isotretinoin outside the pregnancy prevention programme: a survey of e-pharmacies. Pharmacoepidemiol Drug Saf. 2014 Apr;23(4):411–8. pmid:24493556
  58. 58. Orizio G, Schulz P, Domenighini S, Caimi L, Rosati C, Rubinelli S et al. Cyberdrugs: a cross-sectional study of online pharmacies characteristics. Eur J Public Health. 2009 Aug;19(4):375–7. pmid:19151103
  59. 59. Mackey TK, Liang BA. Oncology and the Internet: regulatory failure and reform. J Oncol Pract. 2012 Nov;8(6):341–3. pmid:23450970
  60. 60. National Institute of Pharmacy and Nutrition. Temporary dug shortages. [Internet] Available from: http://ogyei.gov.hu/temporary_discontinuation_of_sale_/
  61. 61. Germany Drug shortage information. [Internet] Available from: http://www.bfarm.de/DE/Arzneimittel/zul/amInformationen/Lieferengpaesse/_node.html
  62. 62. Belgium: Drug shortage information. [Internet] Available from: http://www.fagg-afmps.be/fr/items-HOME/indisponibilites_de_medicaments/
  63. 63. France: Drug shortage information. [Internet] Available from: http://ansm.sante.fr/S-informer/Informations-de-securite-Ruptures-de-stock-des-medicaments
  64. 64. Italy: Drug shortage information, [Internet] Available from: http://www.agenziafarmaco.gov.it/it/content/carenze-dei-medicinali
  65. 65. The Netherlands: Drug shortage information. [Internet] Available from: http://www.farmanco.knmp.nl/
  66. 66. European Medicines Agency shortages catalogue. [Internet] Available from: http://www.ema.europa.eu/ema/index.jsp?curl=pages/regulation/document_listing/document_listing_000376.jsp&mid=WC0b01ac05807477a6
  67. 67. Food and Drug Administration. FDA drug shortages. Current and Resolved Drug Shortages and Discontinuations Reported to FDA. [Internet] Available from: http://www.accessdata.fda.gov/scripts/drugshortages/default.cfm
  68. 68. American Society of Health-System Pharmacists. Drug Shortages Resource Center–ASHP. [Internet] Available from: http://www.ashp.org/menu/DrugShortages
  69. 69. Canada: CANADIAN DRUG SHORTAGE DATABASE. [Internet] Available from: https://www.drugshortagescanada.ca/
  70. 70. Australia: Therapeutic Goods Administration Medicine Shortages Information Initiative. [Internet] Available from: https://www.tga.gov.au/medicine-shortages-information-initiative
  71. 71. LegitScript: Online Pharmacy Reviews & Verification. [Internet] Available from: https://www.legitscript.com/
  72. 72. Verified Internet Pharmacy Practice Sites (VIPPS) National Association of Boards of Pharmacy. [Internet] Available from: http://vipps.nabp.net/
  73. 73. Verified Internet Pharmacy Practice Sites (VIPPS) National Association of Boards of Pharmacy. VIPPS-Accredited Pharmacies List. [Internet] [cited 2017 August 15] Available from: https://nabp.pharmacy/programs/vipps/vipps-accredited-pharmacies-list/
  74. 74. Verified Internet Pharmacy Practice Sites (VIPPS) National Association of Boards of Pharmacy. Not Recommended Sites. [Internet] [cited 2017 August 15] Available from: https://nabp.pharmacy/initiatives/dot-pharmacy/not-recommended-sites/
  75. 75. European Commission: EU logo for online sale of medicines. [Internet] [cited 2017 August 14] Available from: https://ec.europa.eu/health/human-use/eu-logo_en
  76. 76. Woodcock J, Wosinska M. Economic and technological drivers of generic sterile injectable drug shortages. Clin Pharmacol Ther. 2013 Feb;93(2):170–6. pmid:23337525
  77. 77. Huys I, Simoens S. European drug shortages: a call for action! Int J Pharm Pract. 2013 Feb;21(1):1–2. pmid:23301528
  78. 78. Food and Drug Administration. FDA acts to prevent more drug shortages. [Internet] [cited 2017 January 02]. Available from: http://www.fda.gov/ForConsumers/ConsumerUpdates/ucm370495.htm
  79. 79. Kaposy C. Drugs, money, and power: the Canadian drug shortage. J Bioeth Inq. 2014 Mar;11(1):85–9. pmid:24357073
  80. 80. WHO Collaborating Centre for Drug Statistics Methodology. [Internet] [cited 3 January 2017] Available from: https://www.whocc.no/atc_ddd_index/
  81. 81. Mackey TK, Liang BA. The global counterfeit drug trade: patient safety and public health risks. J Pharm Sci. 2011 Nov;100(11):4571–9. pmid:21698604
  82. 82. Butterfield L, Cash J, Pham K; Advocacy Committee for the Pediatric Pharmacy Advocacy Group. Drug shortages and implications for pediatric patients. J Pediatr Pharmacol Ther. 2015 Mar-Apr;20(2):149–52. pmid:25964733
  83. 83. Mackey TK, Aung P, Liang BA. Illicit Internet availability of drugs subject to recall and patient safety consequences. Int J Clin Pharm. 2015 Dec;37(6):1076–85. pmid:26148859
  84. 84. Yang C, Wu L, Cai W, Zhu W, Shen Q, Li Z, Fang Y. Current Situation, Determinants, and Solutions to Drug Shortages in Shaanxi Province, China: A Qualitative Study. PLoS One. 2016 Oct 25;11(10):e0165183. pmid:27780218
  85. 85. Blackstone EA, Fuhr JP Jr, Pociask S. The health and economic effects of counterfeit drugs. Am Health Drug Benefits. 2014 Jun;7(4):216–24. pmid:25126373
  86. 86. INTERPOL. Operation Pangea—Combating the sale of illegal medicines online. [Internet] [cited 2017 January 02] Available from: http://www.interpol.int/Crime-areas/Pharmaceutical-crime/Operations/Operation-Pangea
  87. 87. National Association of Boards of Pharmacy. Pharmacy Generic Top-Level Domain to Help Consumers Find Safe Pharmacies Online [Internet] [cited 2016 November 17] Available from: https://nabp.pharmacy/initiatives/dot-pharmacy/
  88. 88. Martin Stephens: Hospital Pharmacy. 11. Strategic medicines management pages 181–182. Second edition. Pharmaceutical Press. 2011. Royal Pharmaceutical Society of Great Britain.
  89. 89. Kathleen Holloway, Terry Green: Drug and Therapeutics Committees—A Practical Guide. World Health Organization Department of Essential Drugs and Medicines Policy Geneva, Switzerland; Management Sciences for Health Center for Pharmaceutical Management Rational Pharmaceutical Management Program Arlington, Virginia, USA. WHO/EDM/PAR/2004.1 [Internet] [cited 2017 May 12] Available from: http://apps.who.int/medicinedocs/en/d/Js4882e/
  90. 90. Fittler A, Vida R, Rádics V, et al DD-010 Online availability of oncology drugs affected by shortages European Journal of Hospital Pharmacy: Science and Practice 2014;21:A67.
  91. 91. Institute for Safe Medication Practices: Drug Shortages Summit: August 1, 2014. [Internet] [cited 2016 December 3]. Available from: http://www.ismp.org/pressroom/2014-Drug-Shortages-Summit.pdf
  92. 92. United States Government Accountability Office: Drug shortages: Public Health Threat Continues, Despite Efforts to Help Ensure Product Availability. February 2014. GAO-14-194. [Internet] [cited 2016 December 3]. Available from: http://www.gao.gov/assets/670/660785.pdf
  93. 93. Caulder CR, Mehta B, Bookstaver PB, Sims LD, Stevenson B. Impact of Drug Shortages on Health System Pharmacies in the Southeastern United States. Hosp Pharm. 2015 Apr;50(4):279–86. pmid:26448658
  94. 94. Quadri F, Mazer-Amirshahi M, Fox ER, Hawley KL, Pines JM et al. Antibacterial drug shortages from 2001 to 2013: implications for clinical practice. Clin Infect Dis. 2015 Jun 15;60(12):1737–42. pmid:25908680
  95. 95. Malone C, Acheson JR, Hinds JD, McComiskey MH. Uterotonics for Non-emergent Caesarean Section: Protocol Change During UK-Licensed Drug Shortage. Ulster Med J. 2016 Sep;85(3):174–177. pmid:27698519
  96. 96. Alsheikh M, Seoane-Vazquez E, Rittenhouse B, Fox ER, Fanikos J. A Comparison of Drug Shortages in the Hospital Setting in the United States and Saudi Arabia: An Exploratory Analysis. Hosp Pharm. 2016 May;51(5):370–5. pmid:27303090
  97. 97. Reed BN, Fox ER, Konig M, Jackevicius CA, Masoudi FA, Rabinstein AA et al. The impact of drug shortages on patients with cardiovascular disease: causes, consequences, and a call to action. Am Heart J. 2016 May;175:130–41. pmid:27179732
  98. 98. Iyengar S, Hedman L, Forte G, Hill S. Medicine shortages: a commentary on causes and mitigation strategies. BMC Med. 2016 Sep 29;14(1):124. pmid:27683105