http://orcid.org/0000-0001-6854-7326
Figures
Abstract
Background
Champlain BASE™ (Building Access to Specialists through eConsultation) is a web-based asynchronous electronic communication service that allows primary-care- practitioners (PCPs) to submit “elective” clinical questions to a specialist. For adults, PCPs have reported improved access and timeliness to specialist advice, averted face-to-face specialist referrals in up to 40% of cases and high provider satisfaction.
Objective
To determine whether the expansion of eConsult to a pediatric setting would result in similar measures of improved healthcare system process and high provider acceptance reported in adults.
Setting
Single Canadian tertiary-care academic pediatric hospital (June 2014–16) servicing 1.2 million people.
Participants
1. PCPs already using eConsult. 2.Volunteer pediatric specialists provided services in addition to their regular workload. 3.Pediatric patients (< 18 years-old) referred for none-acute care conditions.
Main outcomes and measures
Specialty service utilization and access, impact on PCP course-of-action and referral-patterns and survey-based provider satisfaction data were collected.
Results
1064 eConsult requests from 367 PCPs were answered by 23 pediatric specialists representing 14 specialty-services. The top three specialties represented were: General Pediatrics 393 cases (36.9%), Orthopedics 162 (15.2%) and Psychiatry 123 (11.6%). Median specialist response time was 0.9 days (range <1 hour-27 days), most consults (63.2%) required <10minutes to complete and 21/21(100%) specialist survey-respondents reported minimal workload burden. For 515/1064(48.4%) referrals, PCPs received advice for a new or additional course of action; 391/1064(36.7%) referrals resulted in an averted face-to-face specialist visit. In 9 specialties with complete data, the median wait-time was significantly less (p<0.001) for an eConsult (1 day, 95%CI:0.9–1.2) compared with a face-to-face referral (132 days; 95%CI:127–136). The majority (>93.3%) of PCPs rated eConsult as very good/excellent value for both patients and themselves. All specialist survey-respondents indicated eConsult should be a continued service.
Conclusions and relevance
Similar to adults, eConsult improves PCP access and timeliness to elective pediatric specialist advice and influences their care decisions, while reporting high end-user satisfaction. Further study is warranted to assess impact on resource utilization and clinical outcomes.
Citation: Lai L, Liddy C, Keely E, Afkham A, Kurzawa J, Abdeen N, et al. (2018) The impact of electronic consultation on a Canadian tertiary care pediatric specialty referral system: A prospective single-center observational study. PLoS ONE 13(1): e0190247. https://doi.org/10.1371/journal.pone.0190247
Editor: Ravi Jhaveri, University of North Carolina at Chapel Hill School of Medicine, UNITED STATES
Received: August 24, 2017; Accepted: December 11, 2017; Published: January 10, 2018
Copyright: © 2018 Lai et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: These data contain potentially identifying and sensitive information. As such, the Chair of the hospital Research Ethics Committee has imposed ethical restrictions on publicly sharing these data. CHEO-OCTC Hospital and Champlain LHIN-based data are available from Tammy DeGiovanni (Tdegiovanni@cheo.on.ca), the Director of Ambulatory Services at CHEO-OCTC and Douglas Archibald (darchibald@bruyere.org), Assistant Professor and Education Researcher, Dept. of Family Medicine, University of Ottawa, respectively. If contacted, a formal data sharing agreement and REB notification will be required to provide the de-identified data.
Funding: This study was supported by an Innovation in Research Grant from The Academic Health Science Center Alternate Funding Plan Innovation Fund ($67, 200 CAN; Grant No.-CHA-14-006 and URL: https://ifpoc.org/). The funding organization had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Competing interests: I have read the journal's policy and the authors of this manuscript have the following competing interests: Drs. Leigh Fraser Roberts, Kathy Keely and Judy Van Stralen were paid directly for their services by eConsult during the study period. The rest of the authors have no financial relationships relevant to this article to disclose. The authors have no other conflicts of interest related to activities, relationships and affiliations to disclose involving the work under consideration for publication. This does not alter our adherence to PLOS ONE policies on sharing data and materials.
Introduction
The World Health Organization reports that excessive wait-times for specialist care can impact continuity of care, leading to inappropriate treatment and potential patient harm. Canada has the second longest wait time for adult specialists among 10 other commonwealth countries.[1] Dissatisfaction with the referral process in Canada is evident among both adult-based primary care practitioners (PCPs) and specialists.[2] Pediatric literature on Canadian wait times for specialist care is limited. While there is published data on surgical wait times,[3] no data exists on wait times for elective pediatric medical referrals. A 2015 internal review conducted at the tertiary care Children’s Hospital of Eastern Ontario-Ottawa Children’s Treatment Center (CHEO-OCTC), Ontario, Canada, however, revealed elective wait times of up to 16 months for some specialties (personal communication Dr. Ciaran Duffy, CHEO-OCTC April 2015), mirroring the excess wait times seen in adults. Dissatisfaction with the pediatric referral process is assumed to be similar to that found among adult-based providers, and supports the need for more timely access to specialist care for Canadian children.
Electronic consultation is a potential solution to address prolonged specialist wat-times that has been implemented by several countries to improve access to single and multiple adult-based specialty departments.[4–7] Research has shown that eConsult, defined as an asynchronous consultative provider-to-provider communication within a shared web-based platform or electronic health-record[7], has enabled more timely access to care in the adult population and high levels of satisfaction among providers and patients.[7–12] Although three integrated American health care systems figure prominently in the literature (San Francisco General Hospital, the Mayo Clinic and the Department of Veterans Affairs)[7], it is the Canadian Champlain BASE™ (Building Access to Specialists through eConsultation) eConsult service, here in referred to as “eConsult” and located in Ottawa, Ontario, who have reported the largest number of available specialty services and eConsult requests. This secure web-based platform enables PCPs to request advice from 84 different adult specialty groups. As of December 22, 2017, over 32,293 eConsults have been completed with a median response time of two days and averted a face-to-face (FTF) referral in up to 40% of cases.[13–15] With the aim to address the long wait times in our region and to contribute to the dearth of pediatric eConsult literature[16–19], in June 2014 the breadth of pediatric specialty services offered through BASE eConsult, which was initially limited to general pediatrics and hematology/oncology,[20] was expanded. The specific objectives of this study were to evaluate the impact of the expanded pediatric services available through eConsult on measures of PCP access to specialty services, elective hospital-referral patterns, provider satisfaction, and to estimate patient family cost-savings. Based on our adult experience with BASE eConsult, we hypothesized that PCP eConsult utilization would be high and impact patient care, 40% of eConsult referrals would avoid a FTF specialist visit, wait-times for specialist advice and elective hospital-referrals would decrease, provider satisfaction would be high, and cost-savings would be realized.
Materials and methods
Setting and participants
This study reports on the results of a 2-year pilot phase which began in June 2014 at a 150-bed tertiary care pediatric hospital (CHEO-OCTC) located within the Champlain local health integration network (LHIN) one of 14 LHINs within the Province of Ontario, Canada, that services approximately 1.2 million people, 269,056 (20.2%) of whom are 0–18 years old.[21] CHEO-OCTC provides complete pediatric specialty consultation to Ottawa and the surrounding region and locations outside of our LHIN (i.e. northern Ontario, Nunavut and Gatineau, Quebec).
Participants were PCPs (family doctors and nurse practitioners) already using eConsult representing approximately 75% all PCPs practicing within the Champlain LHIN. CHEO-OCTC clinician specialists and community pediatricians were recruited on a volunteer basis. The former did not receive additional income for participating due to restrictions of their salary arrangement. At least two specialists per service were targeted to ensure timely coverage of eConsult requests. The eConsult service was available for any pediatric patient from within the LHIN catchment area through their PCP for any medical condition not requiring acute care.
The Champlain BASE eConsult service (eConsult)
The eConsult service is web-based and developed to allow PCPs to submit a patient-specific clinical question to a specialist, using a standardized electronic form. A detailed description of the eConsult process including issues related to privacy and security are provided in S1 Methods. Specialists are expected to respond within 1 week. As part of the case-closure process all PCPs are required to complete a close-out survey (S2 Methods) to assess impact, which includes written feedback to the specialist.
Qualitative and quantitative outcomes: Provider survey responses, system utilization & projected cost-savings
The primary outcomes were the impact of eConsult on the PCP’s course of action and associated referral-pattern. Secondary outcomes reflected impact on specialty service wait-times, elective hospital specialty referral patterns, provider acceptance (e.g. satisfaction and perceived workload burden) and projected indirect family/caregiver cost-savings as a result of an averted FTF specialist clinic visit. All data was collected prospectively. For each case-file, several data points, including demographics, the clinical question asked and the types and content of answers provided were automatically captured and stored. Time-dependent data including log-in times, time spent on the consultation, time for reply and closure of the case were also recorded. Each specialist was required to complete a satisfaction survey (S3 Methods) after study closure.
Electronic health record (EPIC) and individual department databases were used to quantify the impact of eConsult on the number of hospital referrals received by specialists and wait times. The pre-program implementation period was defined as July 1, 2013 to May 31, 2014 (11months); the post-period was defined as June 1, 2015 to April 31, 2016 (11months) allowing for 1 year (June 2014-May 2015) of established use. Finally, family/caregiver indirect cost-savings projections were determined based on the number of FTF consults avoided and as a result avoided travel expenses and costs associated with lost wages/productivity. As such, the following assumptions were made: all parent/guardians worked; the time taken to complete a FTF clinic visit at CHEO-OCTC necessitated at least a half-full day off work (depending on urban or rural designation); and the family’s urban/rural designation was based on the PCP’s office location.
Statistical analysis
The data were analyzed using SPSS 21 (SPSS, Inc. Chicago IL, USA). All data are summarized using descriptive statistics including proportions, means or medians where appropriate. The mean numbers of monthly referrals for the pre-and post-program implementation periods were compared using a two-sample t-test. Before performing the t-test, a test for equality of variances was used, verifying that the variances in the two samples were not significantly different (p = 0.63). Wait times were compared using the Mann-Whitney-U tests. A P value <0.05 was considered statistically significant.
Ethics approval
Both the CHEO Research Institute’s Ethics Review Board (REB No. 13/225X and 17/206X) and the Ottawa Health Science Network Research Ethics Board (REB No. 2009848) approved this research. All participating providers signed a consent form when registering for the service. Separate specialist consent to assess their satisfaction with eConsult via a survey was obtained. Patients and/or parents/guardians did not sign consent. It was expected, as with any referral, that the provider has verbally informed the patient and/or parents/guardian they will be using the eConsult service to get specialist input into their case.
Results
Provider characteristics
Within a few months of initiation, 16 specialty services supported by 25 participating physician specialists were represented in the expanded pediatric BASE eConsult platform (Table 1). The participating PCPs consisted of family doctors (n = 318) and nurse practitioners (n = 49). Most PCPs were located in urban areas (87.5%) while the remainder practiced in a rural setting.
Utilization of eConsult
A total of 1064 pediatric eConsult requests were directed to 14 of 16 specialty services (Table 1). The top three pediatric specialties consulted were General Pediatrics 393 cases (36.9%), Orthopedics 162 (15.2%) and Psychiatry 123 (11.6%). The majority of PCPs (55.9%) used the service 2 or more times with a median of 2 (range 1–31) eConsult requests per PCP. The median initial specialist response time to the PCP request was 0.9 days (range <1 hour to 27 days). The delays occurred early in our experience and were due to specialist absence without available back-up. Most specialists reported spending less than 10 minutes per eConsult (63.2% of cases specialists completed the case in <10min; 22.6% in 10-15min; 10.2% in 15-20min; 4.1% >20min). The specialist responded without need for further information in 983 (92.4%) cases. In the remaining 81 (7.6%) cases, either the specialist or PCP asked additional questions.
Impact of eConsult on PCP course of action and referral patterns to the specialist
The impact of eConsult on the PCPs course of action is displayed in Fig 1. Overall, 515/1064 (48.4%) cases resulted in the PCP receiving good advice for a new or additional course of action, 520/1064 (48.9%) confirmed their original course of action and 19/1064 (1.8%) found eConsult “not useful”. The impact of eConsult on PCP referral activity is seen in Fig 2 (for associated comments, S1 Table). PCPs confirmed a FTF referral was still or still not required in 286/1064 (26.9%) and 315/1064 (29.6%) cases, respectively. Of note, 391/1064 (36.7%) of referrals were originally contemplated but were avoided as a result of using eConsult. Only 33/1064 (3.1%) of cases not thought to require a FTF referral by the PCP required FTF assessment by the specialist following eConsult.
Impact of specialist response on PCP course of action: (Blue) Provided new information and/or additional course of action; (Red) Confirmed course of action; (Green) Considered not useful and (Purple) Other.
Impact of specialist response on PCP perceived need for patient referral: (Light Blue) Referral avoided; (Orange) Referral still not needed; (Gray) Referral still needed; (Yellow) New referral needed; (Dark Blue) No benefit and (Green) Other.
Impact of eConsult on specialty service wait-times
Nine specialties had complete wait-time data for comparative analysis. Sixteen observations were removed from analysis as they were recorded inaccurately in the hospital electronic health record (EPIC). The overall median wait-time of these nine specialty services for an eConsult (1 day; 95% CI 0.9–1.2) compared with a FTF referral (132 days; 95% CI 127–136) was significantly shorter (p<0.001) (Table 2).
Hospital elective-referral patterns
CHEO-OCTC began tracking referrals in July 2013 in a gradual rollout fashion. As a result, pre-and post-program implementation data of elective referral patterns was only available for 8 specialties (S1 Fig). During the study time period, CHEO-OCTC received 18,700 referrals, of which 3246 were triaged as “elective” referrals. There was minimal difference between the monthly rates of specialist visits (124 vs 123 referrals/month; P = 0.91) and total elective referrals (1520 vs 1448 cases) prior to and following study implementation.
Satisfaction
There was a 1064/1064 (100%) survey response rate among PCPs. They felt that the overall value of the service was excellent or very good value for them (93.3%) and their patients (94.4%) (see examples of comments in S2 Table). The specialist satisfaction survey response rate was 21/25 (84%). The majority of specialist survey respondents (20/21) “strongly agreed” or “agreed” that the system was simple and easy to use. On workload, 5/21 (24%) felt there was no significant impact to clinical workload, while the majority 16/21 (76%) felt an acceptable increase in workload. No specialist felt it increased workload significantly. All specialist survey respondents indicated eConsult should continue as a hospital service provided to the community.
Potential parent/caregiver cost-savings
The PCPs reported that eConsult averted 391 FTF visits. Estimated indirect cost savings for the patient families was approximately $135.16 CAN per visit for a total savings of $50, 895.00 based on 337 patients (54 patients outside of Champlain LHIN were excluded) (Table 3).
Discussion
This prospective cohort study details the impact of eConsult within an urban pediatric universal healthcare setting. Specifically, it demonstrated that the eConsult service significantly increased PCP access and timeliness to specialist advice for non-urgent referrals, with a high rate of satisfaction among health care providers. It deferred one-third of cases from requiring a FTF specialist visit, saving patient’s families an estimated $135 CAN per visit. System capacity for specialist visits was increased while reporting minimal associated workload burden.
Our results are comparable to the only other pediatric eConsult system, Electronic Children’s Hospital of the Pacific (ECHO-Pac), based out of the Tripler Army Medical Center in Hawaii.[18,19] Despite servicing different populations (civilian urban versus rural and military urban) we report similar high rates for surgical consultations requests and short wait times to access specialist advice. Our lower rates of eConsults per 1000 children per month, (0.17 versus 1.0) may be due to different directives provided to the users on cases and conditions eligible for eConsult services or the fact that their service was established for several years prior to their study.[16,18] Indeed, the number of pediatric eConsults were only half that observed over the same timeframe in the adult BASE eConsult service, suggesting that this service was not yet as established. In addition, we may not have accounted for the relative exclusion of enrolled community pediatricians who function as PCPs for some families and pediatric questions answered by adult-based specialists during this pilot period.
Our findings are comparable with adult studies in terms of high user satisfaction[13,22–24] with PCPs reporting improved and faster access, educational value, and avoidance of unnecessary patient travel. Compared to adult reports, we show similar rates of FTF referral avoidance, short access time to receive specialist advice[4,13] and specialist response times to answer an eConsult.[12,13,22] Our specialists’ high satisfaction mirrored the adult literature, where specialists report improved clarity of clinical questions, fewer inappropriate clinic visits, and improved efficiency by ordering more appropriate investigations making the first FTF visit more valuable.[7,22,25,26] However, some institutions find recruitment difficult due to concerns with increased workload and difficulty with technology. [7,22,25,26] While one of our specialists did cite technology as a barrier, they still felt eConsult should be an on-going service. Unique to the BASE eConsult system is the practice of providing the specialist with the written feedback from the PCP following the consultation. One specialist found this very satisfying compared to the lack of feedback from FTF consultations reported in the literature[9,27] and may explain the unanimous support for continued on-going provision of eConsult among specialists.
The eConsult team collectively answered 1064 eConsult referrals during this 2-year time period in addition to their regular clinic workload, thus, effectively increasing capacity in the system. Our finding that 12.5% of eConsults were from PCPs located in rural areas is consistent with the percentage of children living in rural areas in Ontario,[28] and may represent an important improvement in accessibility for this population. While previous studies have reported decreased hospital utilization following the implementation of electronic consultation,[29] our data did not demonstrate this in the 8 specialties for which complete pre-and post-implementation data was available. Essentially, hospital referral rates remained unchanged as indicated by the relatively flat trend line reported in S1 Fig. This may be due to the fact that the approximately 300 cases avoiding a clinic consult represented only 9% of all elective consults in the 8 specialties with complete data.
Our indirect cost-saving estimates suggest that patients and their families save approximately $135 CAN dollars and a half or full day off work or school for each avoided FTF consultation. This is a crude measurement because it does not account for eConsult-related direct costs consisting of those related to care delivery, consultation specific (e.g. added tests) and need for additional referrals.[30] To the 12.5% of eConsults from PCPs located in rural areas, eConsult may be an important health care service to reduce the time and money to support travel for FTF consultations.
We are the first to report on the use of a web-based electronic consultation portal to access multiple pediatric specialties in a mid-sized urban civilian setting within a universal healthcare access system. There are, however, several limitations to our study. First, despite being the largest reported so far in the pediatric literature our sample size is small, which may explain the lack of observed impact on resource utilization following implementation of the pediatric service. Second, this study is limited by the subjective PCP survey responses. We did not follow the patient to determine if they in fact avoided a FTF referral. A study is planned to track patients over the next 2 years using their universal health care number. Third, the impact of eConsult compared with a FTF specialist visit on costs related to resource utilization and clinical outcomes was not assessed; a cost-effectiveness analysis was beyond the scope of this study. Fourth, the high satisfaction seen in provider survey responses may be biased given that volunteer specialists likely already considered this service as useful and the community pediatricians were paid for their services. Furthermore, there was no direct assessment of patient satisfaction, which was only assessed via PCP opinion. Fifth, a true denominator of total referrals could not be calculated to put into context the impact of eConsult on referral activity. Despite these shortcomings, the short time for eConsultations (1 day) is nonetheless impressive and warrants further study.[35]
Conclusion and future initiatives
In an urban civilian setting, pediatric eConsult improves access and timeliness to specialist advice, increases capacity in the system while providing high PCP and specialist satisfaction and saving the patient’s family time and resources. CHEO-OCTC has endorsed eConsult as a continuous service to be provided to our community. Furthermore, the Ontario Ministry of Health and Long-Term Care has recently decided to expand the delivery of this eConsult service to all 14 LHINs within the Province of Ontario. Future plans include assessment of the impact on patient outcomes related to efficacy, safety, stress and anxiety reduction, and management of vulnerable and isolated populations (e.g. Nunavut) including financial implications. Finally, we are exploring the nature of the questions posed by PCPs to define topics for their continuing medical education.
Supporting information
S1 Methods. The Champlain BASE™ eConsult service (eConsult).
https://doi.org/10.1371/journal.pone.0190247.s001
(DOCX)
S2 Methods. Primary care practitioner close-out survey.
https://doi.org/10.1371/journal.pone.0190247.s002
(DOCX)
S3 Methods. CHEO-OCTC specialist satisfaction survey.
https://doi.org/10.1371/journal.pone.0190247.s003
(DOCX)
S1 Table. Examples of primary care practitioner comments associated with impact on referral, by category.
Categories are “Need for new referral”, “No benefit” and ‘Other”.
https://doi.org/10.1371/journal.pone.0190247.s004
(DOCX)
S2 Table. Examples of theme-based comments by PCPs on close-out survey.
Themes related to “Time saved”, “Money saved”, “Faster treatment” and “Reassurance”.
https://doi.org/10.1371/journal.pone.0190247.s005
(DOCX)
S1 Fig. Elective face-to-face referrals over pre-and post eConsult implementation period.
Elective face-to-face referrals for July 2013-April 2016: (Blue) Number of referrals. (Red) Trend line.
https://doi.org/10.1371/journal.pone.0190247.s006
(TIF)
References
- 1. Schoen C, Osborn R, Squires D, Doty M, Rasmussen P, Pierson R, et al. A survey of primary care doctors in ten countries shows progress in use of health information technology, less in other areas. Health Aff (Millwood) 2012;31(12):2805–16.
- 2.
Association CM. Experiences with Referral from Primary to Specialty Care. Ottawa, Ontario: Canadian Medical Association; 2012.
- 3. Wright JG, Menaker RJ, the Canadian Paediatric Surgical Wait Times Study Group. Waiting for children’s surgery in Canada: the Canadian Paediatric Surgical Wait Times project. CMAJ. 2011; 183(9): e559–64. pmid:21543299
- 4. Williams L, O'Riordan S, McGuigan C, Hutchinson M, Tubridy N. A web-based electronic neurology referral system: a solution for an overburdened healthcare system? Ir Med J. 2012;105(9):301–3. pmid:23240282
- 5. Whited JD, Warshaw EM, Edison KE, Kapur K, Thottapurathu L, Raju S, et al. Effect of store and forward teledermatology on quality of life: a randomized controlled trial. JAMA Dermatol. 2013;149(5):584–91. pmid:23426111
- 6. Scherpbier-de Haan ND, van Gelder VA, Van Weel C, Vervoort GM, Wetzels JF, de Grauw WJ. Initial implementation of a web-based consultation process for patients with chronic kidney disease. Ann Fam Med. 2013;11(2):151–6. pmid:23508602
- 7. Vimalananda VG, Gupte G, Seraj SM, Orlander J, Berlowitz D, Fincke BG, et al. Electronic consultations (e-consults) to improve access to specialty care: A systematic review and narrative synthesis. JTelemedTelecare. 2015; 21(6): 323–30.
- 8. Chen AH, Murphy EJ, Yee HF Jr. eReferral—a new model for integrated care. N Engl J Med. 2013;368(26):2450–3. pmid:23802515
- 9. Chen AH, Yee HF Jr. Improving primary care-specialty care communication: lessons from San Francisco's safety net: comment on "Referral and consultation communication between primary care and specialist physicians". Arch Intern Med. 2011;171(1):65–7. pmid:21220663
- 10. Malagrino GD, Rajeev C, Gardner M, Kahn M, Speer L, Spurrier BR, et al. A study of 6,000 electronic specialty consultations for person-centered care at The Mayo Clinic. Int J Pers Cent Med 2012;2(3):458–66.
- 11. McAdams M, Cannavo L, Orlander JD. A Medical Specialty e-Consult Program in a VA Health Care System. Fed Pract. 2014;31(5):26–31.
- 12. Lee RH, Lyles KW, Pearson M, Barnard K, Colon-Emeric C. Osteoporosis screening and treatment among veterans with recent fracture after implementation of an electronic consult service. Calcif Tissue Int. 2014;94(6):659–64. pmid:24699797
- 13. Keely E, Liddy C, Afkham A. Utilization, benefits, and impact of an e-consultation service across diverse specialties and primary care providers. Telemed JE Health. 2013;19(10):733–8.
- 14.
eConsult CB. Champlain BASE eConsult website-publications http://www.champlainbaseeconsult.com/publications. Accessed December 22, 2017.
- 15.
eConsult CB. Champlain BASE eConsult website-statistics http://www.champlainbaseeconsult.com/statistics. Accessed December 22, 2017.
- 16. Callahan CW, Malone F, Estroff D, Person DA. Effectiveness of an Internet-based store-and-forward telemedicine system for pediatric subspecialty consultation. Arch Pediatr Adolesc Med. 2005;159(4):389–93. pmid:15809396
- 17. Person DA. Pacific Island Health Care Project: early experiences with a Web-based consultation and referral network. Pac Health Dialog. 2000;7(2):29–35. pmid:11588916
- 18. Person DA. The pacific island health care project. Front Public Health. 2014;2:175. pmid:25353012
- 19. Mahnke CB, Jordan CP, Bergvall E, Person DA, Pinsker JE. The Pacific Asynchronous TeleHealth (PATH) system: review of 1,000 pediatric teleconsultations. Telemed J E Health. 2011;17(1):35–9. pmid:21214304
- 20. Johnston DL, Murto K, Kurzawa J, Liddy C, Keely E, Lai L. Use of Electronic Consultation System to Improve Access to Care in Pediatric Hematology/Oncology. J Pediatr Hematol Oncol. 2017; 39(7): e367–e369. pmid:28437292
- 21.
Government of Ontario Ministry of Finance. LHIN Population Projections 2016 to 2041. https://www.ontario.ca/data/population-projections. Accessed July 14, 2017.
- 22. Liddy C, Rowan MS, Afkham A, Maranger J, Keely E. Building access to specialist care through e-consultation. Open Med. 2013;7(1):e1–8. pmid:23687533
- 23. Palen TE, Price D, Shetterly S, Wallace KB. Comparing virtual consults to traditional consults using an electronic health record: an observational case-control study. BMC Med Inform Decis Mak. 2012;12:65. pmid:22769592
- 24. Jaatinen PT, Aarnio P, Remes J, Hannukainen J, Koymari-Seilonen T. Teleconsultation as a replacement for referral to an outpatient clinic. J Telemed Telecare. 2002;8(2):102–6. pmid:11972945
- 25. Kim-Hwang JE, Chen AH, Bell DS, Guzman D, Yee HF Jr., Kushel MB. Evaluating electronic referrals for specialty care at a public hospital. J Gen Intern Med. 2010;25(10):1123–8. pmid:20512531
- 26. Angstman KB, Adamson SC, Furst JW, Houston MS, Rohrer JE. Provider satisfaction with virtual specialist consultations in a family medicine department. Health Care Manag (Frederick). 2009;28(1):14–8.
- 27. Chaudhry R SB, Wood D, LaRusso NF. Physician perspectives on electronic consultations for specialty care delivery for patients: implications for person-centered medicine. Int J Pers Cent Med. 2012;2(3):453–7.
- 28.
Statistics Canada. National Household Survey. 2013. http://www23.statcan.gc.ca/imdb/p2SV.pl?Function=getSurvey&SDDS=5178. Accessed July 14, 2017.
- 29. Keely E, Drosinis P, Afkham A, Liddy C. Perspectives of Champlain BASE Specialist Physicians: Their Motivation, Experiences and Recommendations for Providing eConsultations to Primary Care Providers. Stud Health Technol Inform. 2015;209:38–45. pmid:25980703
- 30. Liddy C, Deri Armstrong C, Drosinis P, Mito-Yobo F, Afkham A, Keely E. What are the Costs of Improving Access to Specialists through eConsultation? The Champlain BASE Experience. Stud Health Technol Inform. 2015;209:67–74. pmid:25980707
- 31.
Government of Canada. Earnings, average hourly for hourly paid employees, by province and territory. 2016 http://open.canada.ca/data/en/dataset/7459609a-4bbd-48fe-8a87-7caaa47b2c62. Accessed July 14, 2017.
- 32.
Ontario MOHLTC. Northern Health Programs. Communities by Rurality Index for Ontario (ROI) Score. http://www.health.gov.on.ca/en/pro/programs/northernhealth/rio_score.aspx. Accessed January 9, 2017.
- 33.
Canada Revenue Agency. Automobile Allowance Rates for 2016 and 2017. 2017 http://www.cra-arc.gc.ca/tx/bsnss/tpcs/pyrll/bnfts/tmbl/llwnc/rts-eng.html. Accessed January 9, 2017.
- 34.
Ontario Medical Association. RIO postal code look-up.https://application.oma.org/PublicApp/nlp/NLPWF003.aspx]. Accessed January 9, 2017.
- 35. Liddy C, Maranger J, Afkham A, Keely E. Ten steps to establishing an e-consultation service to improve access to specialist care. Telemed J E Health. 2013;19(12):982–90. pmid:24073898