Review

Exploring Adult Patients’ Perceptions and Experiences of Telemedicine Consultations in Primary Care: A Qualitative Systematic Review


Jack Allen1


doi: http://dx.doi.org/10.5195/ijms.2022.1363

Volume 10, Number 3: 288-315
Received 19 01 2022; Rev-request 05 03 2022; Rev-request 16 05 2022; Rev-recd 20 04 2022; Rev-recd 30 05 2022; Accepted 21 06 2022

ABSTRACT

The COVID-19 pandemic transformed a gradual uptake of telemedicine into a sudden worldwide implementation of telemedicine consultations. Primary care is a particular area affected and one where telemedicine consultations are expected to be the future. However, for effective long-term implementation, it is vital that patient perceptions and experiences are understood. The aim of this qualitative systematic review was to explore the perceptions and experiences of adults who have used telemedicine consultations in primary care. Studies were identified through a search of four electronic databases (MEDLINE, EMBASE, CINAHL, and CENTRAL) alongside reference list and citation searches. Quality assessment was conducted using the CASP checklist and data was synthesized using a simplified approach to thematic analysis. From 2492 identified records, ten studies met the eligibility criteria- all of which were judged as either good or moderate quality. Three themes were identified, which were potential benefits, potential barriers, and beneficial prerequisites for telemedicine consultations in primary care. Within these themes, sixteen sub-themes were identified with examples including accessibility and convenience for potential benefits, lack of face-to-face interaction and impersonal consultations for potential barriers, and continuity of care for beneficial prerequisites. Analyzing these sub-themes, four main recommendations for practice can be made that are: to utilize continuity of care, offer both video and telephone consultations, provide adequate support, and that healthcare professionals should demonstrate an explicit understanding of the patient's health issues. Further research is needed to explore and expand on this topic area and future research should be viewed as a continuous process.

Keywords: Telemedicine; Primary Health Care; General Practice; Qualitative Research (Source: MeSH-NLM).

Introduction

Telemedicine is a general term covering various forms of healthcare that are delivered remotely via telecommunication.1,2 Since the term originated, various other terms such as telehealth, eHealth, and telecare have been used interchangeably within the literature.14

The potential advantages of telemedicine for both patients and healthcare systems are vast and are well discussed throughout the literature.5 These potential advantages include increased access and reach of healthcare, convenience, and reduced costs.6,7 Telemedicine does still have disadvantages such as difficulties developing a patient-physician relationship, technological obstacles, and inconsistencies with implementation.8,9 Nevertheless, as these disadvantages are being addressed with various methods whilst advantages become more established, questions are moving beyond clinical and cost effectiveness of telemedicine into other areas such as patient perceptions.10

Over recent years, telemedicine use has been gradually increasing with benefits shown in a vast range of areas such as surgery, diabetes, and geriatrics.3,7,11,12 Despite this, overall uptake has remained low.13 However, during the COVID-19 outbreak, face-to-face interaction had to be minimized, hence transforming this gradual uptake into sudden worldwide implementation of telemedicine.14,15 Although this abrupt implementation affected all forms of telemedicine, some of the biggest changes to day-to-day practice were seen in telemedicine consultations, with these changes comprising of significant uptake rates, additional funding, and telemedicine becoming a fundamental component of healthcare rather than just an adjuvant.1619 Inadvertently, this unexpected mass implementation showcased the advantages of embedding telemedicine into healthcare on a large scale, particularly telemedicine consultations.15,20

Primary care (PC) encompasses services which provide the first point of contact in a healthcare system, and it is a particular area in which telemedicine consultations are expected to be widely utilized in the future, with them anticipated to represent one of the biggest changes to working practices.16,21 Telemedicine consultations in PC became standard practice during the pandemic. This is shown by the appointments which were face-to-face or via telemedicine consultations in General Practice in England changing from 79.6% and 14.46% respectively in December 2019, to 46.79% and 48.14% in April 2020, to 54.77% and 41.04% in April 2021.22 This trend of an abrupt increase followed by a slightly lower but sustained increase in telemedicine consultations in primary care was also seen in many countries such as the US, Australia, and Canada.21,23,24 The acute increase in telemedicine is further demonstrated by telemedicine consultations in the US increasing from 1.1% in 2018-2019 to 35.3% in the second calendar quarter of 2020.25 The view that telemedicine consultations are the future of PC was fairly well established before the pandemic, but it was greatly enhanced by the substantial benefits shown during the COVID-19 outbreak.26,27 However, to effectively implement telemedicine into PC in the long term, certain areas such as patient perceptions need to be explored further.6

Patient satisfaction is a vital indicator of how healthcare is meeting patient expectations, acting as both an influential motivator and stressor to the development and improvement of healthcare services.28,29 Additionally, continuous active involvement and engagement of patients in healthcare has been associated with improved outcomes and patient experiences, with patient participation in decision-making becoming a political necessity.28,30,31 The importance of patient perceptions is further demonstrated by the key healthcare principle of person-centered care as to deliver person-centered care the patient perspective must be explored.31

Patient perceptions of telemedicine are typically assessed as patient satisfaction in the literature, which usually relates to quantitative assessment measures. However, patient perceptions and experiences are complex and are beyond any survey or predefined criteria.32 Additionally, many studies only assess patient perceptions as a secondary consideration. These factors often combine to result in superficial findings that only discuss the well-documented benefits rather than interviewing patients in-depth. Another concern is primary research often assesses clinician and patient perceptions together, resulting in some studies prioritizing the clinician's perceptions and neglecting detailed analysis of patient perceptions.33

To assess current literature and the feasibility of a review, an initial scoping search was conducted. Common well-discussed aspects of telemedicine mentioned in studies were convenience, saving time, and a preference for face-to-face consultation.3441 Other important themes which are not as well acknowledged also arose, such as patient perceptions of the patient-physician relationship in telemedicine.35,36,39 Although no comprehensive analysis was performed, the scoping search showed the literature was available to generate and explore themes to help better understand the patient perspective, which can then lead to recommendations for improving practice.

Several reviews have studied patient perceptions and experiences of telemedicine, and the consensus is: patient satisfaction is high for telemedicine, however, the number of reviews studying patient perceptions and experiences of telemedicine in PC is significantly less.28,42,43 Reviews that relate to this topic area were assessed and multiple issues were identified. In several of these reviews, patient perceptions were not the main focus, with perceptions only being assessed quantitatively.44,45 Thus, findings were minimal with analysis being superficial, consisting mostly of naming factors without thematic exploration. Further issues included reviews with narrow scopes meaning evidence was limited, therefore, narrative analysis of patient perceptions was also limited.46 These issues highlighted a gap in the literature for a review which assess exclusively patient perceptions and experiences of telemedicine consultations in PC, utilizing qualitative research to explore perceptions in a greater depth.

This systematic review aims to explore the perceptions and experiences of adults who have used telemedicine consultations in a PC setting. To achieve this, key aspects that relate to the perceptions and experiences of adults who have used telemedicine consultations in a PC setting will be identified. Common themes for these perceptions and experiences will be generated using these key aspects, and finally the review will explore how the identification of these themes can be used to benefit future practice.

Methods

A comprehensive approach to searching was taken for this review with both the PRISMA and ENTREQ checklists being used throughout to improve reporting.47,48 The review protocol and the checklists can be found in Appendices 13.

Eligibility Criteria

The SPIDER tool was utilized to develop the review question, eligibility criteria, and search strategy.49

Sample: Studies were included if they assessed adults (18 years and older) in PC, whilst studies only assessing or focusing on children would be excluded.

Phenomenon of Interest: The phenomenon of interest was adjusted from any form of telemedicine in PC, to telemedicine consultations in PC in order to increase the review's feasibility whilst lowering the heterogeneity of included studies to facilitate thematic analysis. Studies were thus included if they were assessing telemedicine consultations in PC. The exclusion criteria included studies not based in PC, not primarily focused on telemedicine, and studies focused on telemedicine for a specific medical condition or for monitoring.

Design: Non-interventional qualitative or mixed-method studies of any theoretical framework were included.

Evaluation: Studies assessing patient perceptions and experiences of telemedicine consultations in a PC setting were included. If a study did not focus on patient perceptions or only focused on clinician's perspective, it was excluded. When both patient and physicians’ perceptions were assessed, results had to be clearly reported separately for inclusion.

Research type: Qualitative and mixed-method studies were included whilst purely quantitative studies were excluded. Mixed-method studies were however excluded if the qualitative aspect was minimal or there was a clear and significant imbalance in the weighting of the quantitative and qualitative aspects.

Information Sources

Four electronic databases were searched, which were MEDLINE via OvidSP (1946 to June 25, 2021), EMBASE via OvidSP (1974 to 2021 June 25), CINAHL via EBSCO (1981 to 2021), and CENTRAL (Issue 6 of 12, June 2021). Databases were last consulted on June 28, 2021. Reference list and citation searching (using Google scholar) was also conducted for all included studies. This consisted of all references and citations for each included study being screened against the eligibility criteria. All results from both searches were directly exported to the reference management software EndNote.50

Search Strategy

The review question was preliminarily divided into the following concepts: telemedicine, PC, and perceptions/experiences. Scoping searches resulted in significant numbers of irrelevant results, so the concept of ‘perceptions/experiences’ was refined to ‘patient perceptions/experiences’ and the additional concept of qualitative research was added. After further scoping searches, free-text terms and relevant index terms/subject headings for each database were used alongside proximity searches to improve strategy effectiveness. The search strategy was trialed on each database and adjusted accordingly. The same search strategy was used for each database, and these can be found in Appendices 47.

Selection Process

Titles and abstracts were initially screened against the eligibility criteria, followed by full text screening.51,52 Deduplication was done using the duplicate identification tool in EndNote then manually checked. If during this stage information was missing, the study authors would have been contacted and where there was no response, the studies would have been excluded and labelled as ‘potentially relevant’.51 As this review was conducted for a master's dissertation, study selection along with all other stages were conducted by a single reviewer, and this is a recognized limitation of the review.

Data Collection

Data was extracted from all study sections using a standardized data extraction form, developed by adapting a pre-existing form whilst using the Centre for Reviews and Dissemination guidelines.51,53 The extraction form was then piloted and refined accordingly. Data extraction fields consisted of study details and context, participants, intervention, design/methods, findings, and other information. A complete list of the data items extracted can be found in Appendix 8. As with the other steps of this review, data extraction was conducted by a single reviewer and if data was missing the study authors would be contacted but as no missing data or inconsistencies were experienced, no authors were contacted.

Quality Assessment

To critically appraise the included studies, the CASP checklist for qualitative research was used.54,55 The CASP checklist consists of ten major items which assess the studies according to the validity of results, what are the results, and how will the results help locally.55 Studies were assessed against the sub-elements and then, these decisions were used to make a judgement of either ‘Yes’, ‘No’, or ‘Cannot tell’ for each major item.55 Six major items from the CASP checklist (statement of aims, recruitment strategy, data collection, data analysis, statement of findings, and value of the research) were used to determine the overall quality assessment as outlined by Salmon56.55 This combined approach was taken as it produces a more simplified assessment whilst ensuring that the most important aspects for determining study quality are considered. The overall quality was determined as ‘good quality’ if all items were judged to be ‘Yes’, ‘moderate quality’ if one to two items were judged to be ‘No’ or ‘Cannot tell’, and ‘poor quality’ if three or more items were judged to be ‘No’ or ‘Cannot tell’. The quality assessment stage was conducted by a single reviewer due to the reason previously mentioned.

Data Synthesis

Data was synthesized using a simplified approach to thematic analysis as described by Aveyard,54. Thematic analysis was chosen as it is a highly flexible approach, whilst being well suited to exploring the perspectives and developing new insights.57 Aveyard's,54 specific approach was used as it was developed considering aspects relevant to the review such as, limited resources, being conducted by a single reviewer, and not requiring expertise beyond a postgraduate level. The simplified thematic analysis consisted of summarizing article content with the use of tables, identifying themes, and then developing, naming, comparing, and scrutinizing these themes.54 Data was coded line-by-line using an inductive approach with studies coded into pre-existing concepts and new concepts developed when required. Since data synthesis was conducted by a single reviewer, all steps were performed at least twice with frequent review to reduce this limitation. Due to limited resources, software programs were not used, but it was unlikely that this impacted the process. Subgroup and sensitivity analyses were not performed.

Ethics

As this is a systematic review, a student declaration alongside a risk assessment form signed by the reviewer and dissertation supervisor constitutes ethical approval as outlined by the University of Sheffield guidelines.

Results

Study Selection

The search strategy produced 1833 unique records which after initial screening of titles and abstracts left 23 records. Full-text screening of these records led to the identification of ten records for inclusion in this review. The breakdown of the study selection process can be seen in Figure 1 and the reasons for exclusion for the thirteen studies that reached full text screening can be found in Appendix 9.



Figure 1.

PRISMA Flowchart.


Study Characteristics

The main characteristics for included studies are presented in Table 1 and Table 2. As previously discussed, for the studies that were mixed-method studies, only the qualitative aspects of the study have been considered in this review.

Table 1.

Characteristics of Participants for Included Studies.

Study Sample size Description of participants Age Gender (% female)
Ball et al., 201858 43 Patients who had been using the ‘telephone-first’ approach for between 18 months and five years Range: 28–86
Mean: Not calculable
69.8%
Bleyel et al., 202034 13 Patients from primary care practices and a tertiary care hospital Range: 21–77
Mean: 48.7
62%
Eccles et al., 201963 569* Patients who were users of an online triage platform Range: 0–91*
Mean: 44.2*
62%*
Gabrielsson-Järhult et al., 202159 26* Users of telemedicine consultations from a national sample Range: 18–73*
Mean: 43*
62%*
Holmström et al., 201660 10 Older persons in Sweden Range: 68–95
Mean: 79
60%
Imlach et al., 202035 38* Adults (> 18 years) who had contact with practices during lockdown Range and mean not reported 63%*
Javanparast et al., 202164 30 Patients from nine general practices in metropolitan Adelaide Range: 54–88
Mean: Not calculable
57%
Lindberg et al., 202151 19 Older persons living in the sparsely populated northern interior of Sweden who were using digital services at two primary health care centres Range: 61–85
Mean: Not calculable
63%
Nymberg et al., 201962 15 Elderly patients from three primary health care centres in Southern Sweden Range: 65–80
Mean: 73
53%
Powell et al., 201736 19 Patients who are 18 years old or older who had a video visit with their established primary care clinicians Range: 23–94
Mean: 43
47%

Legend:

*These values are only for the qualitative aspect of a mixed-method study. Table 2.

Characteristics of Included Studies.

Study Year Country Form of Telemedicine Assessed Study design Data Collection Methods Data Analysis Methods
Ball et al., 201858 2018 England ‘Telephone-first‘ approach Qualitative Semi-structured interviews Thematic analysis
Bleyel et al., 202034 2020 Germany Mental health video consultations Qualitative Semi-structured interviews Thematic analysis
Eccles et al., 201963 2019 UK Online triage Mixed-method Online survey* Thematic analysis*
Gabrielsson-Järhult et al., 202159 2021 Sweden Consultations via video or chat in a digital platform Mixed-method Semi-structured interviews (telephone)* Thematic analysis*
Holmström et al., 201660 2016 Sweden Telephone advice nursing service Qualitative Semi-structured interviews Qualitative content analysis
Imlach et al., 202035 2020 New Zealand Telephone and video consultations Mixed-method Semi-structured interviews* Thematic analysis*
Javanparast et al., 202164 2021 Australia Telemedicine consultations (telephone or video) and self-monitoring Qualitative Semi-structured interviews (telephone) Thematic analysis
Lindberg et al., 202161 2021 Sweden Virtual Health Room, remote patient monitoring, and Virtual Acute Cart Qualitative Semi-structured interviews Qualitative content analysis
Nymberg et al., 201962 2019 Sweden No specific type was assessed (e-health generally) Qualitative Semi-structured focus group interviews Thematic content analysis
Powell et al., 201736 2017 United States Video consultations Qualitative Semi-structured interviews Qualitative content analysis

Legend:

*This is only the qualitative data collection and analysis methods for the mixed-method studies.

Quality Assessment

Of the ten included studies, eight studies,3436,5862 were considered ‘good quality’ whilst the two remaining studies,63,64 were considered ‘moderate quality’. One of the ‘moderate quality’ studies,63 was judged to be of the lowest quality due to inadequate recruitment and data collection as it used retrospective data that was not collected for research purposes. The other ‘moderate quality’ study,64 was judged as ‘unclear’ for data analysis as not enough information was provided. The results for all CASP checklist major items for each study are presented in Table 3. whilst a more detailed table which includes sub-elements is outlined in Appendix 10.

Table 3.

CASP Checklist Quality Assessment Results.

CASP Questions Ball et al., 201858 Bleyel et al., 202034 Eccles et al., 201963 Gabrielsson-Järhult et al., 202159 Holmström et al., 201660 Imlach et al., 202035 Javanparast et al., 202164 Lindberg et al., 202161 Nymberg et al., 201962 Powell et al., 201736
Was there a clear statement of the aims of the research? Y Y Y Y Y Y Y Y Y Y
Was the recruitment strategy appropriate to the aims of the research? Y Y N Y Y Y Y Y Y Y
Was the data collected in a way that addressed the research issue? Y Y N Y Y Y Y Y Y Y
Y Was the data analysis sufficiently rigorous? Y Y Y Y Y Y ? Y Y Y
Is there a clear statement of findings? Y Y Y Y Y Y Y Y Y Y
Is the research valuable? Y Y Y Y Y Y Y Y Y Y
Overall Quality Good Good Moderate Good Good Good Moderate Good Good Good
Additional Assessment
Questions included in CASP but are not part of the quality assessment criteria used in this review
Is a qualitative methodology appropriate? Y Y Y Y Y Y Y Y Y Y
Was the research design appropriate to address the aims of the research? Y Y Y Y Y Y Y Y Y Y
Has the relationship between researcher and participants been adequately considered? ? Y ? ? ? ? ? ? Y Y
Have ethical issues been taken into consideration? Y Y Y Y Y Y Y Y Y Y

Legend: Yes = Y, No = N, Cannot tell = ?

Findings

Three overall themes were identified and developed which are potential benefits, potential barriers, and beneficial prerequisites for telemedicine consultations. Within these three themes, sixteen sub-themes were also identified. The results from individual studies can be found in Appendix 11 which is a table listing the existing themes from included studies. A table listing all the studies that contributed to each theme is outlined in Appendix 12.

Theme 1: Potential Benefits of Telemedicine Consultations Accessibility

Improved accessibility was a very common sub-theme that was identified in nine studies,3436,5862,64 with it being viewed as both an influencing and motivating factor for implementation of telemedicine consultations in PC. Another perception was that there was increased appointment availability which enabled a more prompt response whilst giving healthcare professionals (HCPs) more time to spend with patients. However, in one study,62 patients raised concerns about telemedicine consultations reducing accessibility for the elderly, especially if the system is not suitable for this demographic and becomes overused by younger patients. This is an important note for practice that if telemedicine consultations are ineffectively implemented, the potential benefit of improving access might not only be lost but result in reduced accessibility.

Equitable/Fair access

Moving beyond just improving accessibility, patients in three studies,36,58,63 expressed views of telemedicine consultations creating more equitable access to PC. This was achieved by telemedicine consultations resulting in a fairer ability to access care for those finding face-to-face consultations difficult and at the same time, enabling clinicians to judge which patients require face-to-face consultations.

Convenience

Greater convenience was identified as a potential benefit in seven studies3436,58,59,63,64. Common aspects that improved convenience were: reduced travelling, saving time, and not missing work, with the latter even being described as potentially improving access for individuals with previously low engagement with healthcare.

Improved efficiency

The sub-theme of improved efficiency arose in five studies,35,36,58,59,63 with patients describing various ways they believed telemedicine consultations would make PC more efficient. Generally, all these points correlated to patients viewing telemedicine consultations as better use of resources and a way of preventing ineffective use such as removing unnecessary in-person appointments. The reason for removing unnecessary appointments links directly to the sub-theme of equitable access, as removing ‘timewasters’ was one of the ways patients perceived telemedicine consultations creating more equitable access. This helps to demonstrate how many of the identified sub-themes in this review are interlinked. Furthermore, improved efficiency due to telemedicine consultations has significant relevance to practice as it is a potential solution to the excessive demands on primary care which are thought to be negatively affecting the quality of care.65,66

Lower threshold for seeking care

Telemedicine consultations lowering the threshold for seeking care was a sub-theme identified in four studies34,59,63,64. Although this can be viewed as beneficial for patients, if the threshold becomes too low it could cause excess demand, negating the potential benefits. Thus, clear guidance should be available for its appropriate use.

Improved care for minor conditions or adjuvant to care

In four studies,35,59,62,64 several points were made by patients about how rather than implementing telemedicine consultations for all consultations, a particular focus should be on minor conditions. Furthermore, patients from two studies,36,61 described how telemedicine consultations should be an adjuvant to in-person care as the true benefits were as a supplement to face-to-face consultations and not as a replacement.

As with several of the other potential benefits, this sub-theme does not lead to a definitive recommendation for practice. However, the value of identifying the potential benefits is by recognizing, promoting and protecting them when developing telemedicine consultations for long-term implementation in PC.

Theme 2: Potential Barriers to Telemedicine Consultations Lack of face-to-face and physical interaction

A lack of face-to-face and physical interaction was one of the most common barriers with the sub-theme arising in nine studies3436,5861,63,64. Concerns around not being seen in person or adequately examined were prevalent, with these in-person consultation aspects often giving patients reassurance that HCPs had conducted an effective assessment of health. Thus, these concerns represented a majority of the patients’ feelings with regards to the lack of face-to-face and physical interaction, and fearing that it would negatively affect care. Further worries included a loss of nonverbal communication and some patients describing difficulties discussing mental health issues without face-to-face interaction.58 However, the effects of a lack of face-to-face interaction could be lowered by using video consultations rather than PC practices solely relying on telephone consultations as their only form of telemedicine.59

Impersonal consultations

Heavily interlinked to the previous sub-theme, the potential barrier of impersonal consultations arose in seven studies,3436,5860,64 with patients describing telemedicine consultations as a less personal approach and a few reported feeling uncomfortable. Not all patients had this view- some patients found that telemedicine consultations were more focused and personal, although this was only reported by a minority of patients.35 A further point for this sub-theme was several patients related impersonal consultations to not having an existing relationship with the HCP. Therefore, this barrier could be addressed by utilizing pre-existing relationships with continuity of care.

Difficulties with communication

Feelings of being unable to effectively communicate health issues when using telemedicine consultations were expressed by patients in five studies,35,5860,63. Certain patient groups were found to be particularly affected including the elderly, those with mental health issues, and patients with hearing impairments. In contrast, a few patients felt more comfortable communicating in telemedicine consultations as they felt more relaxed.58,63

Technological concerns

Certain forms of telemedicine consultations, such as video consultations, may require a more advanced level of technological experience. Concern about this aspect was identified in six studies3436,60,62,63, which was mostly surrounding technological challenges the elderly may face when using telemedicine consultations that have a high demand on potential users. Further sub-theme development highlighted various ways to address this concern including providing a telephone consultation alternative to those with lower digital literacy and ensuring adequate support is available.64

Confidentiality/Privacy concerns

Several patients across three studies,35,36,58 expressed feelings of confidentiality being partly compromised when using telemedicine consultations. Most patients related this concern to not being able to achieve privacy at work, which meant they were reluctant to properly discuss their health issues, thereby making consultations ineffective.35,36,59 A potential solution to this, and one suggested by patients during interviews, is for workplaces to have multifunctional private rooms in which telemedicine consultations could be conducted.

Concern of being overlooked

Patients in four studies,5860,63 described various concerns about being overlooked during telemedicine consultations as they felt the approach was intended to prevent patients from having face-to-face consultations. Therefore, to avoid patients feeling dismissed, HCPs need to demonstrate an understanding of the patients’ health issues and clearly explain why a face-to-face consultation is not required.

Difficulties with the uncertainty of consultation timings

Difficulty with the uncertainty of consultation timings, particularly considering work, was a small sub-theme only being identified in two studies,58,63. However, this barrier can be overcome by methods such as more precise consultation timing periods.

Theme 3: Beneficial Prerequisites for Telemedicine Consultations Continuity of care

Telemedicine consultations being conducted by HCPs who have an existing relationship with the patient was described as a beneficial prerequisite in six studies,3436,58,61,64. Many patients believed having familiar HCPs was vital for communication during telemedicine consultations. This continuity of care as a prerequisite for telemedicine consultations can further be used to overcome several of the previously identified barriers, including the lack of face-to-face interaction, impersonal consultations, and communication difficulties. Two more relevant points which emerged for this sub-theme were the value of the importance of continuity of care to patients could vary depending on the medical complexity, and rapport could still be built if there was no previous relationship, but it was more difficult.35,59

Provide support

The beneficial prerequisite of providing support was discussed by patients in three studies35,61,62. Patients expressed worries about being excluded from PC services if adequate support is not provided. Additionally, this prerequisite can directly address technological concerns as a barrier to telemedicine consultations.

Clear process

Although only identified in two studies,58,62 a prerequisite of having a clear process for telemedicine consultations was described as a critical aspect for successful implementation. A clear process involved having adequate and tailored information available to patients about how telemedicine consultations would function.

Discussion

Summary of Key findings

Six potential benefits of telemedicine consultations in PC were identified with many being interlinked. The two most prevalent benefits were improved accessibility and convenience, with the others being improved care for minor conditions, improved efficiency, a lower threshold for care, and a more equitable access. Additionally, an important finding was the concern that many of these potential benefits would be lost if the time is not taken to implement telemedicine consultations effectively.

A lack of face-to-face and physical interaction was the most prevalent barrier to telemedicine consultations in PC. Another important barrier was the impersonality of telemedicine consultations and was greatly linked to the previous barrier. Other barriers identified were difficulties with communication, technological concerns, confidentiality concerns, concerns of being overlooked, and uncertainty of consultation timings. Further development of each sub-theme led to potential ways to address each barrier.

The main beneficial prerequisite identified was having continuity of care for telemedicine consultations. This relates to patients having a pre-existing relationship with the HCP and can be used to overcome several of the previously identified barriers. The two other beneficial prerequisites were providing support and having a clear process.

Although it was thought that the COVID-19 pandemic may have lessened the severity of patient concerns of telemedicine, there was no observed difference in the pattern of how the two studies,35,64 conducted around the COVID-19 pandemic contributed to benefits versus barrier compared to the other studies.59

Comparisons with Previous Literature

No previous reviews have been conducted on patient perceptions and experiences of telemedicine consultations in PC using qualitative research. Despite this, some comparisons can be made between this review's findings and previous literature. Several sub-themes such as improved access, convenience, and patient concerns about a lack of face-to-face interaction, are also very prevalent in previous literature.10,28,3742,46 However, these sub-themes are only mentioned rather than explored, an example of this is how one study reported only factor frequency, presenting findings such as 9% of articles stated ease of use as a benefit, without any further analysis.10,28,42,46 Therefore, it is difficult to make any detailed comparisons. On the other hand, some sub-themes identified that are not as well acknowledged in previous literature were continuity of care, improved care for minor conditions, and patient concerns of being overlooked. Although not as well acknowledged, these factors were identified as very important aspects such as continuity of care being found to address many of the barriers identified.35,36,67

Implications for Practice

Considering sub-themes alongside their prevalence in included studies and the strength of evidence, four main recommendations for practice can be made:

Implications for Future Research

Although the review does not provide a comprehensive report of patients’ perceptions and experiences of telemedicine care in PC, it demonstrates important findings that are relevant to practice can be generated by studying this topic. Therefore, further research into patient perceptions and experience of telemedicine care in PC using qualitative research is not only required but should be seen as a continuous process.28,29 The specific areas of focus for future research should include the benefits of telemedicine consultations that need to be protected, barriers that need to be addressed, and continuously evolving patient perceptions.

Limitations of the Review

A major limitation of this review was it being conducted by a single reviewer which affects all stages of the review, reducing the reliability whilst potentially introducing bias.51,68 Limited resources, due to this review being for a postgraduate master's dissertation, contributed to further limitations. One of these limitations was that potential improvements to the search strategy that were identified such as grey literature searching, hand-searching, and contacting experts were not conducted.51,69,70 Another limitation caused by the limited resources was the exclusion of non-English studies. In addition, not every sub-theme that was preliminarily identified in the initial stages of coding could be developed and explored, meaning that a few minor sub-themes are not included in this review.

Conclusion

The review explored patient perceptions and experiences of telemedicine consultations in PC using qualitative research. Three themes were identified: potential benefits, potential barriers, and beneficial prerequisites for telemedicine consultations in primary care. Within these themes, sixteen sub-themes were, identified with examples including accessibility and convenience for potential benefits, lack of face-to-face interaction and impersonal consultations for potential barriers, and continuity of care for beneficial prerequisites. Analyzing these subthemes, four main recommendations for practice can be made: to utilize continuity of care, offer both video and telephone consultations, provide adequate support, and that HCPs should demonstrate an explicit understanding of the patient's health issues.

Summary – Accelerating Translation

Title: Exploring Adults Patients’ Perceptions and Experiences of Telemedicine Consultations in Primary Care: A Qualitative Systematic Review Telemedicine is a general term covering various forms of healthcare that are delivered remotely via telecommunication. Despite the use of telemedicine gradually increasing over recent years with benefits shown in a vast range of areas, overall uptake remained low. However, during the COVID-19 outbreak, face-to-face interaction had to be minimized, thereby transforming this gradual uptake into sudden worldwide implementation of telemedicine consultations. Primary care is a particular area affected and one where telemedicine consultations are expected to be the future. Nonetheless, to effectively implement telemedicine into primary care in the long term, it is vital that patient perceptions and experiences are understood and explored.

Patient perceptions of telemedicine are typically assessed using quantitative measures even though patient perceptions and experiences are complex and beyond any survey or predefined criteria. Furthermore, they are often only assessed as a secondary consideration resulting in findings which are superficial. These issues highlighted a gap in the literature for a review, which assess exclusively patient perceptions and experiences of telemedicine consultations in primary care whilst using qualitative research to explore perceptions in a greater depth.

The aim of this systematic review is to explore the perceptions and experiences of adults who have used telemedicine consultations in a primary care setting using qualitative research.

Studies were identified through a search of four electronic databases (MEDLINE, EMBASE, CINAHL, and CENTRAL) alongside reference list and citation searches. Quality assessment for included studies was conducted using the CASP checklist which assess the studies according to the validity of results, what are the results, and how will the results help locally. Data was synthesized using a simplified approach to thematic analysis which consisted of summarizing article content with the use of tables, identifying themes, then developing, naming, comparing, and scrutinizing these themes.

From 2492 identified records, ten studies met the eligibility criteria all of which were judged as either good or moderate quality. Three themes were identified: potential benefits, potential barriers, and beneficial prerequisites for telemedicine consultations in primary care. Within these themes sixteen sub-themes were identified, with many interlinked. Six potential benefits of telemedicine were explored with the two most prevalent benefits being improved accessibility and convenience. Other potential benefits included improved care for minor conditions, improved efficiency, a lower threshold for care, and more equitable access. A lack of face-to-face and physical interaction was the most prevalent barrier to telemedicine consultations in primary care with the other potential barriers being impersonality of telemedicine consultations, difficulties with communication, technological concerns, confidentiality concerns, concerns of being overlooked, and uncertainty of consultation timings. The main beneficial prerequisite identified was having continuity of care for telemedicine consultations. This relates to patients having a pre-existing relationship with the healthcare professional, and can be used to overcome several of the previously identified barriers. The two other beneficial prerequisites were providing support and having a clear process.

Analyzing these subthemes, four main recommendations for practice can be made- to utilize continuity of care, offer both video and telephone consultations, provide adequate support, and that healthcare professionals should demonstrate an explicit understanding of the patient's health issues.

In conclusion, exploring patient perceptions and experiences of telemedicine consultations in primary care led to the identification of key benefits of telemedicine consultations that need to be promoted and protected, barriers that should be addressed for successful long-term implementation, and beneficial prerequisites for a better patient experience. All these aspects combine to produce valuable recommendations for practice with further research needed to explore and expand on this topic to ensure continuous improvement.

Acknowledgments

I would like to thank my supervisor Claire Beecroft for her continuous support and guidance throughout my dissertation and assistance in adapting it for publication.

Conflict of Interest Statement & Funding

The Authors have no funding, financial relationships or conflicts of interest to disclose.

Author Contributions

Conceptualization, Data Curation, Formal Analysis, Investigation, Methodology, Project Administration, Resources, Software, Validation, Visualization, Writing – Original Draft Preparation, and Writing – Review & Editing: JA.

References

1. World Health Organization, editor. Telemedicine: opportunities and developments in member states: report on the second Global survey on eHealth. Geneva, Switzerland: World Health Organization; 2010. 93 p. (Global observatory for eHealth series).

2. Wootton R. Recent advances: Telemedicine. BMJ. 2001;323(7312):557–60.

3. Asiri A, AlBishi S, AlMadani W, ElMetwally A, Househ M. The Use of Telemedicine in Surgical Care: a Systematic Review. Acta Inform Medica. 2018;26(2):201.

4. Wade VA, Karnon J, Elshaug AG, Hiller JE. A systematic review of economic analyses of telehealth services using real time video communication. BMC Health Serv Res. 2010;10(1):233.

5. Greenhalgh T, Vijayaraghavan S, Wherton J, Shaw S, Byrne E, Campbell-Richards D, et al. Virtual online consultations: advantages and limitations (VOCAL) study. BMJ Open. 2016;6(1):e009388.

6. Atmojo JT, Sudaryanto WT, Widiyanto A, Ernawati E, Arradini D. Telemedicine, Cost Effectiveness, and Patients Satisfaction: A Systematic Review. J Health Policy Manag. 2020;5(2):103–7.

7. Dorsey ER, Topol EJ. State of Telehealth. Campion EW, editor. N Engl J Med. 2016;375(2):154–61.

8. Mills EC, Savage E, Lieder J, Chiu ES. Telemedicine and the COVID-19 Pandemic: Are We Ready to Go Live? Adv Skin Wound Care. 2020;33(8):410–7.

9. Hjelm NM. Benefits and drawbacks of telemedicine. J Telemed Telecare. 2005;11(2):60–70.

10. Ekeland AG, Bowes A, Flottorp S. Effectiveness of telemedicine: A systematic review of reviews. Int J Med Inf. 2010;79(11):736–71.

11. Batsis JA, DiMilia PR, Seo LM, Fortuna KL, Kennedy MA, Blunt HB, et al. Effectiveness of Ambulatory Telemedicine Care in Older Adults: A Systematic Review. J Am Geriatr Soc. 2019;67(8):1737–49.

12. Lee JY, Lee SWH. Telemedicine Cost–Effectiveness for Diabetes Management: A Systematic Review. Diabetes Technol Ther. 2018;20(7):492–500.

13. Holtz BE. Patients Perceptions of Telemedicine Visits Before and After the Coronavirus Disease 2019 Pandemic. Telemed E-Health. 2021;27(1):107–12.

14. Kannampallil T, Ma J. Digital Translucence: Adapting Telemedicine Delivery Post-COVID-19. Telemed E-Health. 2020;26(9):1120–2.

15. Leite H, Hodgkinson IR, Gruber T. New development: ‘Healing at a distance’—telemedicine and COVID-19. Public Money Manag. 2020;40(6):483–5.

16. Thornton J. Covid-19: how coronavirus will change the face of general practice forever. BMJ. 2020;m1279.

17. Greenhalgh T, Wherton J, Shaw S, Morrison C. Video consultations for covid-19. BMJ. 2020;m998.

18. Lovell T, Albritton J, Dalto J, Ledward C, Daines W. Virtual vs traditional care settings for low-acuity urgent conditions: An economic analysis of cost and utilization using claims data. J Telemed Telecare. 2021;27(1):59–65.

19. Fisk M, Livingstone A, Pit SW. Telehealth in the Context of COVID-19: Changing Perspectives in Australia, the United Kingdom, and the United States. J Med Internet Res. 2020;22(6):e19264.

20. Chiang C, Halker Singh R, Lalvani N, Shubin Stein K, Henscheid Lorenz D, Lay C, et al. Patient experience of telemedicine for headache care during the COVID?19 pandemic: An American Migraine Foundation survey study. Headache J Head Face Pain. 2021;61(5):734–9.

21. Jonnagaddala J, Godinho MA, Liaw ST. From telehealth to virtual primary care in Australia? A Rapid scoping review. Int J Med Inf. 2021;151:104470.

22. NHS Digital. Appointments in General Practice – Appointment Mode. 2022 Available from: https://app.powerbi.com/view?r=eyJrIjoiYzU2OTA2ODktZTIyNy00ODhmLTk1ZGEtOGVlZmRlZDNjYzY3IiwidCI6IjUwZjYwNzFmLWJiZmUtNDAxYS04ODAzLTY3Mzc0OGU2MjllMiIsImMiOjh9. Cited Apr 14, 2022.

23. Drake C, Lian T, Cameron B, Medynskaya K, Bosworth HB, Shah K. Understanding Telemedicine's “New Normal”: Variations in Telemedicine Use by Specialty Line and Patient Demographics. Telemed E-Health. 2022;28(1):51–9.

24. Liaw ST, Kuziemsky C, Schreiber R, Jonnagaddala J, Liyanage H, Chittalia A, et al. Primary Care Informatics Response to Covid-19 Pandemic: Adaptation, Progress, and Lessons from Four Countries with High ICT Development. Yearb Med Inform. 2021;30(01):044–55.

25. Alexander GC, Tajanlangit M, Heyward J, Mansour O, Qato DM, Stafford RS. Use and Content of Primary Care Office-Based vs Telemedicine Care Visits During the COVID-19 Pandemic in the US. JAMA Netw Open. 2020;3(10):e2021476.

26. Bashshur RL, Howell JD, Krupinski EA, Harms KM, Bashshur N, Doarn CR. The Empirical Foundations of Telemedicine Interventions in Primary Care. Telemed E-Health. 2016;22(5):342–75.

27. Daniel H, Sulmasy LS. Policy Recommendations to Guide the Use of Telemedicine in Primary Care Settings: An American College of Physicians Position Paper. Ann Intern Med. 2015;163(10):787.

28. Kruse CS, Krowski N, Rodriguez B, Tran L, Vela J, Brooks M. Telehealth and patient satisfaction: a systematic review and narrative analysis. BMJ Open. 2017;7(8):e016242.

29. Cohen JB, Myckatyn TM, Brandt K. The Importance of Patient Satisfaction: A Blessing, a Curse, or Simply Irrelevant? Plast Reconstr Surg. 2017;139(1):257–61.

30. Vahdat S, Hamzehgardeshi L, Hessam S, Hamzehgardeshi Z. Patient Involvement in Health Care Decision Making: A Review. Iran Red Crescent Med J. 2014;16(1):e12454.

31. National Health System (NHS). NHS England » Involving people in their own care. NHS. Available from: https://www.england.nhs.uk/ourwork/patient-participation/. Cited Mar 6, 2021.

32. MacFarlane A, Harrison R, Wallace P. The Benefits of a Qualitative Approach to Telemedicine Research. J Telemed Telecare. 2002;8(2_suppl):56–7.

33. Peeters JM, Krijgsman JW, Brabers AE, Jong JDD, Friele RD. Use and Uptake of eHealth in General Practice: A Cross-Sectional Survey and Focus Group Study Among Health Care Users and General Practitioners. JMIR Med Inform. 2016;4(2):e11.

34. Bleyel C, Hoffmann M, Wensing M, Hartmann M, Friederich HC, Haun MW. Patients’ Perspective on Mental Health Specialist Video Consultations in Primary Care: Qualitative Preimplementation Study of Anticipated Benefits and Barriers. J Med Internet Res. 2020;22(4):e17330.

35. Imlach F, McKinlay E, Middleton L, Kennedy J, Pledger M, Russell L, et al. Telehealth consultations in general practice during a pandemic lockdown: survey and interviews on patient experiences and preferences. BMC Fam Pract. 2020;21(1):269.

36. Powell RE, Henstenburg JM, Cooper G, Hollander JE, Rising KL. Patient Perceptions of Telehealth Primary Care Video Visits. Ann Fam Med. 2017;15(3):225–9.

37. Reed ME, Huang J, Parikh R, Millman A, Ballard DW, Barr I, et al. Patient-Provider Video Telemedicine Integrated With Clinical Care: Patient Experiences. Ann Intern Med. 2019;171(3):222–4.

38. Sevean P, Dampier S, Spadoni M, Strickland S, Pilatzke S. Patients and families experiences with video telehealth in rural/remote communities in Northern Canada. J Clin Nurs. 2009;18(18):2573–9.

39. West KS. Perceptions of Adult Patients Accessing Telehealth in an Urban Medical Group [Internet] [Doctor of Nursing Practice]. [San Jose, CA, USA, San Jose, CA, USA]: San Jose State University, Northern California Consortium, Doctor of Nursing Practice Program, California State University, Fresno and San José State University; 2019. Available from: https://scholarworks.sjsu.edu/etd_doctoral/93. Cited Mar 13, 2021.

40. Liaw WR, Jetty A, Coffman M, Petterson S, Moore MA, Sridhar G, et al. Disconnected: a survey of users and nonusers of telehealth and their use of primary care. J Am Med Inform Assoc. 2019;26(5):420–8.

41. Grubaugh AL, Cain GD, Elhai JD, Patrick SL, Frueh BC. Attitudes Toward Medical and Mental Health Care Delivered Via Telehealth Applications Among Rural and Urban Primary Care Patients. J Nerv Ment Dis. 2008;196(2):166–70.

42. Mair F, Whitten P. Systematic review of studies of patient satisfaction with telemedicine. BMJ. 2000;320(7248):1517–20.

43. Williams TL, May CR, Esmail A. Limitations of Patient Satisfaction Studies in Telehealthcare: A Systematic Review of the Literature. Telemed J E Health. 2001;7(4):293–316.

44. Mold F, Hendy J, Lai YL, de Lusignan S. Electronic Consultation in Primary Care Between Providers and Patients: Systematic Review. JMIR Med Inform. 2019;7(4):e13042.

45. Bunn F, Byrne G, Kendall S. The effects of telephone consultation and triage on healthcare use and patient satisfaction: a systematic review. Br J Gen Pract J R Coll Gen Pract. 2005;55(521):956–61.

46. Thiyagarajan A, Grant C, Griffiths F, Atherton H. Exploring patients’ and clinicians’ experiences of video consultations in primary care: a systematic scoping review. BJGP Open. 2020;4(1):bjgpopen20X101020.

47. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.

48. Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Med Res Methodol. 2012;12(1):181.

49. Cooke A, Smith D, Booth A. Beyond PICO: The SPIDER Tool for Qualitative Evidence Synthesis. Qual Health Res. 2012;22(10):1435–43.

50. The EndNote Team. End Note. Philadelphia, PA: Clarivate; 2013.

51. Centre for Reviews and Dissemination, editor. CRD's guidance for undertaking reviews in healthcare. 3. ed. York: York Publ. Services; 2009. 281 p. (Systematic reviews).

52. Meline T. Selecting Studies for Systemic Review: Inclusion and Exclusion Criteria. Contemp Issues Commun Sci Disord. 2006;33(Spring):21–7.

53. Noyes J, Lewin S, Booth A, Hannes K, Harden A, Harris J, et al. Chapter 5: Extracting qualitative evidence. In: Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions [Internet]. 2011. Available from: http://cqrmg.cochrane.org/supplemental-handbook-guidance

54. Aveyard H. Doing a literature review in health and social care: a practical guide. Third edition. Maidenhead: McGraw-Hill Education, Open University Press; 2014. 190.

55. Critical Appraisal Skills Programme. CASP Qualitative Checklist [Internet]. 2018. Available from: https://casp-uk.net/wp-content/uploads/2018/03/CASP-Qualitative-Checklist-2018_fillable_form.pdf. Cited Mar 8, 2021.

56. Salmon P. Assessing the quality of qualitative research. Patient Educ Couns. 2013;90(1):1–3.

57. Nowell LS, Norris JM, White DE, Moules NJ. Thematic Analysis: Striving to Meet the Trustworthiness Criteria. Int J Qual Methods. 2017;16(1):160940691773384.

58. Ball SL, Newbould J, Corbett J, Exley J, Pitchforth E, Roland M. Qualitative study of patient views on a ‘telephone-first’ approach in general practice in England: speaking to the GP by telephone before making face-to-face appointments. BMJ Open. 2018;8(12):e026197.

59. Gabrielsson-Järhult F, Kjellström S, Josefsson KA. Telemedicine consultations with physicians in Swedish primary care: a mixed methods study of users’ experiences and care patterns. Scand J Prim Health Care. 2021;1–10.

60. Holmström IK, Nokkoudenmäki MB, Zukancic S, Sundler AJ. It is important that they care - older persons’ experiences of telephone advice nursing. J Clin Nurs. 2016;25(11–12):1644–53.

61. Lindberg J, Bhatt R, Ferm A. Older people and rural eHealth: perceptions of caring relations and their effects on engagement in digital primary health care. Scand J Caring Sci. 2021;scs.12953.

62. Nymberg VM, Bolmsjö BB, Wolff M, Calling S, Gerward S, Sandberg M. ‘Having to learn this so late in our lives…’ Swedish elderly patients’ beliefs, experiences, attitudes and expectations of e-health in primary health care. Scand J Prim Health Care. 2019;37(1):41–52.

63. Eccles A, Hopper M, Turk A, Atherton H. Patient use of an online triage platform: a mixed-methods retrospective exploration in UK primary care. Br J Gen Pract. 2019;69(682):e336–44.

64. Javanparast S, Roeger L, Kwok Y, Reed RL. The experience of Australian general practice patients at high risk of poor health outcomes with telehealth during the COVID-19 pandemic: a qualitative study. BMC Fam Pract. 2021;22(1):69.

65. Cowie J, Calveley E, Bowers G, Bowers J. Evaluation of a Digital Consultation and Self-Care Advice Tool in Primary Care: A Multi-Methods Study. Int J Environ Res Public Health. 2018;15(5):896.

66. Farr M, Banks J, Edwards HB, Northstone K, Bernard E, Salisbury C, et al. Implementing online consultations in primary care: a mixed-method evaluation extending normalisation process theory through service co-production. BMJ Open. 2018;8(3):e019966.

67. West K, Artinian B. Weighing options: Perceptions of adult patients accessing telehealth in primary care. Online J Nurs Inform. 2019;23(3).

68. Porritt K, Gomersall J, Lockwood C. JBI's Systematic Reviews: Study Selection and Critical Appraisal. Am J Nurs. 2014;114(6):47–52.

69. Aromataris E, Riitano D. Constructing a Search Strategy and Searching for Evidence. Am J Nurs. 2014;114(5):49–56.

70. Bramer WM, Rethlefsen ML, Kleijnen J, Franco OH. Optimal database combinations for literature searches in systematic reviews: a prospective exploratory study. Syst Rev. 2017;6(1):245.

71. Atherton H, Pappas Y, Heneghan C, Murray E. Experiences of using email for general practice consultations: a qualitative study. Br J Gen Pract. 2013;63(616):e760–7.

72. Bulik RJ. Human factors in primary care telemedicine encounters. J Telemed Telecare. 2008;14(4):169–72.

73. Chang F, Paramsothy T, Roche M, Gupta NS. Patient, staff, and clinician perspectives on implementing electronic communications in an interdisciplinary rural family health practice. Prim Health Care Res Dev. 2017;18(02):149–60.

74. Donaghy E, Atherton H, Hammersley V, McNeilly H, Bikker A, Robbins L, et al. Acceptability, benefits, and challenges of video consulting: a qualitative study in primary care. Br J Gen Pract. 2019;69(686):e586–94.

75. Hiratsuka V, Delafield R, Starks H, Ambrose AJ, Mau MM. Patient and provider perspectives on using telemedicine for chronic disease management among Native Hawaiian and Alaska Native people. Int J Circumpolar Health. 2013;72(1):21401.

76. Leng S, MacDougall M, McKinstry B. The acceptability to patients of video-consulting in general practice: semi-structured interviews in three diverse general practices. J Innov Health Inform. 2016;23(2):493.

77. Mangin D, Parascandalo J, Khudoyarova O, Agarwal G, Bismah V, Orr S. Multimorbidity, eHealth and implications for equity: a cross-sectional survey of patient perspectives on eHealth. BMJ Open. 2019;9(2):e023731.

78. McKinstry B, Watson P, Pinnock H, Heaney D, Sheikh A. Telephone consulting in primary care: a triangulated qualitative study of patients and providers. Br J Gen Pract. 2009;59(563):e209–18.

79. Radhakrishnan K, Xie B, Jacelon CS. Unsustainable Home Telehealth: A Texas Qualitative Study. The Gerontologist. 2016;56(5):830–40.

80. Zanaboni P, Fagerlund AJ. Patients’ use and experiences with e-consultation and other digital health services with their general practitioner in Norway: results from an online survey. BMJ Open. 2020;10(6):e034773.

81. Cernadas Ramos A, Bouzas-Lorenzo R, Mesa del Olmo A, Barral Buceta B. Opinión de los facultativos y usuarios sobre avances de la e-salud en atención primaria. Aten Primaria. 2020;52(6):389–99.

82. Kung K, Wong H, Chen J. An exploratory qualitative study of patients’ views on medical e-consultation in a public primary care setting. Hong Kong Pract. 2016;38(4):120–7.

Supplementary Material
Appendix 1: Review Protocol

Protocol for Systematic Review: Exploring Adults’ Perceptions and Experiences of Telemedicine in Primary Care

Background and Rationale

Telemedicine is an umbrella term covering various forms of healthcare which is delivered remotely using telecommunication.1,2 Other terms such as telehealth, eHealth, and mHealth are generally used interchangeably with telemedicine in the literature.1,3 Potential advantages of telemedicine are well discussed throughout the literature, such as increasing the assess and reach of healthcare, improving convenience, and reducing cost.4,5 With these factors around telemedicine becoming more established, questions are moving beyond the clinical and cost-effectiveness of telemedicine into other areas such as patient perceptions.6

Over recent years the use of telemedicine in healthcare has been gradually increasing with benefits shown in a vast range of areas including surgery, diabetes, and geriatrics.2,4,7,8 However, during the COVID-19 outbreak face-to-face consultations had to be avoided, causing this gradual uptake to become a sudden worldwide implementation of telemedicine to help manage the pandemic.9,10 Inadvertently, this unexpected mass implementation has showcased the advantages of embedding telemedicine into healthcare on a large scale.9

Primary care is a particular area in which telemedicine is expected to be widely utilized in the future, and this view was further enhanced by the substantial benefits shown during the COVID-19 pandemic.11,12 However, in order to effectively implement telemedicine into primary care in the long-term, certain areas need to be explored further. One of the areas that will be vital to the effective implementation of telemedicine is understanding patient perceptions and experiences.5

Patient satisfaction acts as both an influential motivator and stressor to the development and improvement of healthcare services.13 Additionally, active involvement and engagement of patients in healthcare has been associated with improved outcomes and patient experiences.14,15 The importance of patient perceptions are further demonstrated by the key NHS and general healthcare principle of person-centered care, as to deliver person-centered care the patient perspective must be explored.15

Although there is literature on patient perceptions of telemedicine generally, there is a gap in the literature regarding a review of the patient perceptions specifically surrounding telemedicine in primary care. Various primary research has been produced on this topic generating several themes, however, this information has not yet been brought together in a review. The current literature around patient perceptions of telemedicine and primary care will be discussed further in the literature review section.

Summarizing the previous points, the use of telemedicine in primary care is continuously increasing and the focus for telemedicine research is moving beyond clinical and cost-effectiveness. Furthermore, these points combined with the importance of understanding patient perceptions in healthcare, demonstrate the rationale behind a review exploring patient perception of telemedicine specifically relating to primary care.

Research Question

What are the perceptions and experiences of adult patients who have used telemedicine in primary care?

Aims and Objectives

Aim

Objectives

Preliminary Literature Review

Patient satisfaction of telemedicine usually relates to quantitative measures of assessing patient perceptions of telemedicine, and there is various literature exploring this. The consensus of the literature is that patients are satisfied with telemedicine with consideration to various parameters such as access and convenience.5,16 However, for this systematic review the focus is to explore beyond if patients are satisfied, but to try to understand the themes behind patient perceptions of telemedicine, specifically primary care.

Various telemedicine studies include aspects assessing patient perceptions, but this is often not the focus of the study and is a secondary consideration. As a result, the findings tend to be superficial, and only discuss the well documented benefits to patients rather than interviewing patients in-depth. In order to assess what literature has been published and the feasibility of a systematic review on patient perceptions of telemedicine in primary care, a scoping search was performed.

For this scoping search the CINAHL database was used, and the search terms can be seen in the appendix. After reviewing the titles and abstracts for suitable studies that focused on patient perception of telemedicine in primary care, the 748 articles were reduced to 18. Various methods were used by the studies with nine using qualitative methods,1725 seven using quantitative methods,2632 and two being mixed method studies,33,34. The different studies resulted in a variety of conclusions but there were some key themes that arose.

Common, well-discussed aspects of telemedicine were mentioned in numerous studies such as convenience,21,22,24,25,32,34 saving time,21,22,24,27,32,34 and a preference to be seen face-to-face,24,26,34. One theme which is not as well acknowledged currently in the literature is patient perceptions of the patient physician relationship in telemedicine. This transpersonal relationship is an important aspect to a positive experience of telemedicine for patients,21,25,34. It was easier if this relationship was pre-existing, but it could be developed without a prior relationship before the telemedicine consultation.34 The relevance of this to practice is that consideration and effort needs to be made for developing this patient physician relationship in order to deliver telemedicine in an effective way, whilst enhancing the patient experience.

Another theme that arose from multiple articles was patients expressing a need for telemedicine in primary care to be tailored to the individual or group,17,18,20,22,33. A user-centered design approach should be taken as trying to use telemedicine without consideration to specific context would cause negative patient attitudes and experiences.20

Although this is only a scoping search, so no comprehensive analysis of the themes has been done, it demonstrates that addressing the gap in the current literature of a review surrounding patient perceptions of telemedicine in primary care would be of benefit, as bringing the current literature together will produce findings which can help to better understand the patient perspective. Both of the themes disused along with others such as a concern for telemedicine not being effectively integrated with other aspects of healthcare,17,20,22,27 would be explored in further detail in the systematic review.

Methodology Focused review question

As the focus of this review is exploring the perceptions and experiences of patients, literature using the qualitative interpretivism approach is more appropriate than the quantitative positivist approach.35 This was confirmed by the scoping search with qualitative studies exploring this area in significantly more depth than quantitative studies. Considering this, the SPIDER acronym was used to help guide development of a focused research question as it was specifically developed for qualitative research questions.36

Question: What are the perceptions and experiences of adult patients who have used telemedicine in primary care?

Sample: Adult patients in primary care.

Phenomena of Interest: Use of any form of telemedicine in primary care.

Design: Non-interventional qualitative or mixed method studies of any theoretical framework.

Evaluation: Perceptions and experiences of telemedicine in primary care.

Research: Qualitative or mixed method research.

Search strategy Search terms:

Both MeSH and free-text terms will be used alongside Boolean operators to search the electronic databases.37 Below are the MeSH and free-text terms which will be used.

Terms MeSH terms Free text
Telemedicine Telemedicine telehealth or telemedicine or telemonitoring or telepractice or telenursing or telecare or ehealth or e-health or mobile health or mhealth or m-health
Primary care Primary Health Care, General Practice, Family Practice primary care or primary health* or primary healthcare* or family practi* or community care or general practi* or generalist*
Perceptions and experiences Attitude perception* or attitude* or opinion* or experience* or view* or reflection* or belief* or impact* or influence*
Search limits:
Study designs Qualitative and mixed method study designs
Publication type Peer-reviewed journal articles
Date of publication None
Language English
Sources to be Searched:

Multiple electronic databases will be searched including CINAHL, MEDLINE, EMBASE, and Cochrane Library. To further ensure all relevant articles are identified, both examination of reference lists and citation searching using Google scholar will be conducted.38

Study selection Design of studies:

As previously mentioned, qualitative studies will be used in this systematic review and thus a qualitative systematic review methodology will be utilized.39 Due to the scoping search demonstrating a potentially limited number of primary studies that are purely qualitative studies on the topic, suitable mixed-method studies will also be included in this systematic review.

Inclusion and exclusion criteria:

Inclusion and exclusion criteria have been created using the SPIDER acronym with the addition of language and can be seen below in the table.36

Selection Criteria Inclusion Exclusion
Sample Adults (18 years and older) from all sexes Children or adolescents (less than 18 years old)
Phenomenon of Interest Use of any form of telemedicine in a primary care setting Studies not based in primary care Studies not primarily focused on telemedicine
Design Non-interventional qualitative or mixed method studies Interventional studies which do not have a focus of patient perceptions and experiences
Evaluation Perceptions or experiences of patients who have used telemedicine in primary care setting Studies not focusing on patient perceptions or experiences Studies that only focus on physicians' perceptions and experiences
Research Qualitative and mixed method studies Quantitative studies
Language English Non-English
Selection of Studies:

Study selection will consist of two stages; initially the titles and abstracts will be screened against the inclusion criteria to identify potentially relevant studies.40 Duplicates will be removed and in cases where information is missing the study authors will be contacted, if this is not feasible the studies will be excluded and labelled as ‘potentially relevant studies’.40 In the next step, studies that appear to meet the inclusion criteria or studies where further assessment is required, will be screened using the full papers. To document and report this process in a complete and transparent manner a PRISMA flow diagram will be used alongside a table showing the characteristics of excluded studies with reasons for exclusion.37,41 All of this processing will be completed by one reviewer, and this is a recognized limitation of the study.

Assessment of validity, applicability and reliability

To critical appraise included studies the Critical Appraisal Skills Programme (CASP) checklist for qualitative research will be used.37,42 The CASP checklist consists of 10 questions which aim to help systematically assess the studies according to the three broad issues of validity of results, what are the results, and how will the results help locally.42

Data extraction

Data will be extracted using a standardized data extraction form to provide consistency to the review whilst reducing bias, but also improving validity and reliability.40 The standardized data extraction form will be created by adapting a pre-existing form such as one outlined by Noyes et al.,43. The Centre of Reviews and Dissemination (CRD) guidelines will also help in this process.40 To ensure all relevant information will be captured, the data extraction form will be piloted on a small sample of studies and then refined accordingly.40 The data extraction form will be electronic to allow for the combination of data extraction and data entry in the same step, whilst also facilitating the data analysis.40 As with all other steps in this review, data extraction will be conducted by a single reviewer and where data is missing study authors will be contacted. An example of some of the data extraction fields and information that will be extracted can be seen in the appendix.

Proposed data synthesis

Data will be synthesized using a simplified approach to thematic analysis as described by Aveyard,37. This approach was developed by taking ideas from previous thematic analysis work in combination with feedback and experience to refine and amend the approach technique. The stages of the simplified thematic analysis that will be used for this review consist of summarizing the content of all articles with the use of tables, identifying themes, developing and naming these themes, comparing themes, and scrutinizing the themes. A simplified approach to thematic analysis as outlined by Aveyard,37 was chosen over other approaches because it was developed to be well suited for use by undergraduate and postgraduate students. This was achieved by considering aspects relevant to single student projects such as limited resources, the review being conducted by only a single reviewer, and not requiring a level of expertise which is beyond postgraduate level.37

Review Timetable

Below is a preliminary timetable for the review with milestones to monitor progress.

Task Completion Date
Focus question 08/03/2021
Scoping search 08/03/2021
Draft protocol 17/03/2021
Final protocol 24/03/2021
Full search 28/06/21
Order papers 05/07/2021
Study selection 12/07/2021
Quality assessment 02/08/2021
Data extraction 02/08/2021
Data synthesis 09/08/2021
Draft review submission 25/08/2021
Final review submission 08/09/2021

Protocol References

1. Wootton R. Recent advances: Telemedicine. BMJ. 2001 Sep 8;323(7312):557–60. Available from doi: http://dx.doi.org/10.1136/bmj.323.7312.557
cross-ref

2. Asiri A, AlBishi S, AlMadani W, ElMetwally A, Househ M. The Use of Telemedicine in Surgical Care: a Systematic Review. Acta Inform Medica. 2018;26(2):201. Available from doi: http://dx.doi.org/10.5455/aim.2018.26.201-206
cross-ref

3. World Health Organization, editor. Telemedicine: opportunities and developments in member states: report on the second Global survey on eHealth. Geneva, Switzerland: World Health Organization; 2010. 93 p. (Global observatory for eHealth series). Available from ISBN: 978-92-4-156414-4

4. Dorsey ER, Topol EJ. State of Telehealth. Campion EW, editor. N Engl J Med. 2016 Jul 14;375(2):154–61. Available from doi: http://dx.doi.org/10.1056/NEJMra1601705
cross-ref

5. School of Health Sciences Mamba’ul ’Ulum, Surakarta, Atmojo JT, Sudaryanto WT, Study Program in Physiotherapy, Universitas Muhammadiyah Surakarta, Widiyanto A, School of Health Sciences Mamba’ul ’Ulum, Surakarta, et al. Telemedicine, Cost Effectiveness, and Patients Satisfaction: A Systematic Review. J Health Policy Manag. 2020;5(2):103–7. Available from doi: http://dx.doi.org/10.26911/thejhpm.2020.05.02.02
cross-ref

6. Ekeland AG, Bowes A, Flottorp S. Effectiveness of telemedicine: A systematic review of reviews. Int J Med Inf. 2010 Nov;79(11):736–71. Available from doi: http://dx.doi.org/10.1016/j.ijmedinf.2010.08.006
cross-ref

7. Batsis JA, DiMilia PR, Seo LM, Fortuna KL, Kennedy MA, Blunt HB, et al. Effectiveness of Ambulatory Telemedicine Care in Older Adults: A Systematic Review. J Am Geriatr Soc. 2019 Aug;67(8):1737–49. Available from doi: http://dx.doi.org/10.1111/jgs.15959
cross-ref

8. Lee JY, Lee SWH. Telemedicine Cost–Effectiveness for Diabetes Management: A Systematic Review. Diabetes Technol Ther. 2018 Jul;20(7):492–500. Available from doi: http://dx.doi.org/10.1089/dia.2018.0098
cross-ref

9. Leite H, Hodgkinson IR, Gruber T. New development: ‘Healing at a distance’—telemedicine and COVID-19. Public Money Manag. 2020 Aug 17;40(6):483–5. Available from doi: http://dx.doi.org/10.1080/09540962.2020.1748855
cross-ref

10. Kannampallil T, Ma J. Digital Translucence: Adapting Telemedicine Delivery Post-COVID-19. Telemed E-Health. 2020 Sep 1;26(9):1120–2. Available from doi: http://dx.doi.org/10.1089/tmj.2020.0158
cross-ref

11. Daniel H, Sulmasy LS. Policy Recommendations to Guide the Use of Telemedicine in Primary Care Settings: An American College of Physicians Position Paper. Ann Intern Med. 2015 Nov 17;163(10):787. Available from doi: http://dx.doi.org/10.7326/M15-0498
cross-ref

12. Bashshur RL, Howell JD, Krupinski EA, Harms KM, Bashshur N, Doarn CR. The Empirical Foundations of Telemedicine Interventions in Primary Care. Telemed E-Health. 2016 May;22(5):342–75. Available from doi: http://dx.doi.org/10.1089/tmj.2016.0045
cross-ref

13. Cohen JB, Myckatyn TM, Brandt K. The Importance of Patient Satisfaction: A Blessing, a Curse, or Simply Irrelevant? Plast Reconstr Surg. 2017 Jan;139(1):257–61. Available from doi: http://dx.doi.org/10.1097/PRS.0000000000002848
cross-ref

14. Vahdat S, Hamzehgardeshi L, Hessam S, Hamzehgardeshi Z. Patient Involvement in Health Care Decision Making: A Review. Iran Red Crescent Med J [Internet]. 2014 Jan 5 [cited 2021 Mar 13];16(1). Available from: https://sites.kowsarpub.com/ircmj/articles/16044.html

15. NHS. NHS England ” Involving people in their own care [Internet]. NHS. [cited 2021 Mar 6]. Available from: https://www.england.nhs.uk/ourwork/patient-participation/

16. Kruse CS, Krowski N, Rodriguez B, Tran L, Vela J, Brooks M. Telehealth and patient satisfaction: a systematic review and narrative analysis. BMJ Open. 2017 Aug;7(8):e016242. Available from doi: http://dx.doi.org/10.1136/bmjopen-2017-016242
cross-ref

17. Huygens MWJ, Vermeulen J, Swinkels ICS, Friele RD, van Schayck OCP, de Witte LP. Expectations and needs of patients with a chronic disease toward self-management and eHealth for self-management purposes. BMC Health Serv Res. 2016 Dec;16(1):232. Available from doi: http://dx.doi.org/10.1186/s12913-016-1484-5
cross-ref

18. Nymberg VM, Bolmsjö BB, Wolff M, Calling S, Gerward S, Sandberg M. ‘Having to learn this so late in our lives…’ Swedish elderly patients’ beliefs, experiences, attitudes and expectations of e-health in primary health care. Scand J Prim Health Care. 2019 Jan 2;37(1):41–52. Available from doi: http://dx.doi.org/10.1080/02813432.2019.1570612
cross-ref

19. Holmström IK, Nokkoudenmäki M-B, Zukancic S, Sundler AJ. It is important that they care - older persons’ experiences of telephone advice nursing. J Clin Nurs. 2016 Jun;25(11–12):1644–53. Available from doi: http://dx.doi.org/10.1111/jocn.13173
cross-ref

20. Irfan Khan A, Gill A, Cott C, Hans PK, Steele Gray C. mHealth Tools for the Self-Management of Patients With Multimorbidity in Primary Care Settings: Pilot Study to Explore User Experience. JMIR MHealth UHealth. 2018 Aug 28;6(8):e171. Available from doi: http://dx.doi.org/10.2196/mhealth.8593
cross-ref

21. Powell RE, Henstenburg JM, Cooper G, Hollander JE, Rising KL. Patient Perceptions of Telehealth Primary Care Video Visits. Ann Fam Med. 2017 May;15(3):225–9. Available from doi: http://dx.doi.org/10.1370/afm.2095
cross-ref

22. Sevean P, Dampier S, Spadoni M, Strickland S, Pilatzke S. Patients and families experiences with video telehealth in rural/remote communities in Northern Canada. J Clin Nurs. 2009 Sep;18(18):2573–9. Available from doi: http://dx.doi.org/10.1111/j.1365-2702.2008.02427.x
cross-ref

23. Jones MI, Greenfield SM, Bray EP, Baral-Grant S, Hobbs FR, Holder R, et al. Patients’ experiences of self-monitoring blood pressure and self-titration of medication: the TASMINH2 trial qualitative study. Br J Gen Pract. 2012 Feb;62(595):e135–42. Available from doi: http://dx.doi.org/10.3399/bjgp12X625201
cross-ref

24. Bleyel C, Hoffmann M, Wensing M, Hartmann M, Friederich H-C, Haun MW. Patients’ Perspective on Mental Health Specialist Video Consultations in Primary Care: Qualitative Preimplementation Study of Anticipated Benefits and Barriers. J Med Internet Res. 2020 Apr 20;22(4):e17330. Available from doi: http://dx.doi.org/10.2196/17330
cross-ref

25. West KS. Perceptions of Adult Patients Accessing Telehealth in an Urban Medical Group [Internet] [Doctor of Nursing Practice]. [San Jose, CA, USA, San Jose, CA, USA]: San Jose State University, Northern California Consortium, Doctor of Nursing Practice Program, California State University, Fresno and San José State University; 2019 [cited 2021 Mar 13]. Available from: https://scholarworks.sjsu.edu/etd_doctoral/93

26. Grubaugh AL, Cain GD, Elhai JD, Patrick SL, Frueh BC. Attitudes Toward Medical and Mental Health Care Delivered Via Telehealth Applications Among Rural and Urban Primary Care Patients. J Nerv Ment Dis. 2008 Feb;196(2):166–70. Available from doi: http://dx.doi.org/10.1097/NMD.0b013e318162aa2d
cross-ref

27. Liaw WR, Jetty A, Coffman M, Petterson S, Moore MA, Sridhar G, et al. Disconnected: a survey of users and nonusers of telehealth and their use of primary care. J Am Med Inform Assoc. 2019 May 1;26(5):420–8. Available from doi: http://dx.doi.org/10.1093/jamia/ocy182
cross-ref

28. Deen TL, Fortney JC, Schroeder G. Patient Acceptance of and Initiation and Engagement in Telepsychotherapy in Primary Care. Psychiatr Serv. 2013 Apr;64(4):380–4. Available from doi: http://dx.doi.org/10.1176/appi.ps.201200198
cross-ref

29. Näverlo S, Carson DB, Edin-Liljegren A, Ekstedt M. Patient perceptions of a Virtual Health Room installation in rural Sweden. Rural Remote Health. 2016 Dec;16(4):3823. Available from ISSN: 1445-6354

30. Giesen P, Charante EM van, Mokkink H, Bindels P, van den Bosch W, Grol R. Patients evaluate accessibility and nurse telephone consultations in out-of-hours GP care: Determinants of a negative evaluation. Patient Educ Couns. 2007 Jan;65(1):131–6. Available from doi: http://dx.doi.org/10.1016/j.pec.2006.06.021
cross-ref

31. Johansson A, Larsson M, Ivarsson B. Patients’ Experiences With a Digital Primary Health Care Concept Using Written Dialogues: A Pilot Study. J Prim Care Community Health. 2020 Dec;11:2150132720910564. Available from doi: http://dx.doi.org/10.1177/2150132720910564
cross-ref

32. Reed ME, Huang J, Parikh R, Millman A, Ballard DW, Barr I, et al. Patient-Provider Video Telemedicine Integrated With Clinical Care: Patient Experiences. Ann Intern Med. 2019 Aug 6;171(3):222–4. Available from doi: http://dx.doi.org/10.7326/M18-3081
cross-ref

33. Saleh S, Farah A, El Arnaout N, Dimassi H, El Morr C, Muntaner C, et al. mHealth use for non-communicable diseases care in primary health: patients’ perspective from rural settings and refugee camps. J Public Health. 2018 Dec 1;40(suppl_2):ii52–63. Available from doi: http://dx.doi.org/10.1093/pubmed/fdy172
cross-ref

34. Imlach F, McKinlay E, Middleton L, Kennedy J, Pledger M, Russell L, et al. Telehealth consultations in general practice during a pandemic lockdown: survey and interviews on patient experiences and preferences. BMC Fam Pract. 2020 Dec 13;21(1):269. Available from doi: http://dx.doi.org/10.1186/s12875-020-01336-1
cross-ref

35. Saks M, Allsop J, editors. Researching health: qualitative, quantitative and mixed methods. 2nd ed. London?; Thousand Oaks, Calif: SAGE; 2013. 489 p. Available from ISBN: 978-1-4462-5226-0 978-1-4462-5227-7

36. Cooke A, Smith D, Booth A. Beyond PICO: The SPIDER Tool for Qualitative Evidence Synthesis. Qual Health Res. 2012 Oct;22(10):1435–43. Available from doi: http://dx.doi.org/10.1177/1049732312452938
cross-ref

37. Aveyard H. Doing a literature review in health and social care: a practical guide. Third edition. Maidenhead: McGraw-Hill Education, Open University Press; 2014. 190 p. Available from ISBN: 978-0-335-26308-0 978-0-335-26307-3

38. Greenhalgh T, Peacock R. Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ. 2005 Nov 5;331(7524):1064–5. Available from doi: http://dx.doi.org/10.1136/bmj.38636.593461.68
cross-ref

39. Butler A, Hall H, Copnell B. A Guide to Writing a Qualitative Systematic Review Protocol to Enhance Evidence-Based Practice in Nursing and Health Care: The Qualitative Systematic Review Protocol. Worldviews Evid Based Nurs. 2016 Jun;13(3):241–9. Available from doi: http://dx.doi.org/10.1111/wvn.12134
cross-ref

40. Centre for Reviews and Dissemination, editor. CRD's guidance for undertaking reviews in healthcare. 3. ed. York: York Publ. Services; 2009. 281 p. (Systematic reviews). Available from ISBN: 978-1-900640-47-3

41. Moher D, Liberati A, Tetzlaff J, Altman DG, for the PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009 Jul 21;339(jul21 1):b2535–b2535. Available from doi: http://dx.doi.org/10.1136/bmj.b2535
cross-ref

42. Critical Appraisal Skills Programme. CASP Qualitative Checklist [Internet]. 2018 [cited 2021 Mar 8]. Available from: https://casp-uk.net/wp-content/uploads/2018/03/CASP-Qualitative-Checklist-2018_fillable_form.pdf

43. Noyes J, Lewin S, Booth A, Hannes K, Harden A, Harris J, et al. Chapter 5: Extracting qualitative evidence. In: Supplementary Guidance for Inclusion of Qualitative Research in Cochrane Systematic Reviews of Interventions [Internet]. 2011. Available from: http://cqrmg.cochrane.org/supplemental-handbook-guidance


Protocol Appendix Protocol Appendix 1:

Screenshot of search terms used in the scoping search strategy


Protocol Appendix 2:

Examples of data extraction fields and information to be extracted

Data extraction field Information extracted
Context and participants Research question; Aims; Date and timings; Country and area of study; Rationale; Ethical standards; Participant characteristics (age, gender, ethnicity, SES); Number of participants; Type of publication; Source of funding
Study design and methods used Study setting; Sampling approach; Data collection methods; Data analysis approach
Findings Key themes identified in the study; Data extracts related to the key themes; Author explanations of the key themes; Recommendations made by authors; Opinions of the author; Implications of findings for policy and practice; Generalizability of findings; Conclusions
Quality of the study Assessment of study quality; Assessment of validly
Other Strengths of the study; Limitations of the study
Appendix 2: PRISMA 2020 Checklist.47
Section and Topic Item # Checklist item Location where item is reported
TITLE
Title 1 Identify the report as a systematic review. Pg. 1
ABSTRACT
Abstract 2 See the PRISMA 2020 for Abstracts checklist. Pg. 3
INTRODUCTION
Rationale 3 Describe the rationale for the review in the context of existing knowledge. Pg.4–5
Objectives 4 Provide an explicit statement of the objective(s) or question(s) the review addresses. Pg. 5
METHODS
Eligibility criteria 5 Specify the inclusion and exclusion criteria for the review and how studies were grouped for the syntheses. Pg. 6
Information sources 6 Specify all databases, registers, websites, organisations, reference lists and other sources searched or consulted to identify studies. Specify the date when each source was last searched or consulted. Pg. 6
Search strategy 7 Present the full search strategies for all databases, registers and websites, including any filters and limits used. Pg. 6
Appx. 4–7
Selection process 8 Specify the methods used to decide whether a study met the inclusion criteria of the review, including how many reviewers screened each record and each report retrieved, whether they worked independently, and if applicable, details of automation tools used in the process. Pg. 6–7
Data collection process 9 Specify the methods used to collect data from reports, including how many reviewers collected data from each report, whether they worked independently, any processes for obtaining or confirming data from study investigators, and if applicable, details of automation tools used in the process. Pg. 7
Appx. 8
Data items 10a List and define all outcomes for which data were sought. Specify whether all results that were compatible with each outcome domain in each study were sought (e.g. for all measures, time points, analyses), and if not, the methods used to decide which results to collect. Pg. 7
Appx. 8
10b List and define all other variables for which data were sought (e.g. participant and intervention characteristics, funding sources). Describe any assumptions made about any missing or unclear information. Appx. 8
Study risk of bias assessment 11 Specify the methods used to assess risk of bias in the included studies, including details of the tool(s) used, how many reviewers assessed each study and whether they worked independently, and if applicable, details of automation tools used in the process. Pg. 7
Effect measures 12 Specify for each outcome the effect measure(s) (e.g. risk ratio, mean difference) used in the synthesis or presentation of results. N/A
Synthesis methods 13a Describe the processes used to decide which studies were eligible for each synthesis (e.g. tabulating the study intervention characteristics and comparing against the planned groups for each synthesis (item #5)). N/A
13b Describe any methods required to prepare the data for presentation or synthesis, such as handling of missing summary statistics, or data conversions. N/A
13c Describe any methods used to tabulate or visually display results of individual studies and syntheses. Pg. 7
13d Describe any methods used to synthesize results and provide a rationale for the choice(s). If meta-analysis was performed, describe the model(s), method(s) to identify the presence and extent of statistical heterogeneity, and software package(s) used. Pg. 7
13e Describe any methods used to explore possible causes of heterogeneity among study results (e.g., subgroup analysis, meta-regression). N/A
13f Describe any sensitivity analyses conducted to assess robustness of the synthesized results. N/A
Reporting bias assessment 14 Describe any methods used to assess risk of bias due to missing results in a synthesis (arising from reporting biases). N/A
Certainty assessment 15 Describe any methods used to assess certainty (or confidence) in the body of evidence for an outcome. N/A
RESULTS
Study selection 16a Describe the results of the search and selection process, from the number of records identified in the search to the number of studies included in the review, ideally using a flow diagram. Pg. 8
Figure 1
16b Cite studies that might appear to meet the inclusion criteria, but which were excluded, and explain why they were excluded. Appx. 9
Study characteristics 17 Cite each included study and present its characteristics. Pg.8
Table 12
Risk of bias in studies 18 Present assessments of risk of bias for each included study. Pg. 8
Table 3
Appx. 10
Results of individual studies 19 For all outcomes, present, for each study: (a) summary statistics for each group (where appropriate)and (b) an effect estimate and its precision (e.g. confidence/credible interval), ideally using structured tables or plots. N/A
Results of syntheses 20a For each synthesis, briefly summarise the characteristics and risk of bias among contribu ting studies. Pg. 8
Table 3
Appx. 10
20b Present results of all statistical syntheses conducted. If meta-analysis was done, present for each the summary estimate and its precision (e.g. confidence/credible interval) and measures of statistical heterogeneity. If comparing groups, describe the direction of the effect. Pg. 8–11
20c Present results of all investigations of possible causes of heterogeneity among study results. N/A
20d Present results of all sensitivity analyses conducted to assess the robustness of the synthesized results. N/A
Reporting biases 21 Present assessments of risk of bias due to missing results (arising from reporting biases) for each synthesis assessed. N/A
Certainty of evidence 22 Present assessments of certainty (or confidence) in the body of evidence for each outcome assessed. N/A
DISCUSSION
Discussion 23a Provide a general interpretation of the results in the context of other evidence. Pg. 12
23b Discuss any limitations of the evidence included in the review. Pg. 13
23c Discuss any limitations of the review processes used. Pg. 13
23d Discuss implications of the results for practice, policy, and future research. Pg. 13
OTHER INFORMATION
Registration and protocol 24a Provide registration information for the review, including register name and registration number, or state that the review was not registered. Pg. 3
24b Indicate where the review protocol can be accessed, or state that a protocol was not prepared. Pg. 6
24c Describe and explain any amendments to information provided at registration or in the protocol. Pg. 6–7
Support 25 Describe sources of financial or non-financial support for the review, and the role of the funders or sponsors in the review. Pg. 1
Competing interests 26 Declare any competing interests of review authors. Pg. 1
Availability of data, code and other materials 27 Report which of the following are publicly available and where they can be found: template data collection forms; data extracted from included studies; data used for all analyses; analytic code; any other materials used in the review. N/A
Appendix 3: ENTREQ Checklist.48
No Item Guide and description Location
1 Aim State the research question the synthesis addresses. Pg. 5
2 Synthesis methodology Identify the synthesis methodology or theoretical framework which underpins the synthesis, and describe the rationale for choice of methodology (e.g. meta-ethnography, thematic synthesis, critical interpretive synthesis, grounded theory synthesis, realist synthesis, meta-aggregation, meta-study, framework synthesis). Pg.7
3 Approach to searching Indicate whether the search was pre-planned (comprehensive search strategies to seek all available studies) or iterative (to seek all available concepts until they theoretical saturation is achieved). Pg. 6–7
4 Inclusion criteria Specify the inclusion/exclusion criteria (e.g. in terms of population, language, year limits, type of publication, study type). Pg. 6
5 Data sources Describe the information sources used (e.g. electronic databases (MEDLINE, EMBASE, CINAHL, psycINFO, Econlit), grey literature databases (digital thesis, policy reports), relevant organisational websites, experts, information specialists, generic web searches (Google Scholar) hand searching, reference lists) and when the searches conducted; provide the rationale for using the data sources. Pg. 6
6 Electronic Search strategy Describe the literature search (e.g. provide electronic search strategies with population terms, clinical or health topic terms, experiential or social phenomena related terms, filters for qualitative research, and search limits). Pg. 6
Appx. 4–7
7 Study screening methods Describe the process of study screening and sifting (e.g. title, abstract and full text review, number of independent reviewers who screened studies). Pg. 6–7
8 Study characteristics Present the characteristics of the included studies (e.g. year of publication, country, population, number of participants, data collection, methodology, analysis, research questions). Pg. 8
Figure 1
9 Study selection results Identify the number of studies screened and provide reasons for study exclusion (e,g, for comprehensive searching, provide numbers of studies screened and reasons for exclusion indicated in a figure/flowchart; for iterative searching describe reasons for study exclusion and inclusion based on modifications t the research question and/or contribution to theory development). Pg. 8
Tables 12
10 Rationale for appraisal Describe the rationale and approach used to appraise the included studies or select ed findings (e.g. assessment of conduct (validity and robustness), assessment of reporting (transparency), assessment of content and utility of the findings). Pg. 7
11 Appraisal items State the tools, frameworks and criteria used to appraise the studies or selected findings (e.g. Existing tools: CASP, QARI, COREQ, Mays and Pope [25]; reviewer developed tools; describe the domains assessed: research team, study design, data analysis and interpretations, reporting). Pg. 7
12 Appraisal process Indicate whether the appraisal was conducted independently by more than one reviewer and if consensus was required. Pg. 7
13 Appraisal results Present results of the quality assessment and indicate which articles, if any, were weighted/excluded based on the assessment and give the rationale. Pg. 8
Table 3
Appx. 10
14 Data extraction Indicate which sections of the primary studies were analysed and how were the data extracted from the primary studies? (e.g. all text under the headings “results/conclusions” were extracted electronically and entered into a computer software). Pg. 7
15 Software State the computer software used, if any. Pg. 7
16 Number of reviewers Identify who was involved in coding and analysis. Pg. 7
17 Coding Describe the process for coding of data (e.g. line by line coding to search for concepts). Pg. 7
18 Study comparison Describe how were comparisons made within and across studies (e.g. subsequent studies were coded into pre-existing concepts, and new concepts were created when deemed necessary). Pg. 7
19 Derivation of themes Explain whether the process of deriving the themes or constructs was inductive or deductive. Pg. 7
20 Quotations Provide quotations from the primary studies to illustrate themes/constructs, and identify whether the quotations were participant quotations of the author's interpretation. N/A
21 Synthesis output Present rich, compelling and useful results that go beyond a summary of the primary studies (e.g.new interpretation, models of evidence, conceptual models, analytical framework, development of a new theory or construct). Pg. 8–11
Appendix 4: Search Strategy for MEDLINE
Search Term Search Strategy Results
1 exp Telemedicine/ 35203
2 (telehealth or telemedicine or telemonitoring or telepractice or telenursing or telecare or ehealth or e-health or mobile health or mhealth or m-health or (digital adj2 health*)).ti,ab. 33200
3 1 or 2 50489
4 exp Primary Health Care/or exp Family Practice/or exp General Practice/ 237882
5 (primary care or primary health* or primary healthcare* or family practi* or community care or general practi* or generalist*).mp. 299217
6 4 or 5 381964
7 ((patient* or user* or client* or individual* or people* or public*) adj4 (perception* or attitude* or opinion* or experience* or view* or reflection* or belief* or impact* or influence* or expect* or perspective*)).mp. 450859
8 exp Qualitative Research/ 64550
9 (qualitative research or qualitative study or qualitative methods or interview* or focus group* or survey* or ethnographic or phenomenological or case study or dialogue* or mixed method* or mixed methods design or mixed methods research).ti,ab. 1162758
10 8 or 9 1172366
11 3 and 6 and 7 and 10 350
Appendix 5: Search Strategy for EMBASE
Search Term Search Strategy Results
1 exp telemedicine/or exp telehealth/ 59123
2 (telehealth or telemedicine or telemonitoring or telepractice or telenursing or telecare or ehealth or e-health or mobile health or mhealth or m-health or (digital adj2 health*)).ti,ab. 42090
3 1 or 2 72570
4 exp primary medical care/or exp general practice/or exp primary health care/ 246958
5 (primary care or primary health* or primary healthcare* or family practi* or community care or general practi* or generalist*).mp. 445436
6 4 or 5 466068
7 ((patient* or user* or client* or individual* or people* or public*) adj4 (perception* or attitude* or opinion* or experience* or view* or reflection* or belief* or impact* or influence* or expect* or perspective*)).mp. 724770
8 exp qualitative research/ 89493
9 (qualitative research or qualitative study or qualitative methods or interview or focus group* or survey* or ethnographic or phenomenological or case study or dialogue* or mixed method* or mixed methods design or mixed methods research).ti,ab. 1474902
10 8 or 9 1488624
11 3 and 6 and 7 and 10 496
Appendix 6: Search Strategy for CINAHL
Search Term Search Strategy Results
S1 (MH “Telemedicine+”) or (MH “Telehealth+”) 28292
S2 TI (telehealth or telemedicine or telemonitoring or telepractice or telenursing or telecare or ehealth or e-health or mobile health or mhealth or m-health or (digital N2 health*)) 14112
S3 AB (telehealth or telemedicine or telemonitoring or telepractice or telenursing or telecare or ehealth or e-health or mobile health or mhealth or m-health or (digital N2 health*)) 15032
S4 S1 OR S2 OR S3 37847
S5 (MH “Primary Health Care”) or (MH “Family Practice”) 88592
S6 (primary care or primary health* or primary healthcare* or family practi* or community care or general practi* or generalist*) 195717
S7 S5 OR S6 195717
S8 ((patient* or user* or client* or individual* or people* or public*) N4 (perception* or attitude* or opinion* or experience* or view* or reflection* or belief* or impact* or influence* or expect* or perspective*)) 913309
S9 (MH “Qualitative Studies+”) 157993
S10 TI (qualitative research or qualitative study or qualitative me thods or interview* or focus group* or survey* or ethnographic or phenomenological or case study or dialogue* or mixed method* or mixed methods design or mixed methods research) 156503
S11 AB (qualitative research or qualitative study or qualitative metho ds or interview* or focus group* or survey* or ethnographic or phenomenological or case study or dialogue* or mixed method* or mixed methods design or mixed methods research) 589376
S12 S9 OR S10 OR S11 709121
S13 S4 AND S7 AND S8 AND S12 569
Appendix 7: Search Strategy for CENTRAL
Search Term Search Strategy Results
#1 MeSH descriptor: [Telemedicine] explode all trees 2796
#2 ((telehealth or telemedicine or telemonitoring or telepractice or telenursing or telecare or ehealth or e-health or mobile health or mhealth or m-health or (digital NEAR/2 health*))):ti,ab,kw 12358
#3 #1 or #2 12719
#4 MeSH descriptor: [Primary Health Care] explode all trees 7550
#5 MeSH descriptor: [General Practice] explode all trees 2433
#6 MeSH descriptor: [Family Practice] explode all trees 1960
#7 ((primary care or primary health* or primary healthcare* or family practi* or community care or general practi* or generalist*)):ti,ab,kw 181135
#8 #4 or #5 or #6 or #7 182990
#9 ((patient* or user* or client* or individual* or people* or public*) NEAR/4 (perception* or attitude* or opinion* or experience* or view* or reflection* or belief* or impact* or influence* or expect* or perspective*)):ti,ab,kw 58916
#10 MeSH descriptor: [Qualitative Research] explode all trees 1138
#11 (qualitative research or qualitative study or qualitative methods or interview* or focus group* or survey* or ethnographic or phenomenological or case study or dialogue* or mixed method* or mixed methods design or mixed methods research):ti,ab,kw 180109
#12 #10 or #11 180109
#13 #3 and #8 and #9 and #12 413
Appendix 8: Data Items for Data Extraction
Data Extraction Field Information Extracted
Study Details and Context Title; Research question; Aims; Dates and timings; Country and area of study; Rationale; Ethical standards; Type of publication; Source of funding
Participants Description of participants; Number of participants; Age; Gender; Other participant characteristics (e.g., ethnicity, SES)
Intervention Type of telemedicine being studied
Study design and methods Study setting; Sampling approach; Data collection methods; Data analysis approach
Findings Key themes and relevant data extracts; Author explanations of the key themes; Recommendations made by authors; Opinions of the author; Implications of findings for policy and practice; Generalizability of findings; Conclusions
Other Strengths of the study; Limitations of the study
Appendix 9: Excluded Studies
Study ID Reason for Exclusion
Atherton et al., 201371 Patient and physicians’ perceptions and experiences are not reported separately. Consequently, the findings for only patients cannot be assessed and as this review is only focused on patient perceptions and experiences the study is excluded.
Bulik, 200872 Patient and physicians’ perceptions and experiences are not reported separately. Consequently, the findings for only patients cannot be assessed and as this review is only focused on patient perceptions and experiences the study is excluded.
Chang et al., 201773 Patient and physicians’ perceptions and experiences are not reported separately. Consequently, the findings for only patients cannot be assessed and as this review is only focused on patient perceptions and experiences the study is excluded.
Donaghy et al., 201974 Patient and physicians’ perceptions and experiences are not reported separately. Consequently, the findings for only patients cannot be assessed and as this review is only focused on patient perceptions and experiences the study is excluded.
Hiratsuka et al., 201375 Patient and physicians’ perceptions and experiences are not reported separately. Consequently, the findings for only patients cannot be assessed and as this review is only focused on patient perceptions and experiences the study is excluded.
Leng et al., 201676 The qualitative analysis is very minimal, and no themes are developed from the qualitative part of the study. Therefore, the study is excluded as the qualitative research is minimal and the findings cannot be used in this review.
Mangin et al., 201977 The qualitative analysis is very minimal and is only two sentences long. Therefore, the study is excluded as the qualitative research is minimal and there is a clear and significant imbalance in the weighting of the quantitative and qualitative parts of the study.
McKinstry et al., 200978 Patient and physicians’ perceptions and experiences are not reported separately. Consequently, the findings for only patients cannot be assessed and as this review is only focused on patient perceptions and experiences the study is excluded.
Peeters et al., 201633 The qualitative analysis for patient perceptions and experiences is minimal and only consists of a short paragraph at the end of the results section. Therefore, the study is excluded as the qualitative research is minimal and there is a clear and significant imbalance in the weighting of the quantitative and qualitative parts of the study.
Radhakrishnan et al., 201679 The study was only focused on telemonitoring and thus was excluded for the review.
Zanaboni and Fagerlund, 202080 The qualitative analysis for telemedicine consultations is minimal and findings are not relevant for the review. Therefore, the study was excluded.
Potentially Relevant Studies
Cernadas Ramos et al., 202081 An English translation of the full text could not be found.
Kung et al., 201682 Full text version could not be found.
Appendix 10: Detailed Quality Assessment Results
CASP Checklist Questions Ball et al., 201858 Bleyel et al., 202034 Eccles et al., 201963 Gabrielsson-Järhult et al., 202159 Holmström et al., 201660
1. Was there a clear statement of the aims of the research?
What was the goal of the research Yes Yes Yes Yes Yes
Why it was thought important Yes Yes Yes Yes Yes
Its relevance Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes
2. Is a qualitative methodology appropriate?
If the research seeks to interpret or illuminate the actions and/or subjective experiences of research participants Yes Yes Yes Yes Yes
Is qualitative research the right methodology for addressing the research goal Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes
3. Was the research design appropriate to address the aims of the research?
If the researcher has justified the research design Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes
4. Was the recruitment strategy appropriate to the aims of the research?
If the researcher has explained how the participants were selected Yes Yes Yes Yes Yes
If they explained why the participants they selected were the most appropriate to provide access to the type of knowledge sought by the study Yes Yes No Yes Yes
If there are any discussions around recruitment Yes Yes No Yes No
Overall (reviewer's decision) Yes Yes No Yes Yes
5. Was the data collected in a way that addressed the research issue?
If the setting for the data collection was justified Yes Cannot tell Yes Cannot tell Yes
If it is clear how data were collected Yes Yes Yes Yes Yes
If the researcher has justified the methods chosen Yes Yes No Yes Yes
If the researcher has made the methods explicit Yes Yes Yes Yes Yes
If methods were modified during the study. If so, has the researcher explained how and why Cannot tell Yes Cannot tell Cannot tell Yes
If the form of data is clear Yes Yes Yes Yes Yes
If the researcher has discussed saturation of data No Yes No No No
Overall (reviewer's decision) Yes Yes No Yes Yes
6. Has the relationship between researcher and participants been adequately considered?
If the researcher critically examined their own role, potential bias and influence during (a) formulation of the research questions (b) data collection, including sample recruitment and choice of location No Yes No No No
How the researcher responded to events during the study and whether they considered the implications of any changes in the research design Cannot tell Cannot tell Cannot tell Cannot tell Cannot tell
Overall (reviewer's decision) Cannot tell Yes Cannot tell Cannot tell Cannot tell
7. Have ethical issues been taken into consideration?
If there are sufficient details of how the research was explained to participants for the reader to assess whether ethical standards were maintained Yes Yes Yes Yes Yes
If the researcher has discussed issues raised by the study No No No No No
If approval has been sought from the ethics committee Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes
8. Was the data analysis sufficiently rigorous?
If there is an in-depth description of the analysis process Yes Yes Yes Yes Yes
If thematic analysis is used. If so, is it clear how the categories/themes were derived from the data Yes Yes Yes Yes Yes
Whether the researcher explains how the data presented were selected from the original sample to demonstrate the analysis process No Yes No No Yes
If sufficient data are presented to support the findings Yes Yes Yes Yes Yes
To what extent contradictory data are taken into account Yes Yes Yes Yes Yes
Whether the researcher critically examined their own role, potential bias and influence during analysis and selection of data for presentation No Yes No No No
Overall (reviewer's decision) Yes Yes Yes Yes Yes
9. Is there a clear statement of findings?
If the findings are explicit Yes Yes Yes Yes Yes
If there is adequate discussion of the evidence both for and against the researcher's arguments Yes Yes Yes Yes Yes
If the researcher has discussed the credibility of their findings Yes Yes Yes Yes Yes
If the findings are discussed in relation to the original research question Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes
10. How valuable is the research?
If the researcher discusses the contribution the study makes to existing knowledge or understanding Yes Yes Yes Yes Yes
If they identify new areas where research is necessary Yes Yes Yes Yes Yes
If the researchers have discussed whether or how the findings can be transferred to other populations or considered other ways the research may be used Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes
Overall Quality Score
Overall Quality Score (reviewer's decision) Good quality Good quality Moderate quality Good quality Good quality
CASP Checklist Questions Imlach et al., 202035 Javanparast et al., 202164 Lindberg et al., 202161 Nymberg et al., 201952 Powell et al., 201736
1. Was there a clear statement of the aims of the research?
What was the goal of the research Yes Yes Yes Yes Yes
Why it was thought important Yes Yes Yes Yes Yes
Its relevance Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes
2. Is a qualitative methodology appropriate?
If the research seeks to interpret or illuminate the actions and/or subjective experiences of research participants Yes Yes Yes Yes Yes
Is qualitative research the right methodology for addressing the research goal Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes
3. Was the research design appropriate to address the aims of the research?
If the researcher has justified the research design Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes
4. Was the recruitment strategy appropriate to the aims of the research?
If the researcher has explained how the participants were selected Yes Yes Yes Yes Yes
If they explained why the participants they selected were the most appropriate to provide access to the type of knowledge sought by the study Yes No Yes Yes Yes
If there are any discussions around recruitment Yes No Yes Yes No
Overall (reviewer's decision) Yes Yes Yes Yes Yes
5. Was the data collected in a way that addressed the research issue?
If the setting for the data collection was justified Yes Cannot tell Yes Yes Cannot tell
If it is clear how data were collected Yes Yes Yes Yes Yes
If the researcher has justified the methods chosen Yes Yes Yes Yes Yes
If the researcher has made the methods explicit Yes Yes No Yes Yes
If methods were modified during the study. If so, has the researcher explained how and why Cannot tell Cannot tell Cannot tell Cannot tell Cannot tell
If the form of data is clear Yes Yes Yes Yes Yes
If the researcher has discussed saturation of data No No No No No
Overall (reviewer's decision) Yes Yes Yes Yes Yes
6. Has the relationship between researcher and participants been adequately considered?
If the researcher critically examined their own role, potential bias and influence during (a) formulation of the research questions (b) data collection, including sample recruitment and choice of location No No No Yes Yes
How the researcher responded to events during the study and whether they considered the implications of any changes in the research design Cannot tell Cannot tell Cannot tell Cannot tell Cannot tell
Overall (reviewer's decision) Cannot tell Cannot tell Cannot tell Yes Yes
7. Have ethical issues been taken into consideration?
If there are sufficient details of how the research was explained to participants for the reader to assess whether ethical standards were maintained Yes Yes Yes Yes Yes
If the researcher has discussed issues raised by the study No No No No No
If approval has been sought from the ethics committee Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes Yes
8. Was the data analysis sufficiently rigorous?
If there is an in-depth description of the analysis process Yes Yes Yes Yes Yes
If thematic analysis is used. If so, is it clear how the categories/themes were derived from the data Yes Yes Yes Yes Yes
Whether the researcher explains how the data presented were selected from the original sample to demonstrate the analysis process No No No Yes No
If sufficient data are presented to support the findings Yes Yes Yes Yes Yes
To what extent contradictory data are taken into account Yes Yes Yes Yes Yes
Whether the researcher critically examined their own role, potential bias and influence during analysis and selection of data for presentation No No No Yes No
Overall (reviewer's decision) Yes Cannot tell Yes Yes Yes
9. Is there a clear statement of findings?
If the findings are explicit Yes Yes Yes Yes Yes
If there is adequate discussion of the evidence both for and against the researcher's arguments Yes Yes Yes Yes Yes
If the researcher has discussed the credibility of their findings Yes No Yes Yes Yes
If the findings are discussed in relation to the original research question Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes
10. How valuable is the research?
If the researcher discusses the contribution the study makes to existing knowledge or understanding Yes Yes Yes Yes Yes
If they identify new areas where research is necessary Yes Yes Yes Yes Yes
If the researchers have discussed whether or how the findings can be transferred to other populations or considered other ways the research may be used Yes Yes Yes Yes Yes
Overall (reviewer's decision) Yes Yes Yes Yes Yes
Overall Quality Score
Overall Quality Score (reviewer's decision) Good quality Moderate quality Good quality Good quality Good quality
Appendix 11: Existing Themes from Included Studies
Ball et al., 201858
Impact on initial contact with the practice
Responsiveness of the practice to patient needs
Implications for equitable/fairaccess to care
Ease and convenience of access to care
Differences in the nature of GP consultations: efficiency, communication and social contact
Effects on continuity of care
Implications for patient safety
Concerns regarding confidentiality
The importance of understanding the purpose of the approach and how it works
Assessing the overall acceptability of the approach
Bleyel et al., 202034
Participants’ Anticipated Benefits Shorter Waiting Times
Shorter Travel Distances
Lower Threshold for Seeking Specialist Mental Health Care
Familiar Primary Care Environment
Anticipated Barriers Lack of Face-to-Face Contact
Technical Challenges
Organizational Challenges
Stigma of Seeking Mental Health Care
Prerequisites for Interacting With Providers in Video Consultations
Eccles et al., 201963
Nature of a remote contact
Quality of communication
Perceived appropriateness
Demand and the role of online triage
Gabrielsson-Järhult et al., 202159
Theme 1: meeting health care needs through accessibility
Theme 2: users’ competent choices
Theme 3: users’ satisfaction with telemedicine consultations
Holmström et al., 201660
Patient-friendly aspects of the telephone advice nursing Being the centerofattention
Supportive communication
Feelings of trust and confidence
Patient-unfriendly aspects of the telephone advice nursing Access to help
Uncertainty surrounding the technique
Unsupportive or disconfirming communication
Feeling forlorn and having a need for follow-up
Imlach et al., 202035
Convenience
Need to be seen in-person
Relationships
Technological barriers
Views on value
Patient preferences
Javanparast et al., 202164
Access to general practice services and management of health conditions
Experience of telehealth services
Opportunity for face-to-face consultations
Continuation of telehealth services
Lindberg et al., 202161
The importance of in-person caring relations
The importance of patient–nurse caring relations
Multi-directional caring relations in eHealth
Nymberg etal., 201962
E-health – a solution for a non-existing Do not fix what is not broken
Problems today that e-health might solve
Importance of accessibility to physician regardless of contact way
Elderly's experiences of e-health Positive experience and knowledge about digital tools
Lack of experiences and knowledge
Unmet expectations of e-health
Dislike of text messages for health monitoring and life style advices
Lack of will, skills, self-trust or mistrust in the new technology Mistrust in knowledge and know how about technology in elderly
Too high knowledge demands on elderly
Insecurity and fear with technology in today's system
The ageing body as a barrier
Lack of interest for digital tools and aversion to technology
Organizational barriers Lack of IT competence in health care organizations
Who is responsible when IT systems fail?
Poor communication between health care organizations' IT systems
Disappointment over poor IT systems
Mistrust in e-health from health care organizations
Wanting and needing to move forward Cannot stop development
Curiosity and interest for digital tools and technical solutions
Need for help and information concerning e-health
To learn on older days
Concerns to be addressed for making e-health a good solution Lack of triage with online booking
Accessibility, costs, and other risks with e-health
Lack of time for physicians despite e-health
Insecurity with e-health in emergency situations
Potential advantages with e-health versus ordinary health care Better access with video consultations
Practical and safe with a comprehensive drug list in the mobile
E-health a future way to reduce bureaucracy, demands and time
Online booking as a complement
Advantages of digital tools for some
Need for speed, access and correct comprehensive information Expectations of higher accessibility with e-health
Need for fast e-health accessibility in emergency situations
Importance of trustworthy information online
Expectations of lab results online
Need for comprehensive drug list
Need for digital consultation in certain situations
Powell et al., 201736
Technological Aspects of the Experience
Perceptions of Video Visits
Comparisons of Office-Based and Video Visits
Future Use
Appendix 12: Summary of Identified Themes and Contributing Studies
Potential Benefits of Telemedicine Consultations Potential Barriers to Telemedicine Consultations
Sub-theme Studies Sub-theme Studies
Accessibility Ball et al., 2018 58
Bleyel et al., 2020 34
Gabrielsson-Järhult et al., 2021,59
Holmström et al., 201660
Imlach et al., 202035
Javanparast et al., 202164
Lindberg et al., 202161
Nymberg et al., 201962
Powell et al., 201736
Lack of face-to-face and physical interaction Ball et al., 2018 58
Bleyel et al., 202034
Eccles et al., 201963
Gabrielsson-Järhult et al., 202159
Holmström et al., 201660
Imlach et al., 202035
Javanparast et al., 202164
Lindberg et al., 202161
Powell et al., 2017 36
Equitable/Fair access Ball et al., 201858
Eccles et al.,201963
Powell et al., 201736
Impersonal consultations Ball et al., 201858
Bleyel et al., 202034
Gabrielsson-Järhult et al., 202159
Holmström et al., 201660
Imlach et al., 202035
Javanparast et al., 202164
Powell et al., 201736
Convenience Ball et al., 201858
Bleyel et al., 202034
Eccles et al., 201963
Gabrielsson-Järhult et al., 202159
Imlach et al., 202035
Javanparast et al., 202164
Powell et al., 201736
Difficulties with communication Ball et al., 201858
Eccles et al., 201963
Gabrielsson-Järhult et al., 202159
Holmström et al., 201660
Imlach et al., 202035
Improved efficiency Ball et al., 201858
Eccles et al., 201963
Gabrielsson-Järhult et al., 202159
Imlach et al., 202035
Powell et al., 201736
Technological concerns Bleyel et al., 202034
Eccles et al., 201963
Holmström et al., 201660
Imlach et al., 202035
Nymberg et al., 201962
Powell et al., 201736
Lower threshold for seeking care Bleyel et al., 202034
Eccles et al., 201963
Gabrielsson-Järhult et al., 202159
Javanparast et al., 202164
Confidentiality/Privacy concerns Ball et al., 201858
Imlach et al., 202035
Powell et al., 201736
Improved care for minor conditions or adjuvant to care Gabrielsson-Järhult et al., 202159
Imlach et al., 202035
Javanparast et al., 202164
Lindberg et al., 202161
Nymberg et al., 201962
Powell et al., 201736
Concern of being overlooked Ball et al., 201858
Eccles et al., 201963
Gabrielsson-Järhult et al., 202159
Holmström et al., 201660
Difficulties with the uncertainty of consultation timings Ball et al., 201858
Eccles et al., 201963
Beneficial Prerequisites for Telemedicine Consultations
Sub-theme Studies Sub-theme Studies
Continuity of care Ball et al., 201858
Bleyel et al., 202034
Imlach et al., 202035
Javanparast et al., 202164
Lindberg et al., 202161
Powell et al., 201736
Provide support Imlach et al., 202035
Lindberg et al., 202161
Nymberg et al., 201962
Clear process Ball et al., 201858
Nymberg et al., 201962

Jack Allen, 1 Master of Public Health (MPH) and Final-year Medical Student. University of Sheffield, Sheffield, UK.

About the Author: Jack Allen is a fifth-year medical student at the University of Sheffield Medical School, Sheffield, England. In between third and fourth year of medical school he completed a Masters in Public Health (Management and Leadership) being awarded a distinction and this research was produced as part of his masters dissertation.

Correspondence: Jack Allen. Address: University of Sheffield, Beech Hill Rd, Broomhall, Sheffield S10 2RX, UK. Email: jtallen1@sheffield.ac.uk

Editor: Vincent Kipkorir Student Editors: Leah Komer, Duha Shellah, & Moez Bashir. Copyeditor: Madeleine J. Cox Proofreader: Madeleine J. Cox Layout Editor: Ana Maria Morales Process: Peer-reviewed

Cite as: Allen J. Exploring Adults Patients' Perceptions and Experiences of Telemedicine Consultations in Primary Care: A Qualitative Systematic Review. Int J Med Stud. 2022 Jul-Sep;10(3):288-315.


Copyright © 2022 Jack Allen

This work is licensed under a Creative Commons Attribution 4.0 International License.



International Journal of Medical Students, VOLUME 10, NUMBER 3, August 2022