{'fraction_non_alphanumeric': 0.032244556113902846, 'fraction_numerical': 0.019861210815984687, 'mean_word_length': 5.437042741624952, 'pattern_counts': {'":': 0, '<': 1, '<?xml version=': 0, '>': 1, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Using Telehealth to Deliver Primary Care to Adolescents During and After the COVID-19 Pandemic: National Survey Study of US Primary Care Professionals

Background The COVID-19 pandemic has led to unprecedented use of telehealth, including by primary care professionals (PCPs) who serve adolescents. Objective To inform future practice and policies, we sought to characterize PCPs’ recent experience using adolescent telehealth as well as their support for it after the COVID-19 pandemic is over. Methods From February to March 2021, we conducted a web-based survey of 1047 PCPs in the United States. Our national sample included physicians (747/1047, 71%), advanced practice providers (177/1047, 17%), and nurses (123/1047, 12%) who provided primary care to adolescents aged 11-17 years. Results Most PCPs reported using telehealth for a low, moderate, or high proportion of their adolescent patients in the three months prior to the survey (424/1047, 40%, 286/1047, 27%, and 219/1047, 21%, respectively); only 11% (118/1047) reported no use. A majority of respondents agreed that adolescent telehealth increases access to care (720/1047, 69%) and enables them to provide high-quality care (560/1047, 53%). Few believed that adolescent telehealth takes too much time (142/1047, 14%) or encourages health care overuse (157/1047, 15%). Most supported giving families the option of adolescent telehealth for primary care after the pandemic is over (683/1047, 65%) and believed that health insurance plans should continue to reimburse for telehealth visits (863/1047, 82%). Approximately two-thirds (702/1047, 67%) wanted to offer adolescent telehealth visits after the pandemic, with intentions being higher among those with recent telehealth experience (P<.001). Conclusions PCPs in our national sample reported widespread use of and predominantly positive attitudes toward adolescent telehealth. Our findings also suggest broad support among PCPs for continuing to offer adolescent telehealth after the COVID-19 pandemic ends.


Introduction
The COVID-19 pandemic has rapidly transformed health care delivery in the United States; for the first time, telehealth is playing a central role in the delivery of primary care for adolescents. Research conducted prior to the pandemic suggests that telehealth is a promising mode of delivering discrete types of health care for adolescents, including in the areas of mental health, asthma and diabetes management, and gender-affirming care [1][2][3][4]. A small body of research also documents the adolescent medicine community's impressive efforts to rapidly scale up telehealth programs in the first months of the pandemic [5][6][7]. However, to our knowledge, no published national studies have explored the experience of primary care professionals (PCPs) in delivering care to adolescents in the ensuing period, during which telehealth has presumably become a standard offering for many. To address this gap, we surveyed a national sample of PCPs. Our aims were to characterize PCPs' recent adolescent telehealth use and attitudes as well as their support for continuing to offer adolescent telehealth after the COVID-19 pandemic is over.

Participants and Procedures
We conducted a web-based survey of PCPs from February to March 2021. We contracted with a survey research company to administer the survey, which we developed, to a standing national panel. The company maintained the panel using a combination of recruitment methods, including web-based registration, referrals, marketing emails, and digital advertisements. As part of the recruitment process, physicians provided licensure information used to verify their identity. For our survey, eligible panel members were US physicians, advanced practitioners (ie, nurse practitioners and physician assistants), and nurses who provided primary care, including vaccinations, to adolescents aged 11-17 years. In compliance with state policies governing PCPs' survey participation, our sample excluded residents of Vermont.
The survey company emailed invitations and up to two reminders to panel members. A total of 1055 panel members responded by accessing the survey. The response rate was 61% among physicians and 41% among advanced practitioners and nurses (American Association for Public Opinion Research response rate 4) [8]. Participants provided informed consent and received up to US $80 for their participation, depending on market rates in their area. Based on survey responses, we excluded 8 PCPs who indicated that they saw no adolescent patients in a typical week, resulting in a final sample size of 1047 participants. The University of North Carolina Institutional Review Board approved the study protocol.

Measures
Our survey began with an introductory statement that defined adolescent telehealth as visits by videoconference or telephone for patients aged 11-17 years. The survey next assessed the extent of PCPs' recent telehealth use with a closed-ended question on the proportion of adolescent patients they saw by telehealth in the 3 months prior to the survey; we recategorized responses as high (51%-75%, 76%-99%, and 100%), moderate (26%-50%), low (1%-25%), or no (0%) use. Among PCPs with any (>0%) use, the survey used 6 closed-ended items to assess telehealth practice. Of these items, 4 used pre-specified lists to assess the type of care provided, perceived advantages, perceived disadvantages, and technological barriers. One item assessed which vaccines PCPs always recommended during telehealth visits for adolescents who were due: seasonal influenza; human papillomavirus (HPV); tetanus, diphtheria, and acellular pertussis (Tdap); and meningococcal ACWY. One item assessed how often PCPs requested confidential time to speak with adolescents during telehealth visits.
Our survey assessed PCPs' perceptions of adolescent telehealth with 7 closed-ended questions that used 5-point response scales, ranging from "strongly disagree" (1) to "strongly agree" (5). Of these items, 4 assessed PCPs' attitudes on whether adolescent telehealth increases access to care, is a way they can provide high-quality care, takes too much time, or encourages health care overuse. A total of 2 items assessed PCPs' support for adolescent telehealth after the COVID-19 pandemic is over in terms of whether families should still have the option to use telehealth for primary care visits and whether health insurance plans should continue to reimburse for visits. One item assessed PCPs' intentions in terms of whether they wanted to offer adolescent telehealth visits once the pandemic is over. For all 7 items, we recategorized responses as disagree ("somewhat" or "strongly"), neither agree or disagree, or agree ("somewhat" or "strongly").
Our survey assessed PCPs' demographic and professional characteristics, including their training, gender, race, number of years in practice, and number of adolescent patients seen in a typical week ( Table 1). The survey also assessed characteristics of the clinics in which the PCPs worked. These measures included clinic specialty (family medicine or pediatrics), practice type (solo/group vs other), whether the clinic was part of a health care system or network, the rurality of the area the clinic served, the US census region in which the clinic was located, and the extent to which the clinic experienced financial strain due to the COVID-19 pandemic. b Includes neither woman nor man, prefer to self-describe, and prefer not to say. c Includes hospital-and university-affiliated clinics, Federally Qualified Health Centers, and community, public health, and nonprofit clinics.

Statistical Analysis
We used Pearson chi-square tests to compare the proportions of PCPs who indicated that they always recommended the seasonal influenza vaccine versus each of the other vaccines (HPV, Tdap, meningococcal) during adolescent telehealth visits. We compared the number of advantages and disadvantages that PCPs endorsed for adolescent telehealth using a Wilcoxon signed-rank test. We used bivariate logistic regression to identify correlates of PCPs' intentions to offer adolescent telehealth visits once the COVID-19 pandemic is over, modeling the outcome as yes ("agree") versus no ("neither agree or disagree" and "disagree"). We then simultaneously entered statistically significant correlates into a multivariable model. We conducted analyses using Stata, version 15.1 (StataCorp LLC). Statistical tests were two-tailed with a critical alpha of .05.

Telehealth Attitudes and Postpandemic Support
Most PCPs reported positive attitudes toward adolescent telehealth. A majority agreed that telehealth increased access to care for adolescents (720/1047, 69%) and was a way they could provide high-quality care (560/1047, 53%, Figure 2). Few agreed that telehealth took too much time (142/1047, 14%) or encouraged families to overuse health care for adolescents (157/1047, 15%).
Most PCPs indicated support for adolescent telehealth after the COVID-19 pandemic is over (Figure 2). Approximately two-thirds (683/1047, 65%) agreed that families should continue to have the option of telehealth for adolescent primary care visits. Approximately four-fifths (863/1047, 82%) agreed that health insurance plans should continue to reimburse for telehealth visits.

Principal Findings
The findings of our national study suggest that adolescent telehealth has achieved widespread adoption in the year since the COVID-19 pandemic began, with most PCPs in our national study reporting that they used adolescent telehealth and wanted to keep using it. The vast majority (89%) of PCPs reported using telehealth to see adolescents in the prior 3 months, including for chronic disease management, acute care, and mental health. This level of adoption is far higher than that reported in prepandemic studies, which found that very few pediatricians or family physicians were using telehealth to deliver care (13% and 15%, respectively) [9,10]. On average, the PCPs in our sample reported that adolescent telehealth offered more advantages than disadvantages, with advantages including increased access to care and reduced time and transportation burdens for families. The most commonly noted disadvantages were the inability to perform physical examinations and technology problems. Despite these limitations, PCPs indicated broad support for adolescent telehealth after the pandemic is over, with approximately two-thirds wanting to offer such visits themselves. This support suggests a pressing need to build on the strengths, address the challenges, and evaluate the quality of adolescent telehealth to ensure it remains a viable option for primary care delivery in the postpandemic era.
Our study provides novel data on two potential challenges for the delivery of adolescent telehealth: vaccine communication and privacy. With regard to vaccine communication, we found that the proportion of PCPs reporting that they "always" recommended vaccines during adolescent telehealth visits was high for seasonal influenza vaccine, perhaps in response to concerns about an influenza-COVID-19 "twindemic." Consistent recommendations were less common for HPV, Tdap, and meningococcal vaccines. In the case of the HPV vaccine, prepandemic studies that used similar measures in the context of traditional primary care documented levels of recommendation consistency that are comparable to or lower than what we observed [11][12][13]. Although such points of comparison are not available for other adolescent vaccines, our findings suggest that many PCPs are including vaccine counseling in adolescent telehealth visits, and these data can inform interventions to support and further strengthen this communication. For example, PCPs may benefit from electronic health record prompts to remind them to recommend adolescent vaccines during telehealth visits and to counsel families about how to schedule those visits. This care coordination could help to ensure that adolescent telehealth complements rather than competes with the in-person care that is integral to the delivery of vaccinations and other routine preventive health services for adolescents [14].
Consistent with prior studies [5,6], our findings suggest that privacy constitutes an important consideration but may not be a primary barrier to the delivery of adolescent telehealth. Among the PCPs in our sample with recent experience, only approximately one-quarter perceived a lack of privacy as a disadvantage of adolescent telehealth. At the same time, however, only approximately one-quarter routinely offered adolescents confidential time during telehealth visits. Despite being a recommended practice, confidential time is also inconsistently offered during in-person visits [15,16]; therefore, this low level of guideline adherence is perhaps unsurprising. Nevertheless, PCPs may have the opportunity to strengthen their telehealth practice by more consistently offering confidential time and by counseling adolescents to take steps that may help protect their privacy, such as using earphones [5,7,17].
Our study can inform future policy making by documenting PCPs' support for offering adolescent telehealth after the COVID-19 pandemic is over. Telehealth adoption during the pandemic has been possible due to expanded payer reimbursement, which prepandemic studies identified as the single largest barrier to bringing pediatric telehealth programs to scale [9,14,18]. Importantly, most PCPs in our sample believed that health insurance plans should continue to reimburse for adolescent telehealth after the pandemic is over. Furthermore, many PCPs believed that families should have the option of telehealth for adolescent primary care visits and wanted to offer telehealth visits themselves. Wanting to offer adolescent telehealth was more common among PCPs who had recently used it or who worked in the South or West regions of the United States, but it was less common among those serving rural areas. Future research can extend the present study by assessing factors, such as internet connectivity, that might explain these geographic differences.

Strengths and Limitations
This study is, to our knowledge, the first national evaluation of PCPs' experience using adolescent telehealth in the context of the COVID-19 pandemic. Study strengths include the use of data from a large, national sample of PCPs, including physicians, advanced practitioners, and nurses. Although evaluating adolescent telehealth from the perspective of those who deliver it is a study strength, our use of self-reported measures also constitutes a limitation. For example, PCPs may have overestimated the consistency with which they recommended vaccines or offered confidential time during adolescent telehealth visits. Another limitation is the modest response rate among advanced practice providers and nurses. Including nonphysician participants was important for enriching our data with diverse perspectives, but additional research with larger sample sizes may be needed to more fully understand how adolescent telehealth practice and attitudes vary across clinical roles. We acknowledge that other perspectives and data sources are important for understanding the impact of adolescent telehealth. Most notably, PCPs in our sample perceived telehealth as expanding access to care and reducing burden on their patients, but future research is needed to understand the extent to which adolescents and their families experience telehealth as patient-centered and equitable. Finally, we note that our study examines telehealth broadly as including visits by video and telephone. PCPs' experience of adolescent telehealth may vary between these two delivery modes as well as by health system factors, such as the extent to which telehealth is integrated with electronic health record platforms and patient portals. Future research will be needed to understand the influence of these contextual factors.

Conclusion
One year into the COVID-19 pandemic, our national study finds that PCPs have widely adopted adolescent telehealth and endorse its continued use. In light of this endorsement, health care system leaders, payers, professional organizations, researchers, and other key stakeholders should redouble their efforts to support PCPs in adolescent telehealth delivery, including by further evaluating and fairly reimbursing such services. In this way, we can ensure that telehealth realizes its potential to increase health care access and to serve adolescents in a way that is effective, patient centered, and equitable.

Data Availability Statement
Deidentified individual participant data will not be made available.