{'fraction_non_alphanumeric': 0.034336917562724015, 'fraction_numerical': 0.01043010752688172, 'mean_word_length': 5.144241356529399, 'pattern_counts': {'":': 0, '<': 0, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
Primary care physicians’ educational needs and learning preferences in end of life care: A focus group study in the UK

Background Primary care physicians (General Practitioners (GPs)) play a pivotal role in providing end of life care (EoLC). However, many lack confidence in this area, and the quality of EoLC by GPs can be problematic. Evidence regarding educational needs, learning preferences and the acceptability of evaluation methods is needed to inform the development and testing of EoLC education. This study therefore aimed to explore GPs’ EoLC educational needs and preferences for learning and evaluation. Methods A qualitative focus group study was conducted with qualified GPs and GP trainees in the UK. Audio recordings were transcribed and analysed thematically. Expert review of the coding frame and dual coding of transcripts maximised rigour. Results Twenty-eight GPs (10 fully qualified, 18 trainees) participated in five focus groups. Four major themes emerged: (1) why education is needed, (2) perceived educational needs, (3) learning preferences, and (4) evaluation preferences. EoLC was perceived as emotionally and clinically challenging. Educational needs included: identifying patients for palliative care; responsibilities and teamwork; out-of-hours care; having difficult conversations; symptom management; non-malignant conditions; and paediatric palliative care. Participants preferred learning through experience, working alongside specialist palliative care staff, and discussion of real cases, to didactic methods and e-learning. 360° appraisals and behavioural assessment using videoing or simulated interactions were considered problematic. Self-assessment questionnaires and patient and family outcome measures were acceptable, if used and interpreted correctly. Conclusions GPs require education and support in EoLC, particularly the management of complex clinical care and counselling. GPs value mentoring, peer-support, and experiential learning alongside EoLC specialists over formal training.


Background
General Practitioners (GPs) and other community healthcare providers are vital to the delivery of end of life care (EoLC) internationally, assuming overall responsibility for direct patient care, providing generalist palliative care, ensuring co-ordination and communication with colleagues and social care providers, and preventing unnecessary hospital admissions [1][2][3][4]. In England, where the current study was conducted, GPs' responsibilities now include commissioning of services in local communities. Working in Clinical Commissioning Groups (CCGs) with other practices, GPs are key players in making the wider systemic changes required to improve EoLC [5] and help shift care from hospitals to the community, in line with patient wishes [6,7].
However, there is evidence that GPs encounter challenges in providing EoLC and that the quality of EoLC by GPs can be problematic [8][9][10][11]. A recent survey of bereaved relatives of 596 people who died of cancer in London, UK, found that GPs received significantly less favourable ratings than district, community or private nurses providing homecare and specialist palliative care providers, with 28.2% of GP care rated very poor, poor, or fair [12]. However, EoLC is a relatively small component of a GP's workload and staying abreast of developments in policy and practice presents challenges [11,[13][14][15]. Furthermore, training in EoLC for general practice has its limitations [15][16][17]. A systematic review of palliative care delivery by GPs found that many GPs feel ill-prepared and lack confidence in EoLC, despite being considered vital players in its delivery, and despite valuing this part of their work [9]. GPs reported feeling particularly challenged in managing patients' and family carers' psychological needs, pain and other symptoms. Policy guidance is right to recognise the urgent need for evidence-based education in EoLC for GPs [5,18].
The literature describes several GP training interventions. Yet their evidence base is often unclear and few have been rigorously evaluated [19]. Where training is based on evidence, it usually concerns the training and education GPs require [20], rather than their learning preferences [17,21]. In the UK, a pilot study of training and support materials (leaflets, postcards and posters) for GPs was conducted in 2011 by the Dying Matters Coalition [22]. However, of the 59 participants, only 25 attended a training workshop, and it is unclear how the content and format of the training were developed. While the Gold Standards Framework (GSF) team offers GP training on the use of the GSF as a set of guidelines, mechanisms and assessment tools, up to now evaluation has focused on categorical questions about the implementation of organisational and clinical processes, and self-rated assessments of quality associated with palliative care provision, rather than staff, patient or family outcomes [23,24]. No rigorous evaluations exist of GP EoLC training in the UK [18]. Outside the UK, evaluations of GP EoLC education have had mixed results, with a recent controlled trial of a palliative care training programme for GPs finding no significant effect on communication skills or patient outcomes [25,26].
To inform the development and evaluation of UK EoLC education for GPs, we aimed to explore their educational needs, preferred learning methods, and acceptable methods of evaluation.

Study design
Face-to-face semi-structured focus groups were conducted with trainee and qualified GPs.

Setting
Participants either worked at a CCG or were trainees completing their specialist training (ST1, ST2 and ST3 years; ST1 is the first year and ST3 the last) in a large UK city. Focus groups were held at convenient times and locations around existing events so as not to interfere with work or study schedules: one took place at a conference centre where an event on cancer care in primary care was being held, one at the research department in line with the schedules of interested participants, and three at a residential conference centre where an away day for trainee GPs was scheduled.

Sampling and recruitment
Inclusion criteria were: practicing as a GP or training to be a GP. Practicing GPs were recruited in two ways: advertisement in the electronic bulletin to the CCG mailing list, and in-person by the researchers at the event on cancer in primary care. Trainees were recruited in-person by the researchers during the away days. Maximum variation sampling aimed to capture diversity of age, years of experience, gender, and ethnicity. Data collection continued until data saturation was reached [27].

Data collection
Focus groups were facilitated by experienced researchers with academic backgrounds in palliative care and health psychology and an interest in the education of healthcare professions (LS or LB), following best practice [28]. Another researcher or research administrator (LB or LK) attended each focus group to take field notes on environmental factors and non-verbal behaviours during and immediately after each group. The researchers and administrator were not known by participants and introduced themselves as academic researchers unconnected to the CCG or their training programme. Guidelines including maintaining confidentiality, allowing all participants to speak and there being no right or wrong answers, were explained at the beginning of each focus group. The research was part of a wider study generating data to inform future training in palliative and EoLC and its evaluation. We defined EoLC broadly as care of patients with incurable, progressive and life-limiting disease, and palliative care as an holistic approach to EoLC in line with the World Health Organization definition [29]. The topic guide (Table 1) was based on gaps in the existing literature, and revised with input from the project team and lay advisory group (one patient with advanced disease and four family caregivers). To prompt discussion, during the focus groups participants were given handouts listing the topics covered in a current two-day training on palliative and EoLC held in a local hospital [30] (Table 2), and asked to reflect on which of these would be relevant or not for GPs. The focus groups were recorded, transcribed verbatim and anonymised. Participants also completed a brief demographics form.

Analysis
Transcripts and associated field notes were analysed within a minimal realist paradigm [31] using thematic analysis [32] to describe the data and explore emerging patterns. This process comprised five stages: (1) Familiarisation with the data and inductive coding of five transcripts to generate a draft coding frame (LB); (2) Refinement of the coding frame with input from academic and clinical members of the project team; (3) Application of the final coding frame to all data (LB); (4) Independent dual coding of a sample of two transcripts by academic and clinical team members to assess inter-rater reliability [33] and refine the coding frame (JK, VR); (5) Review of all coding and generation of a narrative summary, paying attention to deviant cases within each theme and differences between trainees and qualified GPs [34] (LS). Analysis was managed in QSR NVivo 10 [35].

Results
Data saturation was reached after five focus groups, totalling 28 participants. Mean length of the groups was 55 mins (range 35-82 mins). Participants comprised 18 trainees (8 ST1s, 3 ST2s, 7 ST3s) and 10 GPs (median years in practice 109, range 3-45). The majority were women (79%), with a median age of 32 (range 27-63) ( Table 3). Four themes related to the study aims: why education is needed, perceived educational needs, and preferences for learning and evaluation.

Why education is needed
All participants recognised the importance and relevance of EoLC: 'Generalists should be specialists in end of life care because we are the coordinators at the end.' (GP04). All except one participant believed there to be a need for more or better education in EoLC. The reasons given fell into four sub-themes: attrition of skills and the difficulty of keeping up to date; inadequate exposure to care of the dying during training and in clinical practice; a lack of confidence, and the complexity of EoLC. One GP felt that training was not the answer to improving EoLC: 'The training model is one that I would question, because I don't think we can train people to do these things. We can certainly help, help people develop. It's like training   [34,35] Helping patients achieve their preferred place of care Fast Track discharges [37] Understanding and managing common symptoms in dying patients Understanding spiritual and cultural aspects of dying

Having difficult conversations with patients and families
Understanding advance care planning and using Coordinate My Care [37] Understanding grief and providing support for family experiencing bereavement people in music or art or philosophy or something: it has to be inductive rather than structured… it's a matter of mentoring' (GP03).

Attrition of skills and difficulty of keeping up-to-date
Qualified GPs reported attrition in their symptom management skills, using drug charts and setting up syringe drivers: 'Unless you are doing it and getting experience prescribing and seeing patients you forget it instantly' (GP11). EoLC education received during GP specialisation, particularly regarding symptom management, was lost over time from lack of exposure and reliance on palliative care specialists or colleagues with a special interest in palliative care (e.g. Macmillan GP facilitators): 'You're trained to quite a high level. The difficulty is in real life… it's hard to maintain that, I would say particularly if you've got people that are very, very skilled like [Hospice] who take on a big burden of the palliative care… You end up doing less, so you become less skilled, particularly with things like medication use' (GP02).
Inadequate exposure to care of the dying Both established GPs and current trainees reported inadequate, inconsistent education in and exposure to EoLC during undergraduate training and GP specialisation. Palliative care education was described as 'opportunistic' , dependent on where and with whom you worked: 'If you happen to be rota'd onto a care of the elderly job, better for you, because you get to learn about it, but if you are not…' (GP14). This included ST3s soon to complete GP specialisation: 'I feel like I'd need a lot of support, so [EoLC]'s something that I need to try and get involved in before my training ends in three months' time. I don't feel that I'd be competent' (GP25). Amongst trainees, palliative care experience was more often gained in hospital placements than in the community ('In the GP placement, a lot of the palliative patients go to the partners who know the families' (GP25)), but this was inadequate: 'A hospital is completely different… you have the support of nursing staff and… a palliative care team at the hospital… In general practice you don't have as much support' (GP21).

Lack of confidence
Due to limited palliative care education and experience, there was a widespread lack of confidence in EoLC amongst both qualified and trainee GPs. This was reported to lead to hospital admissions ('send them into a hospital and they can work out if it is reversible or not' (GP08)) and poor symptom control: 'I have bottled it more than once and under-treated somebody's pain because I am scared of giving out that much morphine.' (GP12). Confidence was lacking in particular topics: providing out-of-hours care, symptom management, identifying patients at the end of life, initiating palliative care, and some aspects of communication (e.g. initiating discussions about palliative care and communicating with families). Experience of managing EoLC in the community increased confidence: '[My GP trainer and I] had… a handover session with a patient and then, after that, I saw her on my own, with support from my trainer if I needed it, and that worked really well… it made me feel confident.' (GP21), and this practical clinical experience was seen as invaluable: 'Current registrars have a full curriculum statement [on EoLC] devised by locals GPs… But I think it is the practical skills that you need.' (GP04).

The complexity of end of life care
However, both experienced and trainee GPs reported EoLC to be complex and challenging in itself ('When

Perceived educational needs
Education needs arose in nine sub-themes: identification and referral for palliative care; local services and resources; local systems and frameworks; roles, responsibilities and teamwork; out-of-hours care; difficult conversations and counselling skills; symptoms and medication; caring for patients with non-malignant conditions; and paediatric palliative care (

Learning preferences
Both qualified and trainee GPs considered real-life experience of EoLC the gold standard: 'No more lectures. No. We need experience' (GP07). Participants valued highly placements at hospices and opportunities to shadow, discuss cases with and share care with specialist palliative care staff: 'What I am astounded by is actually the benefit and the close working when it goes well with our community nurses and with our specialist palliative care. It is brilliant. Getting out and find the consultant there on a joint visit, you learn so much.' (GP08). Faceto-face mentorship was suggested as a way of providing knowledgeable advice and a source of peer support that was particularly needed in EoLC ("[someone] to turn to, to sort of say, 'that was quite rough'" (GP02)).
As time is at a premium, participants felt training in EoLC needed to be easily integrated into clinical practice, existing meetings and training events. Multidisciplinary teachers and co-learners were favoured. Learning preferences reflected the high value placed on real-life experience: participants were particularly keen to learn from palliative care specialists or experienced GP mentors, and felt that reflection on real case studies in training was more effective for learning than didactic methods ('give a real life situationwhat would you do, I thinkrather than the theory, just the theory.' (GP23)). A role for services users was also suggested: 'discussions with actual relatives who have gone through it… seeing what they felt was good, what they felt was bad.' (GP24). E-learning elicited mixed views. Trainees were used to online learning and understood its value in terms of cost-effectiveness and flexibility, but several reported that they found online learning difficult to absorb and retain: 'You feel like a real expert for the first six weeks after you do it and then you forget it.' (GP11). Done well, role plays could be effective and memorable; however, trainees seemed saturated with the technique by their third year: 'There is only so much you can get out of pretending to tell your friend they are dying and having somebody observe you do it. I think I stopped learning from that about a year ago.' (GP12).

Evaluation preferences
Participants questioned the accuracy of 360°appraisals in assessing quality of care: 'You pick the people… and they're probably people that you've had more interaction with'. (GP25). Participants felt that behavioural assessment using videoing was not acceptable unless it was required for a specific qualification. Several participants were averse to any form of behavioural evaluation: 'I personally avoid anything that's like a role-play where you're assessed. So, if there's like a simulation day, where I know you're going to be watched and assessed, I won't apply for it.' (GP24). Trainees also questioned the validity of simulated behavioural assessments as a way of evaluating communication skills, due to the ability to learn exam technique: GP 16: '[Simulations] probably wouldn't give you an accurate reflection of the course.' GP13: 'Actually, if we are getting into role play, you can learn how to tick the boxes quite easily.' [General sounds of agreement] GP13: 'We are masters at role play now.' Self-assessment questionnaires to test the effects of education on confidence and knowledge were considered of limited use, but respondents reported answering honestly and felt they were acceptable if not too lengthy or burdensome: "We're notoriously bad at knowing how good or bad we're probably doing in a consultation. So… saying, 'Yes, I feel more confident now, ' or, 'I think that I'm better now, ' I don't think we're the best judges of the actual ultimate outcome" (GP17). Most GPs were in favour of patient and family feedback if done sensitively, ('asking them about their experience, what could be done better, what do they feel was missing' (GP24)) but some felt this inappropriate: "Saying to a relative or a patient, 'How do you think your doctor did in treating you as you're dying?' is the last thing they want to be thinking about, this filling in a questionnaire." (GP20). Timing patient and family outcome measurement sensitively was considered important, as was the way in which data are collected: 'If it's a familiar face doing that that would be okay, but I think if it came in the post it could be quite upsetting, or probably the return rate would be quite low.' (GP02). GPs were aware of possible confounders in measuring the effects of education on patient and family outcomes, e.g. 'People who return those [questionnaires] are going to be either really hacked off with you or really impressed.' (GP16).

Discussion
This study is one of the first to examine the needs and preferences of GPs and GP trainees regarding education in EoLC and how its effectiveness might be evaluated. Previous studies in the UK have explored education needs amongst GPs conducting out-of-hours care [17], but not amongst GPs with different levels of training and experience. This study identifies unmet educational needs in EoLC: participants reported that skills erode and remaining up to date is difficult, exposure during 'Identifying which patients need to be highlighted and prioritising those patients… I don't think we really do that very well. I think they slip through the net quite easily.' (GP19) 'Whether everyone needs to be referred to palliative care, or if there are people that we can manage in the community without input, if we feel comfortable enough -I wouldn't know that decision. I would always refer, because… I'm not comfortable with any of the medications.' (GP30) Local services and resources "Practical things -what do you actually do, who do you actually phone up, who' s involved in that team… there must be… all kinds of services going on that we just don't know about… that would be useful, to see 'these are all the people, these are all the resources you potentially use and this is how you get hold of them.'" (GP02) Local systems and frameworks 'How does this system work in my locality? training is inadequate and inconsistent, and in clinical practice palliative care is complex and their confidence low. A key finding is that qualified GPs and trainee GPs valued mentoring, peer-support, and experiential learning alongside specialists in EoLC, over attending formal training. In terms of formal education, real case studies were valued more highly than didactic methods, and e-learning EoLC was not considered appropriate. Respondents emphasised that any formal education needed to be easily integrated into clinical practice and existing meetings. In terms of evaluation, participants felt 360°a ppraisals were inaccurate, and questioned both the validity of assessments using simulated interactions and the acceptability of behavioural assessment using video. Selfassessment questionnaires and patient and family outcome measures were largely considered acceptable and potentially useful, if used and interpreted correctly.
Our findings support other studies in highlighting the limitations of current end of life care education for GPs and their lack of confidence in this area [9,[15][16][17], as well as educational needs relating to out-of-hours care [17], symptom control [20,41,42], non-cancer diagnoses [17,20,43], and counselling [16,20]. Where we add to the evidence is in identifying the need for practice-based mentorship and/or apprenticeship models in education in end of life care. We also describe specific educational needs around the identification and referral of patients for palliative care; roles, responsibilities and teamworking; local services and systems; and in paediatric palliative care. Of note, participants in general felt they had had sufficient communication skills training, despite still finding conversations about dying to be difficult. Perhaps what is needed is not more communication skills training, but qualitatively different communication skills training.
As in a study by Pype et al. in Belgium [21], we found that practical experience, including workplace learning through collaboration with palliative care specialists, was highly valued as a way to learn skills. Our participants were unanimously positive about collaborating with and learning from palliative care specialists. This suggests improvements in this area since 1998, when a study found that GPs questioned the extent to which they should defer to the specialist palliative care team [43]. Our finding that GPs had reservations about learning EoLC in an online format, preferring face-to-face education, contradicts other studies. A survey of GPs (n = 203, 20.3% response rate) working for an independent provider of out-of-hours services in England found that e-learning was the preferred method (67.5%, n = 137) [17]. A randomised controlled trial in Spain [44,45] also found that primary care physicians were satisfied with an online palliative care education programme. However, that programme integrated mentoring, which GPs in the current study also valued. E-learning in this area warrants further research.
A strength of this study is the diverse sample: clinicians ranging from junior trainees to experienced GPs, good representation from both genders, and participants of diverse ethnicities. However, as participants were recruited in a major city our findings might not be directly transferable to non-urban areas or other countries, where access to education and educational needs will differ [20]. GPs who participated in this study may also have had a particular interest in EoLC, and GPs with less interest may report different needs and experiences. In particular, GPs who did not attend due to lack of interest or time constraints may have even greater unmet and unknown needs. Finally, although we identified and discussed differences in the views of experienced GPs and GP trainees, the study was not designed to compare these groups in detail; this would be an interesting area for future research.
The clinical implications of the study include an identified need to improve GP education over several domains, primarily through implementing service models and interventions that provide access to experiential learning, mentorship and joint working with specialist palliative care providers. This may require a paradigm shift away from thinking of formal training as the best way to educate healthcare professionals, particularly in EoLC, which can be both personally difficult and clinically complex. Our findings suggest that formal education which is not supported and enhanced by real-life experience, resources and mentoring may be insufficient to bring about sustainable improvements in EoLC in primary care and a potential waste of resource. While this study was conducted in the UK, we suspect the need for experiential learning and mentorship in end of life care education is more widely applicable internationally. For example, we believe the standard education for physicians in the United States, the Education in Palliative and End-of-Life Care programme, does not currently use mentored real-life clinical situations to teach physicians in practice and in training how to provide EoLC. Further research is needed to adapt and evaluate service models and interventions to improve EoLC in primary care in local settings [46,47] to identify best practice in GPs' education and support. In the UK, Macmillan GP facilitators funded since 2011 could play an important role in supporting primary care staff and enhancing education.
With the caveat that formal education must be implemented alongside systemic changes, this study also provides guidance for the formal education of GPs in EoLC. In the UK, the RCGP Palliative and End of Life Care Toolkit [48] to support GPs' provision of EoLC could be enhanced to include a more comprehensive, searchable database of training available to GPs and associated evidence. A current interdisciplinary course (Transforming EoLC) that is run for a variety of EoLC providers [30] incorporates some of the topics identified here. The course is highly evaluated and further research into its effectiveness warranted [30]. However, four topics are not covered in the generic course: identifying and referring patients for palliative care; out-of-hours care; caring for patients with non-malignant conditions; and paediatric palliative care. These topics may be of specific relevance in developing stand-alone education on EoLC for GPs. It is essential that any education rolled out for GPs is evidence-based and evaluated for effectiveness.

Conclusions
GPs require education and support in EoLC, particularly the management of complex clinical care and counselling. GPs value mentoring, peer-support, and experiential learning alongside EoLC specialists over formal training. Findings from this study can help inform EoLC educational and support interventions for GPs and guide the evaluation of such interventions.