Interventions to Reduce Adult Nursing Turnover: A Systematic Review of Systematic Reviews



Mary Halter1, *, Ferruccio Pelone2, Olga Boiko1, Carole Beighton1, Ruth Harris3, Julia Gale1, Stephen Gourlay4, Vari Drennan1
1 Faculty of Health, Social Care and Education, Kingston University and St George’s, University of London, London, England
2 National Guideline Alliance, Royal College of Obstetricians and Gynaecologists, London, England
3 Nursing & Midwifery, King's College London, England
4 Faculty of Business & Law, Kingston University, London, England


Article Metrics

CrossRef Citations:
0
Total Statistics:

Full-Text HTML Views: 2197
Abstract HTML Views: 809
PDF Downloads: 501
ePub Downloads: 325
Total Views/Downloads: 3832
Unique Statistics:

Full-Text HTML Views: 860
Abstract HTML Views: 463
PDF Downloads: 271
ePub Downloads: 122
Total Views/Downloads: 1716



© 2017 Halter et al.

open-access license: This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 International Public License (CC-BY 4.0), a copy of which is available at: https://creativecommons.org/licenses/by/4.0/legalcode. This license permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

* Address correspondence to this authors at the Faculty of Health, Social Care and Education Kingston University and St George’s, University of London, Cranmer Terrace, London, SW17 0RE; Tel: 00 44 (0)20 8725 0337; E-mail: maryhalter@sgul.kingston.ac.uk


Abstract

Background:

Nurse turnover is an issue of concern in health care systems internationally. Understanding which interventions are effective to reduce turnover rates is important to managers and health care organisations. Despite a plethora of reviews of such interventions, strength of evidence is hard to determine.

Objective:

We aimed to review literature on interventions to reduce turnover in nurses working in the adult health care services in developed economies.

Method:

We conducted an overview (systematic review of systematic reviews) using the Cochrane Database of Systematic Reviews, MEDLINE, EMBASE, Applied Social Sciences Index and Abstracts, CINAHL plus and SCOPUS and forward searching. We included reviews published between 1990 and January 2015 in English. We carried out parallel blinded selection, extraction of data and assessment of bias, using the Assessment of Multiple Systematic Reviews. We carried out a narrative synthesis.

Results:

Despite the large body of published reviews, only seven reviews met the inclusion criteria. These provide moderate quality review evidence, albeit from poorly controlled primary studies. They provide evidence of effect of a small number of interventions which decrease turnover or increase retention of nurses, these being preceptorship of new graduates and leadership for group cohesion.

Conclusion:

We highlight that a large body of reviews does not equate with a large body of high quality evidence. Agreement as to the measures and terminology to be used together with well-designed, funded primary research to provide robust evidence for nurse and human resource managers to base their nurse retention strategies on is urgently required.

Keywords: Intervention, Nurses, Nursing staff, Personnel turnover, Review, Systematic, Workforce.



1. INTRODUCTION

Turnover amongst nurses, that is, nurses leaving their jobs or leaving the profession, has received international attention due to the size of the issue [1] and the consequences of high rates of turnover [2]. Supply demand gaps are projected in developed economies such as Australia [3], Canada [4], the United States of America [5] and in the United Kingdom (UK) [6], as are shortages in many other EU countries [7]. Negative consequences of such shortages for the nursing workforce in less developed economies is well documented [7]. Nurse turnover is described as having a large number of individual, organisational and societal antecedents or determinants and, although the strength of the evidence is not as strong as its size suggests, a number of causal or correlational models from nursing exist and have some overlap with those from the broader human resource management literature [8]. A pressing issue for nurse and human resource managers in developed economies is to introduce interventions which are effective in addressing those determinants, reducing nurse turnover and increasing nurse retention [9]. A series of policy initiatives (in the UK National Health Service) were put in place in the early 2000s [10] but it has been suggested that ‘it is unclear how effective the initiatives were in retaining staff and whether they were fully implemented.’ [11,p16] A recent review aiming to support the growth of nurse numbers concluded that adopting a number of strategies, including some based on evaluated intervention (for example Gess 2008 [12] or Hirschkorn 2010 [13]), although the review did not appraise the quality of these studies [10].

Outside of nursing, the human resources literature on retention management is reported to describe a large number of practices and groups of practice that have been shown to be effective in the retention of individuals, although a conceptualisation of them as a whole has not been forthcoming [14]. Reported strategies include performance-based reward systems, long-term career prospects, personal recruitment and socialisation all based on retaining an individual although a model for the retention of resource has also been proposed as an alternative way of considering the issue of retention [14].

Our awareness of the existence of some literature focused on nursing retention alongside the human resource literature based on many different job roles and settings, led us to undertake a preliminary stage of review - making an assessment of potentially relevant literature specific to nursing and its size for review [15] - when we were commissioned to carry out a review of the adult nurse turnover literature. Using Medline alone at this stage we identified a large body of reviews (Table 1) relevant to the study’s objectives that indicated that nurse and human resource managers would be faced by a plethora of reviews of interventions to reduce turnover in adult nursing [16, 17], many of which were not conducted according to reviews guidance [15].

Against this background, the aim of this research was to undertake an overview (that is a systematic review of systematic reviews [18]) on interventions to reduce turnover in nurses working in the field of adult health care services, that is the largest group of nurses in all countries [19-21]. Our desire to provide a review that might be used by nurses in practice informed our decision to use an overview, whose purpose “in identifying and appraising all published reviews is to describe their quality, summarise and compare their conclusions and discuss the strength of these conclusions, so that the best evidence is made available to clinical decision-makers.” [22].

2. MATERIAL AND METHODS

The review methods and the reporting of them are based on the guideline from the Preferred Reporting Items for Systematic Review and Meta-analysis Protocols (PRISMA-P) 2015 statement [23] and the guidance within the Cochrane Handbook for Systematic Reviews of Interventions [18, 24].

2.1. Criteria for Inclusion

The inclusion criteria were as follows:

  • Published from 1990 onwards
  • Population: The review was focused on those delivering adult nursing (i.e. licensed or registered) in health services (both in hospital and community) in developed economies (according to the definition of the International Monetary Fund [25])
  • Intervention: The review examined any type of service, management or human resources activity aimed at reducing rates of adult nurse turnover
  • Comparison: Any comparators used within the included reviews
  • Outcomes: Any outcome examined within the included reviews
  • Review design: Any form of literature review which had been peer-reviewed, contained a statement of review, reported its search strategy and/or inclusion/exclusion criteria, reported either empirical findings or a list of included primary studies and included a methodological quality assessment of its included primary studies, that is a review containing key aspects of a well-conducted systematic review

Exclusion criteria were as follows: Reports from any types of primary studies; reviews published in language other than English; reviews that did not evaluate adult nursing turnover as described in the inclusion criteria or presented data on nurses working across settings that could include the care of children or in specific mental health settings; reviews that did not report empirical findings; reviews published only in abstract form; any form of literature review using informal and subjective methods to collect and interpret evidence; commentaries and non peer-reviewed reviews; any review in which the majority of included articles were non-peer reviewed publications and reviews that did not report an appraisal of the quality of the studies they included.

2.2. Search Methods for Identification of Studies

We searched the Cochrane Database of Systematic Reviews, MEDLINE (Ovid), EMBASE (Ovid), Applied Social Sciences Index and Abstracts ASSIA, CINAHL plus (EBSCO) and SCOPUS V.4 (Elsevier) from 1990 to 2015 (searches conducted January 2015). Search strategies were guided by a systematic approach to the research questions [26] and a Medline search strategy was developed (Table 1) and converted or modified to run on other databases (Supplementary file 1). We identified additional studies by searching on PubMed by using the “related citations” algorithm and screening the reference lists of included studies on for other reviews [27].

Table 1. Medline search strategy and number of articles found on 17/01/2015.
# Searches Results
1 exp Nursing Staff/ 34106
2 exp Nursing Care/ 58119
3 exp Nurses/ 42050
4 (nurse or nurses or nursing).tw. 176170
5 1 or 2 or 3 or 4 229957
6 exp Personnel Turnover/ 2974
7 ((turnover adj3 (nurse or nurses or nursing)) or ((work or working or workload) adj3 (nurse or nurses or nursing)) or (leaving adj3 (nurse or nurses or nursing)) or (retention adj3 (nurse or nurses or nursing)) or (retain adj3 (nurse or nurses or nursing)) or (stay adj3 (nurse or nurses or nursing))).tw. 10391
8 6 or 7 12673
9 Job Satisfaction/ and (turnover* or leave or leaving or retention or retain or stay or staying).tw. 2220
10 Burnout/ and (turnover* or leave or leaving or retention or retain or stay or staying).tw. 644
11 Personnel Management/ and (turnover* or leave or leaving or retention or retain or stay or staying).tw. 379
12 Workload/ and (turnover* or leave or leaving or retention or retain or stay or staying).tw. 1018
13 ((burnout or morale or stress) adj5 (turnover* or leave or leaving or retention or retain or stay or staying)).tw. 949
14 ((economic* or financial or pay*) adj5 (turnover* or leave or leaving or retention or retain or stay or staying)).tw. 672
15 (job satisfaction adj5 (turnover* or leave or leaving or retention or retain or stay or staying)).tw. 421
16 ((work or working or workload) adj5 (turnover* or leave or leaving or retention or retain or stay or staying)).tw. 2002
17 (organization* adj5 (turnover* or leave or leaving or retention or retain or stay or staying)).tw. 585
18 9 or 10 or 11 or 12 or 13 or 14 or 15 or 16 or 17 6758
19 8 or 18 17664
20 (incentive* or intervention* or strateg*).tw. 885703
21 (meta anal$ or metaanal$).ti,ab,sh. 77150
22 ((methodol$ or systematic$ or quantitativ$) adj3 (review$ or overview$ or survey$)).ti,ab,sh. 63670
23 (medline or embase or index medicus).ti,ab. 57545
24 ((pool$ or combined or combining) adj (data or trials or studies or results)).ti,ab. 10785
25 literature.ti,ab. 352373
26 21 or 22 or 23 or 24 or 25 456788
27 26 and review.pt,sh. 217357
28 5 and 19 and 20 and 27 176
29 limit 28 to english language 165

2.3. Selection of Studies

The results of the electronic search were downloaded into an Excel spreadsheet After removing duplicate articles, relevant reviews were selected according to eligibility criteria using a two-step screening process:

  • Title and abstract screening: Two authors (FP and MH) reviewed in parallel the titles and abstracts of all the articles resulted to ascertain their eligibility for full text retrieval. Disagreements were resolved by peer discussion and a third view from the project lead (VMD) if required.
  • Full-text screening: Two reviewers (FP and CB) read in parallel all the selected full-text articles to analyse whether they met the inclusion/exclusion criteria. Any discrepancies between the two reviewers were resolved in discussion with the third reviewer (MH).

2.4. Data Extraction

Data were extracted to excel spreadsheets (FP and CB) using a predefined extraction form and spreadsheet on: general characteristics of the reviewe.g. author(s), year, geographical scope, research area, and authors’ aims/ research question(s); descriptive characteristicse.g. type of review (design), selection criteria to include primary studies, number and study designs of articles incorporated in the reviews and outcome measures; results- effectiveness of all interventions reported in the included reviews, the direction of findings against the outcome measure and the references for the primary studies; main conclusions, using the review authors’ words and limitations, as noted by the review authors. Discrepancies were resolved through discussion among the data extractors.

The primary studies included in each review were also listed and compared across the reviews to assess the degree of overlap in the reviews we included.

2.5. Assessment of Methodological Quality

The 11-point Assessment of Multiple Systematic Reviews (AMSTAR) checklist [28] was used to assess the quality of each included review. This tool has been widely used in previous similar overview of reviews and it is considered to be a valid and reliable instrument [29]. Using the AMSTAR scale two authors appraised each included paper. Any review that scored eight or higher was considered at low risk of bias, between five and seven at moderate risk of bias and four or less at high risk of bias.

2.6. Data Analysis

Because of the heterogeneous nature of the focus, inclusion criteria and outcome measures of the included studies data were analysed thematically. Following the detailed reading involved for data extraction, the resultant spreadsheet was examined and a thematic index of interventions developed. The thematic index (supplementary data file 2) was applied to each data extraction and four main groupings of interventions (individual, leadership, group and organisational levels) were used to analyse across reviews, using Microsoft Excel 2010 to record the decisions applied for all reviews considered. A narrative account of the findings from the reviews containing an assessment of the methodological quality of included primary studies has been structured using the risk of bias in the review as the primary grouping level and the thematic content analysis as the second level, also drawing on the number and quality of the included primary studies. In this way we aim to describe the findings by ‘weight of evidence’. [30]

The systematic review protocol was registered with PROSPERO 2015: CRD42015017535 [31].

3. RESULTS: REVIEW SELECTION, STUDY CHARACTERISTICS AND QUALITY ASSESSMENT

3.1. Review Selection

The flow chart representing study selection, including reasons for exclusion, is summarised in Fig. (1). A total of seven reviews met the inclusion criteria and were included in the review. Supplementary File 3 provides a list of citations for the excluded studies in the final stage of the selection process.

3.2. Study Characteristics

Details of the seven included reviews are provided in Tables (2, 3 and 4). The included reviews were conducted between 2008 and 2014. All were published in English and originated from Canada [32-35], the United States [36, 37] and Taiwan [38]. Five reviews focused on the effectiveness of retention strategies targeted at registered nurses [33, 38] or newly graduated nurses [34-36]. One review aimed to examine the relationship between managers’ leadership practices and staff nurses’ intent to stay in their current position [32], and another focused on a single intervention: sabbaticals as strategy to enhance nursing retention and revitalisation to generate positive outcomes [37].

Fig. (1). PRISMA flow diagram.

The majority of the reviews limited their searches to the English language, with the exception of two reviews [33, 36]. The number of included primary studies in each review ranged from five to forty-seven Table (3). Three systematic reviews included quasi-experimental study designs [33, 34, 38]; however, observational study designs dominated, and no review reported any randomised controlled trials. Only two reviews included qualitative or mix-methods primary studies [32, 34]. Of the 164 primary studies in the seven included reviews, 14 were included in at least two reviews, and of these only four papers of primary studies [39-42] were included in three reviews Table (4).

Table 2. General characteristics of the included systematic reviews.
First Author
year
Aim(s)
Research question(s)
Selection criteria used to include primary studies (PICOS) Scope
1. Geography
2. Time limit
3. Language
Chen
2014a
To examine current information and clinical applications of mentorship programmes to attain a superior understanding of the implementation and effectiveness of such programmes for recently registered nurses. P Recently RN
I 1:1 Mentorship programme
C No comparison groups
O Retention; Turnover; Cost
S Experimental or a
quasi-experimental peer-reviewed primary studies
1 USA, ASIA
2 1999-2011
3 Not stated
Cowden 2011b To examine the relationship between managers leadership practices and staff nurses intent to stay in their current position. P Staff nurses
I leadership practices
C No comparison groups
O Intention to stay
S Peer-reviewed qualitative or quantitative studies
1 International (by Canada)
2 1985 - 2010
3 English
Larty
2014c
To report the effectiveness of strategies for retaining experienced RNs. P Experienced RN’s (newly qualified excluded)
I Any intervention aimed to increase the retention of experienced RNs
C No comparison groups
O Retention/ turnover
S Quantitative research studies
1 Mostly USA
2 No limits
3 No limits
Park
2010d
To present an integrative review of the research that was conducted to explore the effects of orientation programs for newly graduated nurses on their confidence, competency, and retention. P Hospital based, NGNs
I Orientation programs in nursing literature (included internships, residencies, and structured orientation programs)
C No comparison groups
O Retention
S Not stated
1 USA
2 1990-2007
3 English
Rush
2013e
The purpose of the study was to review existing research literature to identify best practices of formal new graduate nurse transition programs. P NGNs within one year of graduation (acute care settings)
I transition programs or orientation programs
C No comparison groups
O Retention; Turnover
Cost-benefit
S Any empirical study
1 Mostly USA
2 2000-2011
3 English
Salt
2008f
To conduct a systematic review of published research to determine
the effectiveness of retention strategies targeted at NGNs.
P NGNs
I A retention strategy was identified as a way to engage NGNs to continue service within a unit, hospital, or organization
C No comparison groups
O Retention
S Only published and peer-reviewed primary studies
1 USA
2 No limits
3 No limits
Swenty
2011g
To review and examine the literature supporting a professional sabbatical, a potentially viable and innovative change strategy that could renew, revitalize, and retain nursing staff practicing in the acute care setting. What is the evidence related to professional sabbaticals in nursing? P Nursing, business & education
I Clinical practice sabbatical
C No comparison groups
O Retention; Turnover
S Not stated
1 USA
2 1999 - 2010
3 English

3.3. Quality Assessment of Included Reviews

The AMSTAR scores for the reviews ranged from three to seven. Of the reviews, six [32-36, 38] were judged of moderate quality and one [37] of low quality. The assessment of each review against the AMSTAR criteria is presented in Fig. (2).

All reviews noted that the methods of the included studies were different, and that overall quality of the primary study ranged from high to low. The tools used to assess the quality of included papers in the included studies are shown in Table 3.

Table 3. Summary of reviews presenting interventions with multiple strands.
Intervention type Effect
Review authors’
summary of findings
Supporting evidence
Type, number, and quality of included studies as reported by the review author(s) Review quality score Review reference
First Author
Year
- Nursing practice models
- Teamwork approach
- Leadership practice
- Organisational strategies
- Individual strategies.
Most studies reported improved retention as a result of the intervention. Team work and individually targeted strategies including mentoring, leadership interest and in depth orientation increased job satisfaction and produced higher retention results.
Retention was highest when multiple interventions were used.
Total number 12
Quantitative 12
Experimental (quasi) 2
Observational 10-
Quality
Quality assessment tool adapted from Estabrooks et al (2003)a
“All included studies were rated as medium or high in the quality assessment.” b, page 1030
Moderate
(6/11)
Larty
2014b
- Preceptor programme
- Needs-based orientation programme
- Residency programme
- New graduate internship programme
- Externship before graduation from a basic RN programme
Based on the strongest evidence, the highest retention rates were associated with retention strategies that used a preceptor programme model that focused on the NGN as well as a programme length of 3 to 6 months. Total number 16
Quantitative 16^^
^^Type of quantitative studies included not discussed
Quality
Quality assessment tool adapted from several existing frameworks (Cummings and Estabrooks 2003c, Estabrooks et al 2001d);
“Eleven studies in the review were considered moderate, 3 were high, and 2 were weak.”e, page 288
Moderate
(7/11)
Salt
2008e
Fig. (2). Graph of the methodological quality of the included reviews, according to AMSTAR quality items.

No reviews received an AMSTAR score of greater than seven, therefore none have been judged to have presented the strongest category of evidence on interventions to reduce turnover. Six of the included reviews were assessed as being of moderate quality, although three [34, 35, 38] received an AMSTAR score of seven at the top of the range in this category. Only one review [35] was failed to be assessed in the strong evidence category on the basis of one AMSTAR quality criteria. These authors comprehensively described the literature sources used but did not report the keywords or search strategy.

Table 4. Articles most frequently included in the reviews assessed.
Articles Salt Park Cowden Swenty Lartey Rush Chen
2008 a [35] 2010 b [36] 2011 c [32] 2011 d [37] 2013 e [33] 2013 f [34] 2014 g [38]
Owens h [61] 2001 x x
Beecroft i [62] 2001 x x
Squires j [63] 2002 x x
Crimlisk k [64] 2002 x x
Roche l [65] 2004 x x
Almada m [39] 2004 x x x
Blanzola n [66] 2004 x x
Marcum o [40] 2004 x x x
Altier p [41] 2006 x x x
Herdrich q [67] 2006 x x
Keller r [68] 2006 x x
Krugman s [42] 2006 x x x
Lee t [69] 2009 x x
Komaratat u [70] 2009 x x
Table 5. Summary of reviews presenting specific interventions.
Intervention type Effect
Review authors’
summary of findings
Supporting evidence
Type, number, and quality of included studies as reported by the review’ author(s) Review quality score Review reference
First Author
Year
Orientation programs Orientation programmes (included internships, residencies, and structured orientation programmes) may encourage new graduates to stay in their current position Total number 17^
^ Type of studies included not discussed
Quality
Quality assessment tool adapted from Beck (2001) a
No details available
Moderate
(6/11)
Park
2010 b
The presence of a formal new graduate transition programme (or orientation programme) resulted in good retention of NGN and improved competency. Total number 47
Quantitative 15
Experimental (quasi) 8
Observational 7
Qualitative 5
Other* 27
* descriptive studies
Quality
Quality index with 3 criteria developed by Beck (2001)a and later modified by Park and Jones (2010) b
“Evidence was variable, and overall of low quality, limiting best practices recommendations.” c
Moderate
(5/11)
Rush
2013 c
Mentorship Programmes Mentorship programmes are a beneficial process for mentors and recently registered nurses. Results have shown that mentorship programmes improve competence, job satisfaction and reduce the turnover rate among recently registered nurses. Total number 5
Quantitative 5
Experimental (quasi) 5
Quality
Newman and Roberts (2002) d
“significant reliability” e page 468
Moderate
(7/11)
Chen
2014 e
Leadership Practices Managers’ leadership practices, Transformational or relational leadership approaches resulted in greater intentions to stay in their current positions. Other factors including perceived manager power, supervisor support, empowerment, involving them in decision making, and promotion of group cohesion all showed a significant positive correlation affecting the staff nurses intent to stay. Total number 23
Quantitative 22
Experimental (quasi) -
Observational 22
Qualitative -
Mix-Methods 1
Other -
Quality
Quality assessment tool adapted from several existing frameworks (Cummings and Estabrooks 2003 f, Wong and Cummings 2007 g, Lee and Cummings 2008 h);
“..All studies were rated as moderate or strong” i page 468.
Moderate
(6/11)
Cowden 2011 i
Clinical practice sabbatical The authors identified a nursing sabbatical as a viable option, which can enhance nursing retention and revitalization to generate positive outcomes. Total number 19
Quantitative 2
Experimental (quasi) -
Observational 2
Qualitative 3
Mix-Methods -
Other 14**
**opinion/ consensus papers
Quality
Stillwell, Fineout-Overholt, Melnyk and Williamson (2010) j
Weak evidencek page 157
Moderate
(3/11)
Swenty
2011k

3.4. Findings on Interventions to Reduce Turnover in Adult Nursing

The evidence from the included reviews is presented here narratively by thematic analysis of interventions, grouped into four content categories: individual, job-related, interpersonal, and organisational interventions; unless otherwise stated, the reviews were of moderate quality. In addition Tables (3 and 4) split the presentation of the supporting detail of these reviews by the type of interventions reviewed.

3.5. Interventions at the Individual Level

At the individual level, interventions were heavily but not exclusively focused on newly qualified/graduated nurses (NGNs), and on supportive programmes of transition or development. Preceptorship - one-to-one guidance through clinical experience - was a component of the majority, alongside a range of programme components (for example, classroom learning or group discussion) and support systems (for example, the programme director or clinical educator). These programmes were variously named, including the terms residency, internship and orientation as well as mentoring and preceptorship itself.

Residency received positive support in four reviews [34-36, 38] reporting several studies, with some overlapping reviews. One of these reviews did not provide the description of the study designs, although the authors noted that the excluded studies appraised to be of low quality [36], and another described its three included studies as one pre test-post test and two experimental case study designs [35]. The included studies measure the turnover outcome in the experimental group and compare it to general pre-published reports locally or nationally.

Internships also received some emphasis as positive for retention, supported in two reviews [35, 36], drawing on six studies of variable design but including one with a controlled pre test-post test design. Orientation focus programmes for transition were highlighted in three reviews [34-36] as positively impacting on turnover in four primary studies.

One to one mentorship programmes of three months’ duration were reported as essential to retaining newly registered nurses, reducing turnover in two quasi experimental pretest-posttest studies (from the USA and Taiwan) in one review [38]. For preceptorship itself there was evidence in one review [35], from ten studies from the USA, all of which were experimental in design, although six were one group case studies, two were one group pretest-posttest and only two included a control group (nonrandomised) pretest-posttest design. Half of these studies were also reported in the review to have included a focus on supporting RNs to work in the preceptor capacity through educational training and/or monetary incentives [35].

Evidence for the positive impact of externships (preceptored and employment experiences of the student nurse the year before graduation from a basic RN education programme) was limited to one study reported in one review [35]. Needs-based training or specialty training programmes (designed to develop skills for specific clinical areas and including classroom instruction, observational experience, journaling, case study, coaching, and computer-based training) was also reported to increase retention, although only one of the primary studies (where the design was clearly reported by the review authors [35]) was robust, with a control arm.

These reviews vary in how actual turnover rates are reported, making comparison or synthesis difficult. For example, while the rates of turnover compare favourably with average ranges for turnover or retention of new graduates, “few studies had designs with the degree of control necessary to rule out competing explanations”[34]. With the same caveats about strength of evidence, longer transition programmes (up to one year) appeared to achieve better results regarding turnover [34, 35].

Other interventions identified at the individual level in the moderate quality reviews were bicultural training which was positively associated with turnover in one study in one review [35], and degree of fit to the job/lower work abilities which was negatively associated with turnover in one study in another review [33].

In addition, one review of poor quality/high risk of bias [37], suggested that a clinical practice sabbatical (a leave of absence for an identified purpose) for nurses in acute care settings was a viable option as a strategy to increase retention. Descriptions of the 19 included articles in this review are unclear, but it appears that only five addressed nursing sabbaticals and retention and all were at best descriptive studies and at worst anecdotal accounts; the review authors conclude that the evidence is limited.

3.6. Interventions at the Leadership Level

Two reviews addressed interventions at the leadership level. Management training in leadership behaviour featured in one study in one review [33], and supervision support in seven primary studies in another review [32], as significantly related to intent to stay.

3.7. Interventions at the Organisational Level

Two reviews considered interventions at the group or organisational level. One of these reviews [32] discussed nine primary studies where group cohesion was reported as significantly associated with intention to stay. However, no detail was given about the nature of the interventions and variation in the reliability and validity of the measurement tools used was highlighted. Another review also described two studies demonstrating a positive impact of one year team oriented interventions (one of team discussion groups, the other undefined) on turnover [33]. Nursing practice models, for example nurse-managed units and unit-level self-management widely used by hospitals with Magnet accreditation in North America [43-45] were reported to have mixed evidence of effect [33].

3.8. Summary of Interventions and Their Effectiveness

Tables (3 and 4) present the interventions reported in the reviews, alongside a summary of evidence of effectiveness. In summary, the tables highlight that the specific or multiple interventions reviewed that may have an effect on retention or intention to stay are orientation programmes (including preceptorship, internships, residencies, and structured orientation programmes [34, 36] and mentorship [38]) for new graduates; transformational or relational leadership [32, 33]; and team work. [33] Retention is reported as highest when multiple interventions are used [33]. Clinical sabbaticals received some support although the review quality was low [37].

4. DISCUSSION

4.1. Summary of Findings From and Limitations of the Included Reviews

Seven reviews of interventions to reduce nurse turnover were found which had undertaken a quality appraisal of their included studies. These reviews provided consistent and important messages about what might work to increase retention or at least intention to stay. Firstly, they reported positive impact of transition programmes for newly qualified nurses. [34-36, 38]. These programmes were variously named, including the terms residency, internship and orientation as well as mentoring and preceptorship itself. Questions still remain as to the effectiveness, efficiency, and costs of different methods, frequency and duration of preceptorship programmes for newly qualified nurses who are in different types of clinical specialities and are themselves at a different life stages.

Secondly, the reviews also offered evidence of the positive impact of nurse manager leadership styles that were perceived as ‘transformative’ or encouragment of work group cohesion in reducing turnover or increasing retention (used interchangeably in this review) [32, 33]. Questions remain as to the extent these types of nurse leadership or management styles influence nurse turnover rates in different types of clinical services and in different types of organisational and job market contexts. In addition there are questions as to the effective (including judgements of cost) mechanisms for developing, maintaining and enacting these nurse leadership styles as judged by the primary outcome (rates of nurse turnover) and secondary outcomes such as described above.

Reviews of multiple interventions suggest that this approach is more effective than single interventions [33].

There was little overlap in the included primary studies in the reviews we analysed, due to their different foci, apart from two reviews of supportive programmes for newly graduated nurses [35, 36]. This finding highlights the importance of providing a summary of evidence from more than one systematic review on an important topic [19], as the separate reviews focus on different interventions or different sub-populations of adult nurses.

The quality of the reviews was in the AMSTAR category of moderate, although half of them were borderline with being classified as strong reviews. These included the quality appraisal of their included primary studies in weighting their discussion and drawing conclusions [32, 34, 35].

The reviews’ primary studies variously measured the intention to leave, turnover and retention, and the original reviews’ authors commented on the reduction in the strength of conclusions they could infer due to the weak study designs and variable validity and reliability of the measurement of these outcomes [32, 33]. Examples of weak designs commented on were the absence of control data in many of the primary studies [34, 36]. Other limitations noted by the original reviews’ authors included a predominantly North American focus [33, 35, 38], and a lack of focus on the retention of experienced nurses [33]. The absence of meta analysis in each review due to heterogeneity of studies was also a limitation [32].

In view of the critique of systematic reviews in terms of the ease of conducting poor quality ones that are given high esteem in publication and read by many who cannot easily differentiate their quality [46], we suggest that this summary has an important role to play in highlighting what is already known alongside where a lack of research studies leave space for uncertainty in the field of retention strategies for adult nursing.

4.2. Limitations and Strengths of Our Overview

Our overview is limited by design. Systematic reviews themselves are open to criticism as destructive of ‘reading, writing, thinking, interpreting, arguing and justifying [47]. As an overview (systematic review of systematic reviews) we have also relied upon the review authors’ reporting and interpretation of the primary studies and have made some assumptions about quality based on descriptions of research design if critical appraisal of each primary study was not clearly described in the reviews. We suggest that this limitation is mitigated by only including reviews that have reported a quality appraisal of their included studies. We have also assessed the quality of the included reviews using a widely recognised tool for this task [28]. We have therefore provided an account of what should be the highest quality reviews available although we note that there are no reviews which offer strong evidence, and the AMSTAR tool authors themselves promote further testing of the tool [28]. We have accepted review authors’ descriptions of heterogeneity as limiting opportunities for meta analysis without carrying out any formal analysis to consider whether the diversity has implications for the interpretation of findings. We have also treated the terms turnover and retention as direct opposites noting that the included reviews do not comment on their differences, although there are some authors who argue that though interrelated, they are conceptually different and the reduction of one does not necessarily lead to savings in the other in economic terms at least [48].

4.3. Our Findings in the Context of Other Literature

We initiated our investigation of the evidence on interventions to reduce adult nurse turnover following our early reading and subsequent interlinked systematic overview of the determinants of consequences of such turnover [8]. The finding we report there of a myriad of determinants of turnover, albeit a body of literature widely open to critique of its quality, which might suggest a myriad of linked interventions have been studied. In contrast, when we applied criteria based upon guidance for the good conduct of systematic reviews [15] we have found a fairly narrow range of interventions tested and reported. Moreover, interventions were tested with a narrow range of nurses, in studies which the reviews’ authors consider to lack rigour, particularly in the measurement of the primary outcome of interest, that is, the rate of turnover. In the context of the ongoing international phenomenon of nursing turnover and projected supply-demand concerns [6] this is a somewhat surprising finding.

It was also a surprising finding that otherwise well conducted reviews conflated evidence from self-reported determinants of turnover (i.e. what reports groups of nurses say are the causes of their intent or action to leave) with the review authors’ opinions as to strategies to decrease turnover (including in a very recent overview [49]). While the reviews we overviewed make it clear that there remains much to be done to improve the strength of evidence, for example there are no controlled trials and very few attempts to control observational studies, we argue such misapplied conflation has restricted the development of true intervention studies. In this we mean studies based on an intervention hypothesis for testing and framed by questions of interest to nurse and human resource managers which have the primary outcome of reduction of turnover rates (effectiveness) rates but secondary outcomes linked to accepted quality dimension criteria [50] such as of acceptability, patient safety and experience, staff well-being and cost consequences.

These findings are particularly pertinent when strategic guidance exists on good practice in staff retention [10, 51]. A comparison of the available guidance on retention of nursing in England and the evidence from our literature review [52] suggests there is some evidence that the current guidance offered to retain adult nurses is supported in part by the research literature regarding the determinants of turnover, [8] within the limitations of this evidence being of moderate strength. The guidance is supported in part by the research evidence on interventions with regard to developing nurse leaders and line managers, investing in the workforce and developing and continuing staff engagement [51] when we draw on the findings of two reviews [32, 33]. The strategy’s focus on newly qualified nurses is supported more widely supported by the evidence. [32, 33, 35, 36, 38] It would appear therefore that this is the most likely intervention to have a positive impact on retention. However this statement needs to be seen in the context that most of these studies were not true intervention studies and we are unable therefore to conclude that the strategies in the guidance would have the desired impact on turnover, according to the available research evidence.

CONCLUSION

The current evidence on the effectiveness of interventions to reduce turnover in nursing workforces has a number of important limitations. However, it is important to note that a body of moderately high quality review evidence does exist giving a picture of a number of interventions – preceptorship of new graduates and leadership for group cohesion - that are evidenced to decrease turnover or increase retention. A management style by nurse managers that pays attention to a positive work environment and the nurse as an individual within that is also supported by the literature. However, large gaps remain in high quality evidence for interventions addressing the plethora of determinants of nurse turnover. While this is disappointing, the ongoing problems with retention and shortages of nurses in many countries mean that more research attention is required to build on the work reported here. We suggest that nurses and research funders should develop and test the interventions that were shown to be effective in observational or quasi-experimental studies in controlled studies, powered to allow for interrelated concepts on causal pathways to turnover, particularly with groups other than new graduate nurses, and designed with consistent primary and secondary outcome measures.

SUPPLEMENTARY MATERIAL

Supplementary material is available on the publisher’s website along with the published article.

Download File


LIST OF ABBREVIATIONS

AMSTAR  = Assessment of Multiple Systematic Reviews
PICOS  = Population, Intervention, Comparison, Outcomes, Study design; P: Population; I: Intervention; C: Comparison; O: Outcome; S: Study design
PRISMA-P  = Preferred Reporting Items for Systematic review and Meta-analysis Protocols
NGN  = Newly Graduated Nurses;
RN  = Registered Nurse

ETHICS APPROVAL AND CONSENT TO PARTICIPATE

Not applicable.

HUMAN AND ANIMAL RIGHTS

No Animals/Humans were used for studies that are base of this research.

CONSENT FOR PUBLICATION

Not applicable.

CONFLICT OF INTEREST

The authors declare no conflict of interest, financial or otherwise.

ACKNOWLEDGEMENTS

This review was independent research funded by Health Education England South London, part of the National Health Service (NHS). The views expressed herein are those of the authors and not the funding body, the NHS or the Department of Health.

VMD, MH, RH and JG conceived the review and obtained funding; MH, FP, RH, JG, SG and VMD designed the study; FP and MH carried out the searches; MH, OB, FP and CB refined the study design, selected studies and extracted data; OB and MH conducted the thematic analysis; MH led the writing of the manuscript with OB and FP. All authors read, provided critical input and approved the final manuscript.

REFERENCES

[1] Flinkman M, Leino-Kilpi H, Salanterä S. Nurses’ intention to leave the profession: integrative review. J Adv Nurs 2010; 66(7): 1422-34.
[2] Dawson AJ, Stasa H, Roche MA, Homer CS, Duffield C. Nursing churn and turnover in Australian hospitals: nurses perceptions and suggestions for supportive strategies. BMC Nurs 2014; 13(1): 11.
[3] Health Workforce Australia. Health Workforce 2025 - Doctors, nurses and – Volume 1. Health Workforce Australia: Available from: https://www.hwa.gov.au/sites/uploads/health-workforce-2025-volume-1.pdf. 2012. Accessed 19 November 2015.
[4] Tomblin Murphy G, Birch S, MacKenzie A, Alder R, Lethbridge L, Little L. Eliminating the shortage of registered nurses in Canada: an exercise in applied needs-based planning. Health Policy 2012; 105(2-3): 192-202.
[5] Media Relations American Association of Colleges of Nursing. American Association of Colleges of Nursing. Nurse shortage: Available from: http://www.aacn.nche.edu/media-relations/factsheets/nursing-shortage 2012. Accessed 19 November 2015.
[6] Centre for Workforce Intelligence. Future nursing workforce projections Starting the discussion. CFWI: Available from: http://www.cfwi.org.uk/ publications/ future-nursing-workforceprojections-starting%20the%20discussion. 2013. Accessed 19 November 2015
[7] World Health Organisation Regional Office for Europe. Nurses and midwives: A force for health: Available from: http://www.euro.who.int/en/health-topics/ Healthsystems/nursing-and-midwifery/ publications/2010/nurses-and-midwives-a-force-for-health-2009 2009. Accessed on 19 November 2015
[8] Halter M, Boiko O, Pelone F, et al. The determinants and consequences of adult nurse staff turnover: a systematic review of systematic reviews. Submitted to BMC Health Services Research December - under review 2015.
[9] Baumann A. The impact of Turnover and the Benefit of Stability in the Nursing Workforce. International Council of Nurses: Available from: http://www.icn.ch/images/stories/ documents/pillars/sew/ICHRN/ Policy_and _Research_Paper s/The_Impact_of_Turnover_ and_the_Benefit_of _ Stability_in_the _Nursing_Workforce.pdf 2010. Accessed 19 November 2015.
[10] England Health Education. Growing Nursing Numbers Literature on nurses leaving the NHS. Health Education England: Available from; https://www.hee.nhs.uk/sites/default/ files/ documents/Growing%20nursing%20numbers%20%E2%80%93%20Literature%20Review.pdf 2014. Accessed 8 September 2016.
[11] Finlayson B, Dixon J, Meadows S, Blair G. Mind the gap: the policy response to the NHS nursing shortage. BMJ 2002; 325(7363): 541-4.
[12] Gess E, Manojlovich M, Warner S. An evidence-based protocol for nurse retention. J Nurs Adm 2008; 38(10): 441-7.
[13] Hirschkorn CA, West TB, Hill KS, Cleary BL, Hewlett PO. Experienced nurse retention strategies: what can be learned from top-performing organizations. J Nurs Adm 2010; 40(11): 463-7.
[14] Ortlieb R, Sieben B. How to safeguard critical resources of professional and managerial staff: exploration of a taxonomy of resource retention strategies. Int J Hum Resour Manage 2012; 23: 1688-704.
[15] Centre for Reviews and Dissemination. Systematic Reviews CRD’s guidance for undertaking reviews in healthcare. CRD, University of York 2009: Available from: https://www.york.ac.uk/media/crd/ Systematic_Reviews.pdf 2009. Accessed 11 Nov 2015
[16] Bastian H, Glasziou P, Chalmers I. Seventy-five trials and eleven systematic reviews a day: how will we ever keep up? PLoS Med 2010; 7(9): e1000326.
[17] Moher D, Tetzlaff J, Tricco AC, Sampson M, Altman DG. Epidemiology and reporting characteristics of systematic reviews. PLoS Med 2007; 4(3): e78.
[18] Becker LA, Oxman AD. Reviews of reviews. In: Higgins JP, Green S, Eds. Cochrane Handbook for Systematic Reviews of Interventions Version 510. The Cochrane Collaboration 2011.
[19] Bureau of Labor Statistics. Table 8 Occupations with the largest projected number of job openings due to growth and replacement needs, 2012 and projected 2022. In: Employment Projections 2012-2022. United States Department of Labor. http://www.bls.gov/ news.release/ecopro.t08.htm 2015. Accessed 15 Aug 2015
[20] Association Canadian Nurses. Nursing Workforce Data RN Workforce Profiles by Area of Responsibility. Canadian Nurses Association 2015. Available at: https://www.cna-aiic.ca/en/on-the-issues/better-value/health-human-resources/nursing-statistics/nursing-workforce-data. Accessed 11 Nov
[21] Australian Institute of Health and Welfare. Work characteristics of nurses and midwives. Australian Institute of Health and Welfare 2015: Available from: http://www.aihw.gov.au/workforce/ nursing-and-midwifery/work-characteristics/ 2011. Accessed 22 Aug 2015.
[22] Smith V, Devane D, Begley CM, Clarke M. Methodology in conducting a systematic review of systematic reviews of healthcare interventions. BMC Med Res Methodol 2011; 11(1): 15.
[23] Moher D, Shamseer L, Clarke M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev 2015; 4: 1.
[24] Green S, Julian PT. Chapter 2: Preparing a Cochrane review. In Cochrane Handbook for Systematic Reviews of Interventions Version 510 The Cochrane Collaboration, 2011 wwwcochrane-handbookorg 2011. Accessed 11 Nov 2015.
[25] World EO. Advanced Economies. In: Country Groups Information. International Monetary Fund . 2015: Available from: http://www.imf.org/external/ pubs/ft/weo/2015/02/weodata/weoselagr.aspx#a110
[26] O’Connor D, Green S, Higgins JP. Defining the review question and developing criteria for including studies. In: Higgins JP, Green S, Eds. Cochrane handbook for systematic reviews of interventions version 500. [updated February 2008]
[27] Greenhalgh T, Peacock R. Effectiveness and efficiency of search methods in systematic reviews of complex evidence: audit of primary sources. BMJ 2005; 331(7524): 1064-5.
[28] Shea BJ, Grimshaw JM, Wells GA, et al. Development of AMSTAR: a measurement tool to assess the methodological quality of systematic reviews. BMC Med Res Methodol 2007; 7: 10.
[29] Popovich I, Windsor B, Jordan V, Showell M, Shea B, Farquhar CM. Methodological quality of systematic reviews in subfertility: a comparison of two different approaches. PLoS One 2012; 7(12): e50403.
[30] Edwards A, Elwyn G, Hood K, Rollnick S. Judging the ‘weight of evidence’ in systematic reviews: introducing rigour into the qualitative overview stage by assessing Signal and Noise. J Eval Clin Pract 2000; 6(2): 177-84.
[31] Pelone F, Halter M, Beighton C, Boiko O, Drennan V. Adult Nurse Staff turnover – the determinants and consequences, and interventions for reduction: two interlinked systematic reviews of reviews. Part 2: interventions. PROSPERO 2015:CRD42015017535: Available from: http://www.crd.york.ac.uk/PROSPERO/display_record.asp?ID=CRD42015017535 2015. Accessed 11 Nov 2015.
[32] Cowden T, Cummings G, Profetto-McGrath J. Leadership practices and staff nurses’ intent to stay: a systematic review. J Nurs Manag 2011; 19(4): 461-77.
[33] Lartey S, Cummings G, Profetto-McGrath J. Interventions that promote retention of experienced registered nurses in health care settings: a systematic review. J Nurs Manag 2014; 22(8): 1027-41.
[34] Rush KL, Adamack M, Gordon J, Lilly M, Janke R. Best practices of formal new graduate nurse transition programs: an integrative review. Int J Nurs Stud 2013; 50(3): 345-56.
[35] Salt J, Cummings GG, Profetto-McGrath J. Increasing retention of new graduate nurses: a systematic review of interventions by healthcare organizations. J Nurs Adm 2008; 38(6): 287-96.
[36] Park M, Jones CB. A retention strategy for newly graduated nurses: an integrative review of orientation programs. J Nurses Staff Dev 2010; 26(4): 142-9.
[37] Swenty CF, Schaar GL, Phillips LA, Embree JL, McCool IA, Shirey MR. Nursing sabbatical in the acute care setting: what is the evidence? Nurs Forum 2011; 46(3): 195-204.
[38] Chen CM, Lou MF. The effectiveness and application of mentorship programmes for recently registered nurses: a systematic review. J Nurs Manag 2014; 22(4): 433-42.
[39] Almada P, Carafoli K, Flattery JB, French DA, McNamara M. Improving the retention rate of newly graduated nurses. J Nurses Staff Dev 2004; 20(6): 268-73.
[40] Marcum EH, West RD. Structured orientation for new graduates: a retention strategy. J Nurses Staff Dev 2004; 20(3): 118-24.
[41] Altier ME, Krsek CA. Effects of a 1-year residency program on job satisfaction and retention of new graduate nurses. J Nurses Staff Dev 2006; 22(2): 70-7.
[42] Krugman M, Bretschneider J, Horn PB, Krsek CA, Moutafis RA, Smith MO. The national post-baccalaureate graduate nurse residency program: a model for excellence in transition to practice. J Nurses Staff Dev 2006; 22(4): 196-205.
[43] Weisman CS, Gordon DL, Cassard SD, Bergner M, Wong R. The effects of unit self-management on hospital nurses’ work process, work satisfaction, and retention. Med Care 1993; 31(5): 381-93.
[44] Song R, Daly BJ, Rudy EB, Douglas S, Dyer MA. Nurses’ job satisfaction, absenteeism, and turnover after implementing a special care unit practice model. Res Nurs Health 1997; 20(5): 443-52.
[45] Meraviglia M, Grobe SJ, Tabone S, et al. Nurse-Friendly Hospital Project: enhancing nurse retention and quality of care. J Nurs Care Qual 2008; 23(4): 305-13.
[46] Ioannidis JP. The mass production of redundant, misleading, and conflicted systematic reviews and meta-analyses. Milbank Q 2016; 94(3): 485-514.
[47] MacLure M. Clarity bordering on stupidity: where’s the quality in systematic review? Available from: http://www.esri.mmu.ac.uk/ respapers/papers-pdf/ Paper-Clarity%20bordering%20on%20stupidity.pdf 2017.September 2004. Accessed at May 2017.; In: Paper presented to the British Educational Research Association Annual Conference,; Manchester. 2017.
[48] Jones CB. Staff nurse turnover costs: Part I, A conceptual model. J Nurs Adm 1990; 20(4): 18-23.
[49] Misfeldt R, Linder J, Lait J, et al. Incentives for improving human resource outcomes in health care: overview of reviews. J Health Serv Res Policy 2014; 19(1): 52-61.
[50] Maxwell RJ. Dimensions of quality revisited: from thought to action. Qual Health Care 1992; 1(3): 171-7.
[51] NHS Employers. Staff retention - checklist for good practice: Available from: http://www.nhsemployers.org/ your-workforce/ retain-and-improve/retention-checklist 2015. Accessed November 2016.
[52] Drennan VM, Halter M, Grant RL, Gale J, Harris R, Gourlay S. Adult nurse turnover and retention: South London project report. Kingston University and St George’s, University of London,: Faculty of Health, Social Care and Education. 2015.
[53] Estabrooks CA, Floyd JA, Scott-Findlay S, O’Leary KA, Gushta M. Individual determinants of research utilization: a systematic review. J Adv Nurs 2003; 43(5): 506-20.
[54] Cummings GG, Estabrooks CA. The effects of hospital restructuring that included layoffs on individual nurses who remained employed: a systematic review. Int J Sociol Soc Policy 2003; 8(9): 8-53.
[55] Estabrooks C, Goel V, Thiel E, Pinfold P, Sawka C, Williams I. Decision aids: are they worth it? A systematic review. J Health Serv Res Policy 2001; 6(3): 170-82.
[56] Beck CT. Predictors of postpartum depression: an update. Nurs Res 2001; 50(5): 275-85.
[57] Newman M, Roberts T. Critical appraisal 1: is the quality of the study good enough for you to use the finding? In: Craig JV, Smyth RL, Mullally S, Eds. The Evidence Based Practice Manual for Nurses. New York: Churchill Livingstone 2002; pp. 86-113.
[58] Wong CA, Cummings GG. The relationship between nursing leadership and patient outcomes: a systematic review. J Nurs Manag 2007; 15(5): 508-21.
[59] Lee H, Cummings GG. Factors influencing job satisfaction of front line nurse managers: a systematic review. J Nurs Manag 2008; 16(7): 768-83.
[60] Stillwell SB, Fineout-Overholt E, Melnyk BM, Williamson KM. Searching for the evidence: Strategies to help you conduct a successful search. Am J Nurs 2010; 110: 41-7.
[61] Owens DL, Turjanica MA, Scanion MW, et al. New graduate RN internship program: a collaborative approach for system-wide integration. J Nurses Staff Dev 2001; 17(3): 144-50.
[62] Beecroft PC, Kunzman L, Krozek C. RN internship: outcomes of a one-year pilot program. J Nurs Adm 2001; 31(12): 575-82.
[63] Squires A. New graduate orientation in the rural community hospital. J Contin Educ Nurs 2002; 33(5): 203-9.
[64] Crimlisk JT, McNulty MJ, Francione DA. New graduate RNs in a float pool. An inner-city hospital experience. J Nurs Adm 2002; 32(4): 211-7.
[65] Roche JP, Lamoureux E, Teehan T. A partnership between nursing education and practice: using an empowerment model to retain new nurses. J Nurs Adm 2004; 34(1): 26-32.
[66] Blanzola C, Lindeman R, King ML. Nurse internship pathway to clinical comfort, confidence, and competency. J Nurses Staff Dev 2004; 20(1): 27-37.
[67] Herdrich B, Lindsay A. Nurse residency programs: Redesigning the transition into practice. J Nurses Staff Dev 2006; 22(2): 55-62.
[68] Keller JL, Meekins K, Summers BL. Pearls and pitfalls of a new graduate academic residency program. J Nurs Adm 2006; 36(12): 589-98.
[69] Lee TY, Tzeng WC, Lin CH, Yeh ML. Effects of a preceptorship programme on turnover rate, cost, quality and professional development. J Clin Nurs 2009; 18(8): 1217-25.
[70] Komaratat S, Oumtanee A. Using a mentorship model to prepare newly graduated nurses for competency. J Contin Educ Nurs 2009; 40(10): 475-80.