Browsing by Author "Ginsburg, Liane R."

Now showing 1 - 3 of 3
  • Thumbnail Image
    ItemOpen Access
    Fidelity is not easy! Challenges and guidelines for assessing fidelity in complex interventions
    (2021-05-29) Ginsburg, Liane R.; Hoben, Matthias; Easterbrook, Adam; Anderson, Ruth A.; Estabrooks, Carole A.; Norton, Peter G.
    Abstract Background Fidelity in complex behavioural interventions is underexplored and few comprehensive or detailed fidelity studies report on specific procedures for monitoring fidelity. Using Bellg’s popular Treatment Fidelity model, this paper aims to increase understanding of how to practically and comprehensively assess fidelity in complex, group-level, interventions. Approach and lessons learned Drawing on our experience using a mixed methods approach to assess fidelity in the INFORM study (Improving Nursing home care through Feedback On perfoRMance data—INFORM), we report on challenges and adaptations experienced with our fidelity assessment approach and lessons learned. Six fidelity assessment challenges were identified: (1) the need to develop succinct tools to measure fidelity given tools tend to be intervention specific, (2) determining which components of fidelity (delivery, receipt, enactment) to emphasize, (3) unit of analysis considerations in group-level interventions, (4) missing data problems, (5) how to respond to and treat fidelity ‘failures’ and ‘deviations’ and lack of an overall fidelity assessment scheme, and (6) ensuring fidelity assessment doesn’t threaten internal validity. Recommendations and conclusions Six guidelines, primarily applicable to group-level studies of complex interventions, are described to help address conceptual, methodological, and practical challenges with fidelity assessment in pragmatic trials. The current study offers guidance to researchers regarding key practical, methodological, and conceptual challenges associated with assessing fidelity in pragmatic trials. Greater attention to fidelity assessment and publication of fidelity results through detailed studies such as this one is critical for improving the quality of fidelity studies and, ultimately, the utility of published trials. Trial registration ClinicalTrials.gov NCT02695836. Registered on February 24, 2016
  • Thumbnail Image
    ItemOpen Access
    Reporting unit context data to stakeholders in long-term care: a practical approach
    (2022-11-21) Cranley, Lisa A.; Lo, T K. T.; Weeks, Lori E.; Hoben, Matthias; Ginsburg, Liane R.; Doupe, Malcolm; Anderson, Ruth A.; Wagg, Adrian; Boström, Anne-Marie; Estabrooks, Carole A.; Norton, Peter G.
    Abstract Background The importance of reporting research evidence to stakeholders in ways that balance complexity and usability is well-documented. However, guidance for how to accomplish this is less clear. We describe a method of developing and visualising dimension-specific scores for organisational context (context rank method). We explore perspectives of leaders in long-term care nursing homes (NHs) on two methods for reporting organisational context data: context rank method and our traditionally presented binary method—more/less favourable context. Methods We used a multimethod design. First, we used survey data from 4065 healthcare aides on 290 care units from 91 NHs to calculate quartiles for each of the 10 Alberta Context Tool (ACT) dimension scores, aggregated at the care unit level based on the overall sample distribution of these scores. This ordinal variable was then summed across ACT scores. Context rank scores were assessed for associations with outcomes for NH staff and for quality of care (healthcare aides’ instrumental and conceptual research use, job satisfaction, rushed care, care left undone) using regression analyses. Second, we used a qualitative descriptive approach to elicit NH leaders’ perspectives on whether the methods were understandable, meaningful, relevant, and useful. With 16 leaders, we conducted focus groups between December 2017 and June 2018: one in Nova Scotia, one in Prince Edward Island, and one in Ontario, Canada. Data were analysed using content analysis. Results Composite scores generated using the context rank method had positive associations with healthcare aides’ instrumental research use (p < .0067) and conceptual research use and job satisfaction (p < .0001). Associations were negative between context rank summary scores and rushed care and care left undone (p < .0001). Overall, leaders indicated that data presented by both methods had value. They liked the binary method as a starting point but appreciated the greater level of detail in the context rank method. Conclusions We recommend careful selection of either the binary or context rank method based on purpose and audience. If a simple, high-level overview is the goal, the binary method has value. If improvement is the goal, the context rank method will give leaders more actionable details.
  • Thumbnail Image
    ItemOpen Access
    Sustained effects of the INFORM cluster randomized trial: an observational post-intervention study
    (2021-08-23) Hoben, Matthias; Ginsburg, Liane R.; Norton, Peter G.; Doupe, Malcolm B.; Berta, Whitney B.; Dearing, James W.; Keefe, Janice M.; Estabrooks, Carole A.
    Abstract Background Numerous studies have examined the efficacy and effectiveness of health services interventions. However, much less research is available on the sustainability of study outcomes. The purpose of this study was to assess the lasting benefits of INFORM (Improving Nursing Home Care Through Feedback On perfoRMance data) and associated factors 2.5 years after removal of study supports. INFORM was a complex, theory-based, three-arm, parallel cluster-randomized trial. In 2015–2016, we successfully implemented two theory-based feedback strategies (compared to a simple feedback approach) to increase nursing home (NH) care aides’ involvement in formal communications about resident care. Methods Sustainability analyses included 51 Western Canadian NHs that had been randomly allocated to a simple and two assisted feedback interventions in INFORM. We measured care aide involvement in formal interactions (e.g., resident rounds, family conferences) and other study outcomes at baseline (T1, 09/2014-05/2015), post-intervention (T2, 01/2017-12/2017), and long-term follow-up (T3, 06/2019–03/2020). Using repeated measures, hierarchical mixed models, adjusted for care aide, care unit, and facility variables, we assess sustainability and associated factors: organizational context (leadership, culture, evaluation) and fidelity of the original INFORM intervention. Results We analyzed data from 18 NHs (46 units, 529 care aides) in simple feedback, 19 NHs (60 units, 731 care aides) in basic assisted feedback, and 14 homes (41 units, 537 care aides) in enhanced assisted feedback. T2 (post-intervention) scores remained stable at T3 in the two enhanced feedback arms, indicating sustainability. In the simple feedback group, where scores were had remained lower than in the enhanced groups during the intervention, T3 scores rose to the level of the two enhanced feedback groups. Better culture (β = 0.099, 95% confidence interval [CI] 0.005; 0.192), evaluation (β = 0.273, 95% CI 0.196; 0.351), and fidelity enactment (β = 0.290, 95% CI 0.196; 0.384) increased care aide involvement in formal interactions at T3. Conclusions Theory-informed feedback provides long-lasting improvement in care aides’ involvement in formal communications about resident care. Greater intervention intensity neither implies greater effectiveness nor sustainability. Modifiable context elements and fidelity enactment during the intervention period may facilitate sustained improvement, warranting further study—as does possible post-intervention spread of our intervention to simple feedback homes.