Rapid reviews in public health As public health organizations across Canada adopt and implement evidence-informed approaches to public health decision-making, there is a need for up to date evidence that can be applied to local contexts. While the most rigorous approach is to find or do a systematic review, timelines and resources often dictate a rapid review of the literature. Rapid reviews are tailored for a shorter timeline, but still use rigorous and transparent methodology to ensure that the best available research evidence is used in decision making. How can the Rapid Review Guidebook help you? The NCCMT has developed a Rapid Review Guidebook that details each step in the rapid review process, with notes on how to tailor the process given resource limitations. The Guidebook also includes a guide to writing the final report, with details on how to structure the report and what to include in each section. Click here to access the method: http://www.nccmt.ca/knowledge-repositories/search/308 There is a 'Links to Supporting Rapid Review Tools' resource available to assist in the rapid review process: https://www.slideshare.net/NCCMT/rapid-review-guidebook-links-to-supporting-tools The National Collaborating Centre for Methods and Tools is funded by the Public Health Agency of Canada and affiliated with McMaster University. The views expressed herein do not necessarily represent the views of the Public Health Agency of Canada. NCCMT is one of six National Collaborating Centres (NCCs) for Public Health. The Centres promote and improve the use of scientific research and other knowledge to strengthen public health practices and policies in Canada.

1. Follow us @nccmt Suivez-nous @ccnmo
Funded by the Public Health Agency of Canada | Affiliated with McMaster University
Production of this presentation has been made possible through a financial contribution from the Public Health Agency of Canada. The
views expressed here do not necessarily reflect the views of the Public Health Agency of Canada..
Rapid Review Guidebook
Presenter:
Maureen Dobbins, RN, PhD
February 13, 2018 1:00 – 2:30 PM EST

2. Follow us @nccmt Suivez-nous @ccnmo
2
Housekeeping
Use Chat to post comments and/or
questions during the webinar
• ‘Send’ questions to All (not
privately to ‘Host’)
Connection issues
• Recommend using a wired
Internet connection (vs.
wireless),
• WebEx 24/7 help line
• 1-866-229-3239
Participant Side
Panel in WebEx
Chat

3. Follow us @nccmt Suivez-nous @ccnmo
3
After Today
The PowerPoint presentation (in English and
French) and English audio recording will be made
available.
These resources will be available at:
http://www.nccmt.ca/previous-webinars

4. Follow us @nccmt Suivez-nous @ccnmo
4
How many people are watching
today’s session with you?
Poll Question #1
A. Just me
B. 1-3
C. 4-5
D. 6-10
E. >10

5. 5
Rapid Review Guidebook
http://www.nccmt.ca/knowledge-repositories/search/308

6. NCC
Infectious
Diseases
Winnipeg, MB
NCC
Methods
and Tools
Hamilton, ON
NCC Healthy
Public Policy
Montreal, QC
NCC
Determinants
of Health
Antigonish, NS
NCC
Aboriginal
Health
Prince George, BC
NCC
Environmental
Health
Vancouver, BC
6

7. Registry of Methods and Tools
Online Learning
Opportunities
WorkshopsMultimedia
Public Health+
Networking and
Outreach
NCCMT Products and Services
7

8. Follow us @nccmt Suivez-nous @ccnmo
8
Poll Question #2
How familiar are you with the
method or tool we are discussing
today?
A. I am not familiar with the method or tool
B. I have heard of the method or tool
C. I have used the method or tool

9. Follow us @nccmt Suivez-nous @ccnmo
9
Poll Question #3
I find rapid reviews to be helpful in
informing program planning
decisions
A. Very helpful
B. Somewhat helpful
C. Not at all helpful
D. Don’t know

10. Follow us @nccmt Suivez-nous @ccnmo
10
Presenters
Maureen Dobbins, RN, PhD
Scientific Director, The
National Collaborating Centre
for Methods and Tools, and
Health Evidence™

11. Follow us @nccmt Suivez-nous @ccnmo
Objectives
• Define rapid reviews
• Describe each step
• Question and answer
11

12. Follow us @nccmt Suivez-nous @ccnmo
Rapid Reviews (definition)
Rapid reviews are a form of knowledge
synthesis in which components of the
systematic review process are simplified or
omitted to produce information in a timely
manner [Khangura 2012]
12

13. Follow us @nccmt Suivez-nous @ccnmo
Why Rapid Reviews are Conducted
• Timelines
• Resources
• Recently completed systematic review not
available
13

14. Follow us @nccmt Suivez-nous @ccnmo
Step 0 - Planning
• Decide on the topic/issue to be addressed
• Identify relevant stakeholders to be involved
• Choose a project leader(s)
• Identify roles
• Define the public health topic
• Review what is currently known about the topic
Summarize in ½ - 1 page
14

15. Follow us @nccmt Suivez-nous @ccnmo
Step 1 - Define
• Identify type of question (effectiveness,
causation/association, diagnosis, lived experience,
economic)
• Depending on type of question use:
• PICO
• PECO
• PS
• Progress Plus (determinants of health framing)
15

16. Step 1 - Supporting Tools
Health Evidence™ tool for developing a question
16
https://healthevidence.org/documents/practice-tools/HETools_DevelopingEfficientSearchStrategyUsingPICO_January2018.doc

17. Step 1 - Supporting Tools
Using an equity perspective
17http://methods.cochrane.org/equity/projects/evidence-equity/progress-plus

18. Follow us @nccmt Suivez-nous @ccnmo
Step 2 - Search and Relevance
• Develop efficient and effective search strategy
• Follow 6S Pyramid
• Document search results
• Save search strategies
• Download results to reference management
software
• Develop inclusion criteria
• Note reasons for exclusion
18

19. Step 2 – Supporting Tools
6S Pyramid
19
http://www.nccmt.ca/about/eiph/search

20. Step 2 – Supporting Tools
Levels of Evidence Tool
20
https://healthevidence.org/documents/practice-tools/HETools_Levels&SourcesPublicHealthEvidence_Jan2018.doc

21. Step 2 – Supporting Tools
Tracking Search Results Tool
21https://www.healthevidence.org/documents/practice-tools/HETools_ResourcesGuideTrackYourSearch_Jan2018.DOC

22. Step 2 – Supporting Tools
22
Flowchart of Search and
Results
https://healthevidence.org/documents/practice-
tools/HETools_KeepingTrackSearchResultsFlowchart_Jan2018.ppt

23. Step 2 – Supporting Tools
Online Learning Module on Searching
23http://www.nccmt.ca/learningcentre/EN/index.php

24. Follow us @nccmt Suivez-nous @ccnmo
Step 3 – Critical Appraisal
• Identify level of evidence (guideline, systematic
review, single study)
• Choose appropriate appraisal tool for level of
evidence
• Complete tutorials/online modules if needed
• 2 raters independently rate each article/
compare results and come to consensus
24

25. Step 3 – Supporting Tools
Practice Guidelines: AGREE II Tool
25www.agreetrust.org/agree-ii

26. Step 3 – Supporting Tools
Systematic Reviews: Health EvidenceTM Tool
26
https://www.healthevidence.org/documents/our-appraisal-tools/QA_Tool&Dictionary_10Nov16.pdf

27. Step 3 – Supporting Tools
Systematic Reviews: AMSTAR Tool
27
www.amstar.ca/Amstar_Checklist.php

28. Step 3 – Supporting Tools
Systematic Reviews: CASP Tool
28http://docs.wixstatic.com/ugd/dded87_7e983a320087439e94533f4697aa109c.pdf

29. Step 3 – Supporting Tools
Single Studies: Collection of CASP Tools
29www.casp-uk.net/casp-tools-checklists

30. Follow us @nccmt Suivez-nous @ccnmo
Step 4 – Synthesis
• Data extraction
• Summarizing results
• Formalizing conclusions
30

31. Follow us @nccmt Suivez-nous @ccnmo
Step 4 - Supporting Tools
What is the effectiveness of family or community-based interventions to decrease sedentary behaviour?
3 age groups: Children 5-13; Adolescents 14-18; Adults 18-50
Participants
Author
(Year)
Quality Interventions
Outcomes
Measured (how
measured, tools
used)
Years
Study
Design
Results
Sub
Population
Differences
Children
5-13
DeMattia
(2007)
Strong (7) Outcomes should focus
on decrease in sedentary
B or increase in PA, so
did prelim relevance
screening based on what
looked like it would meet
that criteria
Connelly
(2007)
Strong (7) Provision/making
PA compulsory
Salmon
(2007) *also
adolescents
Strong (7) Promoting PA
participation (focus
mostly school
setting but 57
interventions total
are evaluated and
some are family)
Flynn (2006)
*also
adolescents
Strong (10)
Flodmark
(2006)
*also
adolescents
Moderate (6)
Campbell
(2001)
Moderate (5)
31

32. Follow us @nccmt Suivez-nous @ccnmo
Step 4 – Supporting Tools
32
Applying a health equity
perspective to data extraction.
Image from Oxman, A. D., Lavis, J.
N., Lewin, S. & Fretheim, A. (2009).
SUPPORT Tools for evidence-
informed health Policymaking (STP)
10: Taking equity into consideration
when assessing the findings of a
systematic review. Health Research
Policy and Systems, 7, (S1): S10.
doi: 10.1186/1478-4505-7-S1-S10

33. Step 4 – Supporting Tools
To summarize results
33https://healthevidence.org/documents/practice-tools/HETools_BriefingNote_Jan2018.doc

34. Step 4 – Supporting Tools
Incorporate an equity perspective
34http://www.nccmt.ca/registry/view/eng/146

35. Follow us @nccmt Suivez-nous @ccnmo
Step 5 – Applicability and
Transferability
• Identify relevant stakeholders
• Share rapid review report
• Meet to discuss findings and relevant factors
• Summarize discussion and add to final report
35

36. Step 5 – Supporting Tools
A&T Tool
36
http://www.nccmt.ca/impact/publications/9

37. Step 5 – Supporting Tools
From an equity perspective
37http://stmichaelshospitalresearch.ca/research-programs/urban-health-solutions/resources-and-reports/knowledge-translation-toolkit

38. Follow us @nccmt Suivez-nous @ccnmo
Writing the Report
• Key messages (1 page)
• Executive Summary (2 pages)
• Full report (20 pages)
• Revisit every 2-3 years (depends on quantity of
new evidence)
• Create organizational knowledge management
system for easy access
38

39. Follow us @nccmt Suivez-nous @ccnmo
Final Report
Sections for the full report:
• Public health topic
• Current knowledge
• Public health policy or program question
• Synthesis of findings
• Implications for organization
• References
• Appendices (search strategy, inclusion criteria,
results of search, critical appraisal results,
description of included articles, data extraction
tables)
39

40. Follow us @nccmt Suivez-nous @ccnmo
40
Poll Question #4
I find rapid reviews to be helpful in
informing program planning
decisions
A. Very helpful
B. Somewhat helpful
C. Not at all helpful
D. Don’t know

41. Follow us @nccmt Suivez-nous @ccnmo
41
Your Comments/Questions
• Use Chat to post comments
and/or questions
• ‘Send’ questions to All (not
privately to ‘Host’)
Chat
Participant Side
Panel in WebEx

42. Follow us @nccmt Suivez-nous @ccnmo
42
Poll Question #5
Could this method or tool be useful
in practice?
A. Very useful
B. Somewhat useful
C. Not at all useful
D. Don’t know

43. Follow us @nccmt Suivez-nous @ccnmo
43
Your Feedback is Important
Please take a few minutes to share your thoughts
on today’s webinar.
Your comments and suggestions help to improve
the resources we offer and plan future webinars.
The short survey is available at:
https://surveys.mcmaster.ca/limesurvey/index.php/
484299?lang=en

44. Follow us @nccmt Suivez-nous @ccnmo
44
Poll Question #6
What are your next steps? (Check all
that apply)
A. Access the method/tool referenced in the
presentation
B. Read the NCCMT summary about the
method/tool described today
C. Consider using the method/tool in
practice
D. Tell a colleague about the method/tool

45. Follow us @nccmt Suivez-nous @ccnmo
Share your story!
• Are you using EIDM in your practice? We want
to hear about it!
• Email us: nccmt@mcmaster.ca
• Need support for EIDM? Contact us for help!
• Email us: nccmt@mcmaster.ca
• We typically respond within 24 business hours
45

46. Follow us @nccmt Suivez-nous @ccnmo
Webinar Series from NCCMT
www.nccmt.ca/webinar-series
• Spotlight on Methods and Tools
• Topic-Specific Methods and Tools
• Online Journal Club
• Peer-to-peer Webinars
46

47. Follow us @nccmt Suivez-nous @ccnmo
Funded by the Public Health Agency of Canada | Affiliated with McMaster University
Production of this presentation has been made possible through a financial contribution from the Public Health Agency of Canada. The
views expressed here do not necessarily reflect the views of the Public Health Agency of Canada..
For more information about the
National Collaborating Centre
for Methods and Tools:
NCCMT website www.nccmt.ca
Contact: nccmt@mcmaster.ca