University of Tasmania, Australia

Systematic reviews for health: critical appraisal.

  • Handbooks / Guidelines for Systematic Reviews
  • Standards for Reporting
  • Registering a Protocol
  • Tools for Systematic Review
  • Online Tutorials & Courses
  • Books and Articles about Systematic Reviews
  • Finding Systematic Reviews

Critical Appraisal

  • Library Help
  • Bibliographic Databases
  • Grey Literature
  • Handsearching
  • Citation Searching
  • 1. Formulate the Research Question
  • 2. Identify the Key Concepts
  • 3. Develop Search Terms - Free-Text
  • 4. Develop Search Terms - Controlled Vocabulary
  • 5. Search Fields
  • 6. Phrase Searching, Wildcards and Proximity Operators
  • 7. Boolean Operators
  • 8. Search Limits
  • 9. Pilot Search Strategy & Monitor Its Development
  • 10. Final Search Strategy
  • 11. Adapt Search Syntax
  • Documenting Search Strategies
  • Handling Results & Storing Papers

Critical appraisal is an integral process in Evidence Based Practice. Critical appraisal aims to identify methodological flaws in the literature and provide consumers of research evidence the opportunity to make informed decisions about the quality of research evidence.

Cochrane Collaboration

The Cochrane Collaboration’s tool for assessing risk of bias

This chapter of the Cochrane Handbook details version 2 of the Cochrane risk-of-bias tool for randomized trials ( RoB 2 ), the recommended tool for use in Cochrane Reviews.

CASP Checklist

Critical Appraisal Skills Programme (CASP)

This set of eight critical appraisal tools are designed to be used when reading research, these include tools for Systematic Reviews, Randomised Controlled Trials, Cohort Studies, Case Control Studies, Economic Evaluations, Diagnostic Studies, Qualitative studies and Clinical Prediction Rule.

These are free to download and can be used by anyone under the Creative Commons License .

Public Health Resource Unit, NHS, England

STROBE checklists for observational studies

Guidelines for checking the quality of cohort, case-control, cross-sectional studies and conference abstracts.

Newcastle-Ottawa Scale (NOS)

Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses

The Newcastle-Ottawa Scale (NOS) is an ongoing collaboration between the Universities of Newcastle, Australia and Ottawa, Canada. It was developed to assess the quality of nonrandomised studies with its design, content and ease of use directed to the task of incorporating the quality assessments in the interpretation of meta-analytic results. A 'star system' has been developed in which a study is judged on three broad perspectives: the selection of the study groups; the comparability of the groups; and the ascertainment of either the exposure or outcome of interest for case-control or cohort studies respectively. The goal of this project is to develop an instrument providing an easy and convenient tool for quality assessment of nonrandomised studies to be used in a systematic review.

Evidence Analysis Manual

Evidence Analysis Manual (Academy of Nutrition and Dietetics)

The Evidence Analysis Manual was created to help understand and carry out the process of conducting a systematic review. It includes information on developing 'good' research questions; conducting a thorough literature search; description of research designs; how to appraise a research article; the Academy's risk of bias tool; and much more. 

YouTube video

  • How to Critically Appraise a Systematic Review: Part 1 UAB School of Medicine [7min41s]
  • How to Critically Appraise a Systematic Review: Part 2 UAB School of Medicine [4min56s]

JBI Critical Appraisal Tools

JBI offers critical appraisal checklists for various study types. The tools are available for download as a PDF.

Risk of Bias Tools

riskofbias.info

This is a list of resources on risk of bias tools for use in systematic reviews. It includes information on RoB 2, ROBINS-E, ROB ME, ROBINS-I and robvis.

NHMRC List of Good Practice Tools to Assess Risk of Bias

NHMRC - Tools to Assess Risk of Bias

Table 1 in Section 2 lists various good practice tools and sources to assess risk of bias.

GRADE (Grading of Recommendations Assessment, Development and Evaluation)

GRADE is an approach to grade the quality of evidence and the strength of recommendations that can be applied across a wide range of interventions and types of studies. 

Assessment of Multiple Systematic Reviews (AMSTAR)

AMSTAR is a 37-item assessment tool used to assess the methodological quality of systematic reviews.

EMGO Institute, The Netherlands

CEBM: Centre for Evidence-Based Medicine (University of Oxford)

Includes critical appraisal checklists for a range of study designs, including systematic reviews.

Centre for Evidence-Based Medicine, University of Oxford.

EPHPP Quality Assessment Tool for Quantitative Studies

EPHPP Quality Assessment Method or Tool

The Effective Public Health Practice Project developed the EPHPP Quality Assessment Method and Tool for quantitative studies method. The tool was developed for use in public health, and can be applied to articles of any public health topic area, including the promotion of family and sexual health and the prevention of chronic disease, injuries and substance misuse. Various types of public health professionals would find this tool relevant to utilise sources of high quality literature to support the decision-making process, especially when designing, implementing and evaluating public health programs and policy. The method includes seven steps.

  • PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies

Need More Help? Book a consultation with a  Learning and Research Librarian  or contact  [email protected] .

  • << Previous: Finding Systematic Reviews
  • Next: Library Help >>
  • Last Updated: Sep 12, 2024 9:53 AM
  • URL: https://utas.libguides.com/SystematicReviews

Australian Aboriginal Flag

Banner

Systematic Reviews

  • Systematic and Other Reviews
  • Systematic Review - Definitions
  • Key Elements of a Review

Critical appraisal

  • Other Reviews
  • Further Resources and Suggested Reading
  • A-Z of Other Guides This link opens in a new window
  • Academic Skills Gateway This link opens in a new window
  • Book an Academic Skills Team Appointment This link opens in a new window

Introduction

Critical appraisal of the literature is an essential part of the systematic review process and relevant also to other review types.  If in doubt, consult your tutor or supervisor regarding correct use of specific methods or tools.

Aveyard (2019a) covers the essentials of critically appraising literature for a review.  It highlights the need to assess different study types and their relevance to the review, as well striking a balance between unqualified acceptance and excess negative criticism of the studies.  Some tools are indicated, such as CASP.

Appraisal Tools

CASP is the Critical Appraisal Skills Programme and has checklists (2022) for various study types such as RCTs, systematic reviews, economic evaluations and others.

Oxford University’s Centre for Evidence-Based Medicine (Nuffield Department of Primary Care Health Sciences, 2023) hosts a set of critical appraisal worksheets, in different languages, for a range of study types.

The Joanna Briggs Institute (2022), specialising in evidence-based healthcare, provides  downloadable critical appraisal tools (checklists) for an extensive set of study types including ‘text and opinion’.

Study Types

A brief summary of Study Types is provided by University Library, Georgia State University (2022).  Aveyard (2019b) and Muir Gray (2009, pp. 125-180) cover these in more detail, including their purpose and suitability for use in research.  Greenhalgh (2019) looks at assessing methodological quality of different study types, with practical exercises.

Aveyard, H. (2019a) ‘Chapter 5. How do I critically appraise the literature?’, in Doing a literature review in health and social care : a practical guide . 4th edn. Maidenhead: McGraw-Hill Education.

Aveyard, H. (2019b) ‘Chapter 3. Which literature will be relevant to my literature review?’, in Doing a literature review in health and social care : a practical guide . 4th edn. Maidenhead : McGraw-Hill Education.

Centre for Evidence-Based Medicine, Nuffield Department of Primary Care Health Sciences, University of Oxford (2023) Critical appraisal tools.  Available at:  https://www.cebm.ox.ac.uk/resources/ebm-tools/critical-appraisal-tools (Accessed 3 January 2023).

Critical appraisal skills programme (2022). CASP checklists . Available at: https://casp-uk.net/casp-tools-checklists/ (Accessed 3 January 2023).

Greenhalgh, T. (2019) 'Chapter 4. Asessing methodological quality', in How to read a paper . 6th edn. Chichester: John Wiley & Sons 

Joanna Briggs Institute, University of Adelaide (2022) Critical appraisal tools.   Available at: https://jbi.global/critical-appraisal-tools (Accessed 4 January 2023).

Muir Gray, J. A. (2009) 'Chapter 5. Appraising the quality of research', in Evidence-based healthcare and public health . 3rd ed. Edinburgh: Churchill Livingstone.

University Library, Georgia State University (2022) Evidence-based medicine: study designs . Available at: https://research.library.gsu.edu/c.php?g=115558&p=1966291   (Accessed 10 January 2023)

  • << Previous: Key Elements of a Review
  • Next: Other Reviews >>
  • Last Updated: Aug 22, 2024 3:48 PM
  • URL: https://libguides.bham.ac.uk/asc/systematicreviews
  • En español – ExME
  • Em português – EME

Making sense of a systematic review: CASPin Tool

Posted on 8th June 2013 by Norah Essali

CASP

The Resource

The CASP International Network ( CASPin ) [1] is a non-profit making organisation for people promoting skills in finding, critically appraising and acting on the results of research papers (evidence).

A systematic review appraisal checklist  comprised of 10 questions that aim to help you decide whether a review is valid and reliable. Alongside each question there are hints that help you understand what is intended by the question and what to look for in order to answer it.

Get Started

The best way to go about it is to print the checklist, open a systematic review that you’re interested in appraising, read the question first, refer to the relevant part of the review then mark your answer! The whole process should only take about an hour. Sounds easy right? To make it easier here are a couple of reviews that you can practice with:

  • Antibiotics for the common cold and acute purulent rhinitis  [2]
  • Selective serotonin reuptake inhibitors for premenstrual syndrome [3]

Go on then! (Or as we say in Arabic, “Yalla!”) Give it a try.

Link To Tool

http://www.caspinternational.org/mod_product/uploads/CASP_Systematic_Review%20_Checklist_14.10.10.pdf

[1] CASP International Network [Internet]. CASP; [cited 7 June 2013]. Available from: http://www.casp-uk.net/#!casp-international/c1zsi

[2 ]Kenealy T, Arroll B. Antibiotics for the common cold and acute purulent rhinitis. Cochrane Database of Systematic Reviews 2013, Issue 6. Art. No.: CD000247. DOI: 10.1002/14651858.CD000247.pub3.

[3] Marjoribanks J, Brown J, O’Brien PMS, Wyatt K. Selective serotonin reuptake inhibitors for premenstrual syndrome. Cochrane Database of Systematic Reviews 2013, Issue 6. Art. No.: CD001396. DOI: 10.1002/14651858.CD001396.pub3.

' src=

Norah Essali

Leave a reply cancel reply.

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

No Comments on Making sense of a systematic review: CASPin Tool

Subscribe to our newsletter.

You will receive our monthly newsletter and free access to Trip Premium.

Related Articles

""

Risk Communication in Public Health

Learn why effective risk communication in public health matters and where you can get started in learning how to better communicate research evidence.

""

Measures of central tendency in clinical research papers: what we should know whilst analysing them

Learn more about the measures of central tendency (mean, mode, median) and how these need to be critically appraised when reading a paper.

""

Journal club: tips for setting up a student journal club

Chris set up a student journal club in his first year of Physical Therapy training. In this blog, he describes how he started the club, how it has changed and expanded throughout his studies, and provides tips and suggested papers to get you started.

Oxford Brookes University

CASP checklists

CASP (Critical Appraisal Skills Programme) checklists are a series of checklists involving prompt questions to help you evaluate research studies. They are often used in Healthcare and cover the following types of research methods: Systematic Reviews, Randomised Controlled Trials, Cohort Studies, Case Control Studies, Economic Evaluations, Diagnostic Studies, Qualitative studies, and Clinical Prediction Rule.

The CASP checklists are usually structured around three main sections asking:

  • Are the results of the study valid?
  • What are the results?
  • Will the results help locally? (in my setting) 

Scroll down for our recommended strategies and resources. 

Structure your evaluation

Use the appropriate checklist to help structure your evaluation of a research study to ensure you have considered all aspects of the study. The checklists can be found here: 

CASP Checklists

Do the groundwork but be selective

Think of the questions on the relevant CASP checklist as a logical way to evaluate the quality of evidence in each text that you read. Following the checklist helps you to do the necessary groundwork, but not everything you write in response to the CASP checklist will be relevant for your assignment. Using the checklist as a way of structuring and stimulating your own thinking means you will have a better understanding of which evidence to select for inclusion in your work, and why it is suitable evidence. 

Back to top

Cookie statement

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings
  • My Bibliography
  • Collections
  • Citation manager

Save citation to file

Email citation, add to collections.

  • Create a new collection
  • Add to an existing collection

Add to My Bibliography

Your saved search, create a file for external citation management software, your rss feed.

  • Search in PubMed
  • Search in NLM Catalog
  • Add to Search

Evidence-based practice article reviews using CASP tools: a method for teaching EBP

Affiliation.

  • 1 Utah State University-Nursing, Logan, Utah, USA.
  • PMID: 25156640
  • DOI: 10.1111/wvn.12059

PubMed Disclaimer

Similar articles

  • Evidence-based practice educational intervention studies: a systematic review of what is taught and how it is measured. Albarqouni L, Hoffmann T, Glasziou P. Albarqouni L, et al. BMC Med Educ. 2018 Aug 1;18(1):177. doi: 10.1186/s12909-018-1284-1. BMC Med Educ. 2018. PMID: 30068343 Free PMC article. Review.
  • Faculty perception of the effectiveness of EBP courses for graduate nursing students. Zeleníková R, Beach M, Ren D, Wolff E, Sherwood P. Zeleníková R, et al. Worldviews Evid Based Nurs. 2014 Dec;11(6):401-13. doi: 10.1111/wvn.12068. Epub 2014 Sep 30. Worldviews Evid Based Nurs. 2014. PMID: 25270089
  • Sicily statement on classification and development of evidence-based practice learning assessment tools. Tilson JK, Kaplan SL, Harris JL, Hutchinson A, Ilic D, Niederman R, Potomkova J, Zwolsman SE. Tilson JK, et al. BMC Med Educ. 2011 Oct 5;11:78. doi: 10.1186/1472-6920-11-78. BMC Med Educ. 2011. PMID: 21970731 Free PMC article.
  • Evidence-based practice in speech-language pathology curricula: a scoping study. Togher L, Yiannoukas C, Lincoln M, Power E, Munro N, Mccabe P, Ghosh P, Worrall L, Ward E, Ferguson A, Harrison E, Douglas J. Togher L, et al. Int J Speech Lang Pathol. 2011 Dec;13(6):459-68. doi: 10.3109/17549507.2011.595825. Int J Speech Lang Pathol. 2011. PMID: 22070726
  • Evidence-based practice: a review of theoretical assumptions and effectiveness of teaching and assessment interventions in health professions. Thomas A, Saroyan A, Dauphinee WD. Thomas A, et al. Adv Health Sci Educ Theory Pract. 2011 May;16(2):253-76. doi: 10.1007/s10459-010-9251-6. Epub 2010 Oct 5. Adv Health Sci Educ Theory Pract. 2011. PMID: 20922477 Review.
  • Optimizing Quality of Life in Kidney Transplant Recipients Through Structured Exercise: A Systematic Review and Evidence-Based Guidelines. Wang W. Wang W. Med Sci Monit. 2024 Jul 24;30:e943617. doi: 10.12659/MSM.943617. Med Sci Monit. 2024. PMID: 39044393 Free PMC article.
  • Artificial Intelligence and Decision-Making in Healthcare: A Thematic Analysis of a Systematic Review of Reviews. Khosravi M, Zare Z, Mojtabaeian SM, Izadi R. Khosravi M, et al. Health Serv Res Manag Epidemiol. 2024 Mar 5;11:23333928241234863. doi: 10.1177/23333928241234863. eCollection 2024 Jan-Dec. Health Serv Res Manag Epidemiol. 2024. PMID: 38449840 Free PMC article. Review.
  • Factors influencing the work of researchers in Scientific Initiation: A systematic review protocol. Costa WPD, Fernandes MDSV, Memon AR, Noll PRES, Sousa MM, Noll M. Costa WPD, et al. PLoS One. 2024 Jan 31;19(1):e0297186. doi: 10.1371/journal.pone.0297186. eCollection 2024. PLoS One. 2024. PMID: 38295057 Free PMC article.
  • Healthcare professionals' perceptions and experiences of obesity and overweight and its management in primary care settings: a qualitative systematic review. Jeffers L, Manner J, Jepson R, McAteer J. Jeffers L, et al. Prim Health Care Res Dev. 2024 Jan 17;25:e5. doi: 10.1017/S1463423623000683. Prim Health Care Res Dev. 2024. PMID: 38229563 Free PMC article. Review.
  • Strategies for reducing pain at dressing change in chronic wounds: protocol for a mapping review. Kirkcaldy AJ, Wilson M, Cooper R, Baxter SK, Campbell F. Kirkcaldy AJ, et al. BMJ Open. 2023 Oct 9;13(10):e072566. doi: 10.1136/bmjopen-2023-072566. BMJ Open. 2023. PMID: 37813540 Free PMC article.
  • Search in MeSH

LinkOut - more resources

Full text sources.

  • Ovid Technologies, Inc.

Other Literature Sources

  • scite Smart Citations

full text provider logo

  • Citation Manager

NCBI Literature Resources

MeSH PMC Bookshelf Disclaimer

The PubMed wordmark and PubMed logo are registered trademarks of the U.S. Department of Health and Human Services (HHS). Unauthorized use of these marks is strictly prohibited.

  • Literature Review Help
  • Systematic Review Help
  • Annotated Bibliographies Help
  • Literature Review Editing & Proofreading
  • Literature Review Topic Selection
  • Literature Review Writing
  • Literature Review Dissertation
  • Literature Review Structure & Formatting
  • UK Student Blog: Assignment Help, Lit Reviews, Insights

CASP Tool vs. Other Literature Review Assessment Methods: Pros and Cons

CASP Tool vs. Other Literature Review Assessment Methods_ Pros and Cons

In the realm of literature review assessment, the choice of the right tool is crucial. Among the various options available, the CASP (Critical Appraisal Skills Programme) tool stands out as a well-recognized choice. However, it’s essential to explore its pros and cons in comparison to other assessment methods for literature reviews and systematic reviews.

Table of Contents

The Significance of Critical Appraisal

Before delving into the CASP tool’s strengths and weaknesses, let’s understand why critical appraisal is a fundamental step in any literature review .

Critical appraisal serves the following essential purposes:

  • Quality Assessment : It helps assess the methodological rigor and trustworthiness of research studies, ensuring that only credible and relevant sources are included in your literature review .
  • Bias Identification : Critical appraisal tools highlight potential biases, limitations, and weaknesses in research, enabling you to make informed decisions about the relevance of each study to your review.
  • Research Synthesis : Through systematic critical appraisal, you can synthesize the findings and evidence from a range of studies, providing a comprehensive and robust review of the literature.

Gaps and Recommendations : It guides you in identifying gaps in the existing literature and making recommendations for future research.

The CASP Tool: An Overview

The CASP tool is one of the most widely used critical appraisal tools, recognized for its structured approach and versatility. It offers a set of checklists specifically tailored for different study types, making it suitable for assessing various research designs.

The CASP tool covers a wide range of study types, including:

  • Randomized Controlled Trials (RCTs)
  • Cohort Studies
  • Case-Control Studies
  • Qualitative Studies
  • Systematic Reviews
  • Diagnostic Test Studies
  • Economic Evaluations

This flexibility makes the CASP tool an attractive choice for literature review assessment.

Pros of the CASP Tool

1. versatility.

The CASP tool’s versatility is one of its primary advantages. Researchers and students can use CASP to critically appraise a variety of study designs, from qualitative research to systematic reviews. This adaptability is particularly valuable in interdisciplinary fields where different research methods are employed.

2. Structured Framework

The CASP tool provides a structured and comprehensive framework for critical appraisal. Each checklist guides users through essential aspects of research quality, such as study design, sample selection, data analysis, and reporting. This systematic approach ensures that all key dimensions of a study are thoroughly evaluated.

3. Wide Acceptance

The CASP tool’s widespread use in the academic and research community lends credibility to its assessment. Many institutions and journals recognize the CASP tool as a reliable method for evaluating research quality, making it a valuable asset for researchers and students seeking broader recognition.

Cons of the CASP Tool

1. learning curve.

One of the potential drawbacks of the CASP tool is that it may have a steep learning curve for beginners. New users may require some time and guidance to become proficient in applying the checklists effectively. However, various training resources and workshops are available to address this issue.

2. Focus on Methodology

The CASP tool emphasizes methodological aspects of research, which can sometimes overshadow other essential components such as the relevance of the study to a specific research question. Researchers should use the tool judiciously, ensuring it aligns with the objectives of their literature review .

Alternatives to the CASP Tool

While the CASP tool has its advantages, other critical appraisal methods offer unique benefits, depending on the context of your literature review .

1. JBI (Joanna Briggs Institute) Critical Appraisal Tools

The JBI offers a set of critical appraisal tools designed for systematic reviews, text and opinion papers, and other study types. These tools provide specialized assessment criteria for specific research designs, ensuring in-depth evaluation.

2. AMSTAR (A Measurement Tool to Assess Systematic Reviews)

AMSTAR is tailored for the assessment of systematic reviews and meta-analyses. It focuses on the quality and reporting of systematic reviews, helping researchers determine the reliability of these comprehensive studies.

3. ROBIS (Risk Of Bias In Systematic Reviews)

ROBIS is a tool dedicated to assessing the risk of bias in systematic reviews. It is particularly valuable for those conducting reviews of reviews, where the focus is on the reliability of systematic reviews as a whole.

Pros and Cons of Alternative Tools

Pros of alternative tools.

  • Specialization : Alternative tools often provide a specialized focus on certain study types, ensuring in-depth evaluation.
  • Simplicity : Some tools are designed to be user-friendly, reducing the learning curve for beginners.
  • Robustness : For specific research types, alternative tools may offer more robust assessment criteria, enabling researchers to uncover nuanced details.

Cons of Alternative Tools

  • Limited Versatility : Specialized tools may not cover as wide a range of study designs as the CASP tool .
  • Recognition : While some tools are widely recognized, they may not enjoy the same level of universal acceptance as the CASP tool .

Selecting the right critical appraisal tool for your literature review is a decision that requires careful consideration. The CASP tool is a versatile, well-structured, and widely recognized choice, making it a valuable asset for researchers across disciplines. However, it is essential to be aware of its learning curve and potential bias toward methodological aspects.

Alternative critical appraisal tools, such as those offered by the JBI, AMSTAR, and ROBIS, provide valuable options when specialized focus and simplicity are required. Researchers should choose the tool that aligns most closely with their specific literature review objectives and study designs.

In the end, the choice of the right tool is a crucial step in ensuring the credibility and quality of your literature review . Consider the pros and cons of each tool, and let your research objectives guide you toward the most suitable critical appraisal method for your review.

' src=

What you can read next

Top Nursing Literature Review Examples for UK-Based Researchers

Top Nursing Literature Review Examples for UK-Based Researchers

Comparing Critical Appraisal Tools_ Which One Is Right for Your Literature Review

Comparing Critical Appraisal Tools: Which One Is Right for Your Literature Review?

dissertation literature review help

Why Choose Our Dissertation Literature Review Help Services in the UK

Leave a reply cancel reply.

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

Get Affordable Expert Help Today!

Literature Review Logo

Welcome to our dedicated literature review services, designed to support UK students in their academic journey. We provide expert assistance in conducting comprehensive literature reviews, ensuring high-quality research and academic success.

  • Systematic Review
  • Annotated Bibliographies
  • Editing & Proofreading
  • Literature Review Structure & Formatting
  • Literature Review Plan
  • Psychology Literature Review
  • Do My Assignment
  • PhD Literature Review
  • Conclusion on Literature Review
  • Literature Review Outline
  • Literature Review Table
  • Tabular Literature Review
  • Thematic Lit Review
  • EPQ Literature Review
  • Narrative Literature Review
  • Thematic Literature Review
  • Do My Homework

Email: [email protected]

Phone: +44 7308 518706

Address: 27 Market Place, Penzance, TR18 2JD, United Kingdom

Disclaimer:   Documents provided by Literature Review serve as model papers and are not meant to be submitted directly to the university or reuse/resell in any way. They are written for individual research and reference purpose only.

Copyright © Literature Review All rights reserved.

About Us   |  Contact Us   |  Terms of Service   |  Privacy Policy   |  Sitemap

Limited Time Offer! - 40% OFF on all Services Get Expert Assistance Today!

Get Literature Review Help at Low Price!

  • Subscribe to Newsletter

NCCMT

KB Mentoring Impact

  • Rapid Evidence Service

Log in to your free NCCMT account to save this method or tool to your dashboard.

Your dashboard is a one-stop shop for accessing various NCCMT resources, tracking your progress as you work through available training opportunities, saving evidence syntheses and publications, and building your own toolkit to match your evidence-informed decision making needs.

Critical Appraisal Skills Programme (CASP) Tools

Oxford Centre for Triple Value Healthcare Ltd (n.d.). The Critical Skills Appraisal Programme: Making sense of evidence . Retrieved from Organization website: http://www.casp-uk.net/

Description

These tools teach users to critically appraise different types of evidence. The program consists of seven critical appraisal tools to assess:

  • Systematic reviews
  • Randomized controlled trials (RCTs)
  • Qualitative research
  • Economic evaluation studies
  • Cohort studies
  • Case-control studies
  • Diagnostic test studies

Steps for Using Method/Tool

Each tool systematically guides users through questions in three main sections:

  • Is the study valid?
  • What are the results?
  • Will the results help locally?

Long, H. A., French, D. P., & Brooks, J. M. (2020). Optimising the value of the Critical Appraisal Skills Programme (CASP) tool for quality appraisal in qualitative evidence synthesis. Research Methods in Medicine & Health Sciences, 1 (1), 31–42. https://doi.org/10.1177/2632084320947559

Ma, L. L., Wang, Y. Y., Yang, Z. H., Huang, D., Weng, H., & Zeng, X. T. (2020). Methodological quality (risk of bias) assessment tools for primary and secondary medical studies: What are they and which is better?. Military Medical Research, 7 (1), 7. https://doi.org/10.1186/s40779-020-00238-8

These summaries are written by the NCCMT to condense and to provide an overview of the resources listed in the Registry of Methods and Tools and to give suggestions for their use in a public health context. For more information on individual methods and tools included in the review, please consult the authors/developers of the original resources.

We have provided the resources and links as a convenience and for informational purposes only; they do not constitute an endorsement or an approval by McMaster University of any of the products, services or opinions of the external organizations, nor have the external organizations endorsed their resources and links as provided by McMaster University. McMaster University bears no responsibility for the accuracy, legality or content of the external sites.

Critical Appraisal Skills Programme (CASP) Tools

Use it with

Briefing note: Decisions, rationale and key findings summary

Using research evidence to frame options to address a problem

Looking to strengthen your skills?

[webpage] Critically and efficiently appraise the evidence

[module] Critical appraisal of qualitative studies

[module] Critical appraisal of systematic reviews

Have you used this resource? Share your story!

Log in here or create an account here .

The resource has been deleted.

Log in using your username and password

  • Search More Search for this keyword Advanced search
  • Latest content
  • Current issue
  • Write for Us
  • BMJ Journals

You are here

  • Volume 19, Issue 1
  • Reviewing the literature
  • Article Text
  • Article info
  • Citation Tools
  • Rapid Responses
  • Article metrics

Download PDF

  • Joanna Smith 1 ,
  • Helen Noble 2
  • 1 School of Healthcare, University of Leeds , Leeds , UK
  • 2 School of Nursing and Midwifery, Queens's University Belfast , Belfast , UK
  • Correspondence to Dr Joanna Smith , School of Healthcare, University of Leeds, Leeds LS2 9JT, UK; j.e.smith1{at}leeds.ac.uk

https://doi.org/10.1136/eb-2015-102252

Statistics from Altmetric.com

Request permissions.

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Implementing evidence into practice requires nurses to identify, critically appraise and synthesise research. This may require a comprehensive literature review: this article aims to outline the approaches and stages required and provides a working example of a published review.

Are there different approaches to undertaking a literature review?

What stages are required to undertake a literature review.

The rationale for the review should be established; consider why the review is important and relevant to patient care/safety or service delivery. For example, Noble et al 's 4 review sought to understand and make recommendations for practice and research in relation to dialysis refusal and withdrawal in patients with end-stage renal disease, an area of care previously poorly described. If appropriate, highlight relevant policies and theoretical perspectives that might guide the review. Once the key issues related to the topic, including the challenges encountered in clinical practice, have been identified formulate a clear question, and/or develop an aim and specific objectives. The type of review undertaken is influenced by the purpose of the review and resources available. However, the stages or methods used to undertake a review are similar across approaches and include:

Formulating clear inclusion and exclusion criteria, for example, patient groups, ages, conditions/treatments, sources of evidence/research designs;

Justifying data bases and years searched, and whether strategies including hand searching of journals, conference proceedings and research not indexed in data bases (grey literature) will be undertaken;

Developing search terms, the PICU (P: patient, problem or population; I: intervention; C: comparison; O: outcome) framework is a useful guide when developing search terms;

Developing search skills (eg, understanding Boolean Operators, in particular the use of AND/OR) and knowledge of how data bases index topics (eg, MeSH headings). Working with a librarian experienced in undertaking health searches is invaluable when developing a search.

Once studies are selected, the quality of the research/evidence requires evaluation. Using a quality appraisal tool, such as the Critical Appraisal Skills Programme (CASP) tools, 5 results in a structured approach to assessing the rigour of studies being reviewed. 3 Approaches to data synthesis for quantitative studies may include a meta-analysis (statistical analysis of data from multiple studies of similar designs that have addressed the same question), or findings can be reported descriptively. 6 Methods applicable for synthesising qualitative studies include meta-ethnography (themes and concepts from different studies are explored and brought together using approaches similar to qualitative data analysis methods), narrative summary, thematic analysis and content analysis. 7 Table 1 outlines the stages undertaken for a published review that summarised research about parents’ experiences of living with a child with a long-term condition. 8

  • View inline

An example of rapid evidence assessment review

In summary, the type of literature review depends on the review purpose. For the novice reviewer undertaking a review can be a daunting and complex process; by following the stages outlined and being systematic a robust review is achievable. The importance of literature reviews should not be underestimated—they help summarise and make sense of an increasingly vast body of research promoting best evidence-based practice.

  • ↵ Centre for Reviews and Dissemination . Guidance for undertaking reviews in health care . 3rd edn . York : CRD, York University , 2009 .
  • ↵ Canadian Best Practices Portal. http://cbpp-pcpe.phac-aspc.gc.ca/interventions/selected-systematic-review-sites / ( accessed 7.8.2015 ).
  • Bridges J , et al
  • ↵ Critical Appraisal Skills Programme (CASP). http://www.casp-uk.net / ( accessed 7.8.2015 ).
  • Dixon-Woods M ,
  • Shaw R , et al
  • Agarwal S ,
  • Jones D , et al
  • Cheater F ,

Twitter Follow Joanna Smith at @josmith175

Competing interests None declared.

Read the full text or download the PDF:

Warning: The NCBI web site requires JavaScript to function. more...

U.S. flag

An official website of the United States government

The .gov means it's official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you're on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings
  • Browse Titles

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

Galdas P, Darwin Z, Fell J, et al. A systematic review and metaethnography to identify how effective, cost-effective, accessible and acceptable self-management support interventions are for men with long-term conditions (SELF-MAN). Southampton (UK): NIHR Journals Library; 2015 Aug. (Health Services and Delivery Research, No. 3.34.)

Cover of A systematic review and metaethnography to identify how effective, cost-effective, accessible and acceptable self-management support interventions are for men with long-term conditions (SELF-MAN)

A systematic review and metaethnography to identify how effective, cost-effective, accessible and acceptable self-management support interventions are for men with long-term conditions (SELF-MAN).

Appendix 6 critical appraisal skills programme criteria.

Critical Appraisal Skills Programme criteria

View in own window

CASP itemCriteria used
1. Was there a clear statement of the aims of the research?Aim can be determined from anywhere in the paper (e.g. title, abstract, introduction, methods)
2. Is a qualitative methodology appropriate?Qualitative research is the appropriate way to address the aim or answer the research question (e.g. the research concerns experiences/views of participants, processes involved, or the nature of interactions)
3. Was the research design appropriate to address the aims of the research?Data collection, data analysis and methodological approach are appropriate to address the aim or answer the research question; the review team classified methodological approach based on whether the approach had consistently been used throughout (e.g. grounded theory required analytical methods such as constant comparison as well as the development of a core category or theory)
4. Was the recruitment strategy appropriate to the aims of the research?Authors clearly report selection of participants and this is appropriate to address the aim or answer the research question.

5. Was the data collected in a way that addressed the research issue?Type of data collection method is clear (e.g. interview, focus group, participant observation, online postings) and has potential to address the aim or research question.

6. Has the relationship between researcher and participants been adequately considered?Authors demonstrate self-reflexivity in data collection and data analysis processes
7. Have ethical issues been taken into consideration?Approval from an ethics committee is reported
8. Was the data analysis sufficiently rigorous?Authors clearly describe data analysis approach and employ strategies to ensure rigour (e.g. peer debriefing, member checking, negative cases).

9. Is there a clear statement of findings?Findings are clearly stated (e.g. in the abstract or findings)
10. Is the research valuable?Study appears valuable in own right (i.e. something has been ‘learnt’), rather than judged in relation to contribution made to the current review.

The main 10 items were scored ‘yes’, ‘no’ or ‘unclear’ whereas the additional prompts were used to facilitate summarising the main strengths, limitations and concerns of each study.

Source: CASP Qualitative Checklist . 281 URL: www.casp-uk.net/#!casp-tools-checklists/c18f8 (accessed 3 September 2013).

Included under terms of UK Non-commercial Government License .

  • Cite this Page Galdas P, Darwin Z, Fell J, et al. A systematic review and metaethnography to identify how effective, cost-effective, accessible and acceptable self-management support interventions are for men with long-term conditions (SELF-MAN). Southampton (UK): NIHR Journals Library; 2015 Aug. (Health Services and Delivery Research, No. 3.34.) Appendix 6, Critical Appraisal Skills Programme criteria.
  • PDF version of this title (3.9M)

Other titles in this collection

  • Health Services and Delivery Research

Recent Activity

  • Critical Appraisal Skills Programme criteria - A systematic review and metaethno... Critical Appraisal Skills Programme criteria - A systematic review and metaethnography to identify how effective, cost-effective, accessible and acceptable self-management support interventions are for men with long-term conditions (SELF-MAN)

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

Connect with NLM

National Library of Medicine 8600 Rockville Pike Bethesda, MD 20894

Web Policies FOIA HHS Vulnerability Disclosure

Help Accessibility Careers

statistics

  • CASP Checklists
  • How to use our CASP Checklists
  • Referencing and Creative Commons
  • Online Training Courses
  • CASP Workshops
  • What is Critical Appraisal
  • Study Designs
  • Useful Links
  • Bibliography
  • View all Tools and Resources
  • Testimonials

How to Critically Appraise a Research Paper

Research papers are a powerful means through which millions of researchers around the globe pass on knowledge about our world.

However, the quality of research can be highly variable. To avoid being misled, it is vital to perform critical appraisals of research studies to assess the validity, results and relevance of the published research. Critical appraisal skills are essential to be able to identify whether published research provides results that can be used as evidence to help improve your practice.

What is a critical appraisal?

Most of us know not to believe everything we read in the newspaper or on various media channels. But when it comes to research literature and journals, they must be critically appraised due to the nature of the context. In order for us to trust research papers, we want to be safe in the knowledge that they have been efficiently and professionally checked to confirm what they are saying. This is where a critical appraisal comes in.

Critical appraisal is the process of carefully and systematically examining research to judge its trustworthiness, value and relevance in a particular context. We have put together a more detailed page to explain what critical appraisal is to give you more information.

Why is a critical appraisal of research required?

Critical appraisal skills are important as they enable you to systematically and objectively assess the trustworthiness, relevance and results of published papers. When a research article is published, who wrote it should not be an indication of its trustworthiness and relevance.

What are the benefits of performing critical appraisals for research papers?

Performing a critical appraisal helps to:

  • Reduce information overload by eliminating irrelevant or weak studies
  • Identify the most relevant papers
  • Distinguish evidence from opinion, assumptions, misreporting, and belief
  • Assess the validity of the study
  • Check the usefulness and clinical applicability of the study

How to critically appraise a research paper

There are some key questions to consider when critically appraising a paper. These include:

  • Is the study relevant to my field of practice?
  • What research question is being asked?
  • Was the study design appropriate for the research question?

CASP has several checklists to help with performing a critical appraisal which we believe are crucial because:

  • They help the user to undertake a complex task involving many steps
  • They support the user in being systematic by ensuring that all important factors or considerations are taken into account
  • They increase consistency in decision-making by providing a framework

In addition to our free checklists, CASP has developed a number of valuable online e-learning modules designed to increase your knowledge and confidence in conducting a critical appraisal.

Introduction To Critical Appraisal & CASP

This Module covers the following:

  • Challenges using evidence to change practice
  • 5 steps of evidence-based practice
  • Developing critical appraisal skills
  • Integrating and acting on the evidence
  • The Critical Appraisal Skills Programme (CASP)
  • Online Learning
  • The Role of Homogeneity in Research
  • PICO Search Strategy Tips & Examples
  • What Is a Subgroup Analysis?
  • What Is Evidence-Based Practice?
  • What Is A Cross-Sectional Study?
  • What Is A PICO Tool?
  • What Is A Pilot Study?
  • Different Types of Bias in Research
  • What is Qualitative Research?
  • What is a Case-Control Study in Research?
  • Privacy Policy

casp tool for literature review

Critical Appraisal Skills Programme

Critical Appraisal Skills Programme (CASP) will use the information you provide on this form to be in touch with you and to provide updates and marketing. Please let us know all the ways you would like to hear from us:

We use Mailchimp as our marketing platform. By clicking below to subscribe, you acknowledge that your information will be transferred to Mailchimp for processing. Learn more about Mailchimp's privacy practices here.

Copyright 2024 CASP UK - OAP Ltd. All rights reserved Website by Beyond Your Brand

COMMENTS

  1. CASP Checklists

    CASP offers free downloadable checklists to help you perform critical appraisal of different study types, such as systematic reviews, RCTs, qualitative studies and more. Learn how to use the checklists and get in touch for more information or workshops.

  2. Systematic Reviews Checklist

    CASP Checklist: CASP Systematic Review Checklist. The following free downloadable checklists are designed to be easy to understand, and to help you accurately perform critical appraisals of systematic reviews:

  3. Critical Appraisal Tools & Resources

    CASP provides simple checklists for the key study designs to help you examine research critically and systematically. Learn more about what critical appraisal is, why we need it and how to use different study designs.

  4. Optimising the value of the critical appraisal skills programme (CASP

    The Critical Appraisal Skills Programme (CASP) tool is the most commonly used tool for quality appraisal in health-related qualitative evidence syntheses, with endorsement from the Cochrane Qualitative and Implementation Methods Group.

  5. Critical Appraisal Tools and Reporting Guidelines

    Optimizing the value of the critical appraisal skills programme (CASP) tool for quality appraisal in qualitative evidence synthesis. Research Methods in Medicine & Health Sciences, 1 (1), 31-42. https://doi.org/10.1177/2632084320947559

  6. Critical Appraisal

    Critical Appraisal Skills Programme (CASP) This set of eight critical appraisal tools are designed to be used when reading research, these include tools for Systematic Reviews, Randomised Controlled Trials, Cohort Studies, Case Control Studies, Economic Evaluations, Diagnostic Studies, Qualitative studies and Clinical Prediction Rule.

  7. LibGuides: Systematic Reviews: Critical appraisal

    Critical appraisal of the literature is an essential part of the systematic review process and relevant also to other review types. If in doubt, consult your tutor or supervisor regarding correct use of specific methods or tools. Aveyard (2019a) covers the essentials of critically appraising literature for a review.

  8. Making sense of a systematic review: CASPin Tool

    The Tool. A systematic review appraisal checklist comprised of 10 questions that aim to help you decide whether a review is valid and reliable. Alongside each question there are hints that help you understand what is intended by the question and what to look for in order to answer it.

  9. CASP checklists

    CASP checklists. CASP (Critical Appraisal Skills Programme) checklists are a series of checklists involving prompt questions to help you evaluate research studies. They are often used in Healthcare and cover the following types of research methods: Systematic Reviews, Randomised Controlled Trials, Cohort Studies, Case Control Studies, Economic ...

  10. Evidence-based practice article reviews using CASP tools: a ...

    MeSH terms Comprehension Educational Measurement / methods* Evidence-Based Practice / education* Humans Review Literature as Topic* Teaching / methods*

  11. The CASP Tool: Literature Review

    In the realm of literature review assessment, the choice of the right tool is crucial. Among the various options available, the CASP (Critical Appraisal Skills Programme) tool stands out as a well-recognized choice. However, it's essential to explore its pros and cons in comparison to other assessment methods for literature reviews and systematic reviews.

  12. PDF CASP Checklist

    The core CASP checklists (randomised controlled trial & systematic review) were based on JAMA 'Users' guides to the medical literature 1994 (adapted from Guyatt GH, Sackett DL, and Cook DJ), and piloted with health care practitioners. For each new checklist, a group of experts were assembled to develop and pilot the checklist and the workshop ...

  13. PDF systematic_review.PDF

    A SYSTEMATIC REVIEW. Study Design: Systematic Review, with or without Meta-analysis Adapted from: Critical Appraisal Skills Programme (CASP), Public Health Resource Unit, Institute of Health Science, Oxford. Oxman AD, Cook DJ, Guyatt GH. Users' guides to the medical literature. VI. How to use an overview. JAMA 1994; 272:1367-1371.

  14. Critical Appraisal Skills Programme (CASP) Tools

    These tools teach users to critically appraise different types of evidence. The program consists of seven critical appraisal tools to assess: Systematic reviews Randomized controlled trials (RCTs) Qualitative research Economic evaluation studies Cohort studies Case-control studies Diagnostic test studies

  15. Evidence-Based Practice Article Reviews Using CASP Tools ...

    Request PDF | Evidence-Based Practice Article Reviews Using CASP Tools: A Method for Teaching EBP | This column shares the best evidence-based strategies and innovative ideas on how to facilitate ...

  16. Critical Appraisal of Clinical Research

    Critical appraisal is the course of action for watchfully and systematically examining research to assess its reliability, value and relevance in order to direct professionals in their vital clinical decision making [1]. Critical appraisal is essential to: Continuing Professional Development (CPD).

  17. CASP

    CASP offers training, workshops and tools to help you read and check health research for trustworthiness, results and relevance. Learn how to use CASP checklists for different study types, such as systematic reviews, randomised controlled trials and qualitative studies.

  18. Reviewing the literature

    Implementing evidence into practice requires nurses to identify, critically appraise and synthesise research. This may require a comprehensive literature review: this article aims to outline the approaches and stages required and provides a working example of a published review. Literature reviews aim to answer focused questions to: inform professionals and patients of the best available ...

  19. A systematic review of the content of critical appraisal tools

    A systematic review was undertaken of 121 published critical appraisal tools sourced from 108 papers located on electronic databases and the Internet. The tools were classified according to the study design for which they were intended. Their items were then classified into one of 12 criteria based on their intent.

  20. Critical Appraisal Skills Programme. CASP Appraisal Tools

    The Critical Appraisal Skills Program (CASP) checklist was utilized to evaluate included studies [25]. This CASP checklist, developed at Oxford University in 1993, is a well-investigated tool ...

  21. Critical Appraisal Skills Programme criteria

    A systematic review and metaethnography to identify how effective, cost-effective, accessible and acceptable self-management support interventions are for men with long-term conditions (SELF-MAN).

  22. PDF Microsoft Word

    The core CASP checklists (randomised controlled trial & systematic review) were based on JAMA 'Users' guides to the medical literature 1994 (adapted from Guyatt GH, Sackett DL, and Cook DJ), and piloted with health care practitioners. For each new checklist, a group of experts were assembled to develop and pilot the checklist and the workshop ...

  23. How to Critically Appraise a Research Paper

    What is a critical appraisal? Most of us know not to believe everything we read in the newspaper or on various media channels. But when it comes to research literature and journals, they must be critically appraised due to the nature of the context. In order for us to trust research papers, we want to be safe in the knowledge that they have been efficiently and professionally checked to ...