what is empirical literature review in research

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

Module 2 Chapter 3: What is Empirical Literature & Where can it be Found?

In Module 1, you read about the problem of pseudoscience. Here, we revisit the issue in addressing how to locate and assess scientific or empirical literature . In this chapter you will read about:

• distinguishing between what IS and IS NOT empirical literature
• how and where to locate empirical literature for understanding diverse populations, social work problems, and social phenomena.

Probably the most important take-home lesson from this chapter is that one source is not sufficient to being well-informed on a topic. It is important to locate multiple sources of information and to critically appraise the points of convergence and divergence in the information acquired from different sources. This is especially true in emerging and poorly understood topics, as well as in answering complex questions.

What Is Empirical Literature

Social workers often need to locate valid, reliable information concerning the dimensions of a population group or subgroup, a social work problem, or social phenomenon. They might also seek information about the way specific problems or resources are distributed among the populations encountered in professional practice. Or, social workers might be interested in finding out about the way that certain people experience an event or phenomenon. Empirical literature resources may provide answers to many of these types of social work questions. In addition, resources containing data regarding social indicators may also prove helpful. Social indicators are the “facts and figures” statistics that describe the social, economic, and psychological factors that have an impact on the well-being of a community or other population group.The United Nations (UN) and the World Health Organization (WHO) are examples of organizations that monitor social indicators at a global level: dimensions of population trends (size, composition, growth/loss), health status (physical, mental, behavioral, life expectancy, maternal and infant mortality, fertility/child-bearing, and diseases like HIV/AIDS), housing and quality of sanitation (water supply, waste disposal), education and literacy, and work/income/unemployment/economics, for example.

Three characteristics stand out in empirical literature compared to other types of information available on a topic of interest: systematic observation and methodology, objectivity, and transparency/replicability/reproducibility. Let’s look a little more closely at these three features.

Systematic Observation and Methodology. The hallmark of empiricism is “repeated or reinforced observation of the facts or phenomena” (Holosko, 2006, p. 6). In empirical literature, established research methodologies and procedures are systematically applied to answer the questions of interest.

Objectivity. Gathering “facts,” whatever they may be, drives the search for empirical evidence (Holosko, 2006). Authors of empirical literature are expected to report the facts as observed, whether or not these facts support the investigators’ original hypotheses. Research integrity demands that the information be provided in an objective manner, reducing sources of investigator bias to the greatest possible extent.

Transparency and Replicability/Reproducibility.   Empirical literature is reported in such a manner that other investigators understand precisely what was done and what was found in a particular research study—to the extent that they could replicate the study to determine whether the findings are reproduced when repeated. The outcomes of an original and replication study may differ, but a reader could easily interpret the methods and procedures leading to each study’s findings.

What is NOT Empirical Literature

By now, it is probably obvious to you that literature based on “evidence” that is not developed in a systematic, objective, transparent manner is not empirical literature. On one hand, non-empirical types of professional literature may have great significance to social workers. For example, social work scholars may produce articles that are clearly identified as describing a new intervention or program without evaluative evidence, critiquing a policy or practice, or offering a tentative, untested theory about a phenomenon. These resources are useful in educating ourselves about possible issues or concerns. But, even if they are informed by evidence, they are not empirical literature. Here is a list of several sources of information that do not meet the standard of being called empirical literature:

• your course instructor’s lectures
• political statements
• advertisements
• newspapers & magazines (journalism)
• television news reports & analyses (journalism)
• many websites, Facebook postings, Twitter tweets, and blog postings
• the introductory literature review in an empirical article

You may be surprised to see the last two included in this list. Like the other sources of information listed, these sources also might lead you to look for evidence. But, they are not themselves sources of evidence. They may summarize existing evidence, but in the process of summarizing (like your instructor’s lectures), information is transformed, modified, reduced, condensed, and otherwise manipulated in such a manner that you may not see the entire, objective story. These are called secondary sources, as opposed to the original, primary source of evidence. In relying solely on secondary sources, you sacrifice your own critical appraisal and thinking about the original work—you are “buying” someone else’s interpretation and opinion about the original work, rather than developing your own interpretation and opinion. What if they got it wrong? How would you know if you did not examine the primary source for yourself? Consider the following as an example of “getting it wrong” being perpetuated.

Example: Bullying and School Shootings . One result of the heavily publicized April 1999 school shooting incident at Columbine High School (Colorado), was a heavy emphasis placed on bullying as a causal factor in these incidents (Mears, Moon, & Thielo, 2017), “creating a powerful master narrative about school shootings” (Raitanen, Sandberg, & Oksanen, 2017, p. 3). Naturally, with an identified cause, a great deal of effort was devoted to anti-bullying campaigns and interventions for enhancing resilience among youth who experience bullying.  However important these strategies might be for promoting positive mental health, preventing poor mental health, and possibly preventing suicide among school-aged children and youth, it is a mistaken belief that this can prevent school shootings (Mears, Moon, & Thielo, 2017). Many times the accounts of the perpetrators having been bullied come from potentially inaccurate third-party accounts, rather than the perpetrators themselves; bullying was not involved in all instances of school shooting; a perpetrator’s perception of being bullied/persecuted are not necessarily accurate; many who experience severe bullying do not perpetrate these incidents; bullies are the least targeted shooting victims; perpetrators of the shooting incidents were often bullying others; and, bullying is only one of many important factors associated with perpetrating such an incident (Ioannou, Hammond, & Simpson, 2015; Mears, Moon, & Thielo, 2017; Newman &Fox, 2009; Raitanen, Sandberg, & Oksanen, 2017). While mass media reports deliver bullying as a means of explaining the inexplicable, the reality is not so simple: “The connection between bullying and school shootings is elusive” (Langman, 2014), and “the relationship between bullying and school shooting is, at best, tenuous” (Mears, Moon, & Thielo, 2017, p. 940). The point is, when a narrative becomes this publicly accepted, it is difficult to sort out truth and reality without going back to original sources of information and evidence.

What May or May Not Be Empirical Literature: Literature Reviews

Investigators typically engage in a review of existing literature as they develop their own research studies. The review informs them about where knowledge gaps exist, methods previously employed by other scholars, limitations of prior work, and previous scholars’ recommendations for directing future research. These reviews may appear as a published article, without new study data being reported (see Fields, Anderson, & Dabelko-Schoeny, 2014 for example). Or, the literature review may appear in the introduction to their own empirical study report. These literature reviews are not considered to be empirical evidence sources themselves, although they may be based on empirical evidence sources. One reason is that the authors of a literature review may or may not have engaged in a systematic search process, identifying a full, rich, multi-sided pool of evidence reports.

There is, however, a type of review that applies systematic methods and is, therefore, considered to be more strongly rooted in evidence: the systematic review .

Systematic review of literature. A systematic reviewis a type of literature report where established methods have been systematically applied, objectively, in locating and synthesizing a body of literature. The systematic review report is characterized by a great deal of transparency about the methods used and the decisions made in the review process, and are replicable. Thus, it meets the criteria for empirical literature: systematic observation and methodology, objectivity, and transparency/reproducibility. We will work a great deal more with systematic reviews in the second course, SWK 3402, since they are important tools for understanding interventions. They are somewhat less common, but not unheard of, in helping us understand diverse populations, social work problems, and social phenomena.

Locating Empirical Evidence

Social workers have available a wide array of tools and resources for locating empirical evidence in the literature. These can be organized into four general categories.

Journal Articles. A number of professional journals publish articles where investigators report on the results of their empirical studies. However, it is important to know how to distinguish between empirical and non-empirical manuscripts in these journals. A key indicator, though not the only one, involves a peer review process . Many professional journals require that manuscripts undergo a process of peer review before they are accepted for publication. This means that the authors’ work is shared with scholars who provide feedback to the journal editor as to the quality of the submitted manuscript. The editor then makes a decision based on the reviewers’ feedback:

• Accept as is
• Accept with minor revisions
• Request that a revision be resubmitted (no assurance of acceptance)

When a “revise and resubmit” decision is made, the piece will go back through the review process to determine if it is now acceptable for publication and that all of the reviewers’ concerns have been adequately addressed. Editors may also reject a manuscript because it is a poor fit for the journal, based on its mission and audience, rather than sending it for review consideration.

Indicators of journal relevance. Various journals are not equally relevant to every type of question being asked of the literature. Journals may overlap to a great extent in terms of the topics they might cover; in other words, a topic might appear in multiple different journals, depending on how the topic was being addressed. For example, articles that might help answer a question about the relationship between community poverty and violence exposure might appear in several different journals, some with a focus on poverty, others with a focus on violence, and still others on community development or public health. Journal titles are sometimes a good starting point but may not give a broad enough picture of what they cover in their contents.

In focusing a literature search, it also helps to review a journal’s mission and target audience. For example, at least four different journals focus specifically on poverty:

• Journal of Children & Poverty
• Journal of Poverty
• Journal of Poverty and Social Justice
• Poverty & Public Policy

Let’s look at an example using the Journal of Poverty and Social Justice . Information about this journal is located on the journal’s webpage: http://policy.bristoluniversitypress.co.uk/journals/journal-of-poverty-and-social-justice . In the section headed “About the Journal” you can see that it is an internationally focused research journal, and that it addresses social justice issues in addition to poverty alone. The research articles are peer-reviewed (there appear to be non-empirical discussions published, as well). These descriptions about a journal are almost always available, sometimes listed as “scope” or “mission.” These descriptions also indicate the sponsorship of the journal—sponsorship may be institutional (a particular university or agency, such as Smith College Studies in Social Work ), a professional organization, such as the Council on Social Work Education (CSWE) or the National Association of Social Work (NASW), or a publishing company (e.g., Taylor & Frances, Wiley, or Sage).

Indicators of journal caliber.  Despite engaging in a peer review process, not all journals are equally rigorous. Some journals have very high rejection rates, meaning that many submitted manuscripts are rejected; others have fairly high acceptance rates, meaning that relatively few manuscripts are rejected. This is not necessarily the best indicator of quality, however, since newer journals may not be sufficiently familiar to authors with high quality manuscripts and some journals are very specific in terms of what they publish. Another index that is sometimes used is the journal’s impact factor . Impact factor is a quantitative number indicative of how often articles published in the journal are cited in the reference list of other journal articles—the statistic is calculated as the number of times on average each article published in a particular year were cited divided by the number of articles published (the number that could be cited). For example, the impact factor for the Journal of Poverty and Social Justice in our list above was 0.70 in 2017, and for the Journal of Poverty was 0.30. These are relatively low figures compared to a journal like the New England Journal of Medicine with an impact factor of 59.56! This means that articles published in that journal were, on average, cited more than 59 times in the next year or two.

Impact factors are not necessarily the best indicator of caliber, however, since many strong journals are geared toward practitioners rather than scholars, so they are less likely to be cited by other scholars but may have a large impact on a large readership. This may be the case for a journal like the one titled Social Work, the official journal of the National Association of Social Workers. It is distributed free to all members: over 120,000 practitioners, educators, and students of social work world-wide. The journal has a recent impact factor of.790. The journals with social work relevant content have impact factors in the range of 1.0 to 3.0 according to Scimago Journal & Country Rank (SJR), particularly when they are interdisciplinary journals (for example, Child Development , Journal of Marriage and Family , Child Abuse and Neglect , Child Maltreatmen t, Social Service Review , and British Journal of Social Work ). Once upon a time, a reader could locate different indexes comparing the “quality” of social work-related journals. However, the concept of “quality” is difficult to systematically define. These indexes have mostly been replaced by impact ratings, which are not necessarily the best, most robust indicators on which to rely in assessing journal quality. For example, new journals addressing cutting edge topics have not been around long enough to have been evaluated using this particular tool, and it takes a few years for articles to begin to be cited in other, later publications.

Beware of pseudo-, illegitimate, misleading, deceptive, and suspicious journals . Another side effect of living in the Age of Information is that almost anyone can circulate almost anything and call it whatever they wish. This goes for “journal” publications, as well. With the advent of open-access publishing in recent years (electronic resources available without subscription), we have seen an explosion of what are called predatory or junk journals . These are publications calling themselves journals, often with titles very similar to legitimate publications and often with fake editorial boards. These “publications” lack the integrity of legitimate journals. This caution is reminiscent of the discussions earlier in the course about pseudoscience and “snake oil” sales. The predatory nature of many apparent information dissemination outlets has to do with how scientists and scholars may be fooled into submitting their work, often paying to have their work peer-reviewed and published. There exists a “thriving black-market economy of publishing scams,” and at least two “journal blacklists” exist to help identify and avoid these scam journals (Anderson, 2017).

This issue is important to information consumers, because it creates a challenge in terms of identifying legitimate sources and publications. The challenge is particularly important to address when information from on-line, open-access journals is being considered. Open-access is not necessarily a poor choice—legitimate scientists may pay sizeable fees to legitimate publishers to make their work freely available and accessible as open-access resources. On-line access is also not necessarily a poor choice—legitimate publishers often make articles available on-line to provide timely access to the content, especially when publishing the article in hard copy will be delayed by months or even a year or more. On the other hand, stating that a journal engages in a peer-review process is no guarantee of quality—this claim may or may not be truthful. Pseudo- and junk journals may engage in some quality control practices, but may lack attention to important quality control processes, such as managing conflict of interest, reviewing content for objectivity or quality of the research conducted, or otherwise failing to adhere to industry standards (Laine & Winker, 2017).

One resource designed to assist with the process of deciphering legitimacy is the Directory of Open Access Journals (DOAJ). The DOAJ is not a comprehensive listing of all possible legitimate open-access journals, and does not guarantee quality, but it does help identify legitimate sources of information that are openly accessible and meet basic legitimacy criteria. It also is about open-access journals, not the many journals published in hard copy.

An additional caution: Search for article corrections. Despite all of the careful manuscript review and editing, sometimes an error appears in a published article. Most journals have a practice of publishing corrections in future issues. When you locate an article, it is helpful to also search for updates. Here is an example where data presented in an article’s original tables were erroneous, and a correction appeared in a later issue.

• Marchant, A., Hawton, K., Stewart A., Montgomery, P., Singaravelu, V., Lloyd, K., Purdy, N., Daine, K., & John, A. (2017). A systematic review of the relationship between internet use, self-harm and suicidal behaviour in young people: The good, the bad and the unknown. PLoS One, 12(8): e0181722. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5558917/
• Marchant, A., Hawton, K., Stewart A., Montgomery, P., Singaravelu, V., Lloyd, K., Purdy, N., Daine, K., & John, A. (2018).Correction—A systematic review of the relationship between internet use, self-harm and suicidal behaviour in young people: The good, the bad and the unknown. PLoS One, 13(3): e0193937.  http://journals.plos.org/plosone/article?id=10.1371/journal.pone.0193937

Search Tools. In this age of information, it is all too easy to find items—the problem lies in sifting, sorting, and managing the vast numbers of items that can be found. For example, a simple Google® search for the topic “community poverty and violence” resulted in about 15,600,000 results! As a means of simplifying the process of searching for journal articles on a specific topic, a variety of helpful tools have emerged. One type of search tool has previously applied a filtering process for you: abstracting and indexing databases . These resources provide the user with the results of a search to which records have already passed through one or more filters. For example, PsycINFO is managed by the American Psychological Association and is devoted to peer-reviewed literature in behavioral science. It contains almost 4.5 million records and is growing every month. However, it may not be available to users who are not affiliated with a university library. Conducting a basic search for our topic of “community poverty and violence” in PsychINFO returned 1,119 articles. Still a large number, but far more manageable. Additional filters can be applied, such as limiting the range in publication dates, selecting only peer reviewed items, limiting the language of the published piece (English only, for example), and specified types of documents (either chapters, dissertations, or journal articles only, for example). Adding the filters for English, peer-reviewed journal articles published between 2010 and 2017 resulted in 346 documents being identified.

Just as was the case with journals, not all abstracting and indexing databases are equivalent. There may be overlap between them, but none is guaranteed to identify all relevant pieces of literature. Here are some examples to consider, depending on the nature of the questions asked of the literature:

• Academic Search Complete—multidisciplinary index of 9,300 peer-reviewed journals
• AgeLine—multidisciplinary index of aging-related content for over 600 journals
• Campbell Collaboration—systematic reviews in education, crime and justice, social welfare, international development
• Google Scholar—broad search tool for scholarly literature across many disciplines
• MEDLINE/ PubMed—National Library of medicine, access to over 15 million citations
• Oxford Bibliographies—annotated bibliographies, each is discipline specific (e.g., psychology, childhood studies, criminology, social work, sociology)
• PsycINFO/PsycLIT—international literature on material relevant to psychology and related disciplines
• SocINDEX—publications in sociology
• Social Sciences Abstracts—multiple disciplines
• Social Work Abstracts—many areas of social work are covered
• Web of Science—a “meta” search tool that searches other search tools, multiple disciplines

Placing our search for information about “community violence and poverty” into the Social Work Abstracts tool with no additional filters resulted in a manageable 54-item list. Finally, abstracting and indexing databases are another way to determine journal legitimacy: if a journal is indexed in a one of these systems, it is likely a legitimate journal. However, the converse is not necessarily true: if a journal is not indexed does not mean it is an illegitimate or pseudo-journal.

Government Sources. A great deal of information is gathered, analyzed, and disseminated by various governmental branches at the international, national, state, regional, county, and city level. Searching websites that end in.gov is one way to identify this type of information, often presented in articles, news briefs, and statistical reports. These government sources gather information in two ways: they fund external investigations through grants and contracts and they conduct research internally, through their own investigators. Here are some examples to consider, depending on the nature of the topic for which information is sought:

• Agency for Healthcare Research and Quality (AHRQ) at https://www.ahrq.gov/
• Bureau of Justice Statistics (BJS) at https://www.bjs.gov/
• Census Bureau at https://www.census.gov
• Morbidity and Mortality Weekly Report of the CDC (MMWR-CDC) at https://www.cdc.gov/mmwr/index.html
• Child Welfare Information Gateway at https://www.childwelfare.gov
• Children’s Bureau/Administration for Children & Families at https://www.acf.hhs.gov
• Forum on Child and Family Statistics at https://www.childstats.gov
• National Institutes of Health (NIH) at https://www.nih.gov , including (not limited to):
• National Institute on Aging (NIA at https://www.nia.nih.gov
• National Institute on Alcohol Abuse and Alcoholism (NIAAA) at https://www.niaaa.nih.gov
• National Institute of Child Health and Human Development (NICHD) at https://www.nichd.nih.gov
• National Institute on Drug Abuse (NIDA) at https://www.nida.nih.gov
• National Institute of Environmental Health Sciences at https://www.niehs.nih.gov
• National Institute of Mental Health (NIMH) at https://www.nimh.nih.gov
• National Institute on Minority Health and Health Disparities at https://www.nimhd.nih.gov
• National Institute of Justice (NIJ) at https://www.nij.gov
• Substance Abuse and Mental Health Services Administration (SAMHSA) at https://www.samhsa.gov/
• United States Agency for International Development at https://usaid.gov

Each state and many counties or cities have similar data sources and analysis reports available, such as Ohio Department of Health at https://www.odh.ohio.gov/healthstats/dataandstats.aspx and Franklin County at https://statisticalatlas.com/county/Ohio/Franklin-County/Overview . Data are available from international/global resources (e.g., United Nations and World Health Organization), as well.

Other Sources. The Health and Medicine Division (HMD) of the National Academies—previously the Institute of Medicine (IOM)—is a nonprofit institution that aims to provide government and private sector policy and other decision makers with objective analysis and advice for making informed health decisions. For example, in 2018 they produced reports on topics in substance use and mental health concerning the intersection of opioid use disorder and infectious disease,  the legal implications of emerging neurotechnologies, and a global agenda concerning the identification and prevention of violence (see http://www.nationalacademies.org/hmd/Global/Topics/Substance-Abuse-Mental-Health.aspx ). The exciting aspect of this resource is that it addresses many topics that are current concerns because they are hoping to help inform emerging policy. The caution to consider with this resource is the evidence is often still emerging, as well.

Numerous “think tank” organizations exist, each with a specific mission. For example, the Rand Corporation is a nonprofit organization offering research and analysis to address global issues since 1948. The institution’s mission is to help improve policy and decision making “to help individuals, families, and communities throughout the world be safer and more secure, healthier and more prosperous,” addressing issues of energy, education, health care, justice, the environment, international affairs, and national security (https://www.rand.org/about/history.html). And, for example, the Robert Woods Johnson Foundation is a philanthropic organization supporting research and research dissemination concerning health issues facing the United States. The foundation works to build a culture of health across systems of care (not only medical care) and communities (https://www.rwjf.org).

While many of these have a great deal of helpful evidence to share, they also may have a strong political bias. Objectivity is often lacking in what information these organizations provide: they provide evidence to support certain points of view. That is their purpose—to provide ideas on specific problems, many of which have a political component. Think tanks “are constantly researching solutions to a variety of the world’s problems, and arguing, advocating, and lobbying for policy changes at local, state, and federal levels” (quoted from https://thebestschools.org/features/most-influential-think-tanks/ ). Helpful information about what this one source identified as the 50 most influential U.S. think tanks includes identifying each think tank’s political orientation. For example, The Heritage Foundation is identified as conservative, whereas Human Rights Watch is identified as liberal.

While not the same as think tanks, many mission-driven organizations also sponsor or report on research, as well. For example, the National Association for Children of Alcoholics (NACOA) in the United States is a registered nonprofit organization. Its mission, along with other partnering organizations, private-sector groups, and federal agencies, is to promote policy and program development in research, prevention and treatment to provide information to, for, and about children of alcoholics (of all ages). Based on this mission, the organization supports knowledge development and information gathering on the topic and disseminates information that serves the needs of this population. While this is a worthwhile mission, there is no guarantee that the information meets the criteria for evidence with which we have been working. Evidence reported by think tank and mission-driven sources must be utilized with a great deal of caution and critical analysis!

In many instances an empirical report has not appeared in the published literature, but in the form of a technical or final report to the agency or program providing the funding for the research that was conducted. One such example is presented by a team of investigators funded by the National Institute of Justice to evaluate a program for training professionals to collect strong forensic evidence in instances of sexual assault (Patterson, Resko, Pierce-Weeks, & Campbell, 2014): https://www.ncjrs.gov/pdffiles1/nij/grants/247081.pdf . Investigators may serve in the capacity of consultant to agencies, programs, or institutions, and provide empirical evidence to inform activities and planning. One such example is presented by Maguire-Jack (2014) as a report to a state’s child maltreatment prevention board: https://preventionboard.wi.gov/Documents/InvestmentInPreventionPrograming_Final.pdf .

When Direct Answers to Questions Cannot Be Found. Sometimes social workers are interested in finding answers to complex questions or questions related to an emerging, not-yet-understood topic. This does not mean giving up on empirical literature. Instead, it requires a bit of creativity in approaching the literature. A Venn diagram might help explain this process. Consider a scenario where a social worker wishes to locate literature to answer a question concerning issues of intersectionality. Intersectionality is a social justice term applied to situations where multiple categorizations or classifications come together to create overlapping, interconnected, or multiplied disadvantage. For example, women with a substance use disorder and who have been incarcerated face a triple threat in terms of successful treatment for a substance use disorder: intersectionality exists between being a woman, having a substance use disorder, and having been in jail or prison. After searching the literature, little or no empirical evidence might have been located on this specific triple-threat topic. Instead, the social worker will need to seek literature on each of the threats individually, and possibly will find literature on pairs of topics (see Figure 3-1). There exists some literature about women’s outcomes for treatment of a substance use disorder (a), some literature about women during and following incarceration (b), and some literature about substance use disorders and incarceration (c). Despite not having a direct line on the center of the intersecting spheres of literature (d), the social worker can develop at least a partial picture based on the overlapping literatures.

Figure 3-1. Venn diagram of intersecting literature sets.

Take a moment to complete the following activity. For each statement about empirical literature, decide if it is true or false.

Social Work 3401 Coursebook Copyright © by Dr. Audrey Begun is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License , except where otherwise noted.

Share This Book

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base

Methodology

• How to Write a Literature Review | Guide, Examples, & Templates

How to Write a Literature Review | Guide, Examples, & Templates

Published on January 2, 2023 by Shona McCombes . Revised on September 11, 2023.

What is a literature review? A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research that you can later apply to your paper, thesis, or dissertation topic .

There are five key steps to writing a literature review:

• Search for relevant literature
• Evaluate sources
• Identify themes, debates, and gaps
• Outline the structure
• Write your literature review

A good literature review doesn’t just summarize sources—it analyzes, synthesizes , and critically evaluates to give a clear picture of the state of knowledge on the subject.

Instantly correct all language mistakes in your text

Upload your document to correct all your mistakes in minutes

Table of contents

What is the purpose of a literature review, examples of literature reviews, step 1 – search for relevant literature, step 2 – evaluate and select sources, step 3 – identify themes, debates, and gaps, step 4 – outline your literature review’s structure, step 5 – write your literature review, free lecture slides, other interesting articles, frequently asked questions, introduction.

• Quick Run-through
• Step 1 & 2

When you write a thesis , dissertation , or research paper , you will likely have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to:

• Demonstrate your familiarity with the topic and its scholarly context
• Develop a theoretical framework and methodology for your research
• Position your work in relation to other researchers and theorists
• Show how your research addresses a gap or contributes to a debate
• Evaluate the current state of research and demonstrate your knowledge of the scholarly debates around your topic.

Writing literature reviews is a particularly important skill if you want to apply for graduate school or pursue a career in research. We’ve written a step-by-step guide that you can follow below.

Don't submit your assignments before you do this

The academic proofreading tool has been trained on 1000s of academic texts. Making it the most accurate and reliable proofreading tool for students. Free citation check included.

Try for free

Writing literature reviews can be quite challenging! A good starting point could be to look at some examples, depending on what kind of literature review you’d like to write.

• Example literature review #1: “Why Do People Migrate? A Review of the Theoretical Literature” ( Theoretical literature review about the development of economic migration theory from the 1950s to today.)
• Example literature review #2: “Literature review as a research methodology: An overview and guidelines” ( Methodological literature review about interdisciplinary knowledge acquisition and production.)
• Example literature review #3: “The Use of Technology in English Language Learning: A Literature Review” ( Thematic literature review about the effects of technology on language acquisition.)
• Example literature review #4: “Learners’ Listening Comprehension Difficulties in English Language Learning: A Literature Review” ( Chronological literature review about how the concept of listening skills has changed over time.)

You can also check out our templates with literature review examples and sample outlines at the links below.

Download Word doc Download Google doc

Before you begin searching for literature, you need a clearly defined topic .

If you are writing the literature review section of a dissertation or research paper, you will search for literature related to your research problem and questions .

Make a list of keywords

Start by creating a list of keywords related to your research question. Include each of the key concepts or variables you’re interested in, and list any synonyms and related terms. You can add to this list as you discover new keywords in the process of your literature search.

• Social media, Facebook, Instagram, Twitter, Snapchat, TikTok
• Body image, self-perception, self-esteem, mental health
• Generation Z, teenagers, adolescents, youth

Search for relevant sources

Use your keywords to begin searching for sources. Some useful databases to search for journals and articles include:

• Your university’s library catalogue
• Google Scholar
• Project Muse (humanities and social sciences)
• Medline (life sciences and biomedicine)
• EconLit (economics)
• Inspec (physics, engineering and computer science)

You can also use boolean operators to help narrow down your search.

Make sure to read the abstract to find out whether an article is relevant to your question. When you find a useful book or article, you can check the bibliography to find other relevant sources.

You likely won’t be able to read absolutely everything that has been written on your topic, so it will be necessary to evaluate which sources are most relevant to your research question.

For each publication, ask yourself:

• What question or problem is the author addressing?
• What are the key concepts and how are they defined?
• What are the key theories, models, and methods?
• Does the research use established frameworks or take an innovative approach?
• What are the results and conclusions of the study?
• How does the publication relate to other literature in the field? Does it confirm, add to, or challenge established knowledge?
• What are the strengths and weaknesses of the research?

Make sure the sources you use are credible , and make sure you read any landmark studies and major theories in your field of research.

You can use our template to summarize and evaluate sources you’re thinking about using. Click on either button below to download.

Take notes and cite your sources

As you read, you should also begin the writing process. Take notes that you can later incorporate into the text of your literature review.

It is important to keep track of your sources with citations to avoid plagiarism . It can be helpful to make an annotated bibliography , where you compile full citation information and write a paragraph of summary and analysis for each source. This helps you remember what you read and saves time later in the process.

Here's why students love Scribbr's proofreading services

Discover proofreading & editing

To begin organizing your literature review’s argument and structure, be sure you understand the connections and relationships between the sources you’ve read. Based on your reading and notes, you can look for:

• Trends and patterns (in theory, method or results): do certain approaches become more or less popular over time?
• Themes: what questions or concepts recur across the literature?
• Debates, conflicts and contradictions: where do sources disagree?
• Pivotal publications: are there any influential theories or studies that changed the direction of the field?
• Gaps: what is missing from the literature? Are there weaknesses that need to be addressed?

This step will help you work out the structure of your literature review and (if applicable) show how your own research will contribute to existing knowledge.

• Most research has focused on young women.
• There is an increasing interest in the visual aspects of social media.
• But there is still a lack of robust research on highly visual platforms like Instagram and Snapchat—this is a gap that you could address in your own research.

There are various approaches to organizing the body of a literature review. Depending on the length of your literature review, you can combine several of these strategies (for example, your overall structure might be thematic, but each theme is discussed chronologically).

Chronological

The simplest approach is to trace the development of the topic over time. However, if you choose this strategy, be careful to avoid simply listing and summarizing sources in order.

Try to analyze patterns, turning points and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred.

If you have found some recurring central themes, you can organize your literature review into subsections that address different aspects of the topic.

For example, if you are reviewing literature about inequalities in migrant health outcomes, key themes might include healthcare policy, language barriers, cultural attitudes, legal status, and economic access.

Methodological

If you draw your sources from different disciplines or fields that use a variety of research methods , you might want to compare the results and conclusions that emerge from different approaches. For example:

• Look at what results have emerged in qualitative versus quantitative research
• Discuss how the topic has been approached by empirical versus theoretical scholarship
• Divide the literature into sociological, historical, and cultural sources

Theoretical

A literature review is often the foundation for a theoretical framework . You can use it to discuss various theories, models, and definitions of key concepts.

You might argue for the relevance of a specific theoretical approach, or combine various theoretical concepts to create a framework for your research.

Like any other academic text , your literature review should have an introduction , a main body, and a conclusion . What you include in each depends on the objective of your literature review.

The introduction should clearly establish the focus and purpose of the literature review.

Depending on the length of your literature review, you might want to divide the body into subsections. You can use a subheading for each theme, time period, or methodological approach.

As you write, you can follow these tips:

• Summarize and synthesize: give an overview of the main points of each source and combine them into a coherent whole
• Analyze and interpret: don’t just paraphrase other researchers — add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
• Critically evaluate: mention the strengths and weaknesses of your sources
• Write in well-structured paragraphs: use transition words and topic sentences to draw connections, comparisons and contrasts

In the conclusion, you should summarize the key findings you have taken from the literature and emphasize their significance.

When you’ve finished writing and revising your literature review, don’t forget to proofread thoroughly before submitting. Not a language expert? Check out Scribbr’s professional proofreading services !

This article has been adapted into lecture slides that you can use to teach your students about writing a literature review.

Scribbr slides are free to use, customize, and distribute for educational purposes.

Open Google Slides Download PowerPoint

If you want to know more about the research process , methodology , research bias , or statistics , make sure to check out some of our other articles with explanations and examples.

• Sampling methods
• Simple random sampling
• Stratified sampling
• Cluster sampling
• Likert scales
• Reproducibility

 Statistics

• Null hypothesis
• Statistical power
• Probability distribution
• Effect size
• Poisson distribution

Research bias

• Optimism bias
• Cognitive bias
• Implicit bias
• Hawthorne effect
• Anchoring bias
• Explicit bias

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a thesis, dissertation , or research paper , in order to situate your work in relation to existing knowledge.

There are several reasons to conduct a literature review at the beginning of a research project:

• To familiarize yourself with the current state of knowledge on your topic
• To ensure that you’re not just repeating what others have already done
• To identify gaps in knowledge and unresolved problems that your research can address
• To develop your theoretical framework and methodology
• To provide an overview of the key findings and debates on the topic

Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.

The literature review usually comes near the beginning of your thesis or dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .

A literature review is a survey of credible sources on a topic, often used in dissertations , theses, and research papers . Literature reviews give an overview of knowledge on a subject, helping you identify relevant theories and methods, as well as gaps in existing research. Literature reviews are set up similarly to other  academic texts , with an introduction , a main body, and a conclusion .

An  annotated bibliography is a list of  source references that has a short description (called an annotation ) for each of the sources. It is often assigned as part of the research process for a  paper .  

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

McCombes, S. (2023, September 11). How to Write a Literature Review | Guide, Examples, & Templates. Scribbr. Retrieved June 11, 2024, from https://www.scribbr.com/dissertation/literature-review/

Is this article helpful?

Shona McCombes

Other students also liked, what is a theoretical framework | guide to organizing, what is a research methodology | steps & tips, how to write a research proposal | examples & templates, get unlimited documents corrected.

✔ Free APA citation check included ✔ Unlimited document corrections ✔ Specialized in correcting academic texts

Writing the literature review for empirical papers

• Production 28

• University of São Paulo

• São Paulo State University

Abstract and Figures

Discover the world's research

• 25+ million members
• 160+ million publication pages
• 2.3+ billion citations
• Susana Garrido

• Wambua Mumanthi Mutua

• Charles Weda

• Nurunnisa Paquita Syech Abu Bakar
• Ani Rohaeni
• Thokozani Zylma Madumuse
• Abubaker Qutieshat

• Gustina Hidayat

• Tania Pacheco Centeno

• Cleofe Nerita
• Vallejo Lima
• L. Shamseer

• Annibal Scavarda
• INT J OPER PROD MAN

• Larissa Shamseer
• David Moher
• Mike Clarke

• Karen Locke

• J OPER MANAG

• Gary Cleveland

• Mahnaz Abbariki

• Mark Easterby-Smith

• Mark Petticrew
• Helen Roberts
• Robert I. Sutton

• Recruit researchers
• Join for free
• Login Email Tip: Most researchers use their institutional email address as their ResearchGate login Password Forgot password? Keep me logged in Log in or Continue with Google Welcome back! Please log in. Email · Hint Tip: Most researchers use their institutional email address as their ResearchGate login Password Forgot password? Keep me logged in Log in or Continue with Google No account? Sign up

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, automatically generate references for free.

• Knowledge Base
• Dissertation
• What is a Literature Review? | Guide, Template, & Examples

What is a Literature Review? | Guide, Template, & Examples

Published on 22 February 2022 by Shona McCombes . Revised on 7 June 2022.

What is a literature review? A literature review is a survey of scholarly sources on a specific topic. It provides an overview of current knowledge, allowing you to identify relevant theories, methods, and gaps in the existing research.

There are five key steps to writing a literature review:

• Search for relevant literature
• Evaluate sources
• Identify themes, debates and gaps
• Outline the structure
• Write your literature review

A good literature review doesn’t just summarise sources – it analyses, synthesises, and critically evaluates to give a clear picture of the state of knowledge on the subject.

Instantly correct all language mistakes in your text

Be assured that you'll submit flawless writing. Upload your document to correct all your mistakes.

Table of contents

Why write a literature review, examples of literature reviews, step 1: search for relevant literature, step 2: evaluate and select sources, step 3: identify themes, debates and gaps, step 4: outline your literature review’s structure, step 5: write your literature review, frequently asked questions about literature reviews, introduction.

• Quick Run-through
• Step 1 & 2

When you write a dissertation or thesis, you will have to conduct a literature review to situate your research within existing knowledge. The literature review gives you a chance to:

• Demonstrate your familiarity with the topic and scholarly context
• Develop a theoretical framework and methodology for your research
• Position yourself in relation to other researchers and theorists
• Show how your dissertation addresses a gap or contributes to a debate

You might also have to write a literature review as a stand-alone assignment. In this case, the purpose is to evaluate the current state of research and demonstrate your knowledge of scholarly debates around a topic.

The content will look slightly different in each case, but the process of conducting a literature review follows the same steps. We’ve written a step-by-step guide that you can follow below.

The only proofreading tool specialized in correcting academic writing

The academic proofreading tool has been trained on 1000s of academic texts and by native English editors. Making it the most accurate and reliable proofreading tool for students.

Correct my document today

Writing literature reviews can be quite challenging! A good starting point could be to look at some examples, depending on what kind of literature review you’d like to write.

• Example literature review #1: “Why Do People Migrate? A Review of the Theoretical Literature” ( Theoretical literature review about the development of economic migration theory from the 1950s to today.)
• Example literature review #2: “Literature review as a research methodology: An overview and guidelines” ( Methodological literature review about interdisciplinary knowledge acquisition and production.)
• Example literature review #3: “The Use of Technology in English Language Learning: A Literature Review” ( Thematic literature review about the effects of technology on language acquisition.)
• Example literature review #4: “Learners’ Listening Comprehension Difficulties in English Language Learning: A Literature Review” ( Chronological literature review about how the concept of listening skills has changed over time.)

You can also check out our templates with literature review examples and sample outlines at the links below.

Download Word doc Download Google doc

Before you begin searching for literature, you need a clearly defined topic .

If you are writing the literature review section of a dissertation or research paper, you will search for literature related to your research objectives and questions .

If you are writing a literature review as a stand-alone assignment, you will have to choose a focus and develop a central question to direct your search. Unlike a dissertation research question, this question has to be answerable without collecting original data. You should be able to answer it based only on a review of existing publications.

Make a list of keywords

Start by creating a list of keywords related to your research topic. Include each of the key concepts or variables you’re interested in, and list any synonyms and related terms. You can add to this list if you discover new keywords in the process of your literature search.

• Social media, Facebook, Instagram, Twitter, Snapchat, TikTok
• Body image, self-perception, self-esteem, mental health
• Generation Z, teenagers, adolescents, youth

Search for relevant sources

Use your keywords to begin searching for sources. Some databases to search for journals and articles include:

• Your university’s library catalogue
• Google Scholar
• Project Muse (humanities and social sciences)
• Medline (life sciences and biomedicine)
• EconLit (economics)
• Inspec (physics, engineering and computer science)

You can use boolean operators to help narrow down your search:

Read the abstract to find out whether an article is relevant to your question. When you find a useful book or article, you can check the bibliography to find other relevant sources.

To identify the most important publications on your topic, take note of recurring citations. If the same authors, books or articles keep appearing in your reading, make sure to seek them out.

You probably won’t be able to read absolutely everything that has been written on the topic – you’ll have to evaluate which sources are most relevant to your questions.

For each publication, ask yourself:

• What question or problem is the author addressing?
• What are the key concepts and how are they defined?
• What are the key theories, models and methods? Does the research use established frameworks or take an innovative approach?
• What are the results and conclusions of the study?
• How does the publication relate to other literature in the field? Does it confirm, add to, or challenge established knowledge?
• How does the publication contribute to your understanding of the topic? What are its key insights and arguments?
• What are the strengths and weaknesses of the research?

Make sure the sources you use are credible, and make sure you read any landmark studies and major theories in your field of research.

You can find out how many times an article has been cited on Google Scholar – a high citation count means the article has been influential in the field, and should certainly be included in your literature review.

The scope of your review will depend on your topic and discipline: in the sciences you usually only review recent literature, but in the humanities you might take a long historical perspective (for example, to trace how a concept has changed in meaning over time).

Remember that you can use our template to summarise and evaluate sources you’re thinking about using!

Take notes and cite your sources

As you read, you should also begin the writing process. Take notes that you can later incorporate into the text of your literature review.

It’s important to keep track of your sources with references to avoid plagiarism . It can be helpful to make an annotated bibliography, where you compile full reference information and write a paragraph of summary and analysis for each source. This helps you remember what you read and saves time later in the process.

You can use our free APA Reference Generator for quick, correct, consistent citations.

To begin organising your literature review’s argument and structure, you need to understand the connections and relationships between the sources you’ve read. Based on your reading and notes, you can look for:

• Trends and patterns (in theory, method or results): do certain approaches become more or less popular over time?
• Themes: what questions or concepts recur across the literature?
• Debates, conflicts and contradictions: where do sources disagree?
• Pivotal publications: are there any influential theories or studies that changed the direction of the field?
• Gaps: what is missing from the literature? Are there weaknesses that need to be addressed?

This step will help you work out the structure of your literature review and (if applicable) show how your own research will contribute to existing knowledge.

• Most research has focused on young women.
• There is an increasing interest in the visual aspects of social media.
• But there is still a lack of robust research on highly-visual platforms like Instagram and Snapchat – this is a gap that you could address in your own research.

There are various approaches to organising the body of a literature review. You should have a rough idea of your strategy before you start writing.

Depending on the length of your literature review, you can combine several of these strategies (for example, your overall structure might be thematic, but each theme is discussed chronologically).

Chronological

The simplest approach is to trace the development of the topic over time. However, if you choose this strategy, be careful to avoid simply listing and summarising sources in order.

Try to analyse patterns, turning points and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred.

If you have found some recurring central themes, you can organise your literature review into subsections that address different aspects of the topic.

For example, if you are reviewing literature about inequalities in migrant health outcomes, key themes might include healthcare policy, language barriers, cultural attitudes, legal status, and economic access.

Methodological

If you draw your sources from different disciplines or fields that use a variety of research methods , you might want to compare the results and conclusions that emerge from different approaches. For example:

• Look at what results have emerged in qualitative versus quantitative research
• Discuss how the topic has been approached by empirical versus theoretical scholarship
• Divide the literature into sociological, historical, and cultural sources

Theoretical

A literature review is often the foundation for a theoretical framework . You can use it to discuss various theories, models, and definitions of key concepts.

You might argue for the relevance of a specific theoretical approach, or combine various theoretical concepts to create a framework for your research.

Like any other academic text, your literature review should have an introduction , a main body, and a conclusion . What you include in each depends on the objective of your literature review.

The introduction should clearly establish the focus and purpose of the literature review.

If you are writing the literature review as part of your dissertation or thesis, reiterate your central problem or research question and give a brief summary of the scholarly context. You can emphasise the timeliness of the topic (“many recent studies have focused on the problem of x”) or highlight a gap in the literature (“while there has been much research on x, few researchers have taken y into consideration”).

Depending on the length of your literature review, you might want to divide the body into subsections. You can use a subheading for each theme, time period, or methodological approach.

As you write, make sure to follow these tips:

• Summarise and synthesise: give an overview of the main points of each source and combine them into a coherent whole.
• Analyse and interpret: don’t just paraphrase other researchers – add your own interpretations, discussing the significance of findings in relation to the literature as a whole.
• Critically evaluate: mention the strengths and weaknesses of your sources.
• Write in well-structured paragraphs: use transitions and topic sentences to draw connections, comparisons and contrasts.

In the conclusion, you should summarise the key findings you have taken from the literature and emphasise their significance.

If the literature review is part of your dissertation or thesis, reiterate how your research addresses gaps and contributes new knowledge, or discuss how you have drawn on existing theories and methods to build a framework for your research. This can lead directly into your methodology section.

A literature review is a survey of scholarly sources (such as books, journal articles, and theses) related to a specific topic or research question .

It is often written as part of a dissertation , thesis, research paper , or proposal .

There are several reasons to conduct a literature review at the beginning of a research project:

• To familiarise yourself with the current state of knowledge on your topic
• To ensure that you’re not just repeating what others have already done
• To identify gaps in knowledge and unresolved problems that your research can address
• To develop your theoretical framework and methodology
• To provide an overview of the key findings and debates on the topic

Writing the literature review shows your reader how your work relates to existing research and what new insights it will contribute.

The literature review usually comes near the beginning of your  dissertation . After the introduction , it grounds your research in a scholarly field and leads directly to your theoretical framework or methodology .

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.

McCombes, S. (2022, June 07). What is a Literature Review? | Guide, Template, & Examples. Scribbr. Retrieved 11 June 2024, from https://www.scribbr.co.uk/thesis-dissertation/literature-review/

Is this article helpful?

Shona McCombes

Other students also liked, how to write a dissertation proposal | a step-by-step guide, what is a theoretical framework | a step-by-step guide, what is a research methodology | steps & tips.

Research Methods

• Getting Started
• Literature Review Research
• Research Design
• Research Design By Discipline
• SAGE Research Methods
• Teaching with SAGE Research Methods

Literature Review

• What is a Literature Review?
• What is NOT a Literature Review?
• Purposes of a Literature Review
• Types of Literature Reviews
• Literature Reviews vs. Systematic Reviews
• Systematic vs. Meta-Analysis

Literature Review  is a comprehensive survey of the works published in a particular field of study or line of research, usually over a specific period of time, in the form of an in-depth, critical bibliographic essay or annotated list in which attention is drawn to the most significant works.

Also, we can define a literature review as the collected body of scholarly works related to a topic:

• Summarizes and analyzes previous research relevant to a topic
• Includes scholarly books and articles published in academic journals
• Can be an specific scholarly paper or a section in a research paper

The objective of a Literature Review is to find previous published scholarly works relevant to an specific topic

• Help gather ideas or information
• Keep up to date in current trends and findings
• Help develop new questions

A literature review is important because it:

• Explains the background of research on a topic.
• Demonstrates why a topic is significant to a subject area.
• Helps focus your own research questions or problems
• Discovers relationships between research studies/ideas.
• Suggests unexplored ideas or populations
• Identifies major themes, concepts, and researchers on a topic.
• Tests assumptions; may help counter preconceived ideas and remove unconscious bias.
• Identifies critical gaps, points of disagreement, or potentially flawed methodology or theoretical approaches.
• Indicates potential directions for future research.

All content in this section is from Literature Review Research from Old Dominion University 

Keep in mind the following, a literature review is NOT:

Not an essay 

Not an annotated bibliography  in which you summarize each article that you have reviewed.  A literature review goes beyond basic summarizing to focus on the critical analysis of the reviewed works and their relationship to your research question.

Not a research paper   where you select resources to support one side of an issue versus another.  A lit review should explain and consider all sides of an argument in order to avoid bias, and areas of agreement and disagreement should be highlighted.

A literature review serves several purposes. For example, it

• provides thorough knowledge of previous studies; introduces seminal works.
• helps focus one’s own research topic.
• identifies a conceptual framework for one’s own research questions or problems; indicates potential directions for future research.
• suggests previously unused or underused methodologies, designs, quantitative and qualitative strategies.
• identifies gaps in previous studies; identifies flawed methodologies and/or theoretical approaches; avoids replication of mistakes.
• helps the researcher avoid repetition of earlier research.
• suggests unexplored populations.
• determines whether past studies agree or disagree; identifies controversy in the literature.
• tests assumptions; may help counter preconceived ideas and remove unconscious bias.

As Kennedy (2007) notes*, it is important to think of knowledge in a given field as consisting of three layers. First, there are the primary studies that researchers conduct and publish. Second are the reviews of those studies that summarize and offer new interpretations built from and often extending beyond the original studies. Third, there are the perceptions, conclusions, opinion, and interpretations that are shared informally that become part of the lore of field. In composing a literature review, it is important to note that it is often this third layer of knowledge that is cited as "true" even though it often has only a loose relationship to the primary studies and secondary literature reviews.

Given this, while literature reviews are designed to provide an overview and synthesis of pertinent sources you have explored, there are several approaches to how they can be done, depending upon the type of analysis underpinning your study. Listed below are definitions of types of literature reviews:

Argumentative Review      This form examines literature selectively in order to support or refute an argument, deeply imbedded assumption, or philosophical problem already established in the literature. The purpose is to develop a body of literature that establishes a contrarian viewpoint. Given the value-laden nature of some social science research [e.g., educational reform; immigration control], argumentative approaches to analyzing the literature can be a legitimate and important form of discourse. However, note that they can also introduce problems of bias when they are used to to make summary claims of the sort found in systematic reviews.

Integrative Review      Considered a form of research that reviews, critiques, and synthesizes representative literature on a topic in an integrated way such that new frameworks and perspectives on the topic are generated. The body of literature includes all studies that address related or identical hypotheses. A well-done integrative review meets the same standards as primary research in regard to clarity, rigor, and replication.

Historical Review      Few things rest in isolation from historical precedent. Historical reviews are focused on examining research throughout a period of time, often starting with the first time an issue, concept, theory, phenomena emerged in the literature, then tracing its evolution within the scholarship of a discipline. The purpose is to place research in a historical context to show familiarity with state-of-the-art developments and to identify the likely directions for future research.

Methodological Review      A review does not always focus on what someone said [content], but how they said it [method of analysis]. This approach provides a framework of understanding at different levels (i.e. those of theory, substantive fields, research approaches and data collection and analysis techniques), enables researchers to draw on a wide variety of knowledge ranging from the conceptual level to practical documents for use in fieldwork in the areas of ontological and epistemological consideration, quantitative and qualitative integration, sampling, interviewing, data collection and data analysis, and helps highlight many ethical issues which we should be aware of and consider as we go through our study.

Systematic Review      This form consists of an overview of existing evidence pertinent to a clearly formulated research question, which uses pre-specified and standardized methods to identify and critically appraise relevant research, and to collect, report, and analyse data from the studies that are included in the review. Typically it focuses on a very specific empirical question, often posed in a cause-and-effect form, such as "To what extent does A contribute to B?"

Theoretical Review      The purpose of this form is to concretely examine the corpus of theory that has accumulated in regard to an issue, concept, theory, phenomena. The theoretical literature review help establish what theories already exist, the relationships between them, to what degree the existing theories have been investigated, and to develop new hypotheses to be tested. Often this form is used to help establish a lack of appropriate theories or reveal that current theories are inadequate for explaining new or emerging research problems. The unit of analysis can focus on a theoretical concept or a whole theory or framework.

* Kennedy, Mary M. "Defining a Literature."  Educational Researcher  36 (April 2007): 139-147.

All content in this section is from The Literature Review created by Dr. Robert Larabee USC

Robinson, P. and Lowe, J. (2015),  Literature reviews vs systematic reviews.  Australian and New Zealand Journal of Public Health, 39: 103-103. doi: 10.1111/1753-6405.12393

What's in the name? The difference between a Systematic Review and a Literature Review, and why it matters . By Lynn Kysh from University of Southern California

Systematic review or meta-analysis?

A  systematic review  answers a defined research question by collecting and summarizing all empirical evidence that fits pre-specified eligibility criteria.

A  meta-analysis  is the use of statistical methods to summarize the results of these studies.

Systematic reviews, just like other research articles, can be of varying quality. They are a significant piece of work (the Centre for Reviews and Dissemination at York estimates that a team will take 9-24 months), and to be useful to other researchers and practitioners they should have:

• clearly stated objectives with pre-defined eligibility criteria for studies
• explicit, reproducible methodology
• a systematic search that attempts to identify all studies
• assessment of the validity of the findings of the included studies (e.g. risk of bias)
• systematic presentation, and synthesis, of the characteristics and findings of the included studies

Not all systematic reviews contain meta-analysis. 

Meta-analysis is the use of statistical methods to summarize the results of independent studies. By combining information from all relevant studies, meta-analysis can provide more precise estimates of the effects of health care than those derived from the individual studies included within a review.  More information on meta-analyses can be found in  Cochrane Handbook, Chapter 9 .

A meta-analysis goes beyond critique and integration and conducts secondary statistical analysis on the outcomes of similar studies.  It is a systematic review that uses quantitative methods to synthesize and summarize the results.

An advantage of a meta-analysis is the ability to be completely objective in evaluating research findings.  Not all topics, however, have sufficient research evidence to allow a meta-analysis to be conducted.  In that case, an integrative review is an appropriate strategy. 

Some of the content in this section is from Systematic reviews and meta-analyses: step by step guide created by Kate McAllister.

• ~[123]~: Aug 21, 2023 4:07 PM
• ~[124]~: https://guides.lib.udel.edu/researchmethods

Purdue Online Writing Lab Purdue OWL® College of Liberal Arts

Writing a Literature Review

Welcome to the Purdue OWL

This page is brought to you by the OWL at Purdue University. When printing this page, you must include the entire legal notice.

Copyright ©1995-2018 by The Writing Lab & The OWL at Purdue and Purdue University. All rights reserved. This material may not be published, reproduced, broadcast, rewritten, or redistributed without permission. Use of this site constitutes acceptance of our terms and conditions of fair use.

A literature review is a document or section of a document that collects key sources on a topic and discusses those sources in conversation with each other (also called synthesis ). The lit review is an important genre in many disciplines, not just literature (i.e., the study of works of literature such as novels and plays). When we say “literature review” or refer to “the literature,” we are talking about the research ( scholarship ) in a given field. You will often see the terms “the research,” “the scholarship,” and “the literature” used mostly interchangeably.

Where, when, and why would I write a lit review?

There are a number of different situations where you might write a literature review, each with slightly different expectations; different disciplines, too, have field-specific expectations for what a literature review is and does. For instance, in the humanities, authors might include more overt argumentation and interpretation of source material in their literature reviews, whereas in the sciences, authors are more likely to report study designs and results in their literature reviews; these differences reflect these disciplines’ purposes and conventions in scholarship. You should always look at examples from your own discipline and talk to professors or mentors in your field to be sure you understand your discipline’s conventions, for literature reviews as well as for any other genre.

A literature review can be a part of a research paper or scholarly article, usually falling after the introduction and before the research methods sections. In these cases, the lit review just needs to cover scholarship that is important to the issue you are writing about; sometimes it will also cover key sources that informed your research methodology.

Lit reviews can also be standalone pieces, either as assignments in a class or as publications. In a class, a lit review may be assigned to help students familiarize themselves with a topic and with scholarship in their field, get an idea of the other researchers working on the topic they’re interested in, find gaps in existing research in order to propose new projects, and/or develop a theoretical framework and methodology for later research. As a publication, a lit review usually is meant to help make other scholars’ lives easier by collecting and summarizing, synthesizing, and analyzing existing research on a topic. This can be especially helpful for students or scholars getting into a new research area, or for directing an entire community of scholars toward questions that have not yet been answered.

What are the parts of a lit review?

Most lit reviews use a basic introduction-body-conclusion structure; if your lit review is part of a larger paper, the introduction and conclusion pieces may be just a few sentences while you focus most of your attention on the body. If your lit review is a standalone piece, the introduction and conclusion take up more space and give you a place to discuss your goals, research methods, and conclusions separately from where you discuss the literature itself.

Introduction:

• An introductory paragraph that explains what your working topic and thesis is
• A forecast of key topics or texts that will appear in the review
• Potentially, a description of how you found sources and how you analyzed them for inclusion and discussion in the review (more often found in published, standalone literature reviews than in lit review sections in an article or research paper)
• Summarize and synthesize: Give an overview of the main points of each source and combine them into a coherent whole
• Analyze and interpret: Don’t just paraphrase other researchers – add your own interpretations where possible, discussing the significance of findings in relation to the literature as a whole
• Critically Evaluate: Mention the strengths and weaknesses of your sources
• Write in well-structured paragraphs: Use transition words and topic sentence to draw connections, comparisons, and contrasts.

Conclusion:

• Summarize the key findings you have taken from the literature and emphasize their significance
• Connect it back to your primary research question

How should I organize my lit review?

Lit reviews can take many different organizational patterns depending on what you are trying to accomplish with the review. Here are some examples:

• Chronological : The simplest approach is to trace the development of the topic over time, which helps familiarize the audience with the topic (for instance if you are introducing something that is not commonly known in your field). If you choose this strategy, be careful to avoid simply listing and summarizing sources in order. Try to analyze the patterns, turning points, and key debates that have shaped the direction of the field. Give your interpretation of how and why certain developments occurred (as mentioned previously, this may not be appropriate in your discipline — check with a teacher or mentor if you’re unsure).
• Thematic : If you have found some recurring central themes that you will continue working with throughout your piece, you can organize your literature review into subsections that address different aspects of the topic. For example, if you are reviewing literature about women and religion, key themes can include the role of women in churches and the religious attitude towards women.
• Qualitative versus quantitative research
• Empirical versus theoretical scholarship
• Divide the research by sociological, historical, or cultural sources
• Theoretical : In many humanities articles, the literature review is the foundation for the theoretical framework. You can use it to discuss various theories, models, and definitions of key concepts. You can argue for the relevance of a specific theoretical approach or combine various theorical concepts to create a framework for your research.

What are some strategies or tips I can use while writing my lit review?

Any lit review is only as good as the research it discusses; make sure your sources are well-chosen and your research is thorough. Don’t be afraid to do more research if you discover a new thread as you’re writing. More info on the research process is available in our "Conducting Research" resources .

As you’re doing your research, create an annotated bibliography ( see our page on the this type of document ). Much of the information used in an annotated bibliography can be used also in a literature review, so you’ll be not only partially drafting your lit review as you research, but also developing your sense of the larger conversation going on among scholars, professionals, and any other stakeholders in your topic.

Usually you will need to synthesize research rather than just summarizing it. This means drawing connections between sources to create a picture of the scholarly conversation on a topic over time. Many student writers struggle to synthesize because they feel they don’t have anything to add to the scholars they are citing; here are some strategies to help you:

• It often helps to remember that the point of these kinds of syntheses is to show your readers how you understand your research, to help them read the rest of your paper.
• Writing teachers often say synthesis is like hosting a dinner party: imagine all your sources are together in a room, discussing your topic. What are they saying to each other?
• Look at the in-text citations in each paragraph. Are you citing just one source for each paragraph? This usually indicates summary only. When you have multiple sources cited in a paragraph, you are more likely to be synthesizing them (not always, but often
• Read more about synthesis here.

The most interesting literature reviews are often written as arguments (again, as mentioned at the beginning of the page, this is discipline-specific and doesn’t work for all situations). Often, the literature review is where you can establish your research as filling a particular gap or as relevant in a particular way. You have some chance to do this in your introduction in an article, but the literature review section gives a more extended opportunity to establish the conversation in the way you would like your readers to see it. You can choose the intellectual lineage you would like to be part of and whose definitions matter most to your thinking (mostly humanities-specific, but this goes for sciences as well). In addressing these points, you argue for your place in the conversation, which tends to make the lit review more compelling than a simple reporting of other sources.

• University of Texas Libraries

Literature Reviews

• What is a literature review?
• Steps in the Literature Review Process
• Define your research question
• Determine inclusion and exclusion criteria
• Choose databases and search
• Review Results
• Synthesize Results
• Analyze Results
• Librarian Support

What is a Literature Review?

A literature or narrative review is a comprehensive review and analysis of the published literature on a specific topic or research question. The literature that is reviewed contains: books, articles, academic articles, conference proceedings, association papers, and dissertations. It contains the most pertinent studies and points to important past and current research and practices. It provides background and context, and shows how your research will contribute to the field. 

A literature review should: 

• Provide a comprehensive and updated review of the literature;
• Explain why this review has taken place;
• Articulate a position or hypothesis;
• Acknowledge and account for conflicting and corroborating points of view

From  S age Research Methods

Purpose of a Literature Review

A literature review can be written as an introduction to a study to:

• Demonstrate how a study fills a gap in research
• Compare a study with other research that's been done

Or it can be a separate work (a research article on its own) which:

• Organizes or describes a topic
• Describes variables within a particular issue/problem

Limitations of a Literature Review

Some of the limitations of a literature review are:

• It's a snapshot in time. Unlike other reviews, this one has beginning, a middle and an end. There may be future developments that could make your work less relevant.
• It may be too focused. Some niche studies may miss the bigger picture.
• It can be difficult to be comprehensive. There is no way to make sure all the literature on a topic was considered.
• It is easy to be biased if you stick to top tier journals. There may be other places where people are publishing exemplary research. Look to open access publications and conferences to reflect a more inclusive collection. Also, make sure to include opposing views (and not just supporting evidence).

Source: Grant, Maria J., and Andrew Booth. “A Typology of Reviews: An Analysis of 14 Review Types and Associated Methodologies.” Health Information & Libraries Journal, vol. 26, no. 2, June 2009, pp. 91–108. Wiley Online Library, doi:10.1111/j.1471-1842.2009.00848.x.

Meryl Brodsky : Communication and Information Studies

Hannah Chapman Tripp : Biology, Neuroscience

Carolyn Cunningham : Human Development & Family Sciences, Psychology, Sociology

Larayne Dallas : Engineering

Janelle Hedstrom : Special Education, Curriculum & Instruction, Ed Leadership & Policy ​

Susan Macicak : Linguistics

Imelda Vetter : Dell Medical School

For help in other subject areas, please see the guide to library specialists by subject .

Periodically, UT Libraries runs a workshop covering the basics and library support for literature reviews. While we try to offer these once per academic year, we find providing the recording to be helpful to community members who have missed the session. Following is the most recent recording of the workshop, Conducting a Literature Review. To view the recording, a UT login is required.

• October 26, 2022 recording
• ~[123]~: Oct 26, 2022 2:49 PM
• ~[124]~: https://guides.lib.utexas.edu/literaturereviews

Want to create or adapt books like this? Learn more about how Pressbooks supports open publishing practices.

Chapter 1: Introduction

Learning objectives.

At the conclusion of this chapter, you will be able to:

• Identify the purpose of the literature review in  the research process
• Distinguish between different types of literature reviews

1.1 What is a Literature Review?

Pick up nearly any book on research methods and you will find a description of a literature review.  At a basic level, the term implies a survey of factual or nonfiction books, articles, and other documents published on a particular subject.  Definitions may be similar across the disciplines, with new types and definitions continuing to emerge.  Generally speaking, a literature review is a:

• “comprehensive background of the literature within the interested topic area…” ( O’Gorman & MacIntosh, 2015, p. 31 ).
• “critical component of the research process that provides an in-depth analysis of recently published research findings in specifically identified areas of interest.” ( House, 2018, p. 109 ).
• “written document that presents a logically argued case founded on a comprehensive understanding of the current state of knowledge about a topic of study” ( Machi & McEvoy,  2012, p. 4 ).

As a foundation for knowledge advancement in every discipline, it is an important element of any research project.  At the graduate or doctoral level, the literature review is an essential feature of thesis and dissertation, as well as grant proposal writing.  That is to say, “A substantive, thorough, sophisticated literature review is a precondition for doing substantive, thorough, sophisticated research…A researcher cannot perform significant research without first understanding the literature in the field.” ( Boote & Beile, 2005, p. 3 ).  It is by this means, that a researcher demonstrates familiarity with a body of knowledge and thereby establishes credibility with a reader.  An advanced-level literature review shows how prior research is linked to a new project, summarizing and synthesizing what is known while identifying gaps in the knowledge base, facilitating theory development, closing areas where enough research already exists, and uncovering areas where more research is needed. ( Webster & Watson, 2002, p. xiii )

A graduate-level literature review is a compilation of the most significant previously published research on your topic. Unlike an annotated bibliography or a research paper you may have written as an undergraduate, your literature review will outline, evaluate and synthesize relevant research and relate those sources to your own thesis or research question. It is much more than a summary of all the related literature.

It is a type of writing that demonstrate the importance of your research by defining the main ideas and the relationship between them. A good literature review lays the foundation for the importance of your stated problem and research question.

Literature reviews:

• define a concept
• map the research terrain or scope
• systemize relationships between concepts
• identify gaps in the literature ( Rocco & Plathotnik, 2009, p. 128 )

The purpose of a literature review is to demonstrate that your research question  is meaningful. Additionally, you may review the literature of different disciplines to find deeper meaning and understanding of your topic. It is especially important to consider other disciplines when you do not find much on your topic in one discipline. You will need to search the cognate literature before claiming there is “little previous research” on your topic.

Well developed literature reviews involve numerous steps and activities. The literature review is an iterative process because you will do at least two of them: a preliminary search to learn what has been published in your area and whether there is sufficient support in the literature for moving ahead with your subject. After this first exploration, you will conduct a deeper dive into the literature to learn everything you can about the topic and its related issues.

Literature Review Tutorial

1.2 Literature Review Basics

An effective literature review must:

• Methodologically analyze and synthesize quality literature on a topic
• Provide a firm foundation to a topic or research area
• Provide a firm foundation for the selection of a research methodology
• Demonstrate that the proposed research contributes something new to the overall body of knowledge of advances the research field’s knowledge base. ( Levy & Ellis, 2006 ).

All literature reviews, whether they are qualitative, quantitative or both, will at some point:

• Introduce the topic and define its key terms
• Establish the importance of the topic
• Provide an overview of the amount of available literature and its types (for example: theoretical, statistical, speculative)
• Identify gaps in the literature
• Point out consistent finding across studies
• Arrive at a synthesis that organizes what is known about a topic
• Discusses possible implications and directions for future research

1.3 Types of Literature Reviews

There are many different types of literature reviews, however there are some shared characteristics or features.  Remember a comprehensive literature review is, at its most fundamental level, an original work based on an extensive critical examination and synthesis of the relevant literature on a topic. As a study of the research on a particular topic, it is arranged by key themes or findings, which may lead up to or link to the  research question.  In some cases, the research question will drive the type of literature review that is undertaken.

The following section includes brief descriptions of the terms used to describe different literature review types with examples of each.   The included citations are open access, Creative Commons licensed or copyright-restricted.

1.3.1 Types of Review

1.3.1.1 conceptual.

Guided by an understanding of basic issues rather than a research methodology. You are looking for key factors, concepts or variables and the presumed relationship between them. The goal of the conceptual literature review is to categorize and describe concepts relevant to your study or topic and outline a relationship between them. You will include relevant theory and empirical research.

Examples of a Conceptual Review:

• Education : The formality of learning science in everyday life: A conceptual literature review. ( Dohn, 2010 ).
• Education : Are we asking the right questions? A conceptual review of the educational development literature in higher education. ( Amundsen & Wilson, 2012 ).

1.3.1.2 Empirical

An empirical literature review collects, creates, arranges, and analyzes numeric data reflecting the frequency of themes, topics, authors and/or methods found in existing literature. Empirical literature reviews present their summaries in quantifiable terms using descriptive and inferential statistics.

Examples of an Empirical Review:

• Nursing : False-positive findings in Cochrane meta-analyses with and without application of trial sequential analysis: An empirical review. ( Imberger, Thorlund, Gluud, & Wettersley, 2016 ).
• Education : Impediments of e-learning adoption in higher learning institutions of Tanzania: An empirical review ( Mwakyusa & Mwalyagile, 2016 ).

1.3.1.3 Exploratory

Unlike a synoptic literature review, the purpose here is to provide a broad approach to the topic area. The aim is breadth rather than depth and to get a general feel for the size of the topic area. A graduate student might do an exploratory review of the literature before beginning a synoptic, or more comprehensive one.

Examples of an Exploratory Review:

• Education : University research management: An exploratory literature review. ( Schuetzenmeister, 2010 ).
• Education : An exploratory review of design principles in constructivist gaming learning environments. ( Rosario & Widmeyer, 2009 ).

1.3.1.4 Focused

A type of literature review limited to a single aspect of previous research, such as methodology. A focused literature review generally will describe the implications of choosing a particular element of past research, such as methodology in terms of data collection, analysis and interpretation.

Examples of a Focused Review:

• Nursing : Clinical inertia in the management of type 2 diabetes mellitus: A focused literature review. ( Khunti, Davies, & Khunti, 2015 ).
• Education : Language awareness: Genre awareness-a focused review of the literature. ( Stainton, 1992 ).

1.3.1.5 Integrative

Critiques past research and draws overall conclusions from the body of literature at a specified point in time. Reviews, critiques, and synthesizes representative literature on a topic in an integrated way. Most integrative reviews are intended to address mature topics or  emerging topics. May require the author to adopt a guiding theory, a set of competing models, or a point of view about a topic.  For more description of integrative reviews, see Whittemore & Knafl (2005).

Examples of an Integrative Review:

• Nursing : Interprofessional teamwork and collaboration between community health workers and healthcare teams: An integrative review. ( Franklin,  Bernhardt, Lopez, Long-Middleton, & Davis, 2015 ).
• Education : Exploring the gap between teacher certification and permanent employment in Ontario: An integrative literature review. ( Brock & Ryan, 2016 ).

1.3.1.6 Meta-analysis

A subset of a  systematic review, that takes findings from several studies on the same subject and analyzes them using standardized statistical procedures to pool together data. Integrates findings from a large body of quantitative findings to enhance understanding, draw conclusions, and detect patterns and relationships. Gather data from many different, independent studies that look at the same research question and assess similar outcome measures. Data is combined and re-analyzed, providing a greater statistical power than any single study alone. It’s important to note that not every systematic review includes a meta-analysis but a meta-analysis can’t exist without a systematic review of the literature.

Examples of a Meta-Analysis:

• Education : Efficacy of the cooperative learning method on mathematics achievement and attitude: A meta-analysis research. ( Capar & Tarim, 2015 ).
• Nursing : A meta-analysis of the effects of non-traditional teaching methods on the critical thinking abilities of nursing students. ( Lee, Lee, Gong, Bae, & Choi, 2016 ).
• Education : Gender differences in student attitudes toward science: A meta-analysis of the literature from 1970 to 1991. ( Weinburgh, 1995 ).

1.3.1.7 Narrative/Traditional

An overview of research on a particular topic that critiques and summarizes a body of literature. Typically broad in focus. Relevant past research is selected and synthesized into a coherent discussion. Methodologies, findings and limits of the existing body of knowledge are discussed in narrative form. Sometimes also referred to as a traditional literature review. Requires a sufficiently focused research question. The process may be subject to bias that supports the researcher’s own work.

Examples of a Narrative/Traditional Review:

• Nursing : Family carers providing support to a person dying in the home setting: A narrative literature review. ( Morris, King, Turner, & Payne, 2015 ).
• Education : Adventure education and Outward Bound: Out-of-class experiences that make a lasting difference. ( Hattie, Marsh, Neill, & Richards, 1997 ).
• Education : Good quality discussion is necessary but not sufficient in asynchronous tuition: A brief narrative review of the literature. ( Fear & Erikson-Brown, 2014 ).
• Nursing : Outcomes of physician job satisfaction: A narrative review, implications, and directions for future research. ( Williams & Skinner, 2003 ).

1.3.1.8 Realist

Aspecific type of literature review that is theory-driven and interpretative and is intended to explain the outcomes of a complex intervention program(s).

Examples of a Realist Review:

• Nursing : Lean thinking in healthcare: A realist review of the literature. ( Mazzacato, Savage, Brommels, 2010 ).
• Education : Unravelling quality culture in higher education: A realist review. ( Bendermacher, Egbrink, Wolfhagen, & Dolmans, 2017 ).

1.3.1.9 Scoping

Tend to be non-systematic and focus on breadth of coverage conducted on a topic rather than depth. Utilize a wide range of materials; may not evaluate the quality of the studies as much as count the number. One means of understanding existing literature. Aims to identify nature and extent of research; preliminary assessment of size and scope of available research on topic. May include research in progress.

Examples of a Scoping Review:

• Nursing : Organizational interventions improving access to community-based primary health care for vulnerable populations: A scoping review. ( Khanassov, Pluye, Descoteaux, Haggerty,  Russell, Gunn, & Levesque, 2016 ).
• Education : Interdisciplinary doctoral research supervision: A scoping review. ( Vanstone, Hibbert, Kinsella, McKenzie, Pitman, & Lingard, 2013 ).
• Nursing : A scoping review of the literature on the abolition of user fees in health care services in Africa. ( Ridde, & Morestin, 2011 ).

1.3.1.10 Synoptic

Unlike an exploratory review, the purpose is to provide a concise but accurate overview of all material that appears to be relevant to a chosen topic. Both content and methodological material is included. The review should aim to be both descriptive and evaluative. Summarizes previous studies while also showing how the body of literature could be extended and improved in terms of content and method by identifying gaps.

Examples of a Synoptic Review:

• Education : Theoretical framework for educational assessment: A synoptic review. ( Ghaicha, 2016 ).
• Education : School effects research: A synoptic review of past efforts and some suggestions for the future. ( Cuttance, 1981 ).

1.3.1.11 Systematic Review

A rigorous review that follows a strict methodology designed with a presupposed selection of literature reviewed.  Undertaken to clarify the state of existing research, the evidence, and possible implications that can be drawn from that.  Using comprehensive and exhaustive searching of the published and unpublished literature, searching various databases, reports, and grey literature.  Transparent and reproducible in reporting details of time frame, search and methods to minimize bias.  Must include a team of at least 2-3 and includes the critical appraisal of the literature.  For more description of systematic reviews, including links to protocols, checklists, workflow processes, and structure see “ A Young Researcher’s Guide to a Systematic Review “.

Examples of a Systematic Review:

• Education : The potentials of using cloud computing in schools: A systematic literature review ( Hartmann, Braae, Pedersen, & Khalid, 2017 )
• Nursing : Is butter back? A systematic review and meta-analysis of butter consumption and risk of cardiovascular disease, diabetes, and total mortality. ( Pimpin, Wu, Haskelberg, Del Gobbo, & Mozaffarian, 2016 ).
• Education : The use of research to improve professional practice: a systematic review of the literature. ( Hemsley-Brown & Sharp, 2003 ).
• Nursing : Using computers to self-manage type 2 diabetes. ( Pal, Eastwood, Michie, Farmer, Barnard, Peacock, Wood, Inniss, & Murray, 2013 ).

1.3.1.12 Umbrella/Overview of Reviews

Compiles evidence from multiple systematic reviews into one document. Focuses on broad condition or problem for which there are competing interventions and highlights reviews that address those interventions and their effects. Often used in recommendations for practice.

Examples of an Umbrella/Overview Review:

• Education : Reflective practice in healthcare education: An umbrella review. ( Fragknos, 2016 ).
• Nursing : Systematic reviews of psychosocial interventions for autism: an umbrella review. ( Seida, Ospina, Karkhaneh, Hartling, Smith, & Clark, 2009 ).

For a brief discussion see “ Not all literature reviews are the same ” (Thomson, 2013).

1.4 Why do a Literature Review?

The purpose of the literature review is the same regardless of the topic or research method. It tests your own research question against what is already known about the subject.

1.4.1 First – It’s part of the whole. Omission of a literature review chapter or section in a graduate-level project represents a serious void or absence of critical element in the research process.

The outcome of your review is expected to demonstrate that you:

• can systematically explore the research in your topic area
• can read and critically analyze the literature in your discipline and then use it appropriately to advance your own work
• have sufficient knowledge in the topic to undertake further investigation

1.4.2 Second – It’s good for you!

• You improve your skills as a researcher
• You become familiar with the discourse of your discipline and learn how to be a scholar in your field
• You learn through writing your ideas and finding your voice in your subject area
• You define, redefine and clarify your research question for yourself in the process

1.4.3 Third – It’s good for your reader. Your reader expects you to have done the hard work of gathering, evaluating and synthesizes the literature.  When you do a literature review you:

• Set the context for the topic and present its significance
• Identify what’s important to know about your topic – including individual material, prior research, publications, organizations and authors.
• Demonstrate relationships among prior research
• Establish limitations of existing knowledge
• Analyze trends in the topic’s treatment and gaps in the literature

1.4.4 Why do a literature review?

• To locate gaps in the literature of your discipline
• To avoid reinventing the wheel
• To carry on where others have already been
• To identify other people working in the same field
• To increase your breadth of knowledge in your subject area
• To find the seminal works in your field
• To provide intellectual context for your own work
• To acknowledge opposing viewpoints
• To put your work in perspective
• To demonstrate you can discover and retrieve previous work in the area

1.5 Common Literature Review Errors

Graduate-level literature reviews are more than a summary of the publications you find on a topic.  As you have seen in this brief introduction, literature reviews are a very specific type of research, analysis, and writing.  We will explore these topics more in the next chapters.  Some things to keep in mind as you begin your own research and writing are ways to avoid the most common errors seen in the first attempt at a literature review.  For a quick review of some of the pitfalls and challenges a new researcher faces when he/she begins work, see “ Get Ready: Academic Writing, General Pitfalls and (oh yes) Getting Started! ”.

As you begin your own graduate-level literature review, try to avoid these common mistakes:

• Accepts another researcher’s finding as valid without evaluating methodology and data
• Contrary findings and alternative interpretations are not considered or mentioned
• Findings are not clearly related to one’s own study, or findings are too general
• Insufficient time allowed to define best search strategies and writing
• Isolated statistical results are simply reported rather than synthesizing the results
• Problems with selecting and using most relevant keywords, subject headings and descriptors
• Relies too heavily on secondary sources
• Search methods are not recorded or reported for transparency
• Summarizes rather than synthesizes articles

In conclusion, the purpose of a literature review is three-fold:

• to survey the current state of knowledge or evidence in the area of inquiry,
• to identify key authors, articles, theories, and findings in that area, and
• to identify gaps in knowledge in that research area.

A literature review is commonly done today using computerized keyword searches in online databases, often working with a trained librarian or information expert. Keywords can be combined using the Boolean operators, “and”, “or” and sometimes “not”  to narrow down or expand the search results. Once a list of articles is generated from the keyword and subject heading search, the researcher must then manually browse through each title and abstract, to determine the suitability of that article before a full-text article is obtained for the research question.

Literature reviews should be reasonably complete, and not restricted to a few journals, a few years, or a specific methodology or research design. Reviewed articles may be summarized in the form of tables, and can be further structured using organizing frameworks such as a concept matrix.

A well-conducted literature review should indicate whether the initial research questions have already been addressed in the literature, whether there are newer or more interesting research questions available, and whether the original research questions should be modified or changed in light of findings of the literature review.

The review can also provide some intuitions or potential answers to the questions of interest and/or help identify theories that have previously been used to address similar questions and may provide evidence to inform policy or decision-making. ( Bhattacherjee, 2012 ).

Read Abstract 1.  Refer to Types of Literature Reviews.  What type of literature review do you think this study is and why?  See the Answer Key for the correct response.

Nursing : To describe evidence of international literature on the safe care of the hospitalised child after the World Alliance for Patient Safety and list contributions of the general theoretical framework of patient safety for paediatric nursing.

An integrative literature review between 2004 and 2015 using the databases PubMed, Cumulative Index of Nursing and Allied Health Literature (CINAHL), Scopus, Web of Science and Wiley Online Library, and the descriptors Safety or Patient safety, Hospitalised child, Paediatric nursing, and Nursing care.

Thirty-two articles were analysed, most of which were from North American, with a descriptive approach. The quality of the recorded information in the medical records, the use of checklists, and the training of health workers contribute to safe care in paediatric nursing and improve the medication process and partnerships with parents.

General information available on patient safety should be incorporated in paediatric nursing care. ( Wegner, Silva, Peres, Bandeira, Frantz, Botene, & Predebon, 2017 ).

Read Abstract 2.  Refer to Types of Literature Reviews.  What type of lit review do you think this study is and why?  See the Answer Key for the correct response.

Education : The focus of this paper centers around timing associated with early childhood education programs and interventions using meta-analytic methods. At any given assessment age, a child’s current age equals starting age, plus duration of program, plus years since program ended. Variability in assessment ages across the studies should enable everyone to identify the separate effects of all three time-related components. The project is a meta-analysis of evaluation studies of early childhood education programs conducted in the United States and its territories between 1960 and 2007. The population of interest is children enrolled in early childhood education programs between the ages of 0 and 5 and their control-group counterparts. Since the data come from a meta-analysis, the population for this study is drawn from many different studies with diverse samples. Given the preliminary nature of their analysis, the authors cannot offer conclusions at this point. ( Duncan, Leak, Li, Magnuson, Schindler, & Yoshikawa, 2011 ).

Test Yourself

See Answer Key for the correct responses.

The purpose of a graduate-level literature review is to summarize in as many words as possible everything that is known about my topic.

A literature review is significant because in the process of doing one, the researcher learns to read and critically assess the literature of a discipline and then uses it appropriately to advance his/her own research.

Read the following abstract and choose the correct type of literature review it represents.

Nursing: E-cigarette use has become increasingly popular, especially among the young. Its long-term influence upon health is unknown. Aim of this review has been to present the current state of knowledge about the impact of e-cigarette use on health, with an emphasis on Central and Eastern Europe. During the preparation of this narrative review, the literature on e-cigarettes available within the network PubMed was retrieved and examined. In the final review, 64 research papers were included. We specifically assessed the construction and operation of the e-cigarette as well as the chemical composition of the e-liquid; the impact that vapor arising from the use of e-cigarette explored in experimental models in vitro; and short-term effects of use of e-cigarettes on users’ health. Among the substances inhaled by the e-smoker, there are several harmful products, such as: formaldehyde, acetaldehyde, acroleine, propanal, nicotine, acetone, o-methyl-benzaldehyde, carcinogenic nitrosamines. Results from experimental animal studies indicate the negative impact of e-cigarette exposure on test models, such as ascytotoxicity, oxidative stress, inflammation, airway hyper reactivity, airway remodeling, mucin production, apoptosis, and emphysematous changes. The short-term impact of e-cigarettes on human health has been studied mostly in experimental setting. Available evidence shows that the use of e-cigarettes may result in acute lung function responses (e.g., increase in impedance, peripheral airway flow resistance) and induce oxidative stress. Based on the current available evidence, e-cigarette use is associated with harmful biologic responses, although it may be less harmful than traditional cigarettes. (J ankowski, Brożek, Lawson, Skoczyński, & Zejda, 2017 ).

• Meta-analysis
• Exploratory

Education: In this review, Mary Vorsino writes that she is interested in keeping the potential influences of women pragmatists of Dewey’s day in mind while presenting modern feminist re readings of Dewey. She wishes to construct a narrowly-focused and succinct literature review of thinkers who have donned a feminist lens to analyze Dewey’s approaches to education, learning, and democracy and to employ Dewey’s works in theorizing on gender and education and on gender in society. This article first explores Dewey as both an ally and a problematic figure in feminist literature and then investigates the broader sphere of feminist pragmatism and two central themes within it: (1) valuing diversity, and diverse experiences; and (2) problematizing fixed truths. ( Vorsino, 2015 ).

Image Attributions

Literature Reviews for Education and Nursing Graduate Students Copyright © by Linda Frederiksen is licensed under a Creative Commons Attribution 4.0 International License , except where otherwise noted.

Share This Book

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• CBE Life Sci Educ
• v.21(3); Fall 2022

Literature Reviews, Theoretical Frameworks, and Conceptual Frameworks: An Introduction for New Biology Education Researchers

Julie a. luft.

† Department of Mathematics, Social Studies, and Science Education, Mary Frances Early College of Education, University of Georgia, Athens, GA 30602-7124

Sophia Jeong

‡ Department of Teaching & Learning, College of Education & Human Ecology, Ohio State University, Columbus, OH 43210

Robert Idsardi

§ Department of Biology, Eastern Washington University, Cheney, WA 99004

Grant Gardner

∥ Department of Biology, Middle Tennessee State University, Murfreesboro, TN 37132

Associated Data

To frame their work, biology education researchers need to consider the role of literature reviews, theoretical frameworks, and conceptual frameworks as critical elements of the research and writing process. However, these elements can be confusing for scholars new to education research. This Research Methods article is designed to provide an overview of each of these elements and delineate the purpose of each in the educational research process. We describe what biology education researchers should consider as they conduct literature reviews, identify theoretical frameworks, and construct conceptual frameworks. Clarifying these different components of educational research studies can be helpful to new biology education researchers and the biology education research community at large in situating their work in the broader scholarly literature.

INTRODUCTION

Discipline-based education research (DBER) involves the purposeful and situated study of teaching and learning in specific disciplinary areas ( Singer et al. , 2012 ). Studies in DBER are guided by research questions that reflect disciplines’ priorities and worldviews. Researchers can use quantitative data, qualitative data, or both to answer these research questions through a variety of methodological traditions. Across all methodologies, there are different methods associated with planning and conducting educational research studies that include the use of surveys, interviews, observations, artifacts, or instruments. Ensuring the coherence of these elements to the discipline’s perspective also involves situating the work in the broader scholarly literature. The tools for doing this include literature reviews, theoretical frameworks, and conceptual frameworks. However, the purpose and function of each of these elements is often confusing to new education researchers. The goal of this article is to introduce new biology education researchers to these three important elements important in DBER scholarship and the broader educational literature.

The first element we discuss is a review of research (literature reviews), which highlights the need for a specific research question, study problem, or topic of investigation. Literature reviews situate the relevance of the study within a topic and a field. The process may seem familiar to science researchers entering DBER fields, but new researchers may still struggle in conducting the review. Booth et al. (2016b) highlight some of the challenges novice education researchers face when conducting a review of literature. They point out that novice researchers struggle in deciding how to focus the review, determining the scope of articles needed in the review, and knowing how to be critical of the articles in the review. Overcoming these challenges (and others) can help novice researchers construct a sound literature review that can inform the design of the study and help ensure the work makes a contribution to the field.

The second and third highlighted elements are theoretical and conceptual frameworks. These guide biology education research (BER) studies, and may be less familiar to science researchers. These elements are important in shaping the construction of new knowledge. Theoretical frameworks offer a way to explain and interpret the studied phenomenon, while conceptual frameworks clarify assumptions about the studied phenomenon. Despite the importance of these constructs in educational research, biology educational researchers have noted the limited use of theoretical or conceptual frameworks in published work ( DeHaan, 2011 ; Dirks, 2011 ; Lo et al. , 2019 ). In reviewing articles published in CBE—Life Sciences Education ( LSE ) between 2015 and 2019, we found that fewer than 25% of the research articles had a theoretical or conceptual framework (see the Supplemental Information), and at times there was an inconsistent use of theoretical and conceptual frameworks. Clearly, these frameworks are challenging for published biology education researchers, which suggests the importance of providing some initial guidance to new biology education researchers.

Fortunately, educational researchers have increased their explicit use of these frameworks over time, and this is influencing educational research in science, technology, engineering, and mathematics (STEM) fields. For instance, a quick search for theoretical or conceptual frameworks in the abstracts of articles in Educational Research Complete (a common database for educational research) in STEM fields demonstrates a dramatic change over the last 20 years: from only 778 articles published between 2000 and 2010 to 5703 articles published between 2010 and 2020, a more than sevenfold increase. Greater recognition of the importance of these frameworks is contributing to DBER authors being more explicit about such frameworks in their studies.

Collectively, literature reviews, theoretical frameworks, and conceptual frameworks work to guide methodological decisions and the elucidation of important findings. Each offers a different perspective on the problem of study and is an essential element in all forms of educational research. As new researchers seek to learn about these elements, they will find different resources, a variety of perspectives, and many suggestions about the construction and use of these elements. The wide range of available information can overwhelm the new researcher who just wants to learn the distinction between these elements or how to craft them adequately.

Our goal in writing this paper is not to offer specific advice about how to write these sections in scholarly work. Instead, we wanted to introduce these elements to those who are new to BER and who are interested in better distinguishing one from the other. In this paper, we share the purpose of each element in BER scholarship, along with important points on its construction. We also provide references for additional resources that may be beneficial to better understanding each element. Table 1 summarizes the key distinctions among these elements.

Comparison of literature reviews, theoretical frameworks, and conceptual reviews

This article is written for the new biology education researcher who is just learning about these different elements or for scientists looking to become more involved in BER. It is a result of our own work as science education and biology education researchers, whether as graduate students and postdoctoral scholars or newly hired and established faculty members. This is the article we wish had been available as we started to learn about these elements or discussed them with new educational researchers in biology.

LITERATURE REVIEWS

Purpose of a literature review.

A literature review is foundational to any research study in education or science. In education, a well-conceptualized and well-executed review provides a summary of the research that has already been done on a specific topic and identifies questions that remain to be answered, thus illustrating the current research project’s potential contribution to the field and the reasoning behind the methodological approach selected for the study ( Maxwell, 2012 ). BER is an evolving disciplinary area that is redefining areas of conceptual emphasis as well as orientations toward teaching and learning (e.g., Labov et al. , 2010 ; American Association for the Advancement of Science, 2011 ; Nehm, 2019 ). As a result, building comprehensive, critical, purposeful, and concise literature reviews can be a challenge for new biology education researchers.

Building Literature Reviews

There are different ways to approach and construct a literature review. Booth et al. (2016a) provide an overview that includes, for example, scoping reviews, which are focused only on notable studies and use a basic method of analysis, and integrative reviews, which are the result of exhaustive literature searches across different genres. Underlying each of these different review processes are attention to the s earch process, a ppraisa l of articles, s ynthesis of the literature, and a nalysis: SALSA ( Booth et al. , 2016a ). This useful acronym can help the researcher focus on the process while building a specific type of review.

However, new educational researchers often have questions about literature reviews that are foundational to SALSA or other approaches. Common questions concern determining which literature pertains to the topic of study or the role of the literature review in the design of the study. This section addresses such questions broadly while providing general guidance for writing a narrative literature review that evaluates the most pertinent studies.

The literature review process should begin before the research is conducted. As Boote and Beile (2005 , p. 3) suggested, researchers should be “scholars before researchers.” They point out that having a good working knowledge of the proposed topic helps illuminate avenues of study. Some subject areas have a deep body of work to read and reflect upon, providing a strong foundation for developing the research question(s). For instance, the teaching and learning of evolution is an area of long-standing interest in the BER community, generating many studies (e.g., Perry et al. , 2008 ; Barnes and Brownell, 2016 ) and reviews of research (e.g., Sickel and Friedrichsen, 2013 ; Ziadie and Andrews, 2018 ). Emerging areas of BER include the affective domain, issues of transfer, and metacognition ( Singer et al. , 2012 ). Many studies in these areas are transdisciplinary and not always specific to biology education (e.g., Rodrigo-Peiris et al. , 2018 ; Kolpikova et al. , 2019 ). These newer areas may require reading outside BER; fortunately, summaries of some of these topics can be found in the Current Insights section of the LSE website.

In focusing on a specific problem within a broader research strand, a new researcher will likely need to examine research outside BER. Depending upon the area of study, the expanded reading list might involve a mix of BER, DBER, and educational research studies. Determining the scope of the reading is not always straightforward. A simple way to focus one’s reading is to create a “summary phrase” or “research nugget,” which is a very brief descriptive statement about the study. It should focus on the essence of the study, for example, “first-year nonmajor students’ understanding of evolution,” “metacognitive prompts to enhance learning during biochemistry,” or “instructors’ inquiry-based instructional practices after professional development programming.” This type of phrase should help a new researcher identify two or more areas to review that pertain to the study. Focusing on recent research in the last 5 years is a good first step. Additional studies can be identified by reading relevant works referenced in those articles. It is also important to read seminal studies that are more than 5 years old. Reading a range of studies should give the researcher the necessary command of the subject in order to suggest a research question.

Given that the research question(s) arise from the literature review, the review should also substantiate the selected methodological approach. The review and research question(s) guide the researcher in determining how to collect and analyze data. Often the methodological approach used in a study is selected to contribute knowledge that expands upon what has been published previously about the topic (see Institute of Education Sciences and National Science Foundation, 2013 ). An emerging topic of study may need an exploratory approach that allows for a description of the phenomenon and development of a potential theory. This could, but not necessarily, require a methodological approach that uses interviews, observations, surveys, or other instruments. An extensively studied topic may call for the additional understanding of specific factors or variables; this type of study would be well suited to a verification or a causal research design. These could entail a methodological approach that uses valid and reliable instruments, observations, or interviews to determine an effect in the studied event. In either of these examples, the researcher(s) may use a qualitative, quantitative, or mixed methods methodological approach.

Even with a good research question, there is still more reading to be done. The complexity and focus of the research question dictates the depth and breadth of the literature to be examined. Questions that connect multiple topics can require broad literature reviews. For instance, a study that explores the impact of a biology faculty learning community on the inquiry instruction of faculty could have the following review areas: learning communities among biology faculty, inquiry instruction among biology faculty, and inquiry instruction among biology faculty as a result of professional learning. Biology education researchers need to consider whether their literature review requires studies from different disciplines within or outside DBER. For the example given, it would be fruitful to look at research focused on learning communities with faculty in STEM fields or in general education fields that result in instructional change. It is important not to be too narrow or too broad when reading. When the conclusions of articles start to sound similar or no new insights are gained, the researcher likely has a good foundation for a literature review. This level of reading should allow the researcher to demonstrate a mastery in understanding the researched topic, explain the suitability of the proposed research approach, and point to the need for the refined research question(s).

The literature review should include the researcher’s evaluation and critique of the selected studies. A researcher may have a large collection of studies, but not all of the studies will follow standards important in the reporting of empirical work in the social sciences. The American Educational Research Association ( Duran et al. , 2006 ), for example, offers a general discussion about standards for such work: an adequate review of research informing the study, the existence of sound and appropriate data collection and analysis methods, and appropriate conclusions that do not overstep or underexplore the analyzed data. The Institute of Education Sciences and National Science Foundation (2013) also offer Common Guidelines for Education Research and Development that can be used to evaluate collected studies.

Because not all journals adhere to such standards, it is important that a researcher review each study to determine the quality of published research, per the guidelines suggested earlier. In some instances, the research may be fatally flawed. Examples of such flaws include data that do not pertain to the question, a lack of discussion about the data collection, poorly constructed instruments, or an inadequate analysis. These types of errors result in studies that are incomplete, error-laden, or inaccurate and should be excluded from the review. Most studies have limitations, and the author(s) often make them explicit. For instance, there may be an instructor effect, recognized bias in the analysis, or issues with the sample population. Limitations are usually addressed by the research team in some way to ensure a sound and acceptable research process. Occasionally, the limitations associated with the study can be significant and not addressed adequately, which leaves a consequential decision in the hands of the researcher. Providing critiques of studies in the literature review process gives the reader confidence that the researcher has carefully examined relevant work in preparation for the study and, ultimately, the manuscript.

A solid literature review clearly anchors the proposed study in the field and connects the research question(s), the methodological approach, and the discussion. Reviewing extant research leads to research questions that will contribute to what is known in the field. By summarizing what is known, the literature review points to what needs to be known, which in turn guides decisions about methodology. Finally, notable findings of the new study are discussed in reference to those described in the literature review.

Within published BER studies, literature reviews can be placed in different locations in an article. When included in the introductory section of the study, the first few paragraphs of the manuscript set the stage, with the literature review following the opening paragraphs. Cooper et al. (2019) illustrate this approach in their study of course-based undergraduate research experiences (CUREs). An introduction discussing the potential of CURES is followed by an analysis of the existing literature relevant to the design of CUREs that allows for novel student discoveries. Within this review, the authors point out contradictory findings among research on novel student discoveries. This clarifies the need for their study, which is described and highlighted through specific research aims.

A literature reviews can also make up a separate section in a paper. For example, the introduction to Todd et al. (2019) illustrates the need for their research topic by highlighting the potential of learning progressions (LPs) and suggesting that LPs may help mitigate learning loss in genetics. At the end of the introduction, the authors state their specific research questions. The review of literature following this opening section comprises two subsections. One focuses on learning loss in general and examines a variety of studies and meta-analyses from the disciplines of medical education, mathematics, and reading. The second section focuses specifically on LPs in genetics and highlights student learning in the midst of LPs. These separate reviews provide insights into the stated research question.

Suggestions and Advice

A well-conceptualized, comprehensive, and critical literature review reveals the understanding of the topic that the researcher brings to the study. Literature reviews should not be so big that there is no clear area of focus; nor should they be so narrow that no real research question arises. The task for a researcher is to craft an efficient literature review that offers a critical analysis of published work, articulates the need for the study, guides the methodological approach to the topic of study, and provides an adequate foundation for the discussion of the findings.

In our own writing of literature reviews, there are often many drafts. An early draft may seem well suited to the study because the need for and approach to the study are well described. However, as the results of the study are analyzed and findings begin to emerge, the existing literature review may be inadequate and need revision. The need for an expanded discussion about the research area can result in the inclusion of new studies that support the explanation of a potential finding. The literature review may also prove to be too broad. Refocusing on a specific area allows for more contemplation of a finding.

It should be noted that there are different types of literature reviews, and many books and articles have been written about the different ways to embark on these types of reviews. Among these different resources, the following may be helpful in considering how to refine the review process for scholarly journals:

• Booth, A., Sutton, A., & Papaioannou, D. (2016a). Systemic approaches to a successful literature review (2nd ed.). Los Angeles, CA: Sage. This book addresses different types of literature reviews and offers important suggestions pertaining to defining the scope of the literature review and assessing extant studies.
• Booth, W. C., Colomb, G. G., Williams, J. M., Bizup, J., & Fitzgerald, W. T. (2016b). The craft of research (4th ed.). Chicago: University of Chicago Press. This book can help the novice consider how to make the case for an area of study. While this book is not specifically about literature reviews, it offers suggestions about making the case for your study.
• Galvan, J. L., & Galvan, M. C. (2017). Writing literature reviews: A guide for students of the social and behavioral sciences (7th ed.). Routledge. This book offers guidance on writing different types of literature reviews. For the novice researcher, there are useful suggestions for creating coherent literature reviews.

THEORETICAL FRAMEWORKS

Purpose of theoretical frameworks.

As new education researchers may be less familiar with theoretical frameworks than with literature reviews, this discussion begins with an analogy. Envision a biologist, chemist, and physicist examining together the dramatic effect of a fog tsunami over the ocean. A biologist gazing at this phenomenon may be concerned with the effect of fog on various species. A chemist may be interested in the chemical composition of the fog as water vapor condenses around bits of salt. A physicist may be focused on the refraction of light to make fog appear to be “sitting” above the ocean. While observing the same “objective event,” the scientists are operating under different theoretical frameworks that provide a particular perspective or “lens” for the interpretation of the phenomenon. Each of these scientists brings specialized knowledge, experiences, and values to this phenomenon, and these influence the interpretation of the phenomenon. The scientists’ theoretical frameworks influence how they design and carry out their studies and interpret their data.

Within an educational study, a theoretical framework helps to explain a phenomenon through a particular lens and challenges and extends existing knowledge within the limitations of that lens. Theoretical frameworks are explicitly stated by an educational researcher in the paper’s framework, theory, or relevant literature section. The framework shapes the types of questions asked, guides the method by which data are collected and analyzed, and informs the discussion of the results of the study. It also reveals the researcher’s subjectivities, for example, values, social experience, and viewpoint ( Allen, 2017 ). It is essential that a novice researcher learn to explicitly state a theoretical framework, because all research questions are being asked from the researcher’s implicit or explicit assumptions of a phenomenon of interest ( Schwandt, 2000 ).

Selecting Theoretical Frameworks

Theoretical frameworks are one of the most contemplated elements in our work in educational research. In this section, we share three important considerations for new scholars selecting a theoretical framework.

The first step in identifying a theoretical framework involves reflecting on the phenomenon within the study and the assumptions aligned with the phenomenon. The phenomenon involves the studied event. There are many possibilities, for example, student learning, instructional approach, or group organization. A researcher holds assumptions about how the phenomenon will be effected, influenced, changed, or portrayed. It is ultimately the researcher’s assumption(s) about the phenomenon that aligns with a theoretical framework. An example can help illustrate how a researcher’s reflection on the phenomenon and acknowledgment of assumptions can result in the identification of a theoretical framework.

In our example, a biology education researcher may be interested in exploring how students’ learning of difficult biological concepts can be supported by the interactions of group members. The phenomenon of interest is the interactions among the peers, and the researcher assumes that more knowledgeable students are important in supporting the learning of the group. As a result, the researcher may draw on Vygotsky’s (1978) sociocultural theory of learning and development that is focused on the phenomenon of student learning in a social setting. This theory posits the critical nature of interactions among students and between students and teachers in the process of building knowledge. A researcher drawing upon this framework holds the assumption that learning is a dynamic social process involving questions and explanations among students in the classroom and that more knowledgeable peers play an important part in the process of building conceptual knowledge.

It is important to state at this point that there are many different theoretical frameworks. Some frameworks focus on learning and knowing, while other theoretical frameworks focus on equity, empowerment, or discourse. Some frameworks are well articulated, and others are still being refined. For a new researcher, it can be challenging to find a theoretical framework. Two of the best ways to look for theoretical frameworks is through published works that highlight different frameworks.

When a theoretical framework is selected, it should clearly connect to all parts of the study. The framework should augment the study by adding a perspective that provides greater insights into the phenomenon. It should clearly align with the studies described in the literature review. For instance, a framework focused on learning would correspond to research that reported different learning outcomes for similar studies. The methods for data collection and analysis should also correspond to the framework. For instance, a study about instructional interventions could use a theoretical framework concerned with learning and could collect data about the effect of the intervention on what is learned. When the data are analyzed, the theoretical framework should provide added meaning to the findings, and the findings should align with the theoretical framework.

A study by Jensen and Lawson (2011) provides an example of how a theoretical framework connects different parts of the study. They compared undergraduate biology students in heterogeneous and homogeneous groups over the course of a semester. Jensen and Lawson (2011) assumed that learning involved collaboration and more knowledgeable peers, which made Vygotsky’s (1978) theory a good fit for their study. They predicted that students in heterogeneous groups would experience greater improvement in their reasoning abilities and science achievements with much of the learning guided by the more knowledgeable peers.

In the enactment of the study, they collected data about the instruction in traditional and inquiry-oriented classes, while the students worked in homogeneous or heterogeneous groups. To determine the effect of working in groups, the authors also measured students’ reasoning abilities and achievement. Each data-collection and analysis decision connected to understanding the influence of collaborative work.

Their findings highlighted aspects of Vygotsky’s (1978) theory of learning. One finding, for instance, posited that inquiry instruction, as a whole, resulted in reasoning and achievement gains. This links to Vygotsky (1978) , because inquiry instruction involves interactions among group members. A more nuanced finding was that group composition had a conditional effect. Heterogeneous groups performed better with more traditional and didactic instruction, regardless of the reasoning ability of the group members. Homogeneous groups worked better during interaction-rich activities for students with low reasoning ability. The authors attributed the variation to the different types of helping behaviors of students. High-performing students provided the answers, while students with low reasoning ability had to work collectively through the material. In terms of Vygotsky (1978) , this finding provided new insights into the learning context in which productive interactions can occur for students.

Another consideration in the selection and use of a theoretical framework pertains to its orientation to the study. This can result in the theoretical framework prioritizing individuals, institutions, and/or policies ( Anfara and Mertz, 2014 ). Frameworks that connect to individuals, for instance, could contribute to understanding their actions, learning, or knowledge. Institutional frameworks, on the other hand, offer insights into how institutions, organizations, or groups can influence individuals or materials. Policy theories provide ways to understand how national or local policies can dictate an emphasis on outcomes or instructional design. These different types of frameworks highlight different aspects in an educational setting, which influences the design of the study and the collection of data. In addition, these different frameworks offer a way to make sense of the data. Aligning the data collection and analysis with the framework ensures that a study is coherent and can contribute to the field.

New understandings emerge when different theoretical frameworks are used. For instance, Ebert-May et al. (2015) prioritized the individual level within conceptual change theory (see Posner et al. , 1982 ). In this theory, an individual’s knowledge changes when it no longer fits the phenomenon. Ebert-May et al. (2015) designed a professional development program challenging biology postdoctoral scholars’ existing conceptions of teaching. The authors reported that the biology postdoctoral scholars’ teaching practices became more student-centered as they were challenged to explain their instructional decision making. According to the theory, the biology postdoctoral scholars’ dissatisfaction in their descriptions of teaching and learning initiated change in their knowledge and instruction. These results reveal how conceptual change theory can explain the learning of participants and guide the design of professional development programming.

The communities of practice (CoP) theoretical framework ( Lave, 1988 ; Wenger, 1998 ) prioritizes the institutional level , suggesting that learning occurs when individuals learn from and contribute to the communities in which they reside. Grounded in the assumption of community learning, the literature on CoP suggests that, as individuals interact regularly with the other members of their group, they learn about the rules, roles, and goals of the community ( Allee, 2000 ). A study conducted by Gehrke and Kezar (2017) used the CoP framework to understand organizational change by examining the involvement of individual faculty engaged in a cross-institutional CoP focused on changing the instructional practice of faculty at each institution. In the CoP, faculty members were involved in enhancing instructional materials within their department, which aligned with an overarching goal of instituting instruction that embraced active learning. Not surprisingly, Gehrke and Kezar (2017) revealed that faculty who perceived the community culture as important in their work cultivated institutional change. Furthermore, they found that institutional change was sustained when key leaders served as mentors and provided support for faculty, and as faculty themselves developed into leaders. This study reveals the complexity of individual roles in a COP in order to support institutional instructional change.

It is important to explicitly state the theoretical framework used in a study, but elucidating a theoretical framework can be challenging for a new educational researcher. The literature review can help to identify an applicable theoretical framework. Focal areas of the review or central terms often connect to assumptions and assertions associated with the framework that pertain to the phenomenon of interest. Another way to identify a theoretical framework is self-reflection by the researcher on personal beliefs and understandings about the nature of knowledge the researcher brings to the study ( Lysaght, 2011 ). In stating one’s beliefs and understandings related to the study (e.g., students construct their knowledge, instructional materials support learning), an orientation becomes evident that will suggest a particular theoretical framework. Theoretical frameworks are not arbitrary , but purposefully selected.

With experience, a researcher may find expanded roles for theoretical frameworks. Researchers may revise an existing framework that has limited explanatory power, or they may decide there is a need to develop a new theoretical framework. These frameworks can emerge from a current study or the need to explain a phenomenon in a new way. Researchers may also find that multiple theoretical frameworks are necessary to frame and explore a problem, as different frameworks can provide different insights into a problem.

Finally, it is important to recognize that choosing “x” theoretical framework does not necessarily mean a researcher chooses “y” methodology and so on, nor is there a clear-cut, linear process in selecting a theoretical framework for one’s study. In part, the nonlinear process of identifying a theoretical framework is what makes understanding and using theoretical frameworks challenging. For the novice scholar, contemplating and understanding theoretical frameworks is essential. Fortunately, there are articles and books that can help:

• Creswell, J. W. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Los Angeles, CA: Sage. This book provides an overview of theoretical frameworks in general educational research.
• Ding, L. (2019). Theoretical perspectives of quantitative physics education research. Physical Review Physics Education Research , 15 (2), 020101-1–020101-13. This paper illustrates how a DBER field can use theoretical frameworks.
• Nehm, R. (2019). Biology education research: Building integrative frameworks for teaching and learning about living systems. Disciplinary and Interdisciplinary Science Education Research , 1 , ar15. https://doi.org/10.1186/s43031-019-0017-6 . This paper articulates the need for studies in BER to explicitly state theoretical frameworks and provides examples of potential studies.
• Patton, M. Q. (2015). Qualitative research & evaluation methods: Integrating theory and practice . Sage. This book also provides an overview of theoretical frameworks, but for both research and evaluation.

CONCEPTUAL FRAMEWORKS

Purpose of a conceptual framework.

A conceptual framework is a description of the way a researcher understands the factors and/or variables that are involved in the study and their relationships to one another. The purpose of a conceptual framework is to articulate the concepts under study using relevant literature ( Rocco and Plakhotnik, 2009 ) and to clarify the presumed relationships among those concepts ( Rocco and Plakhotnik, 2009 ; Anfara and Mertz, 2014 ). Conceptual frameworks are different from theoretical frameworks in both their breadth and grounding in established findings. Whereas a theoretical framework articulates the lens through which a researcher views the work, the conceptual framework is often more mechanistic and malleable.

Conceptual frameworks are broader, encompassing both established theories (i.e., theoretical frameworks) and the researchers’ own emergent ideas. Emergent ideas, for example, may be rooted in informal and/or unpublished observations from experience. These emergent ideas would not be considered a “theory” if they are not yet tested, supported by systematically collected evidence, and peer reviewed. However, they do still play an important role in the way researchers approach their studies. The conceptual framework allows authors to clearly describe their emergent ideas so that connections among ideas in the study and the significance of the study are apparent to readers.

Constructing Conceptual Frameworks

Including a conceptual framework in a research study is important, but researchers often opt to include either a conceptual or a theoretical framework. Either may be adequate, but both provide greater insight into the research approach. For instance, a research team plans to test a novel component of an existing theory. In their study, they describe the existing theoretical framework that informs their work and then present their own conceptual framework. Within this conceptual framework, specific topics portray emergent ideas that are related to the theory. Describing both frameworks allows readers to better understand the researchers’ assumptions, orientations, and understanding of concepts being investigated. For example, Connolly et al. (2018) included a conceptual framework that described how they applied a theoretical framework of social cognitive career theory (SCCT) to their study on teaching programs for doctoral students. In their conceptual framework, the authors described SCCT, explained how it applied to the investigation, and drew upon results from previous studies to justify the proposed connections between the theory and their emergent ideas.

In some cases, authors may be able to sufficiently describe their conceptualization of the phenomenon under study in an introduction alone, without a separate conceptual framework section. However, incomplete descriptions of how the researchers conceptualize the components of the study may limit the significance of the study by making the research less intelligible to readers. This is especially problematic when studying topics in which researchers use the same terms for different constructs or different terms for similar and overlapping constructs (e.g., inquiry, teacher beliefs, pedagogical content knowledge, or active learning). Authors must describe their conceptualization of a construct if the research is to be understandable and useful.

There are some key areas to consider regarding the inclusion of a conceptual framework in a study. To begin with, it is important to recognize that conceptual frameworks are constructed by the researchers conducting the study ( Rocco and Plakhotnik, 2009 ; Maxwell, 2012 ). This is different from theoretical frameworks that are often taken from established literature. Researchers should bring together ideas from the literature, but they may be influenced by their own experiences as a student and/or instructor, the shared experiences of others, or thought experiments as they construct a description, model, or representation of their understanding of the phenomenon under study. This is an exercise in intellectual organization and clarity that often considers what is learned, known, and experienced. The conceptual framework makes these constructs explicitly visible to readers, who may have different understandings of the phenomenon based on their prior knowledge and experience. There is no single method to go about this intellectual work.

Reeves et al. (2016) is an example of an article that proposed a conceptual framework about graduate teaching assistant professional development evaluation and research. The authors used existing literature to create a novel framework that filled a gap in current research and practice related to the training of graduate teaching assistants. This conceptual framework can guide the systematic collection of data by other researchers because the framework describes the relationships among various factors that influence teaching and learning. The Reeves et al. (2016) conceptual framework may be modified as additional data are collected and analyzed by other researchers. This is not uncommon, as conceptual frameworks can serve as catalysts for concerted research efforts that systematically explore a phenomenon (e.g., Reynolds et al. , 2012 ; Brownell and Kloser, 2015 ).

Sabel et al. (2017) used a conceptual framework in their exploration of how scaffolds, an external factor, interact with internal factors to support student learning. Their conceptual framework integrated principles from two theoretical frameworks, self-regulated learning and metacognition, to illustrate how the research team conceptualized students’ use of scaffolds in their learning ( Figure 1 ). Sabel et al. (2017) created this model using their interpretations of these two frameworks in the context of their teaching.

Conceptual framework from Sabel et al. (2017) .

A conceptual framework should describe the relationship among components of the investigation ( Anfara and Mertz, 2014 ). These relationships should guide the researcher’s methods of approaching the study ( Miles et al. , 2014 ) and inform both the data to be collected and how those data should be analyzed. Explicitly describing the connections among the ideas allows the researcher to justify the importance of the study and the rigor of the research design. Just as importantly, these frameworks help readers understand why certain components of a system were not explored in the study. This is a challenge in education research, which is rooted in complex environments with many variables that are difficult to control.

For example, Sabel et al. (2017) stated: “Scaffolds, such as enhanced answer keys and reflection questions, can help students and instructors bridge the external and internal factors and support learning” (p. 3). They connected the scaffolds in the study to the three dimensions of metacognition and the eventual transformation of existing ideas into new or revised ideas. Their framework provides a rationale for focusing on how students use two different scaffolds, and not on other factors that may influence a student’s success (self-efficacy, use of active learning, exam format, etc.).

In constructing conceptual frameworks, researchers should address needed areas of study and/or contradictions discovered in literature reviews. By attending to these areas, researchers can strengthen their arguments for the importance of a study. For instance, conceptual frameworks can address how the current study will fill gaps in the research, resolve contradictions in existing literature, or suggest a new area of study. While a literature review describes what is known and not known about the phenomenon, the conceptual framework leverages these gaps in describing the current study ( Maxwell, 2012 ). In the example of Sabel et al. (2017) , the authors indicated there was a gap in the literature regarding how scaffolds engage students in metacognition to promote learning in large classes. Their study helps fill that gap by describing how scaffolds can support students in the three dimensions of metacognition: intelligibility, plausibility, and wide applicability. In another example, Lane (2016) integrated research from science identity, the ethic of care, the sense of belonging, and an expertise model of student success to form a conceptual framework that addressed the critiques of other frameworks. In a more recent example, Sbeglia et al. (2021) illustrated how a conceptual framework influences the methodological choices and inferences in studies by educational researchers.

Sometimes researchers draw upon the conceptual frameworks of other researchers. When a researcher’s conceptual framework closely aligns with an existing framework, the discussion may be brief. For example, Ghee et al. (2016) referred to portions of SCCT as their conceptual framework to explain the significance of their work on students’ self-efficacy and career interests. Because the authors’ conceptualization of this phenomenon aligned with a previously described framework, they briefly mentioned the conceptual framework and provided additional citations that provided more detail for the readers.

Within both the BER and the broader DBER communities, conceptual frameworks have been used to describe different constructs. For example, some researchers have used the term “conceptual framework” to describe students’ conceptual understandings of a biological phenomenon. This is distinct from a researcher’s conceptual framework of the educational phenomenon under investigation, which may also need to be explicitly described in the article. Other studies have presented a research logic model or flowchart of the research design as a conceptual framework. These constructions can be quite valuable in helping readers understand the data-collection and analysis process. However, a model depicting the study design does not serve the same role as a conceptual framework. Researchers need to avoid conflating these constructs by differentiating the researchers’ conceptual framework that guides the study from the research design, when applicable.

Explicitly describing conceptual frameworks is essential in depicting the focus of the study. We have found that being explicit in a conceptual framework means using accepted terminology, referencing prior work, and clearly noting connections between terms. This description can also highlight gaps in the literature or suggest potential contributions to the field of study. A well-elucidated conceptual framework can suggest additional studies that may be warranted. This can also spur other researchers to consider how they would approach the examination of a phenomenon and could result in a revised conceptual framework.

It can be challenging to create conceptual frameworks, but they are important. Below are two resources that could be helpful in constructing and presenting conceptual frameworks in educational research:

• Maxwell, J. A. (2012). Qualitative research design: An interactive approach (3rd ed.). Los Angeles, CA: Sage. Chapter 3 in this book describes how to construct conceptual frameworks.
• Ravitch, S. M., & Riggan, M. (2016). Reason & rigor: How conceptual frameworks guide research . Los Angeles, CA: Sage. This book explains how conceptual frameworks guide the research questions, data collection, data analyses, and interpretation of results.

CONCLUDING THOUGHTS

Literature reviews, theoretical frameworks, and conceptual frameworks are all important in DBER and BER. Robust literature reviews reinforce the importance of a study. Theoretical frameworks connect the study to the base of knowledge in educational theory and specify the researcher’s assumptions. Conceptual frameworks allow researchers to explicitly describe their conceptualization of the relationships among the components of the phenomenon under study. Table 1 provides a general overview of these components in order to assist biology education researchers in thinking about these elements.

It is important to emphasize that these different elements are intertwined. When these elements are aligned and complement one another, the study is coherent, and the study findings contribute to knowledge in the field. When literature reviews, theoretical frameworks, and conceptual frameworks are disconnected from one another, the study suffers. The point of the study is lost, suggested findings are unsupported, or important conclusions are invisible to the researcher. In addition, this misalignment may be costly in terms of time and money.

Conducting a literature review, selecting a theoretical framework, and building a conceptual framework are some of the most difficult elements of a research study. It takes time to understand the relevant research, identify a theoretical framework that provides important insights into the study, and formulate a conceptual framework that organizes the finding. In the research process, there is often a constant back and forth among these elements as the study evolves. With an ongoing refinement of the review of literature, clarification of the theoretical framework, and articulation of a conceptual framework, a sound study can emerge that makes a contribution to the field. This is the goal of BER and education research.

Supplementary Material

• Allee, V. (2000). Knowledge networks and communities of learning . OD Practitioner , 32 ( 4 ), 4–13. [ Google Scholar ]
• Allen, M. (2017). The Sage encyclopedia of communication research methods (Vols. 1–4 ). Los Angeles, CA: Sage. 10.4135/9781483381411 [ CrossRef ] [ Google Scholar ]
• American Association for the Advancement of Science. (2011). Vision and change in undergraduate biology education: A call to action . Washington, DC. [ Google Scholar ]
• Anfara, V. A., Mertz, N. T. (2014). Setting the stage . In Anfara, V. A., Mertz, N. T. (eds.), Theoretical frameworks in qualitative research (pp. 1–22). Sage. [ Google Scholar ]
• Barnes, M. E., Brownell, S. E. (2016). Practices and perspectives of college instructors on addressing religious beliefs when teaching evolution . CBE—Life Sciences Education , 15 ( 2 ), ar18. https://doi.org/10.1187/cbe.15-11-0243 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Boote, D. N., Beile, P. (2005). Scholars before researchers: On the centrality of the dissertation literature review in research preparation . Educational Researcher , 34 ( 6 ), 3–15. 10.3102/0013189x034006003 [ CrossRef ] [ Google Scholar ]
• Booth, A., Sutton, A., Papaioannou, D. (2016a). Systemic approaches to a successful literature review (2nd ed.). Los Angeles, CA: Sage. [ Google Scholar ]
• Booth, W. C., Colomb, G. G., Williams, J. M., Bizup, J., Fitzgerald, W. T. (2016b). The craft of research (4th ed.). Chicago, IL: University of Chicago Press. [ Google Scholar ]
• Brownell, S. E., Kloser, M. J. (2015). Toward a conceptual framework for measuring the effectiveness of course-based undergraduate research experiences in undergraduate biology . Studies in Higher Education , 40 ( 3 ), 525–544. https://doi.org/10.1080/03075079.2015.1004234 [ Google Scholar ]
• Connolly, M. R., Lee, Y. G., Savoy, J. N. (2018). The effects of doctoral teaching development on early-career STEM scholars’ college teaching self-efficacy . CBE—Life Sciences Education , 17 ( 1 ), ar14. https://doi.org/10.1187/cbe.17-02-0039 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Cooper, K. M., Blattman, J. N., Hendrix, T., Brownell, S. E. (2019). The impact of broadly relevant novel discoveries on student project ownership in a traditional lab course turned CURE . CBE—Life Sciences Education , 18 ( 4 ), ar57. https://doi.org/10.1187/cbe.19-06-0113 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Creswell, J. W. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Los Angeles, CA: Sage. [ Google Scholar ]
• DeHaan, R. L. (2011). Education research in the biological sciences: A nine decade review (Paper commissioned by the NAS/NRC Committee on the Status, Contributions, and Future Directions of Discipline Based Education Research) . Washington, DC: National Academies Press. Retrieved May 20, 2022, from www7.nationalacademies.org/bose/DBER_Mee ting2_commissioned_papers_page.html [ Google Scholar ]
• Ding, L. (2019). Theoretical perspectives of quantitative physics education research . Physical Review Physics Education Research , 15 ( 2 ), 020101. [ Google Scholar ]
• Dirks, C. (2011). The current status and future direction of biology education research . Paper presented at: Second Committee Meeting on the Status, Contributions, and Future Directions of Discipline-Based Education Research, 18–19 October (Washington, DC). Retrieved May 20, 2022, from http://sites.nationalacademies.org/DBASSE/BOSE/DBASSE_071087 [ Google Scholar ]
• Duran, R. P., Eisenhart, M. A., Erickson, F. D., Grant, C. A., Green, J. L., Hedges, L. V., Schneider, B. L. (2006). Standards for reporting on empirical social science research in AERA publications: American Educational Research Association . Educational Researcher , 35 ( 6 ), 33–40. [ Google Scholar ]
• Ebert-May, D., Derting, T. L., Henkel, T. P., Middlemis Maher, J., Momsen, J. L., Arnold, B., Passmore, H. A. (2015). Breaking the cycle: Future faculty begin teaching with learner-centered strategies after professional development . CBE—Life Sciences Education , 14 ( 2 ), ar22. https://doi.org/10.1187/cbe.14-12-0222 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Galvan, J. L., Galvan, M. C. (2017). Writing literature reviews: A guide for students of the social and behavioral sciences (7th ed.). New York, NY: Routledge. https://doi.org/10.4324/9781315229386 [ Google Scholar ]
• Gehrke, S., Kezar, A. (2017). The roles of STEM faculty communities of practice in institutional and departmental reform in higher education . American Educational Research Journal , 54 ( 5 ), 803–833. https://doi.org/10.3102/0002831217706736 [ Google Scholar ]
• Ghee, M., Keels, M., Collins, D., Neal-Spence, C., Baker, E. (2016). Fine-tuning summer research programs to promote underrepresented students’ persistence in the STEM pathway . CBE—Life Sciences Education , 15 ( 3 ), ar28. https://doi.org/10.1187/cbe.16-01-0046 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Institute of Education Sciences & National Science Foundation. (2013). Common guidelines for education research and development . Retrieved May 20, 2022, from www.nsf.gov/pubs/2013/nsf13126/nsf13126.pdf
• Jensen, J. L., Lawson, A. (2011). Effects of collaborative group composition and inquiry instruction on reasoning gains and achievement in undergraduate biology . CBE—Life Sciences Education , 10 ( 1 ), 64–73. https://doi.org/10.1187/cbe.19-05-0098 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Kolpikova, E. P., Chen, D. C., Doherty, J. H. (2019). Does the format of preclass reading quizzes matter? An evaluation of traditional and gamified, adaptive preclass reading quizzes . CBE—Life Sciences Education , 18 ( 4 ), ar52. https://doi.org/10.1187/cbe.19-05-0098 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Labov, J. B., Reid, A. H., Yamamoto, K. R. (2010). Integrated biology and undergraduate science education: A new biology education for the twenty-first century? CBE—Life Sciences Education , 9 ( 1 ), 10–16. https://doi.org/10.1187/cbe.09-12-0092 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Lane, T. B. (2016). Beyond academic and social integration: Understanding the impact of a STEM enrichment program on the retention and degree attainment of underrepresented students . CBE—Life Sciences Education , 15 ( 3 ), ar39. https://doi.org/10.1187/cbe.16-01-0070 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Lave, J. (1988). Cognition in practice: Mind, mathematics and culture in everyday life . New York, NY: Cambridge University Press. [ Google Scholar ]
• Lo, S. M., Gardner, G. E., Reid, J., Napoleon-Fanis, V., Carroll, P., Smith, E., Sato, B. K. (2019). Prevailing questions and methodologies in biology education research: A longitudinal analysis of research in CBE — Life Sciences Education and at the Society for the Advancement of Biology Education Research . CBE—Life Sciences Education , 18 ( 1 ), ar9. https://doi.org/10.1187/cbe.18-08-0164 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Lysaght, Z. (2011). Epistemological and paradigmatic ecumenism in “Pasteur’s quadrant:” Tales from doctoral research . In Official Conference Proceedings of the Third Asian Conference on Education in Osaka, Japan . Retrieved May 20, 2022, from http://iafor.org/ace2011_offprint/ACE2011_offprint_0254.pdf
• Maxwell, J. A. (2012). Qualitative research design: An interactive approach (3rd ed.). Los Angeles, CA: Sage. [ Google Scholar ]
• Miles, M. B., Huberman, A. M., Saldaña, J. (2014). Qualitative data analysis (3rd ed.). Los Angeles, CA: Sage. [ Google Scholar ]
• Nehm, R. (2019). Biology education research: Building integrative frameworks for teaching and learning about living systems . Disciplinary and Interdisciplinary Science Education Research , 1 , ar15. https://doi.org/10.1186/s43031-019-0017-6 [ Google Scholar ]
• Patton, M. Q. (2015). Qualitative research & evaluation methods: Integrating theory and practice . Los Angeles, CA: Sage. [ Google Scholar ]
• Perry, J., Meir, E., Herron, J. C., Maruca, S., Stal, D. (2008). Evaluating two approaches to helping college students understand evolutionary trees through diagramming tasks . CBE—Life Sciences Education , 7 ( 2 ), 193–201. https://doi.org/10.1187/cbe.07-01-0007 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Posner, G. J., Strike, K. A., Hewson, P. W., Gertzog, W. A. (1982). Accommodation of a scientific conception: Toward a theory of conceptual change . Science Education , 66 ( 2 ), 211–227. [ Google Scholar ]
• Ravitch, S. M., Riggan, M. (2016). Reason & rigor: How conceptual frameworks guide research . Los Angeles, CA: Sage. [ Google Scholar ]
• Reeves, T. D., Marbach-Ad, G., Miller, K. R., Ridgway, J., Gardner, G. E., Schussler, E. E., Wischusen, E. W. (2016). A conceptual framework for graduate teaching assistant professional development evaluation and research . CBE—Life Sciences Education , 15 ( 2 ), es2. https://doi.org/10.1187/cbe.15-10-0225 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Reynolds, J. A., Thaiss, C., Katkin, W., Thompson, R. J. Jr. (2012). Writing-to-learn in undergraduate science education: A community-based, conceptually driven approach . CBE—Life Sciences Education , 11 ( 1 ), 17–25. https://doi.org/10.1187/cbe.11-08-0064 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Rocco, T. S., Plakhotnik, M. S. (2009). Literature reviews, conceptual frameworks, and theoretical frameworks: Terms, functions, and distinctions . Human Resource Development Review , 8 ( 1 ), 120–130. https://doi.org/10.1177/1534484309332617 [ Google Scholar ]
• Rodrigo-Peiris, T., Xiang, L., Cassone, V. M. (2018). A low-intensity, hybrid design between a “traditional” and a “course-based” research experience yields positive outcomes for science undergraduate freshmen and shows potential for large-scale application . CBE—Life Sciences Education , 17 ( 4 ), ar53. https://doi.org/10.1187/cbe.17-11-0248 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Sabel, J. L., Dauer, J. T., Forbes, C. T. (2017). Introductory biology students’ use of enhanced answer keys and reflection questions to engage in metacognition and enhance understanding . CBE—Life Sciences Education , 16 ( 3 ), ar40. https://doi.org/10.1187/cbe.16-10-0298 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Sbeglia, G. C., Goodridge, J. A., Gordon, L. H., Nehm, R. H. (2021). Are faculty changing? How reform frameworks, sampling intensities, and instrument measures impact inferences about student-centered teaching practices . CBE—Life Sciences Education , 20 ( 3 ), ar39. https://doi.org/10.1187/cbe.20-11-0259 [ PMC free article ] [ PubMed ] [ Google Scholar ]
• Schwandt, T. A. (2000). Three epistemological stances for qualitative inquiry: Interpretivism, hermeneutics, and social constructionism . In Denzin, N. K., Lincoln, Y. S. (Eds.), Handbook of qualitative research (2nd ed., pp. 189–213). Los Angeles, CA: Sage. [ Google Scholar ]
• Sickel, A. J., Friedrichsen, P. (2013). Examining the evolution education literature with a focus on teachers: Major findings, goals for teacher preparation, and directions for future research . Evolution: Education and Outreach , 6 ( 1 ), 23. https://doi.org/10.1186/1936-6434-6-23 [ Google Scholar ]
• Singer, S. R., Nielsen, N. R., Schweingruber, H. A. (2012). Discipline-based education research: Understanding and improving learning in undergraduate science and engineering . Washington, DC: National Academies Press. [ Google Scholar ]
• Todd, A., Romine, W. L., Correa-Menendez, J. (2019). Modeling the transition from a phenotypic to genotypic conceptualization of genetics in a university-level introductory biology context . Research in Science Education , 49 ( 2 ), 569–589. https://doi.org/10.1007/s11165-017-9626-2 [ Google Scholar ]
• Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes . Cambridge, MA: Harvard University Press. [ Google Scholar ]
• Wenger, E. (1998). Communities of practice: Learning as a social system . Systems Thinker , 9 ( 5 ), 2–3. [ Google Scholar ]
• Ziadie, M. A., Andrews, T. C. (2018). Moving evolution education forward: A systematic analysis of literature to identify gaps in collective knowledge for teaching . CBE—Life Sciences Education , 17 ( 1 ), ar11. https://doi.org/10.1187/cbe.17-08-0190 [ PMC free article ] [ PubMed ] [ Google Scholar ]

• Connelly Library

Qualitative and Quantitative Research

What is "empirical research".

• empirical research
• Locating Articles in Cinahl and PsycInfo
• Locating Articles in PubMed
• Getting the Articles

Empirical research  is based on observed and measured phenomena and derives knowledge from actual experience rather than from theory or belief. 

How do you know if a study is empirical? Read the subheadings within the article, book, or report and look for a description of the research "methodology."  Ask yourself: Could I recreate this study and test these results?

Key characteristics to look for:

• Specific research questions  to be answered
• Definition of the  population, behavior, or   phenomena  being studied
• Description of the  process  used to study this population or phenomena, including selection criteria, controls, and testing instruments (such as surveys)

Another hint: some scholarly journals use a specific layout, called the "IMRaD" format, to communicate empirical research findings. Such articles typically have 4 components:

• Introduction : sometimes called "literature review" -- what is currently known about the topic -- usually includes a theoretical framework and/or discussion of previous studies
• Methodology:  sometimes called "research design" --  how to recreate the study -- usually describes the population, research process, and analytical tools
• Results : sometimes called "findings"  --  what was learned through the study -- usually appears as statistical data or as substantial quotations from research participants
• Discussion : sometimes called "conclusion" or "implications" -- why the study is important -- usually describes how the research results influence professional practices or future studies

© Copyright La Salle University. All rights reserved.

Summer Undergraduate Research Experience (SURE)

• Start Your Research Project

What is a Literature Review?

Scholarly article types.

• Find Background Information
• Find Articles
• Evaluate Sources
• Manage Citations and Sources
• SURE Research Scenarios

Scholarly Workflow

What is a literature review?

A literature review provides an overview of the scholarly literature (e.g. books, articles, dissertations, proceedings) relevant to an area of research or theory. The review typically will include a summary of the major questions in a area and critical evaluations of work that has already been done. Literature reviews are also helpful for their comprehensive bibliographies. This  webpage by the UC Santa Cruz Library  does a good job of explaining lit reviews.

Literature reviews typically include these components:

• An overview of the subject
• Organization of relevant publications into subtopics, theoretical areas, or key debates
• An analysis and discussion of how various works relate to one another the the relevant questions
• A discussion of unresolved questions or future directions
• Some will also include discussions of key data collection and analysis methodologies

The following resources are great places to start when compiling a comprehensive bibliography.

• Oxford Bibliographies
• Browse by Political Science, Economics or just run search. Note that you can limit by access that Emory has. In cases where we do not, check discoverE, and request needed chapters.
• Great resource for building initial literature reviews, identifying important figures in the literature, and engaging with major theories. Emory has a subscription to all the Handbooks.
• In-depth reviews of the literature in a discipline, published annually, with an emphasis on overviews and more recent approaches and theories.  Note that the HTML version is good for tracking citations, but does not have needed page numbers.

Scholarly journals may contain various types of scholarly literature. Knowing the different types of articles will help you find the best resources for your research needs.

• Research articles (aka empirical articles)  - primary sources of authors reporting their own studies.
• Theoretical articles  - concepts, frameworks, models, and perspectives.
• Literature reviews  - summary of literature on a given topic.
• Meta-analyses  - use statistical methods to summarize studies.
• Systematic reviews  - high-level summary of literature to answer focused--often clinical--question.
• Case studies and clinical trials  - describe real patient cases/treatments.
• Conference materials  - proceedings, notes, etc.
• Commentaries, book reviews, opinions, letters, etc.  - opinion and thought pieces.
• ~[123]~: Jun 4, 2024 4:14 PM
• ~[124]~: https://guides.libraries.emory.edu/sure

Empirical evidence: A definition

Empirical evidence is information that is acquired by observation or experimentation.

The scientific method

Types of empirical research, identifying empirical evidence, empirical law vs. scientific law, empirical, anecdotal and logical evidence, additional resources and reading, bibliography.

Empirical evidence is information acquired by observation or experimentation. Scientists record and analyze this data. The process is a central part of the scientific method , leading to the proving or disproving of a hypothesis and our better understanding of the world as a result.

Empirical evidence might be obtained through experiments that seek to provide a measurable or observable reaction, trials that repeat an experiment to test its efficacy (such as a drug trial, for instance) or other forms of data gathering against which a hypothesis can be tested and reliably measured. 

"If a statement is about something that is itself observable, then the empirical testing can be direct. We just have a look to see if it is true. For example, the statement, 'The litmus paper is pink', is subject to direct empirical testing," wrote Peter Kosso in " A Summary of Scientific Method " (Springer, 2011).

"Science is most interesting and most useful to us when it is describing the unobservable things like atoms , germs , black holes , gravity , the process of evolution as it happened in the past, and so on," wrote Kosso. Scientific theories , meaning theories about nature that are unobservable, cannot be proven by direct empirical testing, but they can be tested indirectly, according to Kosso. "The nature of this indirect evidence, and the logical relation between evidence and theory, are the crux of scientific method," wrote Kosso.

The scientific method begins with scientists forming questions, or hypotheses , and then acquiring the knowledge through observations and experiments to either support or disprove a specific theory. "Empirical" means "based on observation or experience," according to the Merriam-Webster Dictionary . Empirical research is the process of finding empirical evidence. Empirical data is the information that comes from the research.

Before any pieces of empirical data are collected, scientists carefully design their research methods to ensure the accuracy, quality and integrity of the data. If there are flaws in the way that empirical data is collected, the research will not be considered valid.

The scientific method often involves lab experiments that are repeated over and over, and these experiments result in quantitative data in the form of numbers and statistics. However, that is not the only process used for gathering information to support or refute a theory. 

This methodology mostly applies to the natural sciences. "The role of empirical experimentation and observation is negligible in mathematics compared to natural sciences such as psychology, biology or physics," wrote Mark Chang, an adjunct professor at Boston University, in " Principles of Scientific Methods " (Chapman and Hall, 2017).

"Empirical evidence includes measurements or data collected through direct observation or experimentation," said Jaime Tanner, a professor of biology at Marlboro College in Vermont. There are two research methods used to gather empirical measurements and data: qualitative and quantitative.

Qualitative research, often used in the social sciences, examines the reasons behind human behavior, according to the National Center for Biotechnology Information (NCBI) . It involves data that can be found using the human senses . This type of research is often done in the beginning of an experiment. "When combined with quantitative measures, qualitative study can give a better understanding of health related issues," wrote Dr. Sanjay Kalra for NCBI.

Quantitative research involves methods that are used to collect numerical data and analyze it using statistical methods, ."Quantitative research methods emphasize objective measurements and the statistical, mathematical, or numerical analysis of data collected through polls, questionnaires, and surveys, or by manipulating pre-existing statistical data using computational techniques," according to the LeTourneau University . This type of research is often used at the end of an experiment to refine and test the previous research.

Identifying empirical evidence in another researcher's experiments can sometimes be difficult. According to the Pennsylvania State University Libraries , there are some things one can look for when determining if evidence is empirical:

• Can the experiment be recreated and tested?
• Does the experiment have a statement about the methodology, tools and controls used?
• Is there a definition of the group or phenomena being studied?

The objective of science is that all empirical data that has been gathered through observation, experience and experimentation is without bias. The strength of any scientific research depends on the ability to gather and analyze empirical data in the most unbiased and controlled fashion possible. 

However, in the 1960s, scientific historian and philosopher Thomas Kuhn promoted the idea that scientists can be influenced by prior beliefs and experiences, according to the Center for the Study of Language and Information . 

— Amazing Black scientists

— Marie Curie: Facts and biography

— What is multiverse theory?

"Missing observations or incomplete data can also cause bias in data analysis, especially when the missing mechanism is not random," wrote Chang.

Because scientists are human and prone to error, empirical data is often gathered by multiple scientists who independently replicate experiments. This also guards against scientists who unconsciously, or in rare cases consciously, veer from the prescribed research parameters, which could skew the results.

The recording of empirical data is also crucial to the scientific method, as science can only be advanced if data is shared and analyzed. Peer review of empirical data is essential to protect against bad science, according to the University of California .

Empirical laws and scientific laws are often the same thing. "Laws are descriptions — often mathematical descriptions — of natural phenomenon," Peter Coppinger, associate professor of biology and biomedical engineering at the Rose-Hulman Institute of Technology, told Live Science. 

Empirical laws are scientific laws that can be proven or disproved using observations or experiments, according to the Merriam-Webster Dictionary . So, as long as a scientific law can be tested using experiments or observations, it is considered an empirical law.

Empirical, anecdotal and logical evidence should not be confused. They are separate types of evidence that can be used to try to prove or disprove and idea or claim.

Logical evidence is used proven or disprove an idea using logic. Deductive reasoning may be used to come to a conclusion to provide logical evidence. For example, "All men are mortal. Harold is a man. Therefore, Harold is mortal."

Anecdotal evidence consists of stories that have been experienced by a person that are told to prove or disprove a point. For example, many people have told stories about their alien abductions to prove that aliens exist. Often, a person's anecdotal evidence cannot be proven or disproven. 

There are some things in nature that science is still working to build evidence for, such as the hunt to explain consciousness .

Meanwhile, in other scientific fields, efforts are still being made to improve research methods, such as the plan by some psychologists to fix the science of psychology .

" A Summary of Scientific Method " by Peter Kosso (Springer, 2011)

"Empirical" Merriam-Webster Dictionary

" Principles of Scientific Methods " by Mark Chang (Chapman and Hall, 2017)

"Qualitative research" by Dr. Sanjay Kalra National Center for Biotechnology Information (NCBI)

"Quantitative Research and Analysis: Quantitative Methods Overview" LeTourneau University

"Empirical Research in the Social Sciences and Education" Pennsylvania State University Libraries

"Thomas Kuhn" Center for the Study of Language and Information

"Misconceptions about science" University of California

Sign up for the Live Science daily newsletter now

Get the world’s most fascinating discoveries delivered straight to your inbox.

30,000 years of history reveals that hard times boost human societies' resilience

'We're meeting people where they are': Graphic novels can help boost diversity in STEM, says MIT's Ritu Raman

What's the difference between a rock and a mineral?

Most Popular

• 2 Rare fungal STI spotted in US for the 1st time
• 3 James Webb telescope finds carbon at the dawn of the universe, challenging our understanding of when life could have emerged
• 4 Neanderthals and humans interbred 47,000 years ago for nearly 7,000 years, research suggests
• 5 Noise-canceling headphones can use AI to 'lock on' to somebody when they speak and drown out all other noises
• 2 Bornean clouded leopard family filmed in wild for 1st time ever
• 3 What is the 3-body problem, and is it really unsolvable?
• 4 7 potential 'alien megastructures' spotted in our galaxy are not what they seem

• Open access
• Published: 29 September 2021

Defining ethical challenge(s) in healthcare research: a rapid review

• Guy Schofield   ORCID: orcid.org/0000-0002-9055-292X 1 , 3 ,
• Mariana Dittborn   ORCID: orcid.org/0000-0003-2903-6480 2 ,
• Lucy Ellen Selman   ORCID: orcid.org/0000-0001-5747-2699 3 &
• Richard Huxtable   ORCID: orcid.org/0000-0002-5802-1870 1  

BMC Medical Ethics volume  22 , Article number:  135 ( 2021 ) Cite this article

21k Accesses

15 Citations

11 Altmetric

Metrics details

Despite its ubiquity in academic research, the phrase ‘ethical challenge(s)’ appears to lack an agreed definition. A lack of a definition risks introducing confusion or avoidable bias. Conceptual clarity is a key component of research, both theoretical and empirical. Using a rapid review methodology, we sought to review definitions of ‘ethical challenge(s)’ and closely related terms as used in current healthcare research literature.

Rapid review to identify peer-reviewed reports examining ‘ethical challenge(s)’ in any context, extracting data on definitions of ‘ethical challenge(s)’ in use, and synonymous use of closely related terms in the general manuscript text. Data were analysed using content analysis. Four databases (MEDLINE, Philosopher’s Index, EMBASE, CINAHL) were searched from April 2016 to April 2021.

393 records were screened, with 72 studies eligible and included: 53 empirical studies, 17 structured reviews and 2 review protocols. 12/72 (17%) contained an explicit definition of ‘ethical challenge(s), two of which were shared, resulting in 11 unique definitions. Within these 11 definitions, four approaches were identified: definition through concepts; reference to moral conflict, moral uncertainty or difficult choices; definition by participants; and challenges linked to emotional or moral distress. Each definition contained one or more of these approaches, but none contained all four. 68/72 (94%) included studies used terms closely related to synonymously refer to ‘ethical challenge(s)’ within their manuscript text, with 32 different terms identified and between one and eight different terms mentioned per study.

Conclusions

Only 12/72 studies contained an explicit definition of ‘ethical challenge(s)’, with significant variety in scope and complexity. This variation risks confusion and biasing data analysis and results, reducing confidence in research findings. Further work on establishing acceptable definitional content is needed to inform future bioethics research.

Peer Review reports

Methodological rigour within research is a cornerstone in the production of high-quality findings and recommendations. Across the range of empirical methodologies, a broad collection of protocol development tools, methodology guidelines, and reporting guidelines have been developed and evidence of their use is increasingly required by journals [ 1 , 2 , 3 , 4 , 5 , 6 ]. Within both empirical bioethics and descriptive ethics, there has been an accompanying increase in the acknowledgment of the importance of methodological rigour in the empirical elements, including within the recent consensus statement on quality standards in empirical bioethics research by Ives et al. [ 7 , 8 , 9 ]. Aligned with this aim for rigour, definitional clarity of key terms used within a research project is a component of research quality [ 10 , 11 ]. Improving the quality of empirical bioethics is also itself an ethical imperative [ 9 ].

We recently conducted a systematic review examining ‘ethical challenges’ as reported by specialist palliative care practitioners [ 12 ]. Our review, alongside our initial scoping search findings and reading of the literature, suggested that, although many authors use the term ‘ethical challenge(s)’ in empirical ethics research, there appeared to be no commonly described or accepted definition. Furthermore, papers retrieved rarely defined ‘ethical challenge(s)’ explicitly , which has also been noted by other researchers examining other topic areas [ 13 , 14 , 15 ]. Our review further suggested that authors frequently use terms closely related to ‘ethical challenge(s)’—such as ‘moral dilemmas’ or ‘ethical issues’—interchangeably with ‘ethical challenge(s)’ throughout manuscripts, rather than staying with the original term. Research shows that non-philosophers may understand these related terms in heterogeneous ways which may additionally affect understanding of texts across different readerships [ 16 , 17 ].

Without a clear definition of an ethical challenge, each researcher must use individual judgement to ascertain whether they have identified an instance of one within their dataset. This potentially generates an unnecessary source of bias, particularly if multiple researchers are involved in data collection, extraction, or analysis. This risks generating misleading ethical analyses, evaluations, or recommendations. Additionally, and more broadly, if primary studies do not define the term, then work based on these—such as systematic reviews of individual studies or those undertaking secondary data analysis—may unknowingly compare different phenomena without a mechanism for mitigating the effects this introduces.

In the hope of prompting a debate on this topic, we therefore undertook a rapid review, which aimed to explore existing definitions of “ethical challenge(s)” and the use of other closely related terms within recent empirical healthcare ethics literature.

We conducted a rapid review examining the usage of the term ‘ethical challenge(s)’ over the last 5 years in published research articles, in order to identify and summarise if, and how, the term was defined. As a secondary aim, we examined authors’ uses of closely related alternative terms within the included article texts separate to their use within any explicit definitions that may be present.

Rapid reviews use abridged systematic review methodology to understand the evidence base on a particular topic in a time and resource efficient manner [ 18 , 19 , 20 , 21 , 22 ]. Comparative reviews of topics in which both a rapid review and a systematic review had been undertaken demonstrated that the overall conclusions were similar, although rapid reviews were less likely to contain social and economic data, and systematic reviews contained more detailed recommendations [ 18 , 19 , 20 , 23 , 24 ]. The Cochrane Rapid Review Methods Group has recently released interim methodological guidelines for undertaking rapid reviews [ 6 ], advising authors to describe where their protocol deviates from a systematic review and detail any biases that these deviations may introduce [ 18 , 19 , 21 ]. We have followed the Cochrane recommended methodology [ 6 ]. A rapid review reporting guideline is currently under development [ 25 ] and this review is therefore reported based on the PRISMA 2020 statement for systematic reviews, with justifications provided where our approach deviated [ 26 ].

Prospective review protocol registration on the PROSPERO database is the current gold standard, but, at the time of writing, PROSPERO does not accept records for rapid reviews [ 27 ]. The protocol was therefore not published in advance.

Eligibility criteria

The inclusion and exclusion criteria are summarised in Table 1 . We used Strech et al.’s Methodology, Issues, Participants (MIP) structure for our eligibility criteria, which is recommended for systematic reviews in ‘empirical bioethics’ [ 28 ]. The criteria reflect three assumptions. First, that the inclusion of ‘ethical challenge(s)’ in the title would increase the likelihood that this was the authors’ preferred term for the concept under investigation, and therefore increase the probability of a definition being provided. Second, that studies aiming to describe empirical data and identify ethical challenges in real-world contexts are most likely to contain a definition to guide researchers in identifying these challenges as they collect and analyse data. Third, that structured reviews of studies of ethical challenges are likely to include a definition to allow researchers to reliably recognise an ethical challenge in retrieved records. We used a 5-year timeframe as a date restriction. This reflected a balance between adequately covering recent use of the term and time and resource restrictions of the rapid review.

Information sources

The search strategy was as follows:

‘ethical challenge’.ti OR ‘ethical challenges’.ti.

We searched Medline (Ovid interface), Philosopher’s Index (OVID interface), EMBASE (OVID interface), and CINAHL (Cumulative Index to Nursing and Allied Health Literature, EBSCO interface) for studies indexed over a five-year period between April 2016 and April 2021. These resources cover the breadth of healthcare research. Including Philosopher’s Index increased coverage of the bioethics literature. We did not search the grey literature [ 6 ]. The search strategy was tested by successfully retrieving three sentinel studies known to the research team.

Study selection

Retrieved studies were imported into Endnote X9.2 [ 29 ]. Records unavailable through institutional subscriptions were requested from corresponding authors. If unavailable 14 days after the request, the record was excluded. A random sample of 20% of records were dual screened at the title/abstract level by GS/MD. After discussion, the remainder were screened by GS. At full-text screening, a further 20% were dual screened by GS/MD and, again after discussion, the remaining studies were screened by GS.

Data extraction and analysis

Data extraction was undertaken using a pre-piloted form, with the first 5 records dually extracted by GS and MD. Data from the remaining included studies was then extracted by GS, with correctness and completeness checked by MD. We collected data on date of publication, authors, journal, country (for primary studies), methodology, definition of ‘ethical challenge(s)’ (present (yes/no)) and (where offered) the definition provided, and any closely related terms used, with counts of all terms used in each article. For closely related terms, data was extracted from the authors’ text, but not from direct quotations from qualitative research. Where definitions of ‘ethical challenge(s)’ were offered and/or related terms were identified, these were categorised and counted following the principles of summative content analysis [ 30 ]. Summative content analysis combines both the quantitative counting of specific content or words/terms with latent content analysis to identify and categorise their meanings. We identified keywords (‘ethical challenge(s)’ and closely related terms) deployed by the authors of the included papers, both prior to and during data analysis, and analysed the retrieved definitions. This approach allowed for exploration of both the content of definitions and development of insights into the use of related terms.

Risk of bias assessment

The focus of the rapid review was the definition of the term ‘ethical challenge(s)’ within retrieved records. We therefore did not undertake quality assessment for the included studies and reviews.

831 records were retrieved, reduced to 393 after de-duplication. 238 records were excluded after reviewing the title and/or abstract. 157 records were identified for full text screening, with 3 unavailable [ 31 , 32 , 33 ]. 82 records were excluded at full text stage and 72 records were included for analysis. See Fig.  1 for the PRISMA flowchart.

PRISMA flow diagram of record identification

Record characteristics

Of the 72 included records, 53 were empirical studies [ 34 , 35 , 36 , 37 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 , 57 , 58 , 59 , 60 , 61 , 62 , 63 , 64 , 65 , 66 , 67 , 68 , 69 , 70 , 71 , 72 , 73 , 74 , 75 , 76 , 77 , 78 , 79 , 80 , 81 , 82 , 83 , 84 , 85 , 86 ], 10 non-systematic reviews [ 87 , 88 , 89 , 90 , 91 , 92 , 93 , 94 , 95 , 96 ], 7 systematic reviews [ 12 , 13 , 14 , 97 , 98 , 99 , 100 ], 1 systematic review protocol [ 101 ], and 1 non-systematic review protocol [ 102 ]. Of the 53 empirical studies, 42 (79%) were qualitative studies [ 34 , 35 , 36 , 38 , 39 , 40 , 41 , 42 , 43 , 44 , 47 , 48 , 50 , 51 , 52 , 54 , 55 , 56 , 57 , 58 , 60 , 62 , 63 , 64 , 65 , 66 , 67 , 69 , 71 , 72 , 73 , 74 , 75 , 76 , 77 , 79 , 80 , 81 , 83 , 84 , 85 , 86 ], 6 (12%) used a mixed methods approach [ 45 , 46 , 53 , 59 , 61 , 68 ], and 5 (10%) were quantitative [ 37 , 49 , 70 , 78 , 82 ]. 7/56 empirical studies, all qualitative interview studies, recruited participants internationally with no specific location stated [ 40 , 54 , 55 , 58 , 60 , 63 , 73 ]. Of the remaining studies, all but one were single-country studies: Botswana [ 75 ], Canada [ 41 , 65 ], China [ 57 ], Denmark [ 39 , 43 ], Dominican Republic [ 44 ], Germany [ 51 , 84 ], India [ 61 ], Iran [ 38 , 46 , 49 , 68 , 70 , 71 , 72 , 78 , 82 , 98 ], Italy [ 45 ], Mexico [ 87 ], the Netherlands [ 76 ], New Zealand [ 47 ], Norway [ 42 , 52 , 56 , 64 , 80 , 81 , 83 ], Saudi Arabia [ 34 , 35 , 36 , 37 ], Tanzania [ 69 , 74 ], Uganda [ 67 ], UK [ 86 ], and USA [ 50 , 53 , 59 , 62 , 66 , 77 , 79 , 85 , 85 ]. The remaining study was undertaken in both Sierra Leone and the UK [ 48 ]. See Table 2 for a summary.

12/72 (17%) of retrieved studies offered an explicit definition for ‘ethical challenge(s)’ [ 12 , 13 , 14 , 48 , 50 , 56 , 57 , 66 , 69 , 81 , 98 , 101 ]. Definitions were more likely to be found in more recent publications, with 4/12 included studies published in 2016–2018 [ 14 , 48 , 56 , 81 ], and 8/12 published in 2019–2021 [ 12 , 13 , 50 , 57 , 66 , 69 , 98 , 101 ]. The included study locations were evenly distributed, matching the overall pattern of retrieved studies, with studies from high- [ 48 , 50 , 56 , 66 , 81 ], middle- [ 57 , 98 ], and low-income settings [ 48 , 69 ]. The identified studies included eight qualitative studies [ 48 , 50 , 56 , 57 , 66 , 69 , 81 , 98 ], 3 systematic reviews [ 12 , 13 , 14 ], and 1 systematic review protocol [ 101 ]. Two of these records were the systematic review protocol and the report from our group, which accordingly contained the same definition [ 12 , 101 ], leaving 11 unique definitions. Definitions of ‘ethical challenge(s)’ identified in included studies are provided in Table 3 . Additionally, 68/72 (94%) reports used closely related terms synonymously in place of ‘ethical challenge(s)’ throughout their manuscript text, with between 1 and 8 different terms used within each report, and 32 different terms were identified. This occurred in both those reports that contained a definition and those that did not. See Table 4 for terms and frequencies.

Those records that offered explicit definitions used four approaches: (1) definition through concepts [ 12 , 57 , 66 ]; (2) reference to moral conflict, moral uncertainty or difficult choices [ 13 , 14 , 48 , 57 , 69 , 98 ]; (3) definition by study participants [ 12 , 48 , 50 , 56 ]; or (4) challenges as linked to their ability to generate emotional or moral distress within healthcare practitioners [ 14 , 14 , 66 , 81 ]. Each definition was associated with one or more of the identified elements, although none covered all four approaches. We describe these approaches below.

Approach 1: definition through concepts

This approach involves primarily defining ‘ethical challenge(s)’ in terms of related concepts. All three definitions using this approach defined ‘ethical challenge(s)’ as a summative collection of related concepts, including ‘ethical dilemmas’, ‘moral dilemmas’, ‘moral challenges’, ‘ethical issues’, and ‘ethical conflicts’ [ 12 , 57 , 66 ], for example:

‘The expression “ethical challenges” mainly refers to ethical dilemmas and ethical conflicts as well as other scenarios where difficult choices have to be made’ [ 57 ] p34

Only one went on to define the other concepts they utilised, ‘ethical dilemmas’ and ‘ethical conflicts’:

‘Ethical dilemmas are described as situations that cannot be solved; decisions made between two options may be morally plausible but are equally problematic due to the circumstances. Ethical conflicts, on the contrary, arise when one is aware of the necessity of proper actions but he or she may have trouble exercising these actions because of certain internal or external factors.’ [ 57 ] p34

Approach 2: moral conflict, moral uncertainty or difficult choices

This approach anchors an ethical challenge to the requirement for an agent to make a (difficult) choice in a situation where moral principles conflict, or there is moral uncertainty as to the ‘right’ way forward.

‘In this context, ethical challenge refers to the situation whereby every alternative is morally wrong and still one has to make a choice’ [ 69 ] p676 ‘An ethical challenge occurs when one does not know how to behave and act in the best way…’ [ 14 ] p93

Approach 3: definition by study participants

Four of the definitions involved research participants themselves defining something as an ‘ethical challenge’ [ 12 , 48 , 50 , 56 ], with three studies explicitly stating that participants would lead this definitional work [ 48 , 50 , 56 ]. Draper & Jenkins offer a starting definition, adopted from Schwartz et al. [ 103 ] with which to prime participants, while Forbes and Phillips [ 50 ] and Jakobsen and Sørlie [ 56 ] left the definition fully with their participants (Table 3 ). Finally, Schofield et al. proposed a very broad definition (Table 3 ), alongside the specific statement that either participants or researchers could nominate something as an ‘ethical challenge’ [ 12 ].

Approach 4: emotional or moral distress

This final approach was to tie ethical challenges to situations where participants feel ‘discomfort’, emotional distress or more specifically moral distress or moral residue [ 14 , 66 , 81 ]. Larkin et al. are clear that this distress must be tied to moral causes, but Hem et al. and Storaker et al. also refer more broadly to ‘discomfort’ [ 14 ] and ‘emotional stress’ [ 81 ] respectively. For example:

‘In this article, ethical challenges refer to values that entail emotional and moral stress in healthcare personnel.’ [ 81 ] p557

To the authors’ knowledge, this is the first rapid review to examine the use of the term ‘ethical challenge(s)’ in empirical healthcare research literature. Notably, only 12/72 (17%) of included studies published in the last 5 years contained a definition for ‘ethical challenge(s)’, despite this being the focus of the research being reported. The definitions identified were found in qualitative studies and systematic reviews and were evenly distributed geographically across high-, middle- and low-income settings. Definitions contained one or more of the identified approaches, although none contained elements from all four. Taken together, these findings suggest that a clear definition of ‘ethical challenge(s)’, and consistent use thereof, is currently lacking.

The four approaches indicate the diverse approaches to understanding ‘ethical challenge(s)’. Approaches 1 and 2 explore the concept from opposite viewpoints, with approach 1 looking from the conceptual perspective, through terms such as ‘dilemmas’ and ‘conflict’, and approach 2 from a participant perspective, specifically in those situations in which someone is trying to make a decision in circumstances where the preferred option is not possible or when they perceive there to be clash in values they feel are important. Within the concept-led definitions (approach 1), the use of a plurality of terms highlights a potential risk of bias, as different readers may interpret these differently. For example, some terms, such as ‘moral dilemma’, have relatively well understood specific meanings for some readers, particularly those with philosophical training [ 104 , 105 , 106 ]. The presence in the literature of specific and multiple meanings for some related terms highlights the importance of empirical studies providing a definition of these additional terms alongside their primary definition for ‘ethical challenge(s)’. This is more likely to be relevant where an a priori definition is used, but may be relevant to any prompting text for studies using a participant-led process, as in the study by Draper and Jenkins [ 48 ]. This clarity is important for both readers and future researchers who may undertake a secondary analysis of the data.

Approach 3 involves facilitating participants to nominate something as an ethical challenge [ 12 , 48 , 50 , 56 ]. This speaks to an important question about who, in a research context, is permitted to define or describe the object of interest, in this case ‘ethical challenge(s)’. Restricting the identification of ‘ethical challenge(s)’ to researchers alone may introduce bias by excluding input from those without bioethical ‘expertise’, but with important lived experience of the context under investigation. There is evidence that although clinicians can be sensitive to major ethical dilemmas, they can be less sensitive to small everyday ethical elements in clinical practice, and that ethical awareness varies between individuals [ 107 , 108 ]. Additionally, there is evidence in healthcare ethics research that patients and carers identify ethical challenges in situations that healthcare workers do not [ 109 ]. Therefore, relying entirely on a particular stakeholders’ perspectives (such as clinicians’) may risk missing important ethical challenges present in a scenario (assuming, of course, that we can settle what counts as an ‘ethical challenge(s)’).

In Approach 4, ethical challenges were linked to situations in which participants felt discomfort [ 14 ], emotional stress [ 81 ], moral distress or moral residue [ 66 ]. These concepts are themselves defined in quite varied ways (see, for example, definitions of ‘moral distress’ in a systematic review by Morley et al. [ 110 ]), potentially leading to additional conceptual confusion. Identifying triggers for moral distress is important, as high levels of moral distress are known to have negative impacts on work environments and lead to increased levels of compassion fatigue, increased staff turnover rates and poorer patient outcomes [ 110 , 111 , 112 ]. However, it is also possible that the requirement that, to be identified as an ethical challenge, the situation must invoke stress or distress might result in the under-identification of ethical challenges. We anticipate that many practitioners will daily manage multiple low-level ethical challenges, many of which will not generate moral distress or leave a moral residue. As such, the presence of moral distress may not be sufficient or even necessary in order to label a moral event an ‘ethical challenge’. However, the relationship between ‘ethical challenge(s)’ and moral distress is complex, and some might argue that the latter has an important relationship to the former. For example, moral distress, as conceived by Jameton and others [ 110 , 113 , 114 ], is linked to the after-effects of having to handle ethical challenge(s), so some researchers might view the generation of moral distress as relevant to identifying ethical challenges.

Although our review revealed these four approaches, the wider literature indicates there may be alternative approaches available. For example, other potential approaches would define ethical challenges as events that interact with moral principles, such as autonomy, beneficence, non-maleficence or justice, as proposed by Beauchamp and Childress [ 115 ], or as events in which those principles clash, for example as used by Klingler et al. in their research focusing on ethical issues in health surveillance [ 116 ]. However, these approaches were not seen amongst our included papers.

Returning to our included papers, the high rates of use of closely related terms within included manuscript texts may add to difficulties in understanding the exact object of interest if these terms are being used as synonyms for ‘ethical challenge(s)’. This may be particularly the case if terms used include those such as ‘moral dilemma’, which (as shown above) will have specific meanings for some readers. Interchangeable, undefined usage of these terms by study authors within study texts risks further exacerbating the problems caused by a lack of definitional clarity.

Strengths and limitations

This rapid review is the first systematic attempt to describe the definitions of ‘ethical challenge(s)’ available within the recent published literature.

There are, however, five limitations to note. First, the review only includes results from the past 5 years, which inevitably means that older publications, which may have contained further definitions of ‘ethical challenge(s)’, were excluded. The focus on the previous 5 years does, however, allow for an assessment of the term’s use(s) within a reasonable period of time and was felt to be appropriate given the aims and resources available to this project.

Second, our three assumptions listed in the methodology section may have excluded some records that contained a relevant definition. However, these assumptions, and the resulting focus on two search terms, allowed for a balance between retrieved record numbers and team resources.

Third, the four databases searched were chosen for their focus on the healthcare ethics literature; we may therefore may have missed relevant usage in other fields or disciplines. Similarly, we did not search the grey literature, which might have excluded relevant research.

Fourth, for resource reasons, the assessment as to whether a related term was being used interchangeably in the text was undertaken by a single researcher (GS). This subjective assessment risks miscalculating both the number of interchangeable terms identified and the frequency counts.

Finally, we did not review the theoretical literature for conceptual definitions of ‘ethical challenge(s)’, hence the definitions we identified might not match completely conceptual understandings of the term. However, our review shows how the term is currently being used in the research literature. Indeed, if there are strong conceptual definitions within the theoretical literature, then it is clear that they are currently not reaching the researchers whose work was identified by our review.

This review is the first, to our knowledge, to identify and describe definitions (and uses) of the widely-utilised concept of ‘ethical challenge(s)’ within healthcare research. Only 17% (12/72) of retrieved papers presented an explicit definition of ‘ethical challenge(s)’ before beginning to investigate this concept in context. The definitions found contained one or more of four identified approaches, with significant cross-reference to related terms and concepts which themselves have variation in their accepted meanings. We recommend that researchers define the phenomenon of interest—in this case, ‘ethical challenge(s)’—to help ensure clarity. This should either be a priori, or, if using an approach that includes participant participation in the generation of the definition, reporting their final working definition a posteriori. The choice of definition should be justified, including the decision as to whether to include participants in this process. Additionally, if a definition references other conceptual terms, then consideration should be given to defining these as well.

The results of this rapid review suggest that a common conceptual understanding of the term ‘ethical challenge(s)’ is lacking within empirical bioethical research and that there is a need for researchers in this area to consider what conceptual formulations might be most useful. Again, failure to use definitions of crucial research concepts within empirical bioethics research potentially generates confusion and avoidable bias within research outputs, risking misleading ethical analyses, evaluations, and resulting recommendations. We therefore hope this review will help stimulate debate amongst empirical bioethics researchers on possible definitional content for such a commonly used term and prompt further discussion and research. Additionally, given the central role of patient and public partnership and involvement in research, further thought should be given to who should be involved in nominating something as a challenge worthy of study.

Following on from this work, there would be value in conducting an empirical bioethical project combining a full systematic review of definitions of ‘ethical challenge(s)’ (and related terms) integrated with an exploration of the conceptual literature to generate recommendations for approaches towards the content of potential definitions, perhaps related to the identified approaches above. Such a project could also ask authors who currently use the term ‘ethical challenge(s)’ in their research how they conceptualise this. Furthermore, work to better understand the benefits of including study participants in the definition process is also important. Finally, whilst researchers should justify whatever approach they choose to take, there may be merit in examining whether anything is lost if studies lack a robust or agreed definition, or whether doing so affords a flexibility and openness that allows for a broader range of ethical challenges to be identified.

Availability of data and materials

All data is presented in this manuscript.

Critical Appraisal Skills Programme. CASP Qualitative Checklist. 2018. https://casp-uk.net/wp-content/uploads/2018/01/CASP-Qualitative-Checklist.pdf . Accessed 16 Aug 2018.

Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groups | The EQUATOR Network. https://www.equator-network.org/reporting-guidelines/coreq/ . Accessed 2 Apr 2020.

Standards for reporting qualitative research: a synthesis of recommendations | The EQUATOR Network. https://www.equator-network.org/reporting-guidelines/srqr/ . Accessed 2 Apr 2020.

Lewin S, Booth A, Glenton C, Munthe-Kaas H, Rashidian A, Wainwright M, et al. Applying GRADE-CERQual to qualitative evidence synthesis findings: introduction to the series. Implement Sci. 2018;13:2.

Article   Google Scholar  

The EQUATOR Network | Enhancing the QUAlity and Transparency of Health Research. https://www.equator-network.org/ . Accessed 2 Apr 2020.

Garritty C, Gartlehner G, Nussbaumer-Streit B, King VJ, Hamel C, Kamel C, et al. Cochrane Rapid Reviews Methods Group offers evidence-informed guidance to conduct rapid reviews. J Clin Epidemiol. 2021;130:13–22.

Singh I. Evidence, epistemology and empirical bioethics. In: Cribb A, Ives J, Dunn M, editors. Empirical bioethics: theoretical and practical perspectives. Cambridge: Cambridge University Press; 2016. p. 67–83. https://doi.org/10.1017/9781139939829.006 .

Chapter   Google Scholar  

Ives J, Dunn M, Molewijk B, Schildmann J, Bærøe K, Frith L, et al. Standards of practice in empirical bioethics research: towards a consensus. BMC Med Ethics. 2018;19:68.

Mertz M, Inthorn J, Renz G, Rothenberger LG, Salloch S, Schildmann J, et al. Research across the disciplines: a road map for quality criteria in empirical ethics research. BMC Med Ethics. 2014;15:17.

Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.

Cronin P, Ryan F, Coughlan M. Concept analysis in healthcare research. Int J Ther Rehabil. 2010;17:62–8.

Schofield G, Dittborn M, Huxtable R, Brangan E, Selman LE. Real-world ethics in palliative care: a systematic review of the ethical challenges reported by specialist palliative care practitioners in their clinical practice. Palliat Med. 2021;35:315–34.

Heggestad AKT, Magelssen M, Pedersen R, Gjerberg E. Ethical challenges in home-based care: a systematic literature review. Nurs Ethics. 2020;28:628–44.

Hem MH, Gjerberg E, Husum TL, Pedersen R. Ethical challenges when using coercion in mental healthcare: a systematic literature review. Nurs Ethics. 2018;25:92–110.

Lillemoen L, Pedersen R. Ethical challenges and how to develop ethics support in primary health care. Nurs Ethics. 2013;20:96–108.

Saarni SI, Halila R, Palmu P, Vänskä J. Ethically problematic treatment decisions in different medical specialties. J Med Ethics. 2008;34:262–7.

Self D, Skeel J, Jecker N. A comparison of the moral reasoning of physicians and clinical medical ethicists. Acad Med. 1993;68:852–5.

Ganann R, Ciliska D, Thomas H. Expediting systematic reviews: methods and implications of rapid reviews. Implement Sci IS. 2010;5:56.

Cameron A. Rapid versus full systematic reviews: an inventory of current mathods and practice in health technology assessment. Stepney: Royal Australasian College of Dental Surgeons; 2007.

Google Scholar  

Tricco AC, Antony J, Zarin W, Strifler L, Ghassemi M, Ivory J, et al. A scoping review of rapid review methods. BMC Med. 2015;13:224.

Haby MM, Chapman E, Clark R, Barreto J, Reveiz L, Lavis JN. What are the best methodologies for rapid reviews of the research evidence for evidence-informed decision making in health policy and practice: a rapid review. Health Res Policy Syst. 2016;14:83.

Gough D, Thomas J, Oliver S. Clarifying differences between review designs and methods. Syst Rev. 2012;1:28.

Watt A, Cameron A, Sturm L, Lathlean T, Babidge W, Blamey S, et al. Rapid reviews versus full systematic reviews: an inventory of current methods and practice in health technology assessment. Int J Technol Assess Health Care. 2008;24:133–9.

Khangura S, Konnyu K, Cushman R, Grimshaw J, Moher D. Evidence summaries: the evolution of a rapid review approach. Syst Rev. 2012;1:10.

Stevens A, Garritty C, Hersi M, Moher D. Developing PRISMA-RR, a reporting guideline for rapid reviews of primary studies (Protocol). 2018. https://www.equator-network.org/wp-content/uploads/2018/02/PRISMA-RRprotocol.pdf . Accessed 6 Oct 2019.

Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.

PROSPERO: International prospective register of systematic reviews. https://www.crd.york.ac.uk/prospero/ . Accessed 10 June 2021.

Strech D, Synofzik M, Marckmann G. Systematic reviews of empirical bioethics. J Med Ethics. 2008;34:472–7.

The Endnote Team. Endnote X9.2. Philadelphia, PA: Clarivate Analysis; 2013.

Hsieh H-F, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15:1277–88.

Khalili M. Iranian nurses’ ethical challenges in controlling children’s fever. Int J Pharm Res. 2018;10:337–40.

Rezaee N. Ethical challenges in cancer care: a qualitative analysis of nurses’ perceptions. Res Theory Nurs Pract. 2019;33:169–82.

Bartnik E. Ethical challenges in genetics. J Med Liban. 2019;67:138–40.

Alahmad G, Aljohani S, Najjar MF. Ethical challenges regarding the use of stem cells: interviews with researchers from Saudi Arabia. BMC Med Ethics. 2020;21:1–7.

Alahmad G, Al-Kamli H, Alzahrani H. Ethical challenges of pediatric cancer care: interviews with nurses in Saudi Arabia. Cancer Control. 2020;27:1073274820917210.

Alahmad G, Richi H, BaniMustafa A, Almutairi AF. Ethical challenges related to the novel coronavirus (COVID-19) outbreak: interviews with professionals from Saudi Arabia. Front Med. 2021. https://doi.org/10.3389/fmed.2021.620444 .

Alahmad G, AlSaqabi M, Alkamli H, Aleidan M. Ethical challenges in consent procedures involving pediatric cancer patients in Saudi Arabia: an exploratory survey. Dev World Bioeth. 2021. https://doi.org/10.1111/dewb.12308 .

Bijani M, Mohammadi F. Ethical challenges of caring for burn patients: a qualitative study. BMC Med Ethics. 2021;22:1–10.

Bladt T, Vorup-Jensen T, Sædder E, Ebbesen M. Empirical investigation of ethical challenges related to the use of biological therapies. J Law Med Ethics. 2020;48:567–78.

Boulanger RF, Komparic A, Dawson A, Upshur REG, Silva DS. Developing and implementing new TB technologies: key informants’ perspectives on the ethical challenges. J Bioeth Inq. 2020;17:65–73.

Bourbonnais A, Rousseau J, Lalonde M-H, Meunier J, Lapierre N, Gagnon M-P. Conditions and ethical challenges that could influence the implementation of technologies in nursing homes: a qualitative study. Int J Older People Nurs. 2019;14:e12266.

Brodtkorb K, Skisland AV-S, Slettebø Å, Skaar R. Preserving dignity in end-of-life nursing home care: some ethical challenges. Nord J Nurs Res. 2017;37:78–84.

Bruun H, Lystbaek SG, Stenager E, Huniche L, Pedersen R. Ethical challenges assessed in the clinical ethics Committee of Psychiatry in the region of Southern Denmark in 2010–2015: a qualitative content analyses. BMC Med Ethics. 2018;19:62.

Canario Guzmán JA, Espinal R, Báez J, Melgen RE, Rosario PAP, Mendoza ER. Ethical challenges for international collaborative research partnerships in the context of the Zika outbreak in the Dominican Republic: a qualitative case study. Health Res Policy Syst. 2017;15:82.

Carnevale F, Delogu B, Bagnasco A, Sasso L. Correctional nursing in Liguria, Italy: examining the ethical challenges. J Prev Med Hyg. 2018;59:E315.

Delpasand K, Nazari Tavakkoli S, Kiani M, Abbasi M, Afshar L. Ethical challenges in the relationship between the pharmacist and patient in Iran. Int J Hum Rights Healthc. 2020;13:317–23.

Donnelly S, Walker S. Enabling first and second year doctors to negotiate ethical challenges in end-of-life care: a qualitative study. BMJ Support Palliat Care. 2021. https://doi.org/10.1136/bmjspcare-2020-002672 .

Draper H, Jenkins S. Ethical challenges experienced by UK military medical personnel deployed to Sierra Leone (operation GRITROCK) during the 2014–2015 Ebola outbreak: a qualitative study. BMC Med Ethics. 2017;18:77.

Ebrahimi A, Ebrahimi S. Pediatric residents’ and attending physicians’ perspectives on the ethical challenges of end of life care in children. J Med Ethics Hist Med. 2018;11:16.

Forbes S, Phillips C. Ethical challenges encountered by clinical trials nurses: a grounded theory study. Oncol Nurs Forum. 2020;47:428–35.

Gágyor I, Heßling A, Heim S, Frewer A, Nauck F, Himmel W. Ethical challenges in primary care: a focus group study with general practitioners, nurses and informal caregivers. Fam Pract. 2019;36:225–30.

Haugom W, Ruud E, Hynnekleiv T. Ethical challenges of seclusion in psychiatric inpatient wards: a qualitative study of the experiences of Norwegian mental health professionals. BMC Health Serv Res. 2019;19:879.

Hawking M, Kim J, Jih M, Hu C, Yoon JD. “Can virtue be taught?”: a content analysis of medical students’ opinions of the professional and ethical challenges to their professional identity formation. BMC Med Educ. 2020;20:380.

Hyder A, Krubiner C. Ethical challenges in designing and implementing health systems research: experiences from the field. AJOB Empir Bioeth. 2016;7:209–17.

Jackson C, Gardy JL, Shadiloo HC, Silva DS. Trust and the ethical challenges in the use of whole genome sequencing for tuberculosis surveillance: a qualitative study of stakeholder perspectives. BMC Med Ethics. 2019;20:43.

Jakobsen R, Sørlie V. Ethical challenges: trust and leadership in dementia care. Nurs Ethics. 2016;23:636–45.

Jia Y, Chen O, Xiao Z, Xiao J, Bian J, Jia H. Nurses’ ethical challenges caring for people with COVID-19: a qualitative study. Nurs Ethics. 2021;28:33–45.

Kalkman S, van Thiel GJMW, Grobbee DE, Meinecke A-K, Zuidgeest MGP, van Delden JJM, et al. Stakeholders’ views on the ethical challenges of pragmatic trials investigating pharmaceutical drugs. Trials. 2016;17:419.

Kasper J, Mulye A, Doobay-Persaud A, Seymour B, Nelson BD. Perspectives and solutions from clinical trainees and mentors regarding ethical challenges during global health experiences. Ann Glob Health. 2020;86:34.

Kelley MC, Brazg T, Wilfond BS, Lengua LJ, Rivin BE, Martin-Herz SP, et al. Ethical challenges in research with orphans and vulnerable children: a qualitative study of researcher experiences. Int Health. 2016;8:187–96.

Kemparaj VM, Panchmal GS, Kadalur UG. The top 10 ethical challenges in dental practice in indian scenario: dentist perspective. Contemp Clin Dent. 2018;9:97.

Klitzman R. Unconventional combinations of prospective parents: ethical challenges faced by IVF providers. BMC Med Ethics. 2017;18:18.

Komparic A, Dawson A, Boulanger RF, Upshur REG, Silva DS. A failure in solidarity: ethical challenges in the development and implementation of new tuberculosis technologies. Bioethics. 2019;33:557–67.

Laholt H, McLeod K, Guillemin M, Beddari E, Lorem G. Ethical challenges experienced by public health nurses related to adolescents’ use of visual technologies. Nurs Ethics. 2019;26:1822–33.

Laliberté M, Williams-Jones B, Feldman DE, Hunt M. Ethical challenges for patient access to physical therapy: views of staff members from three publicly-funded outpatient physical therapy departments. Narrat Inq Bioeth. 2017;7:157–69.

Larkin ME, Beardslee B, Cagliero E, Griffith CA, Milaszewski K, Mugford MT, et al. Ethical challenges experienced by clinical research nurses: a qualitative study. Nurs Ethics. 2019;26:172–84.

Mbalinda SN, Bakeera-Kitaka S, Amooti DL, Magongo EN, Musoke P, Kaye DK. Ethical challenges of the healthcare transition to adult antiretroviral therapy (ART) clinics for adolescents and young people with HIV in Uganda. BMC Med Ethics. 2021;22:1–14.

Mehdipour Rabori R, Dehghan M, Nematollahi M. Nursing students’ ethical challenges in the clinical settings: a mixed-methods study. Nurs Ethics. 2019;26:1983–91.

Mlughu TS, Anaeli A, Joseph R, Sirili N. Voluntary HIV counseling and testing among commercial motorcyclist youths: an exploration of ethical challenges and coping mechanisms in Dar es Salaam. HIVAIDS - Res Palliat Care. 2020;12:675–85.

Moeini S, Shahriari M, Shamali M. Ethical challenges of obtaining informed consent from surgical patients. Nurs Ethics. 2020;27:527–36.

Naseri-Salahshour V, Sajadi M. Ethical challenges of novice nurses in clinical practice: Iranian perspective. Int Nurs Rev. 2020;67:76–83.

Naseri-Salahshour V, Sajadi M. From suffering to indifference: reaction of novice nurses to ethical challenges in first year of clinical practice. Iran J Nurs Midwifery Res. 2019;24:251.

Nicholls SG, Carroll K, Zwarenstein M, Brehaut JC, Weijer C, Hey SP, et al. The ethical challenges raised in the design and conduct of pragmatic trials: an interview study with key stakeholders. Trials. 2019;20:765.

Pancras G, Shayo J, Anaeli A. Non-medical facilitators and barriers towards accessing haemodialysis services: an exploration of ethical challenges. BMC Nephrol. 2018;19:342.

Sabone M, Mazonde P, Cainelli F, Maitshoko M, Joseph R, Shayo J, et al. Everyday ethical challenges of nurse-physician collaboration. Nurs Ethics. 2020;27:206–20.

Seekles W, Widdershoven G, Robben P, van Dalfsen G, Molewijk B. Inspectors’ ethical challenges in health care regulation: a pilot study. Med Health Care Philos. 2017;20:311–20.

Segal AG, Frasso R, Sisti DA. County jail or psychiatric hospital? Ethical challenges in correctional mental health care. Qual Health Res. 2018;28:963–76.

Shayestefar S, Hamooleh MM, Kouhnavard M, Kadivar M. Ethical challenges in pediatrics from the viewpoints of Iranian pediatric residents. J Compr Pediatr. 2018. https://doi.org/10.5812/compreped.62747 .

Sinow C, Burgart A, Char DS. How anesthesiologists experience and negotiate ethical challenges from drug shortages. AJOB Empir Bioeth. 2020;12:84–91.

Slettebø Å, Skaar R, Brodtkorb K, Skisland A. Conflicting rationales: leader’s experienced ethical challenges in community health care for older people. Scand J Caring Sci. 2018;32:645–53.

Storaker A, Nåden D, Sæteren B. From painful busyness to emotional immunization: nurses’ experiences of ethical challenges. Nurs Ethics. 2017;24:556–68.

Taebi M, Bahrami R, Bagheri-Lankarani N, Shahriari M. Ethical challenges of embryo donation in embryo donors and recipients. Iran J Nurs Midwifery Res. 2018;23:36.

Tønnessen S, Solvoll B-A, Brinchmann BS. Ethical challenges related to next of kin - nursing staffs’ perspective. Nurs Ethics. 2016;23:804–14.

Ullrich A, Theochari M, Bergelt C, Marx G, Woellert K, Bokemeyer C, et al. Ethical challenges in family caregivers of patients with advanced cancer—a qualitative study. BMC Palliat Care. 2020;19:1–13.

Verma A, Smith AK, Harrison KL, Chodos AH. Ethical challenges in caring for unrepresented adults: a qualitative study of key stakeholders. J Am Geriatr Soc. 2019;67:1724–9.

Morley G, Ives J, Bradbury-Jones C. Moral distress and austerity: an avoidable ethical challenge in healthcare. Health Care Anal. 2019;27:185–201.

Ayala-Yáñez R, Ruíz-López R, McCullough LB, Chervenak FA. Violence against trainees: urgent ethical challenges for medical educators and academic leaders in perinatal medicine. J Perinat Med. 2020;48:728–32.

Binns C, Lee M, Kagawa M. Ethical challenges in infant feeding research. Nutrients. 2017;9:59.

Čartolovni A, Habek D. Guidelines for the management of the social and ethical challenges in brain death during pregnancy. Int J Gynecol Obstet. 2019;146:149–56.

Hofmann B. Informing about mammographic screening: ethical challenges and suggested solutions. Bioethics. 2020;34:483–92.

Hunt M, Pal NE, Schwartz L, O’Mathúna D. Ethical challenges in the provision of mental health services for children and families during disasters. Curr Psychiatry Rep. 2018;20:60.

Johnson S, Parker M. Ethical challenges in pathogen sequencing: a systematic scoping review. Wellcome Open Res. 2020;5:119.

MacDonald S, Shemie S. Ethical challenges and the donation physician specialist: a scoping review. Transplantation. 2017. https://doi.org/10.1097/TP.0000000000001697 .

Saigle V, Racine E. Ethical challenges faced by healthcare professionals who care for suicidal patients: a scoping review. Monash Bioeth Rev. 2018;35:50–79.

Saigle V, Séguin M, Racine E. Identifying gaps in suicide research: a scoping review of ethical challenges and proposed recommendations. IRB Ethics Hum Res. 2017;39:1–9.

Wilson E, Kenny A, Dickson-Swift V. Ethical challenges in community-based participatory research: a scoping review. Qual Health Res. 2018;28:189–99.

Martins Pereira S, Hernández-Marrero P. Ethical challenges of outcome measurement in palliative care clinical practice: a systematic review of systematic reviews. Ann Palliat Med. 2018;7:S207–18.

Saghafi A, Bahramnezhad F, Poormollamirza A, Dadgari A, Navab E. Examining the ethical challenges in managing elder abuse: a systematic review. J Med Ethics Hist Med. 2019. https://doi.org/10.18502/jmehm.v12i7.1115 .

West E, Stuckelberger A, Pautex S, Staaks J, Gysels M. Operationalising ethical challenges in dementia research—a systematic review of current evidence. Age Ageing. 2017;46:678–87.

Ewuoso C, Hall S, Dierickx K. How do healthcare professionals respond to ethical challenges regarding information management? A review of empirical studies. Glob Bioeth. 2021;32:67–84.

Schofield G, Brangan E, Dittborn M, Huxtable R, Selman L. Real-world ethics in palliative care: protocol for a systematic review of the ethical challenges reported by specialist palliative care practitioners in their clinical practice. BMJ Open. 2019;9:e028480.

Sun W, Wilson MG, Schreiber D, Wang RH. Ethical challenges related to assistive product access for older adults and adults living with a disability: a scoping review protocol. Syst Rev. 2017;6:24.

Schwartz L, Sinding C, Hunt M, Elit L, Redwood-Campbell L, Adelson N, et al. Ethics in humanitarian aid work: learning from the narratives of humanitarian health workers. AJOB Prim Res. 2010;1:45–54.

McConnell T. Moral Dilemmas. In: Zalta EN, editor. The Stanford Encyclopedia of Philosophy. Fall 2018. Metaphysics Research Lab, Stanford University; 2018. https://plato.stanford.edu/archives/fall2018/entries/moral-dilemmas/ . Accessed 30 Oct 2019.

Tessman L. Moral failure: on the impossible demands of morality. New York, NY: Oxford University Press; 2014. http://search.ebscohost.com/login.aspx?direct=true&scope=site&db=nlebk&db=nlabk&AN=859724 . Accessed 5 Nov 2019.

Ejder Apay S, Gürol A, Gür EY, Church S. Midwifery students’ reactions to ethical dilemmas encountered in outpatient clinics. Nurs Ethics. 2020;27:1542–55.

Milliken A, Ludlow L, DeSanto-Madeya S, Grace P. The development and psychometric validation of the Ethical Awareness Scale. J Adv Nurs. 2018;74:2005–16.

Truog RD, Brown SD, Browning D, Hundert EM, Rider EA, Bell SK, et al. Microethics: the ethics of everyday clinical practice. Hastings Cent Rep. 2015;45:11–7.

Woods S, Beaver K, Luker K. User’s views of palliative care services: ethical implications. Nurs Ethics Int J Health Care Prof. 2000;7:314–26.

Morley G, Ives J, Bradbury-Jones C, Irvine F. What is ‘moral distress’? A narrative synthesis of the literature. Nurs Ethics. 2017;26:646–62.

Epstein EG, Hamric AB. Moral distress, moral residue, and the crescendo effect. J Clin Ethics. 2009;20:330–42.

Mason VM, Leslie G, Clark K, Lyons P, Walke E, Butler C, et al. Compassion fatigue, moral distress, and work engagement in surgical intensive care unit trauma nurses: a pilot study. Dimens Crit Care Nurs DCCN. 2014;33:215–25.

Jameton A. Nursing practice: the ethical issues. Englewood Cliffs: Prentice-Hall; 1984.

Tigard DW. The positive value of moral distress. Bioethics. 2019;33:601–8.

Beauchamp TL, Childress JF. Principles of biomedical ethics. New York: Oxford University Press; 1979.

Klingler C, Silva DS, Schuermann C, Reis AA, Saxena A, Strech D. Ethical issues in public health surveillance: a systematic qualitative review. BMC Public Health. 2017;17:295.

Solvoll B-A, Hall EO, Brinchmann BS. Ethical challenges in everyday work with adults with learning disabilities. Nurs Ethics. 2015;22:417–27.

Download references

Acknowledgements

Not applicable.

GS is supported by a Wellcome Trust Research Award for Health Professionals (208129/Z/17/Z). LES is funded by a Career Development Fellowship from the National Institute for Health Research. RH is part-funded by the Wellcome Trust (209841/Z/17/Z) and the NIHR Biomedical Research Centre at University Hospitals Bristol NHS Foundation Trust and the University of Bristol. He serves on various local, regional, and national ethics committees and related groups. The views expressed in this publication are those of the authors and not necessarily those of the NHS, the National Institute for Health Research, the Department of Health, or any of the other organisations with and for whom the authors work.

Author information

Authors and affiliations.

Centre for Ethics in Medicine, Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, BS8 2PS, UK

Guy Schofield & Richard Huxtable

Paediatric Bioethics Centre, Great Ormond Street Hospital, London, WC1N 3JH, UK

Mariana Dittborn

Palliative and End of Life Care Research Group, Population Health Sciences, Bristol Medical School, University of Bristol, Bristol, BS8 2PS, UK

Guy Schofield & Lucy Ellen Selman

You can also search for this author in PubMed   Google Scholar

Contributions

GS, MD and RH conceived of the idea for the review; LES, GS, MD and RH designed the review protocol; GS and MD conducted the literature searching, screening, data extraction and led on data interpretation but all authors were involved; GS led on drafting the manuscript; all authors critically revised the manuscript for content and approved the version to be published. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Guy Schofield .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

The authors declare that there are no conflicts of interests.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Schofield, G., Dittborn, M., Selman, L.E. et al. Defining ethical challenge(s) in healthcare research: a rapid review. BMC Med Ethics 22 , 135 (2021). https://doi.org/10.1186/s12910-021-00700-9

Download citation

Received : 10 June 2021

Accepted : 03 September 2021

Published : 29 September 2021

DOI : https://doi.org/10.1186/s12910-021-00700-9

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Ethical challenges
• Rapid review
• Empirical bioethics
• Moral dilemmas

BMC Medical Ethics

ISSN: 1472-6939

• General enquiries: [email protected]

Research Design: Theoretical Basis, Empirical Approach

• First Online: 01 June 2024

Cite this chapter

• Rosanna Planer 2  

Chapter 5, “Research Design: Theoretical Basis, Empirical Approach,” gives an overview of the specifics of the research design by introducing the three studies conducted within this dissertation project: It starts with a systematic literature review (Study I), continues with a quantitative analysis of multimedia stories (Study II), and concludes with expert interviews (Study III). 

I think that lesson needs to be understood because it's definitely a niche type of thing. And I think that there isn't a lot of the history of all this that's recorded. So I think that that'll be a helpful piece of research. (Jon Keegan, Visual Correspondent at The Wall Street Journal, about analyzing multimedia storytelling)

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

• Available as PDF
• Read on any device
• Instant download
• Own it forever
• Available as EPUB and PDF
• Compact, lightweight edition
• Dispatched in 3 to 5 business days
• Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

The systematic review method will be outlined in detail within Chapter  6 .

Author information

Authors and affiliations.

Universität Leipzig, Leipzig, Germany

Rosanna Planer

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Rosanna Planer .

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Fachmedien Wiesbaden GmbH, part of Springer Nature

About this chapter

Planer, R. (2024). Research Design: Theoretical Basis, Empirical Approach. In: Two Decades of Multimedia Storytelling in Digital Journalism. Springer VS, Wiesbaden. https://doi.org/10.1007/978-3-658-44485-3_5

Download citation

DOI : https://doi.org/10.1007/978-3-658-44485-3_5

Published : 01 June 2024

Publisher Name : Springer VS, Wiesbaden

Print ISBN : 978-3-658-44484-6

Online ISBN : 978-3-658-44485-3

eBook Packages : Social Science and Law (German Language)

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Publish with us

Policies and ethics

• Find a journal
• Track your research

• Open access
• Published: 02 January 2022

The roles, activities and impacts of middle managers who function as knowledge brokers to improve care delivery and outcomes in healthcare organizations: a critical interpretive synthesis

• Faith Boutcher 1 ,
• Whitney Berta 2 ,
• Robin Urquhart 3 &
• Anna R. Gagliardi 4  

BMC Health Services Research volume  22 , Article number:  11 ( 2022 ) Cite this article

4219 Accesses

7 Citations

1 Altmetric

Metrics details

Middle Managers (MMs) are thought to play a pivotal role as knowledge brokers (KBs) in healthcare organizations. However, the role of MMs who function as KBs (MM KBs) in health care is under-studied. Research is needed that contributes to our understanding of how MMs broker knowledge in health care and what factors influence their KB efforts.

We used a critical interpretive synthesis (CIS) approach to review both qualitative and quantitative studies to develop an organizing framework of how MMs enact the KB role in health care. We used compass questions to create a search strategy and electronic searches were conducted in MEDLINE, CINAHL, Social Sciences Abstracts, ABI/INFORM, EMBASE, PubMed, PsycINFO, ERIC and the Cochrane Library. Searching, sampling, and data analysis was an iterative process, using constant comparison, to synthesize the results.

We included 41 articles (38 empirical studies and 3 conceptual papers) that met the eligibility criteria. No existing review was found on this topic. A synthesis of the studies revealed 12 MM KB roles and 63 associated activities beyond existing roles hypothesized by extant theory, and we elaborate on two MM KB roles: 1) convincing others of the need for, and benefit of an innovation or evidence-based practice; and 2) functioning as a strategic influencer. We identified organizational and individual factors that may influence the efforts of MM KBs in healthcare organizations. Additionally, we found that the MM KB role was associated with enhanced provider knowledge, and skills, as well as improved organizational outcomes.

Our findings suggest that MMs do enact KB roles in healthcare settings to implement innovations and practice change. Our organizing framework offers a novel conceptualization of MM KBs that advances understanding of the emerging KB role that MMs play in healthcare organizations. In addition to roles, this study contributes to the extant literature by revealing factors that may influence the efforts and impacts of MM KBs in healthcare organizations. Future studies are required to refine and strengthen this framework.

Trial registration

A protocol for this review was not registered.

Peer Review reports

Contributions to the literature

MMs may play an important KB role in healthcare organizations.

Additional support for the MM KB role may help enhance quality of care in healthcare settings.

An improved understanding of MM KBs will contribute to this nascent area of inquiry in health care.

Health systems are under increasing pressure to improve performance including productivity, quality of care, and efficiency in service delivery. To promote optimal performance, health systems hold healthcare organizations such as hospitals accountable for the quality of care they provide through accountability agreements tied to performance targets [ 1 , 2 ]. Despite such incentives, healthcare organizations face considerable challenges in providing high-quality care and research continues to show that the quality of hospital-based care is less than ideal [ 3 , 4 , 5 ]. Some researchers contend that this is attributed, in part, to the challenges that healthcare organizations face when integrating new knowledge into practice. Some challenges include dedicating sufficient resources to adopt or implement evidence-informed innovations that enhance service delivery and optimize patient health and outcomes [ 6 ].

Healthcare organizations use knowledge translation (KT) approaches to promote the use of evidence-based practices intended to optimize quality of care. The use of knowledge brokers (KBs) is one such approach. KBs are defined as the human component of KT who work collaboratively with stakeholders to facilitate the transfer and exchange of knowledge in diverse settings, [ 7 , 8 , 9 ]. KBs that facilitate the use of knowledge between people or groups have been referred to as opinion leaders, facilitators, champions, linking agents and change agents whose roles can be formal or informal [ 10 , 11 ]. These “influencer” roles are based on the premise that interpersonal contact improves the likelihood of behavioral change associated with use or adoption of new knowledge [ 12 ]. Research shows that KBs have had a positive effect on increasing knowledge and evidence-based practices among clinicians in hospitals, and on advocating for change on behalf of clinicians to executives [ 13 , 14 , 15 ]. However, greater insight is needed on how to equip and support KBs, so they effectively promote and enable clinicians to use evidence-based practices that improve quality of care [ 13 , 16 , 17 ].

Middle managers (MMs) play a pivotal role in facilitating high quality care and may play a brokerage role in the sharing and use of knowledge in healthcare organizations [ 18 , 19 ]. MMs are managers at the mid-level of an organization supervised by senior managers, and who, in turn, supervise frontline clinicians [ 20 ]. MMs facilitate the integration of new knowledge in healthcare organizations by helping clinicians appreciate the rationale for organizational changes and translating adoption decisions into on-the-ground implementation strategies [ 18 , 19 ]. Current research suggests that MMs may play an essential role as internal KBs because of their mid-level positions in healthcare organizations. Some researchers have called for a deeper understanding of the MM role in knowledge brokering, including how MMs enact internal KB roles [ 16 , 17 , 18 , 19 , 21 ].

To this end, further research is needed on who assumes the KB role and what they do. Prior research suggests that KBs may function across five key roles: knowledge manager, linking agent, capacity builder, facilitator, and evaluator, but it is not clear whether these roles are realized in all healthcare settings [ 7 , 21 , 22 ]. KBs are often distinguished as external or internal to the practice community that they seek to influence, and most studies have focused on external KBs with comparatively little research focused on the role of internal KBs [ 7 , 9 , 17 , 23 , 24 ]. To address this gap, we will focus on internal KBs (MMs) who hold a pivotal position because their credibility and detailed knowledge of local context allows them to overcome the barriers common to external KBs. One such barrier is resistance to advice from external sources unfamiliar with the local context [ 25 ].

With respect to what KBs do, two studies explored KB roles and activities, and generated frameworks that describe KB functions, processes, and outcomes in health care [ 7 , 22 ]. However, these frameworks are not specific to MMs and are limited in detail about KB roles and functions. This knowledge is required by healthcare organizations to develop KB capacity among MMs, who can then enhance quality of care. Therefore, the focus of this study was to synthesize published research on factors that influence the KB roles, activities, and impact of MMs in healthcare settings. In doing so, we will identify key concepts, themes, and the relationships among them to generate an organizing framework that categorizes how MMs function as KBs in health care to guide future policy, practice, and research.

We used a critical interpretive synthesis (CIS) to systematically review the complex body of literature on MM KBs. This included qualitative, quantitative, and theoretical papers. CIS offers an iterative, dynamic, recursive, and reflexive approach to qualitative synthesis. CIS was well-suited to review the MM KB literature than traditional systematic review methods because it integrates findings from diverse studies into a single, coherent framework based on new theoretical insights and interpretations [ 26 , 27 ]. A key feature that distinguishes CIS from other approaches to interpretive synthesis is the critical nature of the analysis that questions the way studies conceptualize and construct the topic under study and uses this as the basis for developing synthesizing arguments [ 26 ]. We ensured rigor by complying with the Enhancing Transparency in Reporting the Synthesis of Qualitative Research (ENTREQ) criteria (Additional file  1 ) and other criteria of trustworthiness [ 28 , 29 ]. We did not register a protocol for this review.

With a medical librarian, we developed a search strategy (Additional file  2 ) that complied with the evidence-based checklist for peer review of electronic search strategies [ 30 ]. We included Medical Subject Headings and keywords that captured the concepts of MMs (e.g., nurse administrator, manager), explicit or non-explicit KB roles (e.g., diffusion of innovation, dissemination, broker, and facilitator), evidence-based practice (e.g., knowledge, evidence) and setting (e.g., hospital, healthcare, or health care). We searched MEDLINE, CINAHL, Social Sciences Abstracts, ABI/INFORM, EMBASE, PubMed, PsycINFO, ERIC, and the Cochrane Library from January 1, 2001, to August 14, 2020. We searched from 2001 onward because the field of KT did not substantially investigate KBs until 2001 [ 7 , 21 ]. We reviewed the reference lists of eligible articles for additional relevant studies not identified by searches. As is typical of CIS, this was an iterative process allowing search terms to be expanded to optimize search results [ 26 , 31 ].

Eligibility

We generated eligibility criteria based on the PICO framework (population, intervention, comparisons, and outcomes) (Additional file  3 ). Populations refer to MMs functioning as KBs in hospitals or other healthcare settings but did not necessarily use those labels. Because the MM literature is emergent, we included settings other than hospitals (e.g., public health department, Veteran Affairs Medical Centres). We included studies involving clinical and non-clinical administrators, managers, directors, or operational leaders if those studies met all other inclusion criteria. The intervention of interest was how MM KBs operated in practice for the creation, use and sharing of knowledge, implementation of evidence-based practice(s), or innovation implementation. Study comparisons may have evaluated one or more MM KB roles, approaches and associated barriers, enablers and impacts alone or in comparison with other types of approaches for the sharing or implementation of knowledge, evidence, evidence-based practices, or innovations. Outcomes included but were not limited to MM KB effectiveness (change in knowledge, skills, policies and/or practices, care delivery, satisfaction in role), behaviors, and outcomes. Searches were limited to English language quantitative, randomized, or pragmatic controlled trials, case studies, surveys, quasi-experimental, qualitative, or mixed methods studies and conceptual papers. Systematic reviews were not eligible, but we screened references for additional eligible primary studies. Publications in the form of editorials, abstracts, protocols, unpublished theses, conference proceedings were not eligible.

FB and ARG independently screened 50 titles and abstracts according to the eligibility criteria and compared and discussed results. Based on discrepancies, they modified the eligibility criteria and discussed how to apply them. Thereafter, FB screened all remaining titles, and discussed all uncertainties with ARG and the research team. FB retrieved all potentially eligible articles. FB and ARG independently screened a sample of 25 full-text articles, and again discussed selection discrepancies to further standardize how eligibility criteria were applied. Thereafter, FB screened all remaining full-text items.

Quality appraisal

We employed quality appraisal tools relevant to different research designs: Standards for Reporting Qualitative Research (SRQR) [ 32 ], the Good Reporting of a Mixed Methods Study (GRAMMS) tool [ 33 ], Critical Appraisal of a Questionnaire Study [ 34 ], Revised Standards for Quality Improvement Reporting Excellence (SQUIRE 2.0) tool [ 35 ], and the Critical Appraisal Checklist for Quasi-Experimental Studies [ 36 ]. FB and ARG independently assessed and compared the quality of a sample of seven studies each. Thereafter, FB assessed the quality of the remaining 24 studies.

Data extraction

We developed a data extraction form to extract information on study characteristics (date of publication, country, purpose, research design) and MM KB characteristics, roles, activities, enablers, barriers, and impacts. To pilot test data extraction, FB and ARG independently extracted data from the same 25 articles, then compared results and discussed how to refine data extraction. Thereafter, FB extracted data from remaining articles, which was independently checked by ARG, and then reviewed by the research team.

Data analysis

FB and ARG conducted an initial reading and coding of a sample of articles independently. Codes were assigned to significant elements of data within the results and conclusions sections of the eligible articles and grouped into relevant categories with shared characteristics and organized into preliminary themes. This was an iterative process that involved ongoing consultation with the research team, who provided feedback on the codes and themes.

We created a matrix of MM KB roles and activities from extant MM and KB theory [ 7 , 18 , 22 , 37 ] and deductively mapped themes from included studies with the matrix to help inform the analysis and interpretation of our findings. As per CIS methodology, we developed an integrative grid (matrix table) where themes pertaining to MM KB roles and activities formed columns, and themes mapped to those roles/activities from individual studies formed rows [ 31 ]. The grid helped us integrate the evidence across studies and explore relationships between concepts and themes to inductively develop synthetic constructs [ 31 , 38 ]. Using a constant comparative approach, we critiqued the synthetic constructs with the full sample of papers to identify conceptual gaps in the available evidence in relation to our aims, and to ensure that the constructs were grounded in the data [ 31 , 38 ]. Our interpretive reflections on MM KB roles, activities, factors, and impacts led us to develop “synthetic arguments” and we used the arguments to structure our findings (attributes, roles, activities, impacts, enablers, barriers) in an organizing framework to capture our interpretation of how MMs function as KBs in healthcare organizations. We used NVivo 12 software to assist with data analysis.

Search results

The initial search yielded 9936 articles. Following removal of duplicates, 9760 titles were not eligible, and 176 items were retrieved as potentially relevant. Of those, 135 were excluded because the study design was ineligible (25), they did not examine MMs (27) or MM KBs (34), were not focused on the evaluation of an MM KB role (39), were editorials (4), or the publication was a duplicate (6). We included 41 articles for review (Fig.  1 PRISMA flow diagram). Additional file  4 includes all data extracted from included studies.

PRISMA flow diagram

Study characteristics

Eligible articles were published between 2003 and 2019. Three (7.3%) were conceptual and 38 (92.7%) were empirical studies. Conceptual articles discussed MM and KB theoretical constructs. Table  1 summarizes study characteristics. Studies examined the impacts of change efforts (47.3%), barriers to practice change (34.2%), and evaluation of KB interventions (18.4%). Most were qualitative (52.6%) and conducted in the United States (36.8%). Of study participants (34.2%) were MMs. In most studies, participants were nurses (63.1%) or allied health (13.2%) and based in hospitals (68.4%). Otherwise, (31.6%) were based in public health or occupational health departments, primary health care centers, Veterans Affairs Medical Centres, community care, and a senior’s care facility.

Quality assessment findings

A critical analysis of the included studies revealed issues related to research design, varying from data collected from heterogeneous healthcare settings and diverse types of MMs to the type of analyses completed (e.g., qualitative, mixed methods), to the strength of conclusions drawn from a few studies’ results (e.g., correlational, or causal). Fifteen (39.5%) studies met the criteria for quality. Twenty-three (60.5%) studies had minor methodological limitations (e.g., no research paradigm identified in qualitative studies, and mixed methods studies did not describe the integration of the two methods) (Additional file  5 ). These methodological flaws did not warrant exclusion of any studies as they provided relevant insights regarding the emerging framework.

MM KB attributes

Seven (18.4%) studies described MM KB attributes (Table  2 ). Of those, 4 (10.5%) identified MM attributes, 2 (5.2%) identified KB attributes, and 1 (2.6%) identified nurse knowledge broker attributes. MM KBs were described as confident, enthusiastic, and experienced with strong research skills [ 41 , 45 ]. They were also responsive and approachable, with an understanding of the complexity of an innovation and the organizational context [ 42 , 43 , 44 ].

MM KB roles and activities

Table  3 summarizes themes pertaining to roles and activities. A total of 63 activities were grouped in the following 12 MM KB roles: (1) gather data, (2) coordinate projects, (3) monitor and evaluate the progress of a project, (4) adjust implementation to organizational context, (5) disseminate information, (6) facilitate networks, (7) bridge the evidence-to-practice gap, (8) engage stakeholders, (9) convince others of the need for, and benefit of a project, (10) coach staff, (11) provide tools and resources and (12) function as a strategic influencer. Roles did not differ among MM KBs in hospital and non-hospital settings.

Table  4 summarizes the frequency of each of the 12 MM KB roles across included studies. The two most common MM KB roles were to monitor and evaluate the progress of a project (14, 36.8%) [ 40 , 41 , 47 , 48 , 49 , 50 , 51 , 54 , 57 , 60 , 63 , 64 , 65 , 66 ] and to convince others of the need for, and benefit of a project (12, 31.6%) [ 46 , 47 , 48 , 50 , 51 , 55 , 58 , 61 , 64 , 65 , 66 , 67 ]. For example, MM KBs played an important role in monitoring the progress of projects to evaluate and reinforce practice change [ 41 , 50 ]. To convince others of the need for, and benefit of a project and to promote staff buy-in, they held ongoing conversations with staff to help them understand the rationale for change, reinforce the message, and encourage staff to consistently maintain the innovations on their units [ 46 , 48 , 66 ]. The least common MM KB role was project coordination (4, 10.5%) [ 39 , 47 , 48 , 56 ].

Several of the identified MM KB roles aligned with five KB roles in prior published frameworks [ 7 , 22 ] and MM role theory [ 18 , 37 ] (Table  5 ). For example, 31 (81.6%) studies described MM KB roles of gather data, project coordination, disseminate information , and adjust implementation to organizational context , which aligned with the roles and activities of a KB knowledge manager. Twenty-nine (76.3%) studies described the MM KB roles of provide tools and resources, convince others of the need for and benefit of a project, and coach staff , which aligned with the roles and activities of a KB capacity builder. We found overlap between the MM KB roles and the four hypothesized roles in MM role theory: (1) disseminate and obtain information, (2) adapt information and the innovations, (3) mediate between strategy and day to day activities, and (4) selling innovation implementation) [ 18 , 37 ]. For example, we found that as capacity builders, MM KBs also mediated between strategy and day-to-day activities such as coaching staff and providing resources, and in the role of knowledge manager, MM KBs obtained, diffused, and synthesized information [ 18 , 37 ].

While MM KB roles identified in included studies aligned with the five previously identified KB roles, the CIS approach we employed identified 12 distinct roles that were further characterized based on corresponding activities associated with each of the 12 roles. Therefore, while this research agrees with prior work on MM KB roles, it represents a robust framework of MM KB roles and activities by elaborating the complexity of MM KB roles and activities.

We fully described two roles compared with prior frameworks: to convince others of the need for and benefit of a project, and function as a strategic influencer. To convince others of the need for and benefit of a project (e.g., a quality improvement, best practice guideline implementation, or innovation), MM KBs used tactics such as role modelling their commitment, providing the rationale for the change, being enthusiastic about its adoption, offering positive reinforcement, and providing emotional support [ 47 , 50 , 58 ]. The role of strategic influencer featured in 7 (18.4%) studies [ 39 , 48 , 52 , 56 , 62 , 65 , 68 ]. For example, MM KBs were influential at the executive level of the hospital, advocating for innovations among less involved team members and administrators, including the hospital board, were members of organizational decision-making groups for strategic planning, and served as an authoritative contact for initiatives.

Factors that influence MMs knowledge brokering

Table  6 summarizes the enablers and barriers of MM KB roles and activities, organized as individual or organizational factors. We identified four enablers at the organizational level: senior management support, availability of resources, engaged staff, and alignment to strategy. The most common was senior management support, featured in 12 (32.0%) studies. We found that senior management support enhanced the commitment of MM KBs to innovation implementation [ 16 , 17 , 19 , 44 , 45 , 52 , 61 , 63 , 66 , 67 , 68 , 69 , 70 ]. For example, senior managers empowered and supported MM KBs to make decisions by ensuring that the necessary structures and resources were in place, and by conveying that the implementation was an organizational priority [ 66 , 68 ]. We identified three individual-level facilitators: training and mentorship, personal attributes, and experience in the MM role. The most common facilitator was training and mentorship, featured in 8 (21.1%) studies. We found that training and mentorship with more experienced managers was important to the success of MM KBs and their projects, especially if they were new to their role [ 16 , 17 , 19 , 41 , 42 , 48 , 54 , 68 ].

Studies reported more barriers ( n  = 8) than enablers ( n  = 7). We found four organizational barriers: a lack of resources, lack of senior management support, staff resistance, and a lack of time. The most common barriers were lack of resources in 12 (32.0%) studies and lack of time in 12 (32.0%) studies. A lack of resources (budget constraints, limited staff) made it challenging for MM KBs to move their projects forward [ 39 , 42 , 44 , 47 , 52 , 55 , 57 , 64 , 68 , 69 , 70 , 71 ]. For example, inadequate funds interfered with obtaining appropriate resources and undermined the feasibility of implementing projects [ 47 , 55 ]. In addition, staffing issues created difficulty in engaging staff in project work and low staffing levels limited capacity to provide desired standards of care [ 42 , 64 ]. Additionally, a lack of protected time for data collection or other project work was identified as a significant barrier to implementing projects [ 17 , 19 , 39 , 42 , 44 , 47 , 52 , 55 , 57 , 64 , 68 , 71 ]. MM KBs also lacked the time to nurture, support and adequately coach staff [ 39 , 55 ].

We identified four individual-level barriers: lack of formal training, dissatisfaction with work life balance, being caught in the middle, and professional boundaries. The most common barriers were lack of formal training (8, 21.1%) and dissatisfaction with work life balance (8, 21.1%). For example, a lack of formal training resulted in MM KBs being unprepared for managerial roles and without the knowledge and skills to promote effective knowledge brokering and knowledge transfer with end users [ 17 , 39 , 41 , 42 , 55 , 57 , 69 , 71 ]. We also found that heavy workloads and conflicting priorities left MM KBs often dissatisfied with their work life balance and hindered their ability to successfully complete projects [ 42 , 44 , 51 , 52 , 57 , 61 , 64 , 71 ]. For example, because of multiple responsibilities and conflicting priorities, MM KBs were often pulled away to address problems or were so absorbed by administrative tasks that they had no time to complete project responsibilities [ 44 , 64 ].

Impact on service delivery and outcomes

Eight (21.1%) studies showed that MM KBs had some impact on organizational and provider outcomes [ 16 , 40 , 43 , 44 , 47 , 56 , 62 , 67 ]. One (2.6%) study reported that practice changes were greater when associated with higher MM leadership scores (OR 1.92 to 6.78) and when MMs worked to help create and sustain practice changes [ 40 ]. One (2.6%) study reported the impact of senior managers’ implementation of an evidence-based Hospital Elder Life Program on administrative outcomes (e.g., reduced length of stay and cost per patient), clinical outcomes (e.g., decreased episodes of delirium and reduced falls), and provider outcomes (e.g., increased knowledge and satisfaction) [ 67 ].

Two (5.3%) studies reported the impact of a Clinical Nurse Leader role on care processes at the service level in American hospitals. Benefits were evident in administrative outcomes such as RN hours per patient day (increased from 3.76 to 4.07) and in reduced surgical cancellation rates from 30 to 14%. There were also significantly improved patient outcomes in dementia care, pressure ulcer prevention, as well as ventilator-assisted pneumonia [ 56 , 62 ]. One (2.6%) study reported financial savings [ 56 ].

Four (10.5%) studies reported the effect of a KB strategy on health professionals’ knowledge, skills, and practices [ 16 , 43 , 44 , 47 ]. For example, Traynor et al. [ 44 ] found that participants who worked closely with a KB showed a statistically significant increase in knowledge and skill (average increase of 2.8 points out of a possible 36 (95% CI 2.0 to 3.6, p  < 0.001) from baseline.

Organizing framework of MM KBs in healthcare organizations

We sought to capture the roles, activities, enablers, barriers and impacts of MM KBs across diverse healthcare settings in an organizing framework (Fig.  2 Organizing framework of MMs who function as knowledge brokers in healthcare organizations). From our interpretation of the published evidence, the findings across studies were categorized into 12 roles and 63 associated activities to represent specific ways in which MM KBs described their roles and activities during project implementation. Influencing factors were categorized into individual and organizational enablers and barriers that influence the efforts of MM KBs in healthcare organizations. While attributes were categorized as enablers, their level of importance as enablers emerged from our synthesis in how they operated in practice. The types of outcomes that we examined also varied between changes in care practice, processes, and competencies which we constructed into provider and organizational outcomes. Our emergent insights were used to construct four synthesizing arguments from the available literature: (1) MM KBs have attributes that equip and motivate them to implement practice change and innovations in healthcare organizations, (2) MMs enact KB roles and activities in healthcare organizations, (3) enablers and barriers influence the knowledge brokering efforts of MMs in healthcare settings; and (4) MM KB efforts impact healthcare service delivery. These synthesizing arguments were used to structure the organizing framework presented in Fig. 2 , which depicts how MM function as KBs in healthcare organizations and their impact on service delivery.

Organizing framework of MMs who function as knowledge brokers in healthcare organizations

We conducted a CIS to synthesize published research on factors that influence the roles, activities, and impacts of MM KBs in healthcare organizations. As per CIS, our output was an organizing framework (Fig. 2 ) that promotes expansive thinking about and extends knowledge of MM KBs in healthcare settings. We identified 63 activities organized within 12 distinct MM KB roles, which is far more comprehensive than any other study [ 7 , 22 ]. We build on prior frameworks and characterize further the roles of strategic influencer and convincing others of the need for, and benefit of an innovation or evidence-based practice. We identified organizational and individual enablers and barriers that may influence the efforts and impact of MM KBs in health care. Of note, a key enabler was senior leadership support while a key barrier for MM KBs was a lack of formal training in project implementation. Such factors should be closely considered when looking at how to strengthen the MM KB role in practice. Furthermore, we found that the MM KB role was associated with enhanced provider knowledge and skills, as well as improved clinical and organizational outcomes.

We offer a novel conceptualization of MM KBs in healthcare organizations that has, thus far, not been considered in the literature. Our theoretical insights (summarized in Fig. 2 ) are an important first step in understanding how individual and organizational factors may influence how MMs enact KB roles, and the impact they have on service delivery and associated outcomes. We found that the many MM KB roles and activities corresponded to the characterization of KB roles in the literature and substantiated MM role theory. Our findings corroborate previous studies and systematic reviews by confirming that MMs function as KBs and build on the MM and KB theoretical constructs previously identified in the literature [ 7 , 18 , 21 , 22 , 37 , 46 , 48 ]. Building on Birken and colleagues’ theory [ 37 ], we found significant overlap between MM and KB roles and activities. Figure  2 helps to define and analyze the intersection of these roles while distinguishing MM KB roles and activities more clearly from other administrative roles.

We contend that Fig. 2 has applicability across a range of healthcare settings and may be used by hospital administrators, policymakers, service providers, and researchers to plan projects and programs. It may be used as a resource in strategic planning, to re-structure clinical programs, build staff capacity, and optimize HR practices. For example, Fig. 2 could be used as a foundation to establish goals, objectives, or key performance indicators for a new or existing clinical program; refine job postings for MM roles to encompass optimal characteristics of candidates to enable KB activities; or identify new evaluation criteria for staff performance and training gaps in existing HR practices. It could also help decision makers take on pilot projects to formalize the KB role in healthcare.

Figure 2 is intended to foster further discussion of the role that MMs play in brokering knowledge in healthcare settings. It can be modified for specific applications, although we encourage retaining the basic structure (reflecting the synthesizing arguments). For example, the factors may change depending on specific localized healthcare contexts (i.e., acute care versus long-term care, or rehabilitation). Although the use of our framework in practice has yet to be evaluated, it may be strengthened with the results of additional mixed methods studies examining MM KBs as well as quasi-experimental studies applying adapted HR practices based upon our framework. As more studies are reported in the literature, the roles, activities, factors, and outcomes can be further refined, organized, and contextualized. Figure 2 can also be used as a guide for future studies examining how MMs enact the KB role across healthcare settings and systems, disciplines, and geographic locations.

Our synthesis provides new insights into the roles of MM KBs in healthcare settings. For example, we further elucidate two MM KB roles: 1) functioning as a strategic influencer; and 2) convincing others of the need for, and benefit of an innovation or evidence-based practice. These are important roles that MM KBs enact when preparing staff for implementation and corroborate Birken et al.’s hypothesized MM role of selling innovation implementation [ 18 , 37 ]. Our findings validate the organizational change literature that emphasizes the important information broker role MMs play in communicating with senior management and helping frontline staff achieve desired changes by bridging information gaps that might otherwise impede innovation implementation [ 37 ]. Our new conceptualization of how MM KBs navigate and enact their roles, and the impact they may have on service delivery and associated outcomes extends the findings of recent studies. These studies found that the role of MMs in organizational change is evolving and elements such as characteristics and context may influence their ability to facilitate organizational adaptation and lead the translation of new ideas [ 53 , 72 , 73 ]. However, further research is required to test and further explicate these relationships in the broader context of practice change.

Our synthesis both confirms and extends previous research by revealing organizational and individual factors that both enabled and hindered MM KBs efforts in healthcare organizations. An important organizational factor in our study was having senior management support. We found that MM KBs who had healthy supportive working relationships with their senior leaders led to project success. This support was critical because without it they experienced significant stress at being “caught in the middle” trying to address the needs of staff while also meeting the demands of senior management. Recent studies confirm our finding that senior management engagement is essential to MM KBs’ ability to implement innovations and underscores the need for senior leaders to be aware of, and acknowledge, the impact that excessive workload, competing demands, and role stress can play in their effectiveness [ 19 , 74 ].

The personal attributes of MM KBs as well as their level of experience were both important factors in how they operated in practice. We identified that key attributes of MM KBs contributed to their ability to drive implementation of initiatives and enhanced staff acceptance and motivation to implement practice change [ 75 , 76 ]. Our findings corroborate recent studies that highlight how the key attributes of effective champions (those that are intrinsic and cannot be taught) [ 77 , 78 , 79 ] may contribute to their ability to lead teams to successful implementation outcomes in healthcare organizations [ 80 , 81 , 82 ]. We also found that experienced MM KBs were well trained, knowledgeable, and better prepared to understand the practice context than novice MM KBs, but a lack of formal training in project implementation was an impediment for both. This emphasizes the importance of providing opportunities for professional development and training to prepare both novice and experienced MM KBs to successfully implement practice change. Our findings contribute to the growing knowledge base regarding what makes an effective MM KB. However, future research should focus on generating evidence, not only on the attributes of MM KBs, but also on how those attributes contribute to their organizational KB roles as well as the relationships among specific “attributes” and specific KB roles. More research is also needed to better understand how and what skills can be taught to boost the professional growth of MM KBs in health care.

Organizational theory and research may provide further insight into our findings and guidance for future research on the role of MM KBs in healthcare organizations. For example, the literature suggests that by increasing MMs’ appreciation of evidence-based practice, context, and implementation strategies may enhance their role in implementing evidence-based practices in healthcare organizations [ 18 , 83 , 84 ]. We found that MM KBs’ commitment to the implementation of an evidence-based project was influenced by the availability of resources, alignment with organizational priorities, a supportive staff and senior leadership. Extending from organizational theory and research, further investigation is needed to explore the nature of the relationship between these factors and the commitment of MM KBs to evidence-based practice implementation and subsequent outcomes.

When assessing the impact of MM KBs in hospitals, we found some evidence of changes in organizational and provider outcomes, suggesting MM KB impact on service delivery. Given that the available outcome data were limited, associational in nature, or poorly evaluated, it was challenging to identify strong thematic areas. Like our study, several systematic reviews also reported the lack of available outcome data [ 7 , 18 , 21 ]. This highlights an important area for research. Future research must include evaluation of the effectiveness of MM KBs and establish rigorous evidence of their impact on service delivery.

Our findings have important implications for policy and practice. MMs are an untapped KB resource who understand the challenges of implementing evidence-based practices in healthcare organizations. Both policy makers and administrators need to consider the preparation and training of MM KBs. As with other studies, our study found that providing MM KBs with opportunities for training and development may yield a substantial return on investment in terms of narrowing evidence-to-practice gaps in health care [ 48 ]. Thus, an argument can be made for recruiting and training MM KBs in health care. However, the lack of guidance on how to identify, determine and develop a curriculum to prepare MM KBs requires more research.

Our synthesis revealed numerous activities associated with 12 MM KB roles providing further insight into the MM role in healthcare settings. Our list of 63 activities (Table 2 ) has implications for practice. We found that MMs enact numerous KB roles and activities, in addition to their day-to day operational responsibilities, highlighting the complexity of the MM KB role. Senior leaders and administrators must acknowledge this complexity. A greater understanding of these KB roles and activities may lead to MM implementation effectiveness, to sustainable MM staffing models, and to organizational structures to support the KB efforts that many MMs are already doing informally. For example, senior leaders and administrators need to take the MM KB role seriously and explicitly include KB activities as a core function of existing MM job descriptions. To date, the KB role and associated activities are not typically or explicitly written into the formal job descriptions for MMs in healthcare settings, as their focus is primarily on operational responsibilities. A formal job description for MM KBs would improve the KB capacity of MMs by giving them the permission and recognition to implement KB-related functions. Our findings inform future research by more clearly articulating the MM KB roles and activities that may be essential to the implementation of evidence-based practice and highlights a much-needed area for future work.

Our study features both strengths and weaknesses. One strength in using CIS methodology was the ability to cast a wide net representing a range of research designs of included studies. This included studies in which MMs were required to be KBs by senior leaders or functioned explicitly as KBs. This enabled us to identify and include diverse studies that made valuable theoretical contributions to the development of an emerging framework, which goes beyond the extant theories summarized in the literature to date [ 18 ]. In contrast to prior systematic reviews of MM roles in implementing innovations [ 18 ], the CIS approach is both systematic and iterative with an interpretive approach to analysis and synthesis that allowed us to capture and critically analyze an in-depth depiction of how MMs may enact the KB role in healthcare organizations. Our synthesis also revealed numerous activities associated with the 12 identified MM KB roles. The resulting theoretical insights were merged into a new organizing framework (Fig. 2 ). These insights are an important first step in understanding how individual and organizational factors may influence how MMs enact KB roles, and the impact they have on service delivery.

Although CIS is an innovative method of synthesizing the literature and continues to evolve, it does have limitations. CIS has yet to be rigorously evaluated [ 85 , 86 ]. While there is some precedent guiding the steps to conduct a CIS, one weakness is that CIS is difficult to operationalize. Another weakness is that the steps to conduct CIS reviews are still being refined and can lack transparency. Therefore, we used standardized, evidence-based checklists and reporting tools to assess transparency and methodological quality, and an established methodology for coding and synthesis. We provided an audit trail of the interpretive process in line with the ENTREQ guidance. Still, there was a risk of methodological bias [ 28 , 85 , 86 ]. Another weakness of qualitative synthesis is its inability to access first order constructs that is the full set of participants’ accounts in each study. As reviewers, we can only work with the data provided in the papers and, therefore, the findings of any review cannot assess primary datasets [ 31 ]. Study retrieval was limited to journals that are indexed in the databases that were searched. We did not search the grey literature, assuming that most empirical research on MM KBs would be found in the indexed databases. Finally, we may have synthesized too small a sample of papers to draw definitive conclusions regarding different aspects of MMs as KBs.

Our study is a first step in advancing the theoretical and conceptual conversation regarding MM KBs by articulating the attributes, roles, activities, and factors influencing their efforts and impact. Through the generation of a novel organizing framework, we identify a potential combination of roles for those in MM positions who may also function as KBs in healthcare organizations. Our study is a timely contribution to the literature and offers an initial understanding of extant evidence of the KB role MMs play in health care. Our framework has utility for policymakers, administrators, and researchers to strengthen the MM role and, ultimately, improve quality of care.

Availability of data and materials

All data generated or analyzed during this study are included in this published article and its supplementary information files.

Abbreviations

Middle Manager

Knowledge Broker

Middle managers who function as Knowledge brokers

Knowledge Translation

Critical Interpretive Synthesis

Quality Improvement

Enhancing Transparency in Reporting the Synthesis of Qualitative Research

Berenson RA, Rice Y. Beyond measurement and reward: methods of motivating quality improvement and accountability. Health Serv Res. 2015;2(2):155–65.

Google Scholar  

Nunes R, Rego G, Brandao C. Healthcare regulation as a tool for public accountability. Medical Healthcare & Philosphy. 2009;12:257–64.

Article   Google Scholar  

Grimshaw JM, Eccles M, Lavis JN, Hill SJ, Squires JE. Knowledge translation of research findings. Implement Sci. 2012;7(50):1–17 Available from: http://www.implementationscience.com/content/7/1/50 .

McGlynn EA, Asch SM, Adams J, Keesey J, Hicks J, DeCristofaro A. The quality of health care delivered to adults in the United States. N England Journal of Medicine. 2003;348:2635–45. https://doi.org/10.1056/NEJMsa022615 .

Squires JE, Graham ID, Grinspun D, Lavis J, Legare F, Bell R, et al. Inappropriateness of health care in Canada: a systematic review protocol. Systematic Review. 2019;8(50). https://doi.org/10.1186/s13643-019-0948-1 .

Innis J, Berta W. Routines for change: How managers can use absorptive capacity to adopt and implement evidence-based practice. Journal of Nursing Management. 2016;24(6). doi: https://doi.org/10.1111/jonm.12368 .

Bornbaum C, Kornas K, Pierson L, Rosella LC. Exploring the function and effectiveness of knowledge brokers as facilitators of knowledge translation in health-realted settings: a systematic review and thematic analysis. Implement Sci. 2015;10. https://doi.org/10.1186/s13012-015-0351-9 .

Currie G, Burgess N, White L, Lockett A, Gladman J, Waring J. A qualitative study of the knowledge-brokering role of middle-level managers in service innovation: managing the translation gap in patient safety for older persons’ care. Health Services and Delivery Research. 2014;2(32). https://doi.org/10.3310/hsdr02320 .

Canadian Health Services Research Foundation. The theory and practice of knowledge brokering in Canada’s health system. 2003. Ottawa, Ontario: www.chsrf.ca .

Flodgren G, Parmelli E, Doumit G, Gattellari M, O’Brien MA, Grimshaw J, et al. Local opinion leaders: effects on professional practice and health care outcomes. Cochrane Database Systematic Review. 2011;8. https://doi.org/10.1002/14651858.CD00125 .

Soo S, Berta W, Baker G. Role of champions in the implementation of patient safety practice change. Healthcare Quarterly. 2009;12:123–8.

Thompson GN, Estabrooks CA, Degner LF. Clarifying the concepts in knowledge transfer: a literature review. J Adv Nurs. 2006;53(6):691.

Glegg S. Knowledge brokering as an intervention in paediatric rehabilitation practice. Int J Ther Rehabil. 2010;17(4):203–9.

Rivard LM, Russell DJ, Roxborough L, Ketelaar M, Bartlett DJ, Rosenbaum P. Promoting the use of measurement tools in practice: a mixed methods study of the activities and experiences of physical therapist knowledge brokers. Phys Ther. 2010;90(11):1580–90.

Russell D, Rivard LM, Walter SD, Rosebaum PL, Roxborough L, Cameron D, et al. Using knowledge brokers to facilitate the uptake of pediatric measurement tools into clinical practice: a before-after intervention study. Implementation Science. 2010;5(92).

Dobbins M, Traynor RL, Workentine S, Yousefi-Nooraie R, Yost J. Impact of an organization-wide knowledge translation strategy to support evidence- informed public health decision making. BMC Public Health. 2018;18:1412.

Dobbins M, Greco L, Yost J, Traynor R, Decorby-Watson K, et al. A description of a tailored knowledge translation intervention delivered by knowledge brokers within public health departments in Canada. Health Research Policy and Systems. 2019;17(63):1–8. https://doi.org/10.1186/s12961-019-0460-z .

Birkin S, Clary A, Tabriz AA, Turner K, Meza R, Zizzi A, et al. Middle managers’ role in implementing evidence-based practices in healthcare: a systematic review. Implementation Science. 2018;13(149): 1-14. Available from: https://doi.org/10.1186/s13012-018-0843-5 .

Urquhart R, Kendell C, Folkes A, Reiman T, Grunfeld E, Porter GA. Factors influencing middle mangers’ commitment to the implementation of innovation in cancer care. J Health Services Res Pol. 2019;24(2):91–9. https://doi.org/10.1177/1355819618804842 .

Burgess N, Currie G. The knowledge brokering role of the hybrid middle level manager: the case of healthcare. Br J Manag. 2013;24:S132–42.

Van Eerd D, Newman K, DeForge R, Urquhart R, Cornelissen E, Dainty KN. Knowledge brokering for healthy aging: a scoping review of potential approaches. Implement Sci. 2016;11:140. https://doi.org/10.1186/s13012-016-0504-5 .

Article   PubMed   PubMed Central   Google Scholar  

Glegg SM, Hoens A. Role domains of knowledge brokering: a model for the health care setting. JNPT. 2016;40:115–23. https://doi.org/10.1097/NPT.000000000000012 .

Article   PubMed   Google Scholar  

Schleifer Taylor J, Verrier MC, Landry MD. What do we know about knowledge brokers in pediatric rehabilitation? A systematic search and narrative summary. Physiother Can. 2014;66(2):143–52.

Ward V, House A, Hamer S. Knowledge brokering: exploring the process of transferring knowledge into action. BMC Health Serv Res. 2009;9(12):1–6.

Cranley LA, Cummings GG, Profetto-McGrath J, Toth F, Estabrooks CA. Facilitation roles and characteristics associated with research use by healthcare professionals: a scoping review. BMJ Open. 2016;7. https://doi.org/10.1136/bmjopen-2016-014384 .

Dixon-Woods M, Cavers D, Agarwal S, Annandale E, Arthur A, Harvey J, et al. Conducting a critical interpretive synthesis of the literature on access to healthcare by vulnerable groups. BMC Med Res Methodol. 2006;6:35. https://doi.org/10.1186/1471-2288-6-35 .

Kangasniemi M, Kallio H, Pietila AM. Towards environmentally responsible nursing: a critical interpretive synthesis. J Adv Nurs. 2013;70(7):1465–78.

Tong A, Flemming K, McInnes E, Oliver S, Craig J. Enhancing transparency in reporting the synthesis of qualitative research: ENTREQ. BMC Medical Research Methodology. 2012;12(181) Available from: http://www.biomedcentral.com/1471-2288/12/181 .

Shenton K. Strategies for ensuring trustworthiness in qualitative research projects. Educ Inf. 2004;22:63–75.

McGowan J, Sampson M, Lefebvre C. An evidence based checklist for the peer review of electronic search strategies (PRESS EBC). Evid Based Libr Inf Pract. 2010;5(1):149–54.

Flemming K. Synthesis of quantitiative and qualitative research: an example of critical interpretive synthesis. J Adv Nurs. 2010;66(1):201–17.

Standards for Reporting Qualitative Research. (2017, April 15). Available from: http://www.equator-network.org .

O'Cathain A, Murphy E, Nicholl J. The quality of mixed methods studies in health services research. J Health Serv Res Policy. 2008;13(2):92–8.

Roever L. Critical appraisal of a questionnaire study. Evidence Based Medicine and Practice. 2016;1(2). Available from: https://doi.org/10.4172/ebmp.1000e110 .

Ogrinc G, Davies L, Goodman D, Batalden P, Davidoff F, Stevens D. SQUIRE 2.0 (Standards for Quality Improvement Reporting Excellence): revided publication guidelines from a detailed consensus process. The Journal of Continuing Education in Nursing. 2015; 46(11):501–507. Available from: https://doi.org/10.3928/00220124-20151020-02 .

Tufanaru C, Munn Z, Aromataris E, Campbell J, Hoop L. Systematic reviews of effectiveness. In: Aromataris E, Munn Z, editors. Joanna Briggs Institute Reviewers Manual. The Joanna Briggs Institute. 2017. Available from: https://reviewersmanual.joannabriggs.org .

Birkin SA, DiMartino LD, Kirk MA, Lee S, McCelland M, Albert NA. Elaborating on theory with middle managers’ experience implementing healthcare innovations in practice. Implement Sci. 2016;11:2. https://doi.org/10.1186/s13012-015-0362-6 .

Johnson M, Tod A, Collins K, Brummell S. Prognostic communication in cancer: a critical interpretive synthesis of the literature. Eur J Oncol Nurs. 2015;19(5):554–67.

Bullock A, Morris ZS, Atwell C. Collaboration between health services managers and researchers: making a difference. Original Research. 2012;17(2):2–10. https://doi.org/10.1258/jhsrp.2011.011099 .

Donahue KE, Halladay JR, Wise A, Reiter K, Lee SD, Ward K, et al. Facilitator of transforming primary care: a look under the Hood at practice leadership. Ann Fam Med. 2013;11:527–33. https://doi.org/10.1370/afm.1492 .

Kakyo TA, Xiao LD. Nurse managers’ experiences in continuous quality improvement in resource-poor healthcare settings. Nurs Health Sci. 2017;19:244–9. https://doi.org/10.1111/nhs.12338 .

Kitson A, Silverton H, Wiechula R, Zeitz K, Marcoionni D, Page T. Clinical nursing’, team members’ and service managers’ experiences of implementing evidence at a local level. J Nurs Manag. 2011;19:542–55. https://doi.org/10.1111/j.1365-2834.2011.01258 .

Schreiber J, Marchetti GF, Racicot B, Kaminski E. The use of knowledge translation program to increase use of standardized outcome measures in outpatient pediatric physical therapy clinic: administrative case report. American Physical Therapy Association. 2015;95(4):613–29. https://doi.org/10.2522/ptj.20130434 .

Traynor R, DeCorby K, Dobbins M. Knowledge brokering in public health: a tale of two studies. The Royal Society for Public Health. 2014;128:533–544. https://doi.org/10.1016/j.puhe.2014.01.015 .

Catallo C. Should nurses be knowledge brokers? Competencies and organizational resources to support the role. Nurs Leadersh. 2015;28(1):24–37.

Engle RL, Lopez ER, Gormley KE, Chan JA, Charns MP, VanDeusen Lukas C. What roles do middle managers play in implementation of innovative practices? Health Care Manag Rev. 2017;42(1):14–27. https://doi.org/10.1097/HMR.0000000000000090 .

Hitch D, Rowan S, Nicola-Richmond K. A case study of knowledge brokerage in occupational therapy. MA Healthcare Ltd. 2014.

Urquhart R, Kendell C, Folkes A, Reiman T, Grunfeld E, Porter GA. Making it happen: middle managers’ roles in innovation implementation in health care. Worldviews Evid-Based Nurs. 2018;15(6):414–23. https://doi.org/10.1111/wvn.12324 .

Ploeg J, Skelly J, Rowan M, Edwards N, Davies B, Grinspun D. The role of nursing best practice champions in diffusing practice guidelines: a mixed methods study. Worldviews Evid-Based Nurs. 2010:238–51. https://doi.org/10.1111/j.1741-6787.2010.00202 .

Fleiszer AR, Semenic SE, Ritchie JA, Richer MC, Denis JL. Nursing unit leaders’ influence on the long-term sustainability of evidence-based practice improvements. J Nurs Manag. 2015;24:309–18. https://doi.org/10.1111/jonm.12320 .

Jeffs L, Indar A, Harvey B, McShane J, Bookey-Bassett S, Flintoft V, et al. Enabling role of manager in engaging clinicians and staff in quality improvement. J Nurs Care Qual. 2016;31(4):367–72. https://doi.org/10.1097/NCQ.0000000000000196 .

Warshawsky NE, Lake SW, Bradford A. Nurse managers describe their practice environment. Nurs Admin Q. 2013;34(4):317–25. https://doi.org/10.1097/NAQ.0b013e3182a2f9c3 .

Gutberg J, Berta W. Understanding middle managers’ influence in implementing patient safety culture. BMC Health Serv Res. 2017;17(582):1–10. https://doi.org/10.1186/s12913-017-2533-4 .

Kislov R, Hodgson D, Boarden R. Professionals as knowledge brokers: the limits of Authority in Healthcare Collaboration. Public Adm. 2016;94(2):472–89. https://doi.org/10.1111/padm.12227 .

Shaw L, McDermid J, Kothari A, Lindsay R, Brake P, Page P. Knowledge brokering with injured workers: perspective of injured worker groups and health care professionals. Work. 2010;36:89–101. https://doi.org/10.3233/WOR-20101010 .

Wilson L, Orff S, Gerry T, Shirley BR, Tabor D, Caiazzo K, et al. Evolution of an innovative role: the clinical nurse leader. J Nurs Manag. 2013;21:175–81. https://doi.org/10.1111/j.1365-2834.2012.01454 .

Currie G, Burgess NA, Hayton JC. HR practices and knowledge brokering by hybrid middle managers in hospital settings: the influence of professional hierarchy. Human Resources Management. 2015;54(5):793–812. https://doi.org/10.1002/hrm.21709 .

Waring J, Currie G, Crompton A, Bishop S. An exploratory study of knowledge sharing and learning for patient safety? Soc Sci Med. 2013;98:79–86. https://doi.org/10.1016/j.socscimed.2013.08.037 .

Girard A, Rochette A, Fillion B. Knowledge translation and improving practices in neurological rehabilitation: managers’ viewpoint. Journal of Evaluation in Clinical Practice. 2013;19:60–7 10.1111/j.1365–2753.

Williams L, Burton C, Rycroft-Malone J. What works: a realist evaluation case study of intermediaries in infection control practice. J Adv Nurs. 2012;69(4):915–26. https://doi.org/10.1111/j.1365-2648.2012.06084 .

Bradley EH, Holmboe ES, Mattera JA, Roumanis SA, Radford MJ, Krumholz HM. The roles of senior Management in Quality Improvement Efforts: what are the key components? J Healthc Manag. 2003;48(1):16–29.

Ott KM, Haddock KS, Fox SE, Shinn JK, Walters SE, Hardin JW. The clinical nurse leader: impact on practice outcomes in the veterans health administration. Nurs Econ. 2009;27(6):363–71.

PubMed   Google Scholar  

Schell WJ, Kuntz SW. Driving change from the middle: an exploration of the complementary roles and leadership Behaviours of clinical nurse leaders and engineers in healthcare process improvement. Eng Manag J. 2013;25(4):33–43.

Jeffs LP, Lo J, Beswick S, Campbell H. Implementing an organization-wide quality improvement initiative. Nursing Administrative Quarterly. 2013;37(3):222–30. https://doi.org/10.1097/NAQ.0b013e318295ec9f .

Lalleman PCB, Smid GAC, Lagerwey MD, Oldenhof L, Schuurmans MJ. Nurse middle managers’ dispositions of habitus: a Bourdieusian analysis of supporting role Behaviours in Dutch and American hospitals. Adv Nurs Sci. 2015;38(3):E1–E16. https://doi.org/10.1097/ANS.0000000000000083 .

Article   CAS   Google Scholar  

Birken SA, Lee S, Weiner BJ, Chin MH, Chiu M, Schaefer CT. From strategy to action: how top managers’ support increases middle managers’ commitment to innovation implementation in health care organization. Health Care Manag Rev. 2015;40(2):159–68. https://doi.org/10.1097/HMR.0000000000000018 .

Bradley EH, Webster TR, Schlesinger M, Baker D, Inouye SK. The roles of senior Management in Improving Hospital Experiences for frail older adults. J Healthc Manag. 2006;51(5):323–37.

Balding C. Embedding organisational quality improvement through middle manager ownership. International Journal of Health Care Quality Assurance. 2005;18(4):271–88. https://doi.org/10.1108/09526860510602541 .

Uvhagen H, Hasson H, Hansson J, von Knorring M. Leading top-down implementation processes: a qualitative study on the role of managers. BMC Health Serv Res. 2018;18:562.

Fryer A-K, Tucker AL, Singer SJ. The impact of middle manager affective commitment on perceived improvement program implementation success. Health Care Manag Rev. 2018;43(3):218–28.

Chang Chen H, Jones MK, Russell C. Exploring attitudes and barriers toward the use of evidence-based nursing among nurse managers in Taiwanese residential aged care facilities. J Gerontol Nurs. 2013;39(2):36–42.

Hansell V. Identifying the prevalence of influential factors on middle manager’s ability to lead organizational change within the context of community nursing and therapy services. Int J Healthcare Management. 2018;11(3):225–32.

Buick F, Blackman D, Johnson S. Enabling middle managers as change agents: why organizational support needs to change. Aust J Public Adm. 2017;77(2):222–35.

Breed M, Downing C, Ally H. Factors influencing motivation of nurse leaders in a private hospital group in Gauteng, South Africa: A quantitative study. Curationis. 2020;43(1): Available from: https://doi.org/10.4102/curationis.v43i1.2011 .

Kallas KD. Profile of an excellent nurse manager: identifying and developing health care team leaders. Nurse Admin Quarterly. 2014;38(3):261–8. https://doi.org/10.1097/NAQ.0000000000000032 .

Sellgren S, Ekvall G, Tomson G. Leadership styles in nursing management: preferred and perceived. J Nurs Manag. 2006;14:348–55.

Dobbins M, DeCorby K, Robeson P, Ciliska D, Hanna S, Cameron R, et al. A description of a knowledge broker role implemented as part of a randomized controlled trial evaluating three knowledge translation strategies. Implementation Science. 2009;4(23). Available from: http://www.implementationscience.com/content/4/1/23 .

Cook MJ. The attributes of effective clinical nurse leaders. Nurs Stand. 2001;15(35):33–6.

Gentry H, Prince-Paul M. The nurse influencer: a concept synthesis and analysis. Nurs Forum. 2020:1–7.

Demes JAE, Nickerson N, Farand L, Montekio VB, Torres P, Dube JG, et al. What are the characteristics of the champion that influence the implementation of quality improvement programs? Evaluation and Program Planning. 2020;80:101795.

Bonawitz K, Wetmore M, Heisler M, Dalton VK, Damschroder LJ, Forman J, et al. Champions in context: which attributes matter for change efforts in healthcare? Implementation Sci. 2020;15:62.

Bunce AE, Grub I, Davis JV, Cowburn S, Cohen D, Oakley J. Lessons learned about effective operationalization of champions as an implementation strategy: results from a qualitative process evaluation of a pragmatic trial. Implementation Sci. 2020;15:87.

Birkin SA, Currie G. Using organization theory to position middle-level managers as agents of evidence-based practice implementation. Implementation Sci. 2021;16:37.

Klein KI, Sorra JS. The challenge of innovation implementation. Acad Manag Rev. 1996;21(4):1055–80.

Tricco AC, Antony J, Soobiah C, Kastner M, MacDonald H, Cogo E, et al. Knowledge synthesis methods for integrating qualitative and quantitative data: a scoping review reveals poor operationalization of the methodological steps. J Clin Epidemiol. 2016a;73:29–35.

Tricco AC, Antony J, Soobiah C, Kastner M, MacDonald H, Cogo E, et al. Knowledge synthesis methods for generating or refining theory: a scoping review reveals that little guidance is available. J Clin Epidemiol. 2016b;73:36–42.

Download references

Acknowledgements

Not applicable.

Author information

Authors and affiliations.

Baycrest Health Sciences, 3560 Bathurst Street, Toronto, Ontario, M6A 2E1, Canada

Faith Boutcher

Institute of Health Policy, Management and Evaluation, University of Toronto, Health Sciences Building Suite 425, 155 College Street, Toronto, Ontario, M5T 3M6, Canada

Whitney Berta

Department of Community Health and Epidemiology, Dalhousie University, Room 413, 5790 University Avenue, Halifax, Nova Scotia, B3H 1V7, Canada

Robin Urquhart

University Health Network, 13EN-228, 200 Elizabeth Street, Toronto, Ontario, M5G 2C4, Canada

Anna R. Gagliardi

You can also search for this author in PubMed   Google Scholar

Contributions

FB, ARG, WB, and RU conceptualized and planned the study, and developed the search strategy and data collection instruments. FB and ARG screened and reviewed articles. FB, ARG, WB and RU analyzed the data. All authors read and gave approval of the final version of the manuscript.

Corresponding author

Correspondence to Faith Boutcher .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

The authors declare that they have no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1..

ENTREQ checklist

Additional file 2.

Search strategy

Additional file 3.

Eligibility criteria

Additional file 4.

Data extraction form for eligible studies

Additional file 5.

Quality appraisal tools and findings

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ . The Creative Commons Public Domain Dedication waiver ( http://creativecommons.org/publicdomain/zero/1.0/ ) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Cite this article.

Boutcher, F., Berta, W., Urquhart, R. et al. The roles, activities and impacts of middle managers who function as knowledge brokers to improve care delivery and outcomes in healthcare organizations: a critical interpretive synthesis. BMC Health Serv Res 22 , 11 (2022). https://doi.org/10.1186/s12913-021-07387-z

Download citation

Received : 02 September 2021

Accepted : 07 December 2021

Published : 02 January 2022

DOI : https://doi.org/10.1186/s12913-021-07387-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Middle managers
• Knowledge brokers
• Critical interpretive synthesis

BMC Health Services Research

ISSN: 1472-6963

• General enquiries: [email protected]