qualitative research method journal

Criteria for Good Qualitative Research: A Comprehensive Review

• Regular Article
• Open access
• Published: 18 September 2021
• Volume 31 , pages 679–689, ( 2022 )

Cite this article

You have full access to this open access article

• Drishti Yadav   ORCID: orcid.org/0000-0002-2974-0323 1  

72k Accesses

25 Citations

72 Altmetric

Explore all metrics

This review aims to synthesize a published set of evaluative criteria for good qualitative research. The aim is to shed light on existing standards for assessing the rigor of qualitative research encompassing a range of epistemological and ontological standpoints. Using a systematic search strategy, published journal articles that deliberate criteria for rigorous research were identified. Then, references of relevant articles were surveyed to find noteworthy, distinct, and well-defined pointers to good qualitative research. This review presents an investigative assessment of the pivotal features in qualitative research that can permit the readers to pass judgment on its quality and to condemn it as good research when objectively and adequately utilized. Overall, this review underlines the crux of qualitative research and accentuates the necessity to evaluate such research by the very tenets of its being. It also offers some prospects and recommendations to improve the quality of qualitative research. Based on the findings of this review, it is concluded that quality criteria are the aftereffect of socio-institutional procedures and existing paradigmatic conducts. Owing to the paradigmatic diversity of qualitative research, a single and specific set of quality criteria is neither feasible nor anticipated. Since qualitative research is not a cohesive discipline, researchers need to educate and familiarize themselves with applicable norms and decisive factors to evaluate qualitative research from within its theoretical and methodological framework of origin.

Similar content being viewed by others

What is Qualitative in Qualitative Research

Patrik Aspers & Ugo Corte

Environmental-, social-, and governance-related factors for business investment and sustainability: a scientometric review of global trends

Hadiqa Ahmad, Muhammad Yaqub & Seung Hwan Lee

Mixed methods research: what it is and what it could be

Rob Timans, Paul Wouters & Johan Heilbron

Avoid common mistakes on your manuscript.

Introduction

“… It is important to regularly dialogue about what makes for good qualitative research” (Tracy, 2010 , p. 837)

To decide what represents good qualitative research is highly debatable. There are numerous methods that are contained within qualitative research and that are established on diverse philosophical perspectives. Bryman et al., ( 2008 , p. 262) suggest that “It is widely assumed that whereas quality criteria for quantitative research are well‐known and widely agreed, this is not the case for qualitative research.” Hence, the question “how to evaluate the quality of qualitative research” has been continuously debated. There are many areas of science and technology wherein these debates on the assessment of qualitative research have taken place. Examples include various areas of psychology: general psychology (Madill et al., 2000 ); counseling psychology (Morrow, 2005 ); and clinical psychology (Barker & Pistrang, 2005 ), and other disciplines of social sciences: social policy (Bryman et al., 2008 ); health research (Sparkes, 2001 ); business and management research (Johnson et al., 2006 ); information systems (Klein & Myers, 1999 ); and environmental studies (Reid & Gough, 2000 ). In the literature, these debates are enthused by the impression that the blanket application of criteria for good qualitative research developed around the positivist paradigm is improper. Such debates are based on the wide range of philosophical backgrounds within which qualitative research is conducted (e.g., Sandberg, 2000 ; Schwandt, 1996 ). The existence of methodological diversity led to the formulation of different sets of criteria applicable to qualitative research.

Among qualitative researchers, the dilemma of governing the measures to assess the quality of research is not a new phenomenon, especially when the virtuous triad of objectivity, reliability, and validity (Spencer et al., 2004 ) are not adequate. Occasionally, the criteria of quantitative research are used to evaluate qualitative research (Cohen & Crabtree, 2008 ; Lather, 2004 ). Indeed, Howe ( 2004 ) claims that the prevailing paradigm in educational research is scientifically based experimental research. Hypotheses and conjectures about the preeminence of quantitative research can weaken the worth and usefulness of qualitative research by neglecting the prominence of harmonizing match for purpose on research paradigm, the epistemological stance of the researcher, and the choice of methodology. Researchers have been reprimanded concerning this in “paradigmatic controversies, contradictions, and emerging confluences” (Lincoln & Guba, 2000 ).

In general, qualitative research tends to come from a very different paradigmatic stance and intrinsically demands distinctive and out-of-the-ordinary criteria for evaluating good research and varieties of research contributions that can be made. This review attempts to present a series of evaluative criteria for qualitative researchers, arguing that their choice of criteria needs to be compatible with the unique nature of the research in question (its methodology, aims, and assumptions). This review aims to assist researchers in identifying some of the indispensable features or markers of high-quality qualitative research. In a nutshell, the purpose of this systematic literature review is to analyze the existing knowledge on high-quality qualitative research and to verify the existence of research studies dealing with the critical assessment of qualitative research based on the concept of diverse paradigmatic stances. Contrary to the existing reviews, this review also suggests some critical directions to follow to improve the quality of qualitative research in different epistemological and ontological perspectives. This review is also intended to provide guidelines for the acceleration of future developments and dialogues among qualitative researchers in the context of assessing the qualitative research.

The rest of this review article is structured in the following fashion: Sect.  Methods describes the method followed for performing this review. Section Criteria for Evaluating Qualitative Studies provides a comprehensive description of the criteria for evaluating qualitative studies. This section is followed by a summary of the strategies to improve the quality of qualitative research in Sect.  Improving Quality: Strategies . Section  How to Assess the Quality of the Research Findings? provides details on how to assess the quality of the research findings. After that, some of the quality checklists (as tools to evaluate quality) are discussed in Sect.  Quality Checklists: Tools for Assessing the Quality . At last, the review ends with the concluding remarks presented in Sect.  Conclusions, Future Directions and Outlook . Some prospects in qualitative research for enhancing its quality and usefulness in the social and techno-scientific research community are also presented in Sect.  Conclusions, Future Directions and Outlook .

For this review, a comprehensive literature search was performed from many databases using generic search terms such as Qualitative Research , Criteria , etc . The following databases were chosen for the literature search based on the high number of results: IEEE Explore, ScienceDirect, PubMed, Google Scholar, and Web of Science. The following keywords (and their combinations using Boolean connectives OR/AND) were adopted for the literature search: qualitative research, criteria, quality, assessment, and validity. The synonyms for these keywords were collected and arranged in a logical structure (see Table 1 ). All publications in journals and conference proceedings later than 1950 till 2021 were considered for the search. Other articles extracted from the references of the papers identified in the electronic search were also included. A large number of publications on qualitative research were retrieved during the initial screening. Hence, to include the searches with the main focus on criteria for good qualitative research, an inclusion criterion was utilized in the search string.

From the selected databases, the search retrieved a total of 765 publications. Then, the duplicate records were removed. After that, based on the title and abstract, the remaining 426 publications were screened for their relevance by using the following inclusion and exclusion criteria (see Table 2 ). Publications focusing on evaluation criteria for good qualitative research were included, whereas those works which delivered theoretical concepts on qualitative research were excluded. Based on the screening and eligibility, 45 research articles were identified that offered explicit criteria for evaluating the quality of qualitative research and were found to be relevant to this review.

Figure  1 illustrates the complete review process in the form of PRISMA flow diagram. PRISMA, i.e., “preferred reporting items for systematic reviews and meta-analyses” is employed in systematic reviews to refine the quality of reporting.

PRISMA flow diagram illustrating the search and inclusion process. N represents the number of records

Criteria for Evaluating Qualitative Studies

Fundamental criteria: general research quality.

Various researchers have put forward criteria for evaluating qualitative research, which have been summarized in Table 3 . Also, the criteria outlined in Table 4 effectively deliver the various approaches to evaluate and assess the quality of qualitative work. The entries in Table 4 are based on Tracy’s “Eight big‐tent criteria for excellent qualitative research” (Tracy, 2010 ). Tracy argues that high-quality qualitative work should formulate criteria focusing on the worthiness, relevance, timeliness, significance, morality, and practicality of the research topic, and the ethical stance of the research itself. Researchers have also suggested a series of questions as guiding principles to assess the quality of a qualitative study (Mays & Pope, 2020 ). Nassaji ( 2020 ) argues that good qualitative research should be robust, well informed, and thoroughly documented.

Qualitative Research: Interpretive Paradigms

All qualitative researchers follow highly abstract principles which bring together beliefs about ontology, epistemology, and methodology. These beliefs govern how the researcher perceives and acts. The net, which encompasses the researcher’s epistemological, ontological, and methodological premises, is referred to as a paradigm, or an interpretive structure, a “Basic set of beliefs that guides action” (Guba, 1990 ). Four major interpretive paradigms structure the qualitative research: positivist and postpositivist, constructivist interpretive, critical (Marxist, emancipatory), and feminist poststructural. The complexity of these four abstract paradigms increases at the level of concrete, specific interpretive communities. Table 5 presents these paradigms and their assumptions, including their criteria for evaluating research, and the typical form that an interpretive or theoretical statement assumes in each paradigm. Moreover, for evaluating qualitative research, quantitative conceptualizations of reliability and validity are proven to be incompatible (Horsburgh, 2003 ). In addition, a series of questions have been put forward in the literature to assist a reviewer (who is proficient in qualitative methods) for meticulous assessment and endorsement of qualitative research (Morse, 2003 ). Hammersley ( 2007 ) also suggests that guiding principles for qualitative research are advantageous, but methodological pluralism should not be simply acknowledged for all qualitative approaches. Seale ( 1999 ) also points out the significance of methodological cognizance in research studies.

Table 5 reflects that criteria for assessing the quality of qualitative research are the aftermath of socio-institutional practices and existing paradigmatic standpoints. Owing to the paradigmatic diversity of qualitative research, a single set of quality criteria is neither possible nor desirable. Hence, the researchers must be reflexive about the criteria they use in the various roles they play within their research community.

Improving Quality: Strategies

Another critical question is “How can the qualitative researchers ensure that the abovementioned quality criteria can be met?” Lincoln and Guba ( 1986 ) delineated several strategies to intensify each criteria of trustworthiness. Other researchers (Merriam & Tisdell, 2016 ; Shenton, 2004 ) also presented such strategies. A brief description of these strategies is shown in Table 6 .

It is worth mentioning that generalizability is also an integral part of qualitative research (Hays & McKibben, 2021 ). In general, the guiding principle pertaining to generalizability speaks about inducing and comprehending knowledge to synthesize interpretive components of an underlying context. Table 7 summarizes the main metasynthesis steps required to ascertain generalizability in qualitative research.

Figure  2 reflects the crucial components of a conceptual framework and their contribution to decisions regarding research design, implementation, and applications of results to future thinking, study, and practice (Johnson et al., 2020 ). The synergy and interrelationship of these components signifies their role to different stances of a qualitative research study.

Essential elements of a conceptual framework

In a nutshell, to assess the rationale of a study, its conceptual framework and research question(s), quality criteria must take account of the following: lucid context for the problem statement in the introduction; well-articulated research problems and questions; precise conceptual framework; distinct research purpose; and clear presentation and investigation of the paradigms. These criteria would expedite the quality of qualitative research.

How to Assess the Quality of the Research Findings?

The inclusion of quotes or similar research data enhances the confirmability in the write-up of the findings. The use of expressions (for instance, “80% of all respondents agreed that” or “only one of the interviewees mentioned that”) may also quantify qualitative findings (Stenfors et al., 2020 ). On the other hand, the persuasive reason for “why this may not help in intensifying the research” has also been provided (Monrouxe & Rees, 2020 ). Further, the Discussion and Conclusion sections of an article also prove robust markers of high-quality qualitative research, as elucidated in Table 8 .

Quality Checklists: Tools for Assessing the Quality

Numerous checklists are available to speed up the assessment of the quality of qualitative research. However, if used uncritically and recklessly concerning the research context, these checklists may be counterproductive. I recommend that such lists and guiding principles may assist in pinpointing the markers of high-quality qualitative research. However, considering enormous variations in the authors’ theoretical and philosophical contexts, I would emphasize that high dependability on such checklists may say little about whether the findings can be applied in your setting. A combination of such checklists might be appropriate for novice researchers. Some of these checklists are listed below:

The most commonly used framework is Consolidated Criteria for Reporting Qualitative Research (COREQ) (Tong et al., 2007 ). This framework is recommended by some journals to be followed by the authors during article submission.

Standards for Reporting Qualitative Research (SRQR) is another checklist that has been created particularly for medical education (O’Brien et al., 2014 ).

Also, Tracy ( 2010 ) and Critical Appraisal Skills Programme (CASP, 2021 ) offer criteria for qualitative research relevant across methods and approaches.

Further, researchers have also outlined different criteria as hallmarks of high-quality qualitative research. For instance, the “Road Trip Checklist” (Epp & Otnes, 2021 ) provides a quick reference to specific questions to address different elements of high-quality qualitative research.

Conclusions, Future Directions, and Outlook

This work presents a broad review of the criteria for good qualitative research. In addition, this article presents an exploratory analysis of the essential elements in qualitative research that can enable the readers of qualitative work to judge it as good research when objectively and adequately utilized. In this review, some of the essential markers that indicate high-quality qualitative research have been highlighted. I scope them narrowly to achieve rigor in qualitative research and note that they do not completely cover the broader considerations necessary for high-quality research. This review points out that a universal and versatile one-size-fits-all guideline for evaluating the quality of qualitative research does not exist. In other words, this review also emphasizes the non-existence of a set of common guidelines among qualitative researchers. In unison, this review reinforces that each qualitative approach should be treated uniquely on account of its own distinctive features for different epistemological and disciplinary positions. Owing to the sensitivity of the worth of qualitative research towards the specific context and the type of paradigmatic stance, researchers should themselves analyze what approaches can be and must be tailored to ensemble the distinct characteristics of the phenomenon under investigation. Although this article does not assert to put forward a magic bullet and to provide a one-stop solution for dealing with dilemmas about how, why, or whether to evaluate the “goodness” of qualitative research, it offers a platform to assist the researchers in improving their qualitative studies. This work provides an assembly of concerns to reflect on, a series of questions to ask, and multiple sets of criteria to look at, when attempting to determine the quality of qualitative research. Overall, this review underlines the crux of qualitative research and accentuates the need to evaluate such research by the very tenets of its being. Bringing together the vital arguments and delineating the requirements that good qualitative research should satisfy, this review strives to equip the researchers as well as reviewers to make well-versed judgment about the worth and significance of the qualitative research under scrutiny. In a nutshell, a comprehensive portrayal of the research process (from the context of research to the research objectives, research questions and design, speculative foundations, and from approaches of collecting data to analyzing the results, to deriving inferences) frequently proliferates the quality of a qualitative research.

Prospects : A Road Ahead for Qualitative Research

Irrefutably, qualitative research is a vivacious and evolving discipline wherein different epistemological and disciplinary positions have their own characteristics and importance. In addition, not surprisingly, owing to the sprouting and varied features of qualitative research, no consensus has been pulled off till date. Researchers have reflected various concerns and proposed several recommendations for editors and reviewers on conducting reviews of critical qualitative research (Levitt et al., 2021 ; McGinley et al., 2021 ). Following are some prospects and a few recommendations put forward towards the maturation of qualitative research and its quality evaluation:

In general, most of the manuscript and grant reviewers are not qualitative experts. Hence, it is more likely that they would prefer to adopt a broad set of criteria. However, researchers and reviewers need to keep in mind that it is inappropriate to utilize the same approaches and conducts among all qualitative research. Therefore, future work needs to focus on educating researchers and reviewers about the criteria to evaluate qualitative research from within the suitable theoretical and methodological context.

There is an urgent need to refurbish and augment critical assessment of some well-known and widely accepted tools (including checklists such as COREQ, SRQR) to interrogate their applicability on different aspects (along with their epistemological ramifications).

Efforts should be made towards creating more space for creativity, experimentation, and a dialogue between the diverse traditions of qualitative research. This would potentially help to avoid the enforcement of one's own set of quality criteria on the work carried out by others.

Moreover, journal reviewers need to be aware of various methodological practices and philosophical debates.

It is pivotal to highlight the expressions and considerations of qualitative researchers and bring them into a more open and transparent dialogue about assessing qualitative research in techno-scientific, academic, sociocultural, and political rooms.

Frequent debates on the use of evaluative criteria are required to solve some potentially resolved issues (including the applicability of a single set of criteria in multi-disciplinary aspects). Such debates would not only benefit the group of qualitative researchers themselves, but primarily assist in augmenting the well-being and vivacity of the entire discipline.

To conclude, I speculate that the criteria, and my perspective, may transfer to other methods, approaches, and contexts. I hope that they spark dialog and debate – about criteria for excellent qualitative research and the underpinnings of the discipline more broadly – and, therefore, help improve the quality of a qualitative study. Further, I anticipate that this review will assist the researchers to contemplate on the quality of their own research, to substantiate research design and help the reviewers to review qualitative research for journals. On a final note, I pinpoint the need to formulate a framework (encompassing the prerequisites of a qualitative study) by the cohesive efforts of qualitative researchers of different disciplines with different theoretic-paradigmatic origins. I believe that tailoring such a framework (of guiding principles) paves the way for qualitative researchers to consolidate the status of qualitative research in the wide-ranging open science debate. Dialogue on this issue across different approaches is crucial for the impending prospects of socio-techno-educational research.

Amin, M. E. K., Nørgaard, L. S., Cavaco, A. M., Witry, M. J., Hillman, L., Cernasev, A., & Desselle, S. P. (2020). Establishing trustworthiness and authenticity in qualitative pharmacy research. Research in Social and Administrative Pharmacy, 16 (10), 1472–1482.

Article   Google Scholar  

Barker, C., & Pistrang, N. (2005). Quality criteria under methodological pluralism: Implications for conducting and evaluating research. American Journal of Community Psychology, 35 (3–4), 201–212.

Bryman, A., Becker, S., & Sempik, J. (2008). Quality criteria for quantitative, qualitative and mixed methods research: A view from social policy. International Journal of Social Research Methodology, 11 (4), 261–276.

Caelli, K., Ray, L., & Mill, J. (2003). ‘Clear as mud’: Toward greater clarity in generic qualitative research. International Journal of Qualitative Methods, 2 (2), 1–13.

CASP (2021). CASP checklists. Retrieved May 2021 from https://casp-uk.net/casp-tools-checklists/

Cohen, D. J., & Crabtree, B. F. (2008). Evaluative criteria for qualitative research in health care: Controversies and recommendations. The Annals of Family Medicine, 6 (4), 331–339.

Denzin, N. K., & Lincoln, Y. S. (2005). Introduction: The discipline and practice of qualitative research. In N. K. Denzin & Y. S. Lincoln (Eds.), The sage handbook of qualitative research (pp. 1–32). Sage Publications Ltd.

Google Scholar  

Elliott, R., Fischer, C. T., & Rennie, D. L. (1999). Evolving guidelines for publication of qualitative research studies in psychology and related fields. British Journal of Clinical Psychology, 38 (3), 215–229.

Epp, A. M., & Otnes, C. C. (2021). High-quality qualitative research: Getting into gear. Journal of Service Research . https://doi.org/10.1177/1094670520961445

Guba, E. G. (1990). The paradigm dialog. In Alternative paradigms conference, mar, 1989, Indiana u, school of education, San Francisco, ca, us . Sage Publications, Inc.

Hammersley, M. (2007). The issue of quality in qualitative research. International Journal of Research and Method in Education, 30 (3), 287–305.

Haven, T. L., Errington, T. M., Gleditsch, K. S., van Grootel, L., Jacobs, A. M., Kern, F. G., & Mokkink, L. B. (2020). Preregistering qualitative research: A Delphi study. International Journal of Qualitative Methods, 19 , 1609406920976417.

Hays, D. G., & McKibben, W. B. (2021). Promoting rigorous research: Generalizability and qualitative research. Journal of Counseling and Development, 99 (2), 178–188.

Horsburgh, D. (2003). Evaluation of qualitative research. Journal of Clinical Nursing, 12 (2), 307–312.

Howe, K. R. (2004). A critique of experimentalism. Qualitative Inquiry, 10 (1), 42–46.

Johnson, J. L., Adkins, D., & Chauvin, S. (2020). A review of the quality indicators of rigor in qualitative research. American Journal of Pharmaceutical Education, 84 (1), 7120.

Johnson, P., Buehring, A., Cassell, C., & Symon, G. (2006). Evaluating qualitative management research: Towards a contingent criteriology. International Journal of Management Reviews, 8 (3), 131–156.

Klein, H. K., & Myers, M. D. (1999). A set of principles for conducting and evaluating interpretive field studies in information systems. MIS Quarterly, 23 (1), 67–93.

Lather, P. (2004). This is your father’s paradigm: Government intrusion and the case of qualitative research in education. Qualitative Inquiry, 10 (1), 15–34.

Levitt, H. M., Morrill, Z., Collins, K. M., & Rizo, J. L. (2021). The methodological integrity of critical qualitative research: Principles to support design and research review. Journal of Counseling Psychology, 68 (3), 357.

Lincoln, Y. S., & Guba, E. G. (1986). But is it rigorous? Trustworthiness and authenticity in naturalistic evaluation. New Directions for Program Evaluation, 1986 (30), 73–84.

Lincoln, Y. S., & Guba, E. G. (2000). Paradigmatic controversies, contradictions and emerging confluences. In N. K. Denzin & Y. S. Lincoln (Eds.), Handbook of qualitative research (2nd ed., pp. 163–188). Sage Publications.

Madill, A., Jordan, A., & Shirley, C. (2000). Objectivity and reliability in qualitative analysis: Realist, contextualist and radical constructionist epistemologies. British Journal of Psychology, 91 (1), 1–20.

Mays, N., & Pope, C. (2020). Quality in qualitative research. Qualitative Research in Health Care . https://doi.org/10.1002/9781119410867.ch15

McGinley, S., Wei, W., Zhang, L., & Zheng, Y. (2021). The state of qualitative research in hospitality: A 5-year review 2014 to 2019. Cornell Hospitality Quarterly, 62 (1), 8–20.

Merriam, S., & Tisdell, E. (2016). Qualitative research: A guide to design and implementation. San Francisco, US.

Meyer, M., & Dykes, J. (2019). Criteria for rigor in visualization design study. IEEE Transactions on Visualization and Computer Graphics, 26 (1), 87–97.

Monrouxe, L. V., & Rees, C. E. (2020). When I say… quantification in qualitative research. Medical Education, 54 (3), 186–187.

Morrow, S. L. (2005). Quality and trustworthiness in qualitative research in counseling psychology. Journal of Counseling Psychology, 52 (2), 250.

Morse, J. M. (2003). A review committee’s guide for evaluating qualitative proposals. Qualitative Health Research, 13 (6), 833–851.

Nassaji, H. (2020). Good qualitative research. Language Teaching Research, 24 (4), 427–431.

O’Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine, 89 (9), 1245–1251.

O’Connor, C., & Joffe, H. (2020). Intercoder reliability in qualitative research: Debates and practical guidelines. International Journal of Qualitative Methods, 19 , 1609406919899220.

Reid, A., & Gough, S. (2000). Guidelines for reporting and evaluating qualitative research: What are the alternatives? Environmental Education Research, 6 (1), 59–91.

Rocco, T. S. (2010). Criteria for evaluating qualitative studies. Human Resource Development International . https://doi.org/10.1080/13678868.2010.501959

Sandberg, J. (2000). Understanding human competence at work: An interpretative approach. Academy of Management Journal, 43 (1), 9–25.

Schwandt, T. A. (1996). Farewell to criteriology. Qualitative Inquiry, 2 (1), 58–72.

Seale, C. (1999). Quality in qualitative research. Qualitative Inquiry, 5 (4), 465–478.

Shenton, A. K. (2004). Strategies for ensuring trustworthiness in qualitative research projects. Education for Information, 22 (2), 63–75.

Sparkes, A. C. (2001). Myth 94: Qualitative health researchers will agree about validity. Qualitative Health Research, 11 (4), 538–552.

Spencer, L., Ritchie, J., Lewis, J., & Dillon, L. (2004). Quality in qualitative evaluation: A framework for assessing research evidence.

Stenfors, T., Kajamaa, A., & Bennett, D. (2020). How to assess the quality of qualitative research. The Clinical Teacher, 17 (6), 596–599.

Taylor, E. W., Beck, J., & Ainsworth, E. (2001). Publishing qualitative adult education research: A peer review perspective. Studies in the Education of Adults, 33 (2), 163–179.

Tong, A., Sainsbury, P., & Craig, J. (2007). Consolidated criteria for reporting qualitative research (COREQ): A 32-item checklist for interviews and focus groups. International Journal for Quality in Health Care, 19 (6), 349–357.

Tracy, S. J. (2010). Qualitative quality: Eight “big-tent” criteria for excellent qualitative research. Qualitative Inquiry, 16 (10), 837–851.

Download references

Open access funding provided by TU Wien (TUW).

Author information

Authors and affiliations.

Faculty of Informatics, Technische Universität Wien, 1040, Vienna, Austria

Drishti Yadav

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Drishti Yadav .

Ethics declarations

Conflict of interest.

The author declares no conflict of interest.

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Yadav, D. Criteria for Good Qualitative Research: A Comprehensive Review. Asia-Pacific Edu Res 31 , 679–689 (2022). https://doi.org/10.1007/s40299-021-00619-0

Download citation

Accepted : 28 August 2021

Published : 18 September 2021

Issue Date : December 2022

DOI : https://doi.org/10.1007/s40299-021-00619-0

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Qualitative research
• Evaluative criteria
• Find a journal
• Publish with us
• Track your research

Qualitative Research Journal

Issue(s) available: 59 – From Volume: 6 Issue: 1 , to Volume: 24 Issue: 2

• Issue 2 2024 When intercultural communication meets translation studies: divergent experiences in qualitative inquiries
• Issue 1 2024 Methodological entanglements – public pedagogy research
• Issue 5 2023
• Issue 4 2023
• Issue 3 2023
• Issue 2 2023
• Issue 1 2023
• Issue 4 2022
• Issue 3 2022
• Issue 2 2022
• Issue 1 2022 Critically Exploring Co-production
• Issue 4 2021
• Issue 3 2021
• Issue 2 2021
• Issue 1 2021
• Issue 4 2020 Research and Methodology in times of Crisis and Emergency
• Issue 3 2020 The Practice of Qualitative Research in Migration Studies: Ethical Issues as a Methodological Challenge
• Issue 2 2020
• Issue 1 2020
• Issue 4 2019 Creative approaches to researching further, higher and adult education
• Issue 3 2019
• Issue 2 2019
• Issue 1 2019 Journeys in and through sound
• Issue 4 2018
• Issue 3 2018
• Issue 2 2018 Revisiting ‘Can the Subaltern Speak?’: 30 years later
• Issue 1 2018
• Issue 4 2017
• Issue 3 2017 Bordering, exclusions and necropolitics
• Issue 2 2017
• Issue 1 2017
• Issue 4 2016
• Issue 3 2016 Auto-, duo- and collaborative- ethnographies:
• Issue 2 2016
• Issue 1 2016
• Issue 4 2015 Art practice as methodological innovation
• Issue 3 2015
• Issue 2 2015 Sub-prime scholarship
• Issue 1 2015
• Issue 3 2014
• Issue 2 2014
• Issue 1 2014 Approaches to Researching Masculinities
• Issue 3 2013
• Issue 2 2013 Selected papers from the 2012 Association of Qualitative ResearchDiscourse, Power and Resistance Conference
• Issue 1 2013
• Issue 2 2012
• Issue 1 2012
• Issue 2 2011
• Issue 1 2011
• Issue 2 2010
• Issue 1 2010
• Issue 2 2009
• Issue 1 2009
• Issue 2 2008
• Issue 1 2008
• Issue 2 2007
• Issue 1 2007
• Issue 2 2006
• Issue 1 2006

Using data as poetry and text in case study research – poetic representations of adult learner experiences in neighbourhood houses

We argue this method of inquiry better represents the participants' learning, lives and experiences in the formal neoliberal education system prioritising performativity…

Conducting collage elicitation research online: what happens when we remove the scissors and glue?

This autoethnographic article presents the adaptation of collage—an arts-based method traditionally used in face-to-face settings—into an online research tool. It emphasizes the…

“But our worlds are different!”: reflexivity as a tool to negotiate insider–outsider dilemmas

In ethnographic research, negotiating insider–outsider perspectives is essential in order to get closer to the participants’ lives. By highlighting the importance of empathy and…

“Online group discussion was challenging but we enjoyed it!” an exploratory practice in extensive reading

While many works have reported adopting exploratory practice (EP) principles in language teaching research, only a few studies have explored the enactment of EP in an online…

Free association and qualitative research interviewing: perspectives and applications

This paper contributes to a dialogue about the psychoanalytic concept of free association and its application in the context of qualitative research interviewing. In doing so, it…

Opportunities and challenges facing LGBTQ+ people in employment in rural England post-pandemic: a thematic analysis

The following study aimed to better understand rural dwelling LGBTQ+ adults’ experiences of the challenges and opportunities facing their working lives in England.

Advancing women to leadership in academia: does personal branding matter?

Personal branding is a strategic tool of marketing and communication to define success in organisations. While it constitutes a conscious attempt to commodify self and audit self…

Tell me about your trauma: an empathetic approach-based protocol for interviewing school leaders who have experienced a crisis

In this study, we illuminate how techniques can be incorporated into interview protocols when conducting research with educational leaders who are being asked to discuss their…

Translanguaging approaches and perceptions of Iranian EGP teachers in bi/multilingual educational spaces: a qualitative inquiry

This study aims to analyze translanguaging practices and beliefs of Iranian English for General Purposes (EGP) teachers and find discrepancies between the practice and perception…

Women leaders' lived experiences of bravery in leadership

The research aims to understand the stories of women leaders who have demonstrated bravery in leadership. By analyzing their lived experiences through storytelling and narratives…

Listening to children's voices: reflections on methods, practices and ethics in researching with children using zoom video interviews

The purpose of this research was to reflect on the enablers, challenges and ethical considerations in conducting qualitative research with young children using online methods. The…

Reflections on a cross-cultural interview study

The aim of this article is to address some aspects of a cross-cultural interview study conducted in a PhD research project. This is done by reflecting on and discussing the…

The use of digital technologies in the co-creation process of photo elicitation

This article approaches the possibilities of photo elicitation as a technique for social research in the landscape of technology-mediated instantaneous interpersonal communication.

Culturally responsive and communicative teaching for multicultural integration: qualitative analysis from public secondary school

The aim of this paper is to examine the strategic approach of culturally responsive and communicative teaching (CRCT) through a critical assessment of interracial teachers in…

Unraveling the challenges of education for sustainable development: a compelling case study

Education for sustainable development (ESD) has gained significant attention, but integrating ESD into existing education systems is challenging. The study aims to explore the…

Handle with care; considerations of Braun and Clarke's approach to thematic analysis

The purpose of this paper is to support potential users of thematic analysis (as outlined by Virginia Braun and Victoria Clarke). Researchers with the intention of applying…

Using teacher narratives to map policy effects in the Victorian Government International Baccalaureate Primary Years Programme (IB-PYP) context

Government primary schools in Australia increasingly take up the International Baccalaureate's Primary Years Programme (IB-PYP) to supplement government-mandated curriculum and…

Illuminating the path: a methodological exploration of grounded theory in doctoral theses

This article explores challenges faced by doctoral candidates using grounded theory (GT) in their theses, focusing on coding, theory development and time constraints. It also…

Children's voices through play-based practice: listening, intensities and critique

This paper offers a reflection of a research process aimed at listening to young children's voices in their everyday school life through a play-based context in a Scottish school…

Problem areas of determining the sample size in qualitative research: a model proposal

The lack of a definite standard for determining the sample size in qualitative research leaves the research process to the initiative of the researcher, and this situation…

Operationalising critical realism for case study research

Critical realism is an increasingly popular “lens” through which complex events, entities and phenomena can be studied. Yet detailed operationalisations of critical realism are at…

Language, educational inequalities and epistemic access: crafting alternative pathways for Fiji

The goal of this article is two-fold. The first is to contribute new insights to inform education policies for addressing the underlying educational inequalities and injustices…

Behind my pet's shadow: exploring the motives underlying the tendency of socially excluded consumers to anthropomorphize their pets

Social exclusion is a complicated psychological phenomenon with behavioral ramifications that influences consumers' lifestyles and behaviors. In contrast, anthropomorphism is a…

Street vendors and power relations among actors: process of place making in Borobudur food and craft market

Existing literature shows conflicting views regarding street vendors in a place. They are considered both positive and negative. Their existence has rarely been examined from a…

Visual tools for supporting interviews in qualitative research: new approaches

This study aims to describe and evaluate various visual and creative tools for supporting the in-depth biographical interview aimed at analyzing educational communities and their…

How to build rapport in online space: using online chat emoticons for qualitative interviewing in feminist research

This study draws on the author's experiences building rapport through online chat for data collection for the author's doctoral dissertation. The author contacted ten Korean women…

The experience of hurt in the deepest part of self; a phenomenological study in young people with non-suicidal self-injury (NSSI)

What is happening in the perceived world of young people who have non-suicidal self-injury? The answer to this question explains many quantitative research findings in the field…

Living with the scepticism for qualitative research: a phenomenological polyethnography

This paper aims to explore how an academic researcher and a practitioner experience scepticism for their qualitative research.

It's too late – the post has gone viral already: a novel methodological stance to explore K-12 teachers' lived experiences of adult cyber abuse

The purpose of this scoping rapid review was to identify and analyse existing qualitative methodologies that have been used to investigate K-12 teachers' lived experiences of…

“A balancing act of keeping the faith and maintaining wellbeing”: perspectives from Australian faith communities during the pandemic

The pandemic presented many new challenges is all spheres of life including faith communities. Around the globe, lockdowns took pace at various stages with varying restrictions…

Online date, start – end:

Copyright holder:, open access:.

• Dr Mark Vicars

Further Information

• About the journal (opens new window)
• Purchase information (opens new window)
• Editorial team (opens new window)
• Write for this journal (opens new window)

We’re listening — tell us what you think

Something didn’t work….

Report bugs here

All feedback is valuable

Please share your general feedback

Join us on our journey

Platform update page.

Visit emeraldpublishing.com/platformupdate to discover the latest news and updates

Questions & More Information

Answers to the most commonly asked questions here

• Open access
• Published: 27 May 2020

How to use and assess qualitative research methods

• Loraine Busetto   ORCID: orcid.org/0000-0002-9228-7875 1 ,
• Wolfgang Wick 1 , 2 &
• Christoph Gumbinger 1  

Neurological Research and Practice volume  2 , Article number:  14 ( 2020 ) Cite this article

690k Accesses

269 Citations

88 Altmetric

Metrics details

This paper aims to provide an overview of the use and assessment of qualitative research methods in the health sciences. Qualitative research can be defined as the study of the nature of phenomena and is especially appropriate for answering questions of why something is (not) observed, assessing complex multi-component interventions, and focussing on intervention improvement. The most common methods of data collection are document study, (non-) participant observations, semi-structured interviews and focus groups. For data analysis, field-notes and audio-recordings are transcribed into protocols and transcripts, and coded using qualitative data management software. Criteria such as checklists, reflexivity, sampling strategies, piloting, co-coding, member-checking and stakeholder involvement can be used to enhance and assess the quality of the research conducted. Using qualitative in addition to quantitative designs will equip us with better tools to address a greater range of research problems, and to fill in blind spots in current neurological research and practice.

The aim of this paper is to provide an overview of qualitative research methods, including hands-on information on how they can be used, reported and assessed. This article is intended for beginning qualitative researchers in the health sciences as well as experienced quantitative researchers who wish to broaden their understanding of qualitative research.

What is qualitative research?

Qualitative research is defined as “the study of the nature of phenomena”, including “their quality, different manifestations, the context in which they appear or the perspectives from which they can be perceived” , but excluding “their range, frequency and place in an objectively determined chain of cause and effect” [ 1 ]. This formal definition can be complemented with a more pragmatic rule of thumb: qualitative research generally includes data in form of words rather than numbers [ 2 ].

Why conduct qualitative research?

Because some research questions cannot be answered using (only) quantitative methods. For example, one Australian study addressed the issue of why patients from Aboriginal communities often present late or not at all to specialist services offered by tertiary care hospitals. Using qualitative interviews with patients and staff, it found one of the most significant access barriers to be transportation problems, including some towns and communities simply not having a bus service to the hospital [ 3 ]. A quantitative study could have measured the number of patients over time or even looked at possible explanatory factors – but only those previously known or suspected to be of relevance. To discover reasons for observed patterns, especially the invisible or surprising ones, qualitative designs are needed.

While qualitative research is common in other fields, it is still relatively underrepresented in health services research. The latter field is more traditionally rooted in the evidence-based-medicine paradigm, as seen in " research that involves testing the effectiveness of various strategies to achieve changes in clinical practice, preferably applying randomised controlled trial study designs (...) " [ 4 ]. This focus on quantitative research and specifically randomised controlled trials (RCT) is visible in the idea of a hierarchy of research evidence which assumes that some research designs are objectively better than others, and that choosing a "lesser" design is only acceptable when the better ones are not practically or ethically feasible [ 5 , 6 ]. Others, however, argue that an objective hierarchy does not exist, and that, instead, the research design and methods should be chosen to fit the specific research question at hand – "questions before methods" [ 2 , 7 , 8 , 9 ]. This means that even when an RCT is possible, some research problems require a different design that is better suited to addressing them. Arguing in JAMA, Berwick uses the example of rapid response teams in hospitals, which he describes as " a complex, multicomponent intervention – essentially a process of social change" susceptible to a range of different context factors including leadership or organisation history. According to him, "[in] such complex terrain, the RCT is an impoverished way to learn. Critics who use it as a truth standard in this context are incorrect" [ 8 ] . Instead of limiting oneself to RCTs, Berwick recommends embracing a wider range of methods , including qualitative ones, which for "these specific applications, (...) are not compromises in learning how to improve; they are superior" [ 8 ].

Research problems that can be approached particularly well using qualitative methods include assessing complex multi-component interventions or systems (of change), addressing questions beyond “what works”, towards “what works for whom when, how and why”, and focussing on intervention improvement rather than accreditation [ 7 , 9 , 10 , 11 , 12 ]. Using qualitative methods can also help shed light on the “softer” side of medical treatment. For example, while quantitative trials can measure the costs and benefits of neuro-oncological treatment in terms of survival rates or adverse effects, qualitative research can help provide a better understanding of patient or caregiver stress, visibility of illness or out-of-pocket expenses.

How to conduct qualitative research?

Given that qualitative research is characterised by flexibility, openness and responsivity to context, the steps of data collection and analysis are not as separate and consecutive as they tend to be in quantitative research [ 13 , 14 ]. As Fossey puts it : “sampling, data collection, analysis and interpretation are related to each other in a cyclical (iterative) manner, rather than following one after another in a stepwise approach” [ 15 ]. The researcher can make educated decisions with regard to the choice of method, how they are implemented, and to which and how many units they are applied [ 13 ]. As shown in Fig.  1 , this can involve several back-and-forth steps between data collection and analysis where new insights and experiences can lead to adaption and expansion of the original plan. Some insights may also necessitate a revision of the research question and/or the research design as a whole. The process ends when saturation is achieved, i.e. when no relevant new information can be found (see also below: sampling and saturation). For reasons of transparency, it is essential for all decisions as well as the underlying reasoning to be well-documented.

Iterative research process

While it is not always explicitly addressed, qualitative methods reflect a different underlying research paradigm than quantitative research (e.g. constructivism or interpretivism as opposed to positivism). The choice of methods can be based on the respective underlying substantive theory or theoretical framework used by the researcher [ 2 ].

Data collection

The methods of qualitative data collection most commonly used in health research are document study, observations, semi-structured interviews and focus groups [ 1 , 14 , 16 , 17 ].

Document study

Document study (also called document analysis) refers to the review by the researcher of written materials [ 14 ]. These can include personal and non-personal documents such as archives, annual reports, guidelines, policy documents, diaries or letters.

Observations

Observations are particularly useful to gain insights into a certain setting and actual behaviour – as opposed to reported behaviour or opinions [ 13 ]. Qualitative observations can be either participant or non-participant in nature. In participant observations, the observer is part of the observed setting, for example a nurse working in an intensive care unit [ 18 ]. In non-participant observations, the observer is “on the outside looking in”, i.e. present in but not part of the situation, trying not to influence the setting by their presence. Observations can be planned (e.g. for 3 h during the day or night shift) or ad hoc (e.g. as soon as a stroke patient arrives at the emergency room). During the observation, the observer takes notes on everything or certain pre-determined parts of what is happening around them, for example focusing on physician-patient interactions or communication between different professional groups. Written notes can be taken during or after the observations, depending on feasibility (which is usually lower during participant observations) and acceptability (e.g. when the observer is perceived to be judging the observed). Afterwards, these field notes are transcribed into observation protocols. If more than one observer was involved, field notes are taken independently, but notes can be consolidated into one protocol after discussions. Advantages of conducting observations include minimising the distance between the researcher and the researched, the potential discovery of topics that the researcher did not realise were relevant and gaining deeper insights into the real-world dimensions of the research problem at hand [ 18 ].

Semi-structured interviews

Hijmans & Kuyper describe qualitative interviews as “an exchange with an informal character, a conversation with a goal” [ 19 ]. Interviews are used to gain insights into a person’s subjective experiences, opinions and motivations – as opposed to facts or behaviours [ 13 ]. Interviews can be distinguished by the degree to which they are structured (i.e. a questionnaire), open (e.g. free conversation or autobiographical interviews) or semi-structured [ 2 , 13 ]. Semi-structured interviews are characterized by open-ended questions and the use of an interview guide (or topic guide/list) in which the broad areas of interest, sometimes including sub-questions, are defined [ 19 ]. The pre-defined topics in the interview guide can be derived from the literature, previous research or a preliminary method of data collection, e.g. document study or observations. The topic list is usually adapted and improved at the start of the data collection process as the interviewer learns more about the field [ 20 ]. Across interviews the focus on the different (blocks of) questions may differ and some questions may be skipped altogether (e.g. if the interviewee is not able or willing to answer the questions or for concerns about the total length of the interview) [ 20 ]. Qualitative interviews are usually not conducted in written format as it impedes on the interactive component of the method [ 20 ]. In comparison to written surveys, qualitative interviews have the advantage of being interactive and allowing for unexpected topics to emerge and to be taken up by the researcher. This can also help overcome a provider or researcher-centred bias often found in written surveys, which by nature, can only measure what is already known or expected to be of relevance to the researcher. Interviews can be audio- or video-taped; but sometimes it is only feasible or acceptable for the interviewer to take written notes [ 14 , 16 , 20 ].

Focus groups

Focus groups are group interviews to explore participants’ expertise and experiences, including explorations of how and why people behave in certain ways [ 1 ]. Focus groups usually consist of 6–8 people and are led by an experienced moderator following a topic guide or “script” [ 21 ]. They can involve an observer who takes note of the non-verbal aspects of the situation, possibly using an observation guide [ 21 ]. Depending on researchers’ and participants’ preferences, the discussions can be audio- or video-taped and transcribed afterwards [ 21 ]. Focus groups are useful for bringing together homogeneous (to a lesser extent heterogeneous) groups of participants with relevant expertise and experience on a given topic on which they can share detailed information [ 21 ]. Focus groups are a relatively easy, fast and inexpensive method to gain access to information on interactions in a given group, i.e. “the sharing and comparing” among participants [ 21 ]. Disadvantages include less control over the process and a lesser extent to which each individual may participate. Moreover, focus group moderators need experience, as do those tasked with the analysis of the resulting data. Focus groups can be less appropriate for discussing sensitive topics that participants might be reluctant to disclose in a group setting [ 13 ]. Moreover, attention must be paid to the emergence of “groupthink” as well as possible power dynamics within the group, e.g. when patients are awed or intimidated by health professionals.

Choosing the “right” method

As explained above, the school of thought underlying qualitative research assumes no objective hierarchy of evidence and methods. This means that each choice of single or combined methods has to be based on the research question that needs to be answered and a critical assessment with regard to whether or to what extent the chosen method can accomplish this – i.e. the “fit” between question and method [ 14 ]. It is necessary for these decisions to be documented when they are being made, and to be critically discussed when reporting methods and results.

Let us assume that our research aim is to examine the (clinical) processes around acute endovascular treatment (EVT), from the patient’s arrival at the emergency room to recanalization, with the aim to identify possible causes for delay and/or other causes for sub-optimal treatment outcome. As a first step, we could conduct a document study of the relevant standard operating procedures (SOPs) for this phase of care – are they up-to-date and in line with current guidelines? Do they contain any mistakes, irregularities or uncertainties that could cause delays or other problems? Regardless of the answers to these questions, the results have to be interpreted based on what they are: a written outline of what care processes in this hospital should look like. If we want to know what they actually look like in practice, we can conduct observations of the processes described in the SOPs. These results can (and should) be analysed in themselves, but also in comparison to the results of the document analysis, especially as regards relevant discrepancies. Do the SOPs outline specific tests for which no equipment can be observed or tasks to be performed by specialized nurses who are not present during the observation? It might also be possible that the written SOP is outdated, but the actual care provided is in line with current best practice. In order to find out why these discrepancies exist, it can be useful to conduct interviews. Are the physicians simply not aware of the SOPs (because their existence is limited to the hospital’s intranet) or do they actively disagree with them or does the infrastructure make it impossible to provide the care as described? Another rationale for adding interviews is that some situations (or all of their possible variations for different patient groups or the day, night or weekend shift) cannot practically or ethically be observed. In this case, it is possible to ask those involved to report on their actions – being aware that this is not the same as the actual observation. A senior physician’s or hospital manager’s description of certain situations might differ from a nurse’s or junior physician’s one, maybe because they intentionally misrepresent facts or maybe because different aspects of the process are visible or important to them. In some cases, it can also be relevant to consider to whom the interviewee is disclosing this information – someone they trust, someone they are otherwise not connected to, or someone they suspect or are aware of being in a potentially “dangerous” power relationship to them. Lastly, a focus group could be conducted with representatives of the relevant professional groups to explore how and why exactly they provide care around EVT. The discussion might reveal discrepancies (between SOPs and actual care or between different physicians) and motivations to the researchers as well as to the focus group members that they might not have been aware of themselves. For the focus group to deliver relevant information, attention has to be paid to its composition and conduct, for example, to make sure that all participants feel safe to disclose sensitive or potentially problematic information or that the discussion is not dominated by (senior) physicians only. The resulting combination of data collection methods is shown in Fig.  2 .

Possible combination of data collection methods

Attributions for icons: “Book” by Serhii Smirnov, “Interview” by Adrien Coquet, FR, “Magnifying Glass” by anggun, ID, “Business communication” by Vectors Market; all from the Noun Project

The combination of multiple data source as described for this example can be referred to as “triangulation”, in which multiple measurements are carried out from different angles to achieve a more comprehensive understanding of the phenomenon under study [ 22 , 23 ].

Data analysis

To analyse the data collected through observations, interviews and focus groups these need to be transcribed into protocols and transcripts (see Fig.  3 ). Interviews and focus groups can be transcribed verbatim , with or without annotations for behaviour (e.g. laughing, crying, pausing) and with or without phonetic transcription of dialects and filler words, depending on what is expected or known to be relevant for the analysis. In the next step, the protocols and transcripts are coded , that is, marked (or tagged, labelled) with one or more short descriptors of the content of a sentence or paragraph [ 2 , 15 , 23 ]. Jansen describes coding as “connecting the raw data with “theoretical” terms” [ 20 ]. In a more practical sense, coding makes raw data sortable. This makes it possible to extract and examine all segments describing, say, a tele-neurology consultation from multiple data sources (e.g. SOPs, emergency room observations, staff and patient interview). In a process of synthesis and abstraction, the codes are then grouped, summarised and/or categorised [ 15 , 20 ]. The end product of the coding or analysis process is a descriptive theory of the behavioural pattern under investigation [ 20 ]. The coding process is performed using qualitative data management software, the most common ones being InVivo, MaxQDA and Atlas.ti. It should be noted that these are data management tools which support the analysis performed by the researcher(s) [ 14 ].

From data collection to data analysis

Attributions for icons: see Fig. 2 , also “Speech to text” by Trevor Dsouza, “Field Notes” by Mike O’Brien, US, “Voice Record” by ProSymbols, US, “Inspection” by Made, AU, and “Cloud” by Graphic Tigers; all from the Noun Project

How to report qualitative research?

Protocols of qualitative research can be published separately and in advance of the study results. However, the aim is not the same as in RCT protocols, i.e. to pre-define and set in stone the research questions and primary or secondary endpoints. Rather, it is a way to describe the research methods in detail, which might not be possible in the results paper given journals’ word limits. Qualitative research papers are usually longer than their quantitative counterparts to allow for deep understanding and so-called “thick description”. In the methods section, the focus is on transparency of the methods used, including why, how and by whom they were implemented in the specific study setting, so as to enable a discussion of whether and how this may have influenced data collection, analysis and interpretation. The results section usually starts with a paragraph outlining the main findings, followed by more detailed descriptions of, for example, the commonalities, discrepancies or exceptions per category [ 20 ]. Here it is important to support main findings by relevant quotations, which may add information, context, emphasis or real-life examples [ 20 , 23 ]. It is subject to debate in the field whether it is relevant to state the exact number or percentage of respondents supporting a certain statement (e.g. “Five interviewees expressed negative feelings towards XYZ”) [ 21 ].

How to combine qualitative with quantitative research?

Qualitative methods can be combined with other methods in multi- or mixed methods designs, which “[employ] two or more different methods [ …] within the same study or research program rather than confining the research to one single method” [ 24 ]. Reasons for combining methods can be diverse, including triangulation for corroboration of findings, complementarity for illustration and clarification of results, expansion to extend the breadth and range of the study, explanation of (unexpected) results generated with one method with the help of another, or offsetting the weakness of one method with the strength of another [ 1 , 17 , 24 , 25 , 26 ]. The resulting designs can be classified according to when, why and how the different quantitative and/or qualitative data strands are combined. The three most common types of mixed method designs are the convergent parallel design , the explanatory sequential design and the exploratory sequential design. The designs with examples are shown in Fig.  4 .

Three common mixed methods designs

In the convergent parallel design, a qualitative study is conducted in parallel to and independently of a quantitative study, and the results of both studies are compared and combined at the stage of interpretation of results. Using the above example of EVT provision, this could entail setting up a quantitative EVT registry to measure process times and patient outcomes in parallel to conducting the qualitative research outlined above, and then comparing results. Amongst other things, this would make it possible to assess whether interview respondents’ subjective impressions of patients receiving good care match modified Rankin Scores at follow-up, or whether observed delays in care provision are exceptions or the rule when compared to door-to-needle times as documented in the registry. In the explanatory sequential design, a quantitative study is carried out first, followed by a qualitative study to help explain the results from the quantitative study. This would be an appropriate design if the registry alone had revealed relevant delays in door-to-needle times and the qualitative study would be used to understand where and why these occurred, and how they could be improved. In the exploratory design, the qualitative study is carried out first and its results help informing and building the quantitative study in the next step [ 26 ]. If the qualitative study around EVT provision had shown a high level of dissatisfaction among the staff members involved, a quantitative questionnaire investigating staff satisfaction could be set up in the next step, informed by the qualitative study on which topics dissatisfaction had been expressed. Amongst other things, the questionnaire design would make it possible to widen the reach of the research to more respondents from different (types of) hospitals, regions, countries or settings, and to conduct sub-group analyses for different professional groups.

How to assess qualitative research?

A variety of assessment criteria and lists have been developed for qualitative research, ranging in their focus and comprehensiveness [ 14 , 17 , 27 ]. However, none of these has been elevated to the “gold standard” in the field. In the following, we therefore focus on a set of commonly used assessment criteria that, from a practical standpoint, a researcher can look for when assessing a qualitative research report or paper.

Assessors should check the authors’ use of and adherence to the relevant reporting checklists (e.g. Standards for Reporting Qualitative Research (SRQR)) to make sure all items that are relevant for this type of research are addressed [ 23 , 28 ]. Discussions of quantitative measures in addition to or instead of these qualitative measures can be a sign of lower quality of the research (paper). Providing and adhering to a checklist for qualitative research contributes to an important quality criterion for qualitative research, namely transparency [ 15 , 17 , 23 ].

Reflexivity

While methodological transparency and complete reporting is relevant for all types of research, some additional criteria must be taken into account for qualitative research. This includes what is called reflexivity, i.e. sensitivity to the relationship between the researcher and the researched, including how contact was established and maintained, or the background and experience of the researcher(s) involved in data collection and analysis. Depending on the research question and population to be researched this can be limited to professional experience, but it may also include gender, age or ethnicity [ 17 , 27 ]. These details are relevant because in qualitative research, as opposed to quantitative research, the researcher as a person cannot be isolated from the research process [ 23 ]. It may influence the conversation when an interviewed patient speaks to an interviewer who is a physician, or when an interviewee is asked to discuss a gynaecological procedure with a male interviewer, and therefore the reader must be made aware of these details [ 19 ].

Sampling and saturation

The aim of qualitative sampling is for all variants of the objects of observation that are deemed relevant for the study to be present in the sample “ to see the issue and its meanings from as many angles as possible” [ 1 , 16 , 19 , 20 , 27 ] , and to ensure “information-richness [ 15 ]. An iterative sampling approach is advised, in which data collection (e.g. five interviews) is followed by data analysis, followed by more data collection to find variants that are lacking in the current sample. This process continues until no new (relevant) information can be found and further sampling becomes redundant – which is called saturation [ 1 , 15 ] . In other words: qualitative data collection finds its end point not a priori , but when the research team determines that saturation has been reached [ 29 , 30 ].

This is also the reason why most qualitative studies use deliberate instead of random sampling strategies. This is generally referred to as “ purposive sampling” , in which researchers pre-define which types of participants or cases they need to include so as to cover all variations that are expected to be of relevance, based on the literature, previous experience or theory (i.e. theoretical sampling) [ 14 , 20 ]. Other types of purposive sampling include (but are not limited to) maximum variation sampling, critical case sampling or extreme or deviant case sampling [ 2 ]. In the above EVT example, a purposive sample could include all relevant professional groups and/or all relevant stakeholders (patients, relatives) and/or all relevant times of observation (day, night and weekend shift).

Assessors of qualitative research should check whether the considerations underlying the sampling strategy were sound and whether or how researchers tried to adapt and improve their strategies in stepwise or cyclical approaches between data collection and analysis to achieve saturation [ 14 ].

Good qualitative research is iterative in nature, i.e. it goes back and forth between data collection and analysis, revising and improving the approach where necessary. One example of this are pilot interviews, where different aspects of the interview (especially the interview guide, but also, for example, the site of the interview or whether the interview can be audio-recorded) are tested with a small number of respondents, evaluated and revised [ 19 ]. In doing so, the interviewer learns which wording or types of questions work best, or which is the best length of an interview with patients who have trouble concentrating for an extended time. Of course, the same reasoning applies to observations or focus groups which can also be piloted.

Ideally, coding should be performed by at least two researchers, especially at the beginning of the coding process when a common approach must be defined, including the establishment of a useful coding list (or tree), and when a common meaning of individual codes must be established [ 23 ]. An initial sub-set or all transcripts can be coded independently by the coders and then compared and consolidated after regular discussions in the research team. This is to make sure that codes are applied consistently to the research data.

Member checking

Member checking, also called respondent validation , refers to the practice of checking back with study respondents to see if the research is in line with their views [ 14 , 27 ]. This can happen after data collection or analysis or when first results are available [ 23 ]. For example, interviewees can be provided with (summaries of) their transcripts and asked whether they believe this to be a complete representation of their views or whether they would like to clarify or elaborate on their responses [ 17 ]. Respondents’ feedback on these issues then becomes part of the data collection and analysis [ 27 ].

Stakeholder involvement

In those niches where qualitative approaches have been able to evolve and grow, a new trend has seen the inclusion of patients and their representatives not only as study participants (i.e. “members”, see above) but as consultants to and active participants in the broader research process [ 31 , 32 , 33 ]. The underlying assumption is that patients and other stakeholders hold unique perspectives and experiences that add value beyond their own single story, making the research more relevant and beneficial to researchers, study participants and (future) patients alike [ 34 , 35 ]. Using the example of patients on or nearing dialysis, a recent scoping review found that 80% of clinical research did not address the top 10 research priorities identified by patients and caregivers [ 32 , 36 ]. In this sense, the involvement of the relevant stakeholders, especially patients and relatives, is increasingly being seen as a quality indicator in and of itself.

How not to assess qualitative research

The above overview does not include certain items that are routine in assessments of quantitative research. What follows is a non-exhaustive, non-representative, experience-based list of the quantitative criteria often applied to the assessment of qualitative research, as well as an explanation of the limited usefulness of these endeavours.

Protocol adherence

Given the openness and flexibility of qualitative research, it should not be assessed by how well it adheres to pre-determined and fixed strategies – in other words: its rigidity. Instead, the assessor should look for signs of adaptation and refinement based on lessons learned from earlier steps in the research process.

Sample size

For the reasons explained above, qualitative research does not require specific sample sizes, nor does it require that the sample size be determined a priori [ 1 , 14 , 27 , 37 , 38 , 39 ]. Sample size can only be a useful quality indicator when related to the research purpose, the chosen methodology and the composition of the sample, i.e. who was included and why.

Randomisation

While some authors argue that randomisation can be used in qualitative research, this is not commonly the case, as neither its feasibility nor its necessity or usefulness has been convincingly established for qualitative research [ 13 , 27 ]. Relevant disadvantages include the negative impact of a too large sample size as well as the possibility (or probability) of selecting “ quiet, uncooperative or inarticulate individuals ” [ 17 ]. Qualitative studies do not use control groups, either.

Interrater reliability, variability and other “objectivity checks”

The concept of “interrater reliability” is sometimes used in qualitative research to assess to which extent the coding approach overlaps between the two co-coders. However, it is not clear what this measure tells us about the quality of the analysis [ 23 ]. This means that these scores can be included in qualitative research reports, preferably with some additional information on what the score means for the analysis, but it is not a requirement. Relatedly, it is not relevant for the quality or “objectivity” of qualitative research to separate those who recruited the study participants and collected and analysed the data. Experiences even show that it might be better to have the same person or team perform all of these tasks [ 20 ]. First, when researchers introduce themselves during recruitment this can enhance trust when the interview takes place days or weeks later with the same researcher. Second, when the audio-recording is transcribed for analysis, the researcher conducting the interviews will usually remember the interviewee and the specific interview situation during data analysis. This might be helpful in providing additional context information for interpretation of data, e.g. on whether something might have been meant as a joke [ 18 ].

Not being quantitative research

Being qualitative research instead of quantitative research should not be used as an assessment criterion if it is used irrespectively of the research problem at hand. Similarly, qualitative research should not be required to be combined with quantitative research per se – unless mixed methods research is judged as inherently better than single-method research. In this case, the same criterion should be applied for quantitative studies without a qualitative component.

The main take-away points of this paper are summarised in Table 1 . We aimed to show that, if conducted well, qualitative research can answer specific research questions that cannot to be adequately answered using (only) quantitative designs. Seeing qualitative and quantitative methods as equal will help us become more aware and critical of the “fit” between the research problem and our chosen methods: I can conduct an RCT to determine the reasons for transportation delays of acute stroke patients – but should I? It also provides us with a greater range of tools to tackle a greater range of research problems more appropriately and successfully, filling in the blind spots on one half of the methodological spectrum to better address the whole complexity of neurological research and practice.

Availability of data and materials

Not applicable.

Abbreviations

Endovascular treatment

Randomised Controlled Trial

Standard Operating Procedure

Standards for Reporting Qualitative Research

Philipsen, H., & Vernooij-Dassen, M. (2007). Kwalitatief onderzoek: nuttig, onmisbaar en uitdagend. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Qualitative research: useful, indispensable and challenging. In: Qualitative research: Practical methods for medical practice (pp. 5–12). Houten: Bohn Stafleu van Loghum.

Chapter   Google Scholar  

Punch, K. F. (2013). Introduction to social research: Quantitative and qualitative approaches . London: Sage.

Kelly, J., Dwyer, J., Willis, E., & Pekarsky, B. (2014). Travelling to the city for hospital care: Access factors in country aboriginal patient journeys. Australian Journal of Rural Health, 22 (3), 109–113.

Article   Google Scholar  

Nilsen, P., Ståhl, C., Roback, K., & Cairney, P. (2013). Never the twain shall meet? - a comparison of implementation science and policy implementation research. Implementation Science, 8 (1), 1–12.

Howick J, Chalmers I, Glasziou, P., Greenhalgh, T., Heneghan, C., Liberati, A., Moschetti, I., Phillips, B., & Thornton, H. (2011). The 2011 Oxford CEBM evidence levels of evidence (introductory document) . Oxford Center for Evidence Based Medicine. https://www.cebm.net/2011/06/2011-oxford-cebm-levels-evidence-introductory-document/ .

Eakin, J. M. (2016). Educating critical qualitative health researchers in the land of the randomized controlled trial. Qualitative Inquiry, 22 (2), 107–118.

May, A., & Mathijssen, J. (2015). Alternatieven voor RCT bij de evaluatie van effectiviteit van interventies!? Eindrapportage. In Alternatives for RCTs in the evaluation of effectiveness of interventions!? Final report .

Google Scholar  

Berwick, D. M. (2008). The science of improvement. Journal of the American Medical Association, 299 (10), 1182–1184.

Article   CAS   Google Scholar  

Christ, T. W. (2014). Scientific-based research and randomized controlled trials, the “gold” standard? Alternative paradigms and mixed methodologies. Qualitative Inquiry, 20 (1), 72–80.

Lamont, T., Barber, N., Jd, P., Fulop, N., Garfield-Birkbeck, S., Lilford, R., Mear, L., Raine, R., & Fitzpatrick, R. (2016). New approaches to evaluating complex health and care systems. BMJ, 352:i154.

Drabble, S. J., & O’Cathain, A. (2015). Moving from Randomized Controlled Trials to Mixed Methods Intervention Evaluation. In S. Hesse-Biber & R. B. Johnson (Eds.), The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry (pp. 406–425). London: Oxford University Press.

Chambers, D. A., Glasgow, R. E., & Stange, K. C. (2013). The dynamic sustainability framework: Addressing the paradox of sustainment amid ongoing change. Implementation Science : IS, 8 , 117.

Hak, T. (2007). Waarnemingsmethoden in kwalitatief onderzoek. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Observation methods in qualitative research] (pp. 13–25). Houten: Bohn Stafleu van Loghum.

Russell, C. K., & Gregory, D. M. (2003). Evaluation of qualitative research studies. Evidence Based Nursing, 6 (2), 36–40.

Fossey, E., Harvey, C., McDermott, F., & Davidson, L. (2002). Understanding and evaluating qualitative research. Australian and New Zealand Journal of Psychiatry, 36 , 717–732.

Yanow, D. (2000). Conducting interpretive policy analysis (Vol. 47). Thousand Oaks: Sage University Papers Series on Qualitative Research Methods.

Shenton, A. K. (2004). Strategies for ensuring trustworthiness in qualitative research projects. Education for Information, 22 , 63–75.

van der Geest, S. (2006). Participeren in ziekte en zorg: meer over kwalitatief onderzoek. Huisarts en Wetenschap, 49 (4), 283–287.

Hijmans, E., & Kuyper, M. (2007). Het halfopen interview als onderzoeksmethode. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [The half-open interview as research method (pp. 43–51). Houten: Bohn Stafleu van Loghum.

Jansen, H. (2007). Systematiek en toepassing van de kwalitatieve survey. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Systematics and implementation of the qualitative survey (pp. 27–41). Houten: Bohn Stafleu van Loghum.

Pv, R., & Peremans, L. (2007). Exploreren met focusgroepgesprekken: de ‘stem’ van de groep onder de loep. In L. PLBJ & H. TCo (Eds.), Kwalitatief onderzoek: Praktische methoden voor de medische praktijk . [Exploring with focus group conversations: the “voice” of the group under the magnifying glass (pp. 53–64). Houten: Bohn Stafleu van Loghum.

Carter, N., Bryant-Lukosius, D., DiCenso, A., Blythe, J., & Neville, A. J. (2014). The use of triangulation in qualitative research. Oncology Nursing Forum, 41 (5), 545–547.

Boeije H: Analyseren in kwalitatief onderzoek: Denken en doen, [Analysis in qualitative research: Thinking and doing] vol. Den Haag Boom Lemma uitgevers; 2012.

Hunter, A., & Brewer, J. (2015). Designing Multimethod Research. In S. Hesse-Biber & R. B. Johnson (Eds.), The Oxford Handbook of Multimethod and Mixed Methods Research Inquiry (pp. 185–205). London: Oxford University Press.

Archibald, M. M., Radil, A. I., Zhang, X., & Hanson, W. E. (2015). Current mixed methods practices in qualitative research: A content analysis of leading journals. International Journal of Qualitative Methods, 14 (2), 5–33.

Creswell, J. W., & Plano Clark, V. L. (2011). Choosing a Mixed Methods Design. In Designing and Conducting Mixed Methods Research . Thousand Oaks: SAGE Publications.

Mays, N., & Pope, C. (2000). Assessing quality in qualitative research. BMJ, 320 (7226), 50–52.

O'Brien, B. C., Harris, I. B., Beckman, T. J., Reed, D. A., & Cook, D. A. (2014). Standards for reporting qualitative research: A synthesis of recommendations. Academic Medicine : Journal of the Association of American Medical Colleges, 89 (9), 1245–1251.

Saunders, B., Sim, J., Kingstone, T., Baker, S., Waterfield, J., Bartlam, B., Burroughs, H., & Jinks, C. (2018). Saturation in qualitative research: Exploring its conceptualization and operationalization. Quality and Quantity, 52 (4), 1893–1907.

Moser, A., & Korstjens, I. (2018). Series: Practical guidance to qualitative research. Part 3: Sampling, data collection and analysis. European Journal of General Practice, 24 (1), 9–18.

Marlett, N., Shklarov, S., Marshall, D., Santana, M. J., & Wasylak, T. (2015). Building new roles and relationships in research: A model of patient engagement research. Quality of Life Research : an international journal of quality of life aspects of treatment, care and rehabilitation, 24 (5), 1057–1067.

Demian, M. N., Lam, N. N., Mac-Way, F., Sapir-Pichhadze, R., & Fernandez, N. (2017). Opportunities for engaging patients in kidney research. Canadian Journal of Kidney Health and Disease, 4 , 2054358117703070–2054358117703070.

Noyes, J., McLaughlin, L., Morgan, K., Roberts, A., Stephens, M., Bourne, J., Houlston, M., Houlston, J., Thomas, S., Rhys, R. G., et al. (2019). Designing a co-productive study to overcome known methodological challenges in organ donation research with bereaved family members. Health Expectations . 22(4):824–35.

Piil, K., Jarden, M., & Pii, K. H. (2019). Research agenda for life-threatening cancer. European Journal Cancer Care (Engl), 28 (1), e12935.

Hofmann, D., Ibrahim, F., Rose, D., Scott, D. L., Cope, A., Wykes, T., & Lempp, H. (2015). Expectations of new treatment in rheumatoid arthritis: Developing a patient-generated questionnaire. Health Expectations : an international journal of public participation in health care and health policy, 18 (5), 995–1008.

Jun, M., Manns, B., Laupacis, A., Manns, L., Rehal, B., Crowe, S., & Hemmelgarn, B. R. (2015). Assessing the extent to which current clinical research is consistent with patient priorities: A scoping review using a case study in patients on or nearing dialysis. Canadian Journal of Kidney Health and Disease, 2 , 35.

Elsie Baker, S., & Edwards, R. (2012). How many qualitative interviews is enough? In National Centre for Research Methods Review Paper . National Centre for Research Methods. http://eprints.ncrm.ac.uk/2273/4/how_many_interviews.pdf .

Sandelowski, M. (1995). Sample size in qualitative research. Research in Nursing & Health, 18 (2), 179–183.

Sim, J., Saunders, B., Waterfield, J., & Kingstone, T. (2018). Can sample size in qualitative research be determined a priori? International Journal of Social Research Methodology, 21 (5), 619–634.

Download references

Acknowledgements

no external funding.

Author information

Authors and affiliations.

Department of Neurology, Heidelberg University Hospital, Im Neuenheimer Feld 400, 69120, Heidelberg, Germany

Loraine Busetto, Wolfgang Wick & Christoph Gumbinger

Clinical Cooperation Unit Neuro-Oncology, German Cancer Research Center, Heidelberg, Germany

Wolfgang Wick

You can also search for this author in PubMed   Google Scholar

Contributions

LB drafted the manuscript; WW and CG revised the manuscript; all authors approved the final versions.

Corresponding author

Correspondence to Loraine Busetto .

Ethics declarations

Ethics approval and consent to participate, consent for publication, competing interests.

The authors declare no competing interests.

Additional information

Publisher’s note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Cite this article.

Busetto, L., Wick, W. & Gumbinger, C. How to use and assess qualitative research methods. Neurol. Res. Pract. 2 , 14 (2020). https://doi.org/10.1186/s42466-020-00059-z

Download citation

Received : 30 January 2020

Accepted : 22 April 2020

Published : 27 May 2020

DOI : https://doi.org/10.1186/s42466-020-00059-z

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Qualitative research
• Mixed methods
• Quality assessment

Neurological Research and Practice

ISSN: 2524-3489

• Submission enquiries: Access here and click Contact Us
• General enquiries: [email protected]

• Search Menu
• Advance articles
• Editor's Choice
• ESHRE Pages
• Mini-reviews
• Author Guidelines
• Submission Site
• Reasons to Publish
• Open Access
• Advertising and Corporate Services
• Advertising
• Reprints and ePrints
• Sponsored Supplements
• Branded Books
• Journals Career Network
• About Human Reproduction
• About the European Society of Human Reproduction and Embryology
• Editorial Board
• Self-Archiving Policy
• Dispatch Dates
• Contact ESHRE
• Journals on Oxford Academic
• Books on Oxford Academic

Article Contents

Introduction, when to use qualitative research, how to judge qualitative research, conclusions, authors' roles, conflict of interest.

• < Previous

Qualitative research methods: when to use them and how to judge them

• Article contents
• Figures & tables
• Supplementary Data

K. Hammarberg, M. Kirkman, S. de Lacey, Qualitative research methods: when to use them and how to judge them, Human Reproduction , Volume 31, Issue 3, March 2016, Pages 498–501, https://doi.org/10.1093/humrep/dev334

• Permissions Icon Permissions

In March 2015, an impressive set of guidelines for best practice on how to incorporate psychosocial care in routine infertility care was published by the ESHRE Psychology and Counselling Guideline Development Group ( ESHRE Psychology and Counselling Guideline Development Group, 2015 ). The authors report that the guidelines are based on a comprehensive review of the literature and we congratulate them on their meticulous compilation of evidence into a clinically useful document. However, when we read the methodology section, we were baffled and disappointed to find that evidence from research using qualitative methods was not included in the formulation of the guidelines. Despite stating that ‘qualitative research has significant value to assess the lived experience of infertility and fertility treatment’, the group excluded this body of evidence because qualitative research is ‘not generally hypothesis-driven and not objective/neutral, as the researcher puts him/herself in the position of the participant to understand how the world is from the person's perspective’.

Qualitative and quantitative research methods are often juxtaposed as representing two different world views. In quantitative circles, qualitative research is commonly viewed with suspicion and considered lightweight because it involves small samples which may not be representative of the broader population, it is seen as not objective, and the results are assessed as biased by the researchers' own experiences or opinions. In qualitative circles, quantitative research can be dismissed as over-simplifying individual experience in the cause of generalisation, failing to acknowledge researcher biases and expectations in research design, and requiring guesswork to understand the human meaning of aggregate data.

As social scientists who investigate psychosocial aspects of human reproduction, we use qualitative and quantitative methods, separately or together, depending on the research question. The crucial part is to know when to use what method.

The peer-review process is a pillar of scientific publishing. One of the important roles of reviewers is to assess the scientific rigour of the studies from which authors draw their conclusions. If rigour is lacking, the paper should not be published. As with research using quantitative methods, research using qualitative methods is home to the good, the bad and the ugly. It is essential that reviewers know the difference. Rejection letters are hard to take but more often than not they are based on legitimate critique. However, from time to time it is obvious that the reviewer has little grasp of what constitutes rigour or quality in qualitative research. The first author (K.H.) recently submitted a paper that reported findings from a qualitative study about fertility-related knowledge and information-seeking behaviour among people of reproductive age. In the rejection letter one of the reviewers (not from Human Reproduction ) lamented, ‘Even for a qualitative study, I would expect that some form of confidence interval and paired t-tables analysis, etc. be used to analyse the significance of results'. This comment reveals the reviewer's inappropriate application to qualitative research of criteria relevant only to quantitative research.

In this commentary, we give illustrative examples of questions most appropriately answered using qualitative methods and provide general advice about how to appraise the scientific rigour of qualitative studies. We hope this will help the journal's reviewers and readers appreciate the legitimate place of qualitative research and ensure we do not throw the baby out with the bath water by excluding or rejecting papers simply because they report the results of qualitative studies.

In psychosocial research, ‘quantitative’ research methods are appropriate when ‘factual’ data are required to answer the research question; when general or probability information is sought on opinions, attitudes, views, beliefs or preferences; when variables can be isolated and defined; when variables can be linked to form hypotheses before data collection; and when the question or problem is known, clear and unambiguous. Quantitative methods can reveal, for example, what percentage of the population supports assisted conception, their distribution by age, marital status, residential area and so on, as well as changes from one survey to the next ( Kovacs et al. , 2012 ); the number of donors and donor siblings located by parents of donor-conceived children ( Freeman et al. , 2009 ); and the relationship between the attitude of donor-conceived people to learning of their donor insemination conception and their family ‘type’ (one or two parents, lesbian or heterosexual parents; Beeson et al. , 2011 ).

In contrast, ‘qualitative’ methods are used to answer questions about experience, meaning and perspective, most often from the standpoint of the participant. These data are usually not amenable to counting or measuring. Qualitative research techniques include ‘small-group discussions’ for investigating beliefs, attitudes and concepts of normative behaviour; ‘semi-structured interviews’, to seek views on a focused topic or, with key informants, for background information or an institutional perspective; ‘in-depth interviews’ to understand a condition, experience, or event from a personal perspective; and ‘analysis of texts and documents’, such as government reports, media articles, websites or diaries, to learn about distributed or private knowledge.

Qualitative methods have been used to reveal, for example, potential problems in implementing a proposed trial of elective single embryo transfer, where small-group discussions enabled staff to explain their own resistance, leading to an amended approach ( Porter and Bhattacharya, 2005 ). Small-group discussions among assisted reproductive technology (ART) counsellors were used to investigate how the welfare principle is interpreted and practised by health professionals who must apply it in ART ( de Lacey et al. , 2015 ). When legislative change meant that gamete donors could seek identifying details of people conceived from their gametes, parents needed advice on how best to tell their children. Small-group discussions were convened to ask adolescents (not known to be donor-conceived) to reflect on how they would prefer to be told ( Kirkman et al. , 2007 ).

When a population cannot be identified, such as anonymous sperm donors from the 1980s, a qualitative approach with wide publicity can reach people who do not usually volunteer for research and reveal (for example) their attitudes to proposed legislation to remove anonymity with retrospective effect ( Hammarberg et al. , 2014 ). When researchers invite people to talk about their reflections on experience, they can sometimes learn more than they set out to discover. In describing their responses to proposed legislative change, participants also talked about people conceived as a result of their donations, demonstrating various constructions and expectations of relationships ( Kirkman et al. , 2014 ).

Interviews with parents in lesbian-parented families generated insight into the diverse meanings of the sperm donor in the creation and life of the family ( Wyverkens et al. , 2014 ). Oral and written interviews also revealed the embarrassment and ambivalence surrounding sperm donors evident in participants in donor-assisted conception ( Kirkman, 2004 ). The way in which parents conceptualise unused embryos and why they discard rather than donate was explored and understood via in-depth interviews, showing how and why the meaning of those embryos changed with parenthood ( de Lacey, 2005 ). In-depth interviews were also used to establish the intricate understanding by embryo donors and recipients of the meaning of embryo donation and the families built as a result ( Goedeke et al. , 2015 ).

It is possible to combine quantitative and qualitative methods, although great care should be taken to ensure that the theory behind each method is compatible and that the methods are being used for appropriate reasons. The two methods can be used sequentially (first a quantitative then a qualitative study or vice versa), where the first approach is used to facilitate the design of the second; they can be used in parallel as different approaches to the same question; or a dominant method may be enriched with a small component of an alternative method (such as qualitative interviews ‘nested’ in a large survey). It is important to note that free text in surveys represents qualitative data but does not constitute qualitative research. Qualitative and quantitative methods may be used together for corroboration (hoping for similar outcomes from both methods), elaboration (using qualitative data to explain or interpret quantitative data, or to demonstrate how the quantitative findings apply in particular cases), complementarity (where the qualitative and quantitative results differ but generate complementary insights) or contradiction (where qualitative and quantitative data lead to different conclusions). Each has its advantages and challenges ( Brannen, 2005 ).

Qualitative research is gaining increased momentum in the clinical setting and carries different criteria for evaluating its rigour or quality. Quantitative studies generally involve the systematic collection of data about a phenomenon, using standardized measures and statistical analysis. In contrast, qualitative studies involve the systematic collection, organization, description and interpretation of textual, verbal or visual data. The particular approach taken determines to a certain extent the criteria used for judging the quality of the report. However, research using qualitative methods can be evaluated ( Dixon-Woods et al. , 2006 ; Young et al. , 2014 ) and there are some generic guidelines for assessing qualitative research ( Kitto et al. , 2008 ).

Although the terms ‘reliability’ and ‘validity’ are contentious among qualitative researchers ( Lincoln and Guba, 1985 ) with some preferring ‘verification’, research integrity and robustness are as important in qualitative studies as they are in other forms of research. It is widely accepted that qualitative research should be ethical, important, intelligibly described, and use appropriate and rigorous methods ( Cohen and Crabtree, 2008 ). In research investigating data that can be counted or measured, replicability is essential. When other kinds of data are gathered in order to answer questions of personal or social meaning, we need to be able to capture real-life experiences, which cannot be identical from one person to the next. Furthermore, meaning is culturally determined and subject to evolutionary change. The way of explaining a phenomenon—such as what it means to use donated gametes—will vary, for example, according to the cultural significance of ‘blood’ or genes, interpretations of marital infidelity and religious constructs of sexual relationships and families. Culture may apply to a country, a community, or other actual or virtual group, and a person may be engaged at various levels of culture. In identifying meaning for members of a particular group, consistency may indeed be found from one research project to another. However, individuals within a cultural group may present different experiences and perceptions or transgress cultural expectations. That does not make them ‘wrong’ or invalidate the research. Rather, it offers insight into diversity and adds a piece to the puzzle to which other researchers also contribute.

In qualitative research the objective stance is obsolete, the researcher is the instrument, and ‘subjects’ become ‘participants’ who may contribute to data interpretation and analysis ( Denzin and Lincoln, 1998 ). Qualitative researchers defend the integrity of their work by different means: trustworthiness, credibility, applicability and consistency are the evaluative criteria ( Leininger, 1994 ).

Trustworthiness

A report of a qualitative study should contain the same robust procedural description as any other study. The purpose of the research, how it was conducted, procedural decisions, and details of data generation and management should be transparent and explicit. A reviewer should be able to follow the progression of events and decisions and understand their logic because there is adequate description, explanation and justification of the methodology and methods ( Kitto et al. , 2008 )

Credibility

Credibility is the criterion for evaluating the truth value or internal validity of qualitative research. A qualitative study is credible when its results, presented with adequate descriptions of context, are recognizable to people who share the experience and those who care for or treat them. As the instrument in qualitative research, the researcher defends its credibility through practices such as reflexivity (reflection on the influence of the researcher on the research), triangulation (where appropriate, answering the research question in several ways, such as through interviews, observation and documentary analysis) and substantial description of the interpretation process; verbatim quotations from the data are supplied to illustrate and support their interpretations ( Sandelowski, 1986 ). Where excerpts of data and interpretations are incongruent, the credibility of the study is in doubt.

Applicability

Applicability, or transferability of the research findings, is the criterion for evaluating external validity. A study is considered to meet the criterion of applicability when its findings can fit into contexts outside the study situation and when clinicians and researchers view the findings as meaningful and applicable in their own experiences.

Larger sample sizes do not produce greater applicability. Depth may be sacrificed to breadth or there may be too much data for adequate analysis. Sample sizes in qualitative research are typically small. The term ‘saturation’ is often used in reference to decisions about sample size in research using qualitative methods. Emerging from grounded theory, where filling theoretical categories is considered essential to the robustness of the developing theory, data saturation has been expanded to describe a situation where data tend towards repetition or where data cease to offer new directions and raise new questions ( Charmaz, 2005 ). However, the legitimacy of saturation as a generic marker of sampling adequacy has been questioned ( O'Reilly and Parker, 2013 ). Caution must be exercised to ensure that a commitment to saturation does not assume an ‘essence’ of an experience in which limited diversity is anticipated; each account is likely to be subtly different and each ‘sample’ will contribute to knowledge without telling the whole story. Increasingly, it is expected that researchers will report the kind of saturation they have applied and their criteria for recognising its achievement; an assessor will need to judge whether the choice is appropriate and consistent with the theoretical context within which the research has been conducted.

Sampling strategies are usually purposive, convenient, theoretical or snowballed. Maximum variation sampling may be used to seek representation of diverse perspectives on the topic. Homogeneous sampling may be used to recruit a group of participants with specified criteria. The threat of bias is irrelevant; participants are recruited and selected specifically because they can illuminate the phenomenon being studied. Rather than being predetermined by statistical power analysis, qualitative study samples are dependent on the nature of the data, the availability of participants and where those data take the investigator. Multiple data collections may also take place to obtain maximum insight into sensitive topics. For instance, the question of how decisions are made for embryo disposition may involve sampling within the patient group as well as from scientists, clinicians, counsellors and clinic administrators.

Consistency

Consistency, or dependability of the results, is the criterion for assessing reliability. This does not mean that the same result would necessarily be found in other contexts but that, given the same data, other researchers would find similar patterns. Researchers often seek maximum variation in the experience of a phenomenon, not only to illuminate it but also to discourage fulfilment of limited researcher expectations (for example, negative cases or instances that do not fit the emerging interpretation or theory should be actively sought and explored). Qualitative researchers sometimes describe the processes by which verification of the theoretical findings by another team member takes place ( Morse and Richards, 2002 ).

Research that uses qualitative methods is not, as it seems sometimes to be represented, the easy option, nor is it a collation of anecdotes. It usually involves a complex theoretical or philosophical framework. Rigorous analysis is conducted without the aid of straightforward mathematical rules. Researchers must demonstrate the validity of their analysis and conclusions, resulting in longer papers and occasional frustration with the word limits of appropriate journals. Nevertheless, we need the different kinds of evidence that is generated by qualitative methods. The experience of health, illness and medical intervention cannot always be counted and measured; researchers need to understand what they mean to individuals and groups. Knowledge gained from qualitative research methods can inform clinical practice, indicate how to support people living with chronic conditions and contribute to community education and awareness about people who are (for example) experiencing infertility or using assisted conception.

Each author drafted a section of the manuscript and the manuscript as a whole was reviewed and revised by all authors in consultation.

No external funding was either sought or obtained for this study.

The authors have no conflicts of interest to declare.

Beeson D , Jennings P , Kramer W . Offspring searching for their sperm donors: how family types shape the process . Hum Reprod 2011 ; 26 : 2415 – 2424 .

Google Scholar

Brannen J . Mixing methods: the entry of qualitative and quantitative approaches into the research process . Int J Soc Res Methodol 2005 ; 8 : 173 – 184 .

Charmaz K . Grounded Theory in the 21st century; applications for advancing social justice studies . In: Denzin NK , Lincoln YS (eds). The Sage Handbook of Qualitative Research . California : Sage Publications Inc. , 2005 .

Google Preview

Cohen D , Crabtree B . Evaluative criteria for qualitative research in health care: controversies and recommendations . Ann Fam Med 2008 ; 6 : 331 – 339 .

de Lacey S . Parent identity and ‘virtual’ children: why patients discard rather than donate unused embryos . Hum Reprod 2005 ; 20 : 1661 – 1669 .

de Lacey SL , Peterson K , McMillan J . Child interests in assisted reproductive technology: how is the welfare principle applied in practice? Hum Reprod 2015 ; 30 : 616 – 624 .

Denzin N , Lincoln Y . Entering the field of qualitative research . In: Denzin NK , Lincoln YS (eds). The Landscape of Qualitative Research: Theories and Issues . Thousand Oaks : Sage , 1998 , 1 – 34 .

Dixon-Woods M , Bonas S , Booth A , Jones DR , Miller T , Shaw RL , Smith JA , Young B . How can systematic reviews incorporate qualitative research? A critical perspective . Qual Res 2006 ; 6 : 27 – 44 .

ESHRE Psychology and Counselling Guideline Development Group . Routine Psychosocial Care in Infertility and Medically Assisted Reproduction: A Guide for Fertility Staff , 2015 . http://www.eshre.eu/Guidelines-and-Legal/Guidelines/Psychosocial-care-guideline.aspx .

Freeman T , Jadva V , Kramer W , Golombok S . Gamete donation: parents' experiences of searching for their child's donor siblings or donor . Hum Reprod 2009 ; 24 : 505 – 516 .

Goedeke S , Daniels K , Thorpe M , Du Preez E . Building extended families through embryo donation: the experiences of donors and recipients . Hum Reprod 2015 ; 30 : 2340 – 2350 .

Hammarberg K , Johnson L , Bourne K , Fisher J , Kirkman M . Proposed legislative change mandating retrospective release of identifying information: consultation with donors and Government response . Hum Reprod 2014 ; 29 : 286 – 292 .

Kirkman M . Saviours and satyrs: ambivalence in narrative meanings of sperm provision . Cult Health Sex 2004 ; 6 : 319 – 336 .

Kirkman M , Rosenthal D , Johnson L . Families working it out: adolescents' views on communicating about donor-assisted conception . Hum Reprod 2007 ; 22 : 2318 – 2324 .

Kirkman M , Bourne K , Fisher J , Johnson L , Hammarberg K . Gamete donors' expectations and experiences of contact with their donor offspring . Hum Reprod 2014 ; 29 : 731 – 738 .

Kitto S , Chesters J , Grbich C . Quality in qualitative research . Med J Aust 2008 ; 188 : 243 – 246 .

Kovacs GT , Morgan G , Levine M , McCrann J . The Australian community overwhelmingly approves IVF to treat subfertility, with increasing support over three decades . Aust N Z J Obstetr Gynaecol 2012 ; 52 : 302 – 304 .

Leininger M . Evaluation criteria and critique of qualitative research studies . In: Morse J (ed). Critical Issues in Qualitative Research Methods . Thousand Oaks : Sage , 1994 , 95 – 115 .

Lincoln YS , Guba EG . Naturalistic Inquiry . Newbury Park, CA : Sage Publications , 1985 .

Morse J , Richards L . Readme First for a Users Guide to Qualitative Methods . Thousand Oaks : Sage , 2002 .

O'Reilly M , Parker N . ‘Unsatisfactory saturation’: a critical exploration of the notion of saturated sample sizes in qualitative research . Qual Res 2013 ; 13 : 190 – 197 .

Porter M , Bhattacharya S . Investigation of staff and patients' opinions of a proposed trial of elective single embryo transfer . Hum Reprod 2005 ; 20 : 2523 – 2530 .

Sandelowski M . The problem of rigor in qualitative research . Adv Nurs Sci 1986 ; 8 : 27 – 37 .

Wyverkens E , Provoost V , Ravelingien A , De Sutter P , Pennings G , Buysse A . Beyond sperm cells: a qualitative study on constructed meanings of the sperm donor in lesbian families . Hum Reprod 2014 ; 29 : 1248 – 1254 .

Young K , Fisher J , Kirkman M . Women's experiences of endometriosis: a systematic review of qualitative research . J Fam Plann Reprod Health Care 2014 ; 41 : 225 – 234 .

• conflict of interest
• credibility
• qualitative research
• quantitative methods

Email alerts

Citing articles via.

• Recommend to your Library

Affiliations

• Online ISSN 1460-2350
• Copyright © 2024 European Society of Human Reproduction and Embryology
• About Oxford Academic
• Publish journals with us
• University press partners
• What we publish
• New features  
• Open access
• Institutional account management
• Rights and permissions
• Get help with access
• Accessibility
• Media enquiries
• Oxford University Press
• Oxford Languages
• University of Oxford

Oxford University Press is a department of the University of Oxford. It furthers the University's objective of excellence in research, scholarship, and education by publishing worldwide

• Copyright © 2024 Oxford University Press
• Cookie settings
• Cookie policy
• Privacy policy
• Legal notice

This Feature Is Available To Subscribers Only

Sign In or Create an Account

This PDF is available to Subscribers Only

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Have a language expert improve your writing

Run a free plagiarism check in 10 minutes, generate accurate citations for free.

• Knowledge Base

Methodology

• What Is Qualitative Research? | Methods & Examples

What Is Qualitative Research? | Methods & Examples

Published on June 19, 2020 by Pritha Bhandari . Revised on June 22, 2023.

Qualitative research involves collecting and analyzing non-numerical data (e.g., text, video, or audio) to understand concepts, opinions, or experiences. It can be used to gather in-depth insights into a problem or generate new ideas for research.

Qualitative research is the opposite of quantitative research , which involves collecting and analyzing numerical data for statistical analysis.

Qualitative research is commonly used in the humanities and social sciences, in subjects such as anthropology, sociology, education, health sciences, history, etc.

• How does social media shape body image in teenagers?
• How do children and adults interpret healthy eating in the UK?
• What factors influence employee retention in a large organization?
• How is anxiety experienced around the world?
• How can teachers integrate social issues into science curriculums?

Table of contents

Approaches to qualitative research, qualitative research methods, qualitative data analysis, advantages of qualitative research, disadvantages of qualitative research, other interesting articles, frequently asked questions about qualitative research.

Qualitative research is used to understand how people experience the world. While there are many approaches to qualitative research, they tend to be flexible and focus on retaining rich meaning when interpreting data.

Common approaches include grounded theory, ethnography , action research , phenomenological research, and narrative research. They share some similarities, but emphasize different aims and perspectives.

Note that qualitative research is at risk for certain research biases including the Hawthorne effect , observer bias , recall bias , and social desirability bias . While not always totally avoidable, awareness of potential biases as you collect and analyze your data can prevent them from impacting your work too much.

Receive feedback on language, structure, and formatting

Professional editors proofread and edit your paper by focusing on:

• Academic style
• Vague sentences
• Style consistency

See an example

Each of the research approaches involve using one or more data collection methods . These are some of the most common qualitative methods:

• Observations: recording what you have seen, heard, or encountered in detailed field notes.
• Interviews:  personally asking people questions in one-on-one conversations.
• Focus groups: asking questions and generating discussion among a group of people.
• Surveys : distributing questionnaires with open-ended questions.
• Secondary research: collecting existing data in the form of texts, images, audio or video recordings, etc.
• You take field notes with observations and reflect on your own experiences of the company culture.
• You distribute open-ended surveys to employees across all the company’s offices by email to find out if the culture varies across locations.
• You conduct in-depth interviews with employees in your office to learn about their experiences and perspectives in greater detail.

Qualitative researchers often consider themselves “instruments” in research because all observations, interpretations and analyses are filtered through their own personal lens.

For this reason, when writing up your methodology for qualitative research, it’s important to reflect on your approach and to thoroughly explain the choices you made in collecting and analyzing the data.

Qualitative data can take the form of texts, photos, videos and audio. For example, you might be working with interview transcripts, survey responses, fieldnotes, or recordings from natural settings.

Most types of qualitative data analysis share the same five steps:

• Prepare and organize your data. This may mean transcribing interviews or typing up fieldnotes.
• Review and explore your data. Examine the data for patterns or repeated ideas that emerge.
• Develop a data coding system. Based on your initial ideas, establish a set of codes that you can apply to categorize your data.
• Assign codes to the data. For example, in qualitative survey analysis, this may mean going through each participant’s responses and tagging them with codes in a spreadsheet. As you go through your data, you can create new codes to add to your system if necessary.
• Identify recurring themes. Link codes together into cohesive, overarching themes.

There are several specific approaches to analyzing qualitative data. Although these methods share similar processes, they emphasize different concepts.

Qualitative research often tries to preserve the voice and perspective of participants and can be adjusted as new research questions arise. Qualitative research is good for:

• Flexibility

The data collection and analysis process can be adapted as new ideas or patterns emerge. They are not rigidly decided beforehand.

• Natural settings

Data collection occurs in real-world contexts or in naturalistic ways.

• Meaningful insights

Detailed descriptions of people’s experiences, feelings and perceptions can be used in designing, testing or improving systems or products.

• Generation of new ideas

Open-ended responses mean that researchers can uncover novel problems or opportunities that they wouldn’t have thought of otherwise.

Researchers must consider practical and theoretical limitations in analyzing and interpreting their data. Qualitative research suffers from:

• Unreliability

The real-world setting often makes qualitative research unreliable because of uncontrolled factors that affect the data.

• Subjectivity

Due to the researcher’s primary role in analyzing and interpreting data, qualitative research cannot be replicated . The researcher decides what is important and what is irrelevant in data analysis, so interpretations of the same data can vary greatly.

• Limited generalizability

Small samples are often used to gather detailed data about specific contexts. Despite rigorous analysis procedures, it is difficult to draw generalizable conclusions because the data may be biased and unrepresentative of the wider population .

• Labor-intensive

Although software can be used to manage and record large amounts of text, data analysis often has to be checked or performed manually.

If you want to know more about statistics , methodology , or research bias , make sure to check out some of our other articles with explanations and examples.

• Chi square goodness of fit test
• Degrees of freedom
• Null hypothesis
• Discourse analysis
• Control groups
• Mixed methods research
• Non-probability sampling
• Quantitative research
• Inclusion and exclusion criteria

Research bias

• Rosenthal effect
• Implicit bias
• Cognitive bias
• Selection bias
• Negativity bias
• Status quo bias

Quantitative research deals with numbers and statistics, while qualitative research deals with words and meanings.

Quantitative methods allow you to systematically measure variables and test hypotheses . Qualitative methods allow you to explore concepts and experiences in more detail.

There are five common approaches to qualitative research :

• Grounded theory involves collecting data in order to develop new theories.
• Ethnography involves immersing yourself in a group or organization to understand its culture.
• Narrative research involves interpreting stories to understand how people make sense of their experiences and perceptions.
• Phenomenological research involves investigating phenomena through people’s lived experiences.
• Action research links theory and practice in several cycles to drive innovative changes.

Data collection is the systematic process by which observations or measurements are gathered in research. It is used in many different contexts by academics, governments, businesses, and other organizations.

There are various approaches to qualitative data analysis , but they all share five steps in common:

• Prepare and organize your data.
• Review and explore your data.
• Develop a data coding system.
• Assign codes to the data.
• Identify recurring themes.

The specifics of each step depend on the focus of the analysis. Some common approaches include textual analysis , thematic analysis , and discourse analysis .

Cite this Scribbr article

If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.

Bhandari, P. (2023, June 22). What Is Qualitative Research? | Methods & Examples. Scribbr. Retrieved March 31, 2024, from https://www.scribbr.com/methodology/qualitative-research/

Is this article helpful?

Pritha Bhandari

Other students also liked, qualitative vs. quantitative research | differences, examples & methods, how to do thematic analysis | step-by-step guide & examples, what is your plagiarism score.

About Journal

American Journal of Qualitative Research (AJQR)  is a quarterly peer-reviewed academic journal that publishes qualitative research articles from a number of social science disciplines such as psychology, health science, sociology, criminology, education, political science, and administrative studies. The journal is an international and interdisciplinary focus and greatly welcomes papers from all countries. The journal offers an intellectual platform for researchers, practitioners, administrators, and policymakers to contribute and promote qualitative research and analysis.

ISSN: 2576-2141

Call for Papers- American Journal of Qualitative Research

American Journal of Qualitative Research (AJQR) welcomes original research articles and book reviews for its next issue. The AJQR is a quarterly and peer-reviewed journal published in February, May, August, and November.

We are seeking submissions for a forthcoming issue published in February 2024. The paper should be written in professional English. The length of 6000-10000 words is preferred. All manuscripts should be prepared in MS Word format and submitted online: https://www.editorialpark.com/ajqr

For any further information about the journal, please visit its website: https://www.ajqr.org

Submission Deadline: November 15, 2023

Announcement 

Dear AJQR Readers, 

Due to the high volume of submissions in the American Journal of Qualitative Research , the editorial board decided to publish quarterly since 2023.

Volume 8, Issue 1

Current issue.

Social distancing requirements resulted in many people working from home in the United Kingdom during the COVID-19 pandemic. The topic of working from home was often discussed in the media and online during the pandemic, but little was known about how quality of life (QOL) and remote working interfaced. The purpose of this study was to describe QOL while working from home during the COVID-19 pandemic. The novel topic, unique methodological approach of the General Online Qualitative Study ( D’Abundo & Franco, 2022a), and the strategic Social Distancing Sampling ( D’Abundo & Franco, 2022c) resulted in significant participation throughout the world (n = 709). The United Kingdom subset of participants (n = 234) is the focus of this article. This big qual, large qualitative study (n >100) included the principal investigator-developed, open-ended, online questionnaire entitled the “Quality of Life Home Workplace Questionnaire (QOLHWQ)” and demographic questions. Data were collected peak-pandemic from July to September 2020. Most participants cited increased QOL due to having more time with family/kids/partners/pets, a more comfortable work environment while being at home, and less commuting to work. The most cited issue associated with negative QOL was social isolation. As restrictions have been lifted and public health emergency declarations have been terminated during the post-peak era of the COVID-19 pandemic, the potential for future public health emergencies requiring social distancing still exists. To promote QOL and work-life balance for employees working remotely in the United Kingdom, stakeholders could develop social support networks and create effective planning initiatives to prevent social isolation and maximize the benefits of remote working experiences for both employees and organizations.

Keywords: qualitative research, quality of life, remote work, telework, United Kingdom, work from home.

(no abstract)

This essay reviews classic works on the philosophy of science and contemporary pedagogical guides to scientific inquiry in order to present a discussion of the three logics that underlie qualitative research in political science. The first logic, epistemology, relates to the essence of research as a scientific endeavor and is framed as a debate between positivist and interpretivist orientations within the discipline of political science. The second logic, ontology, relates to the approach that research takes to investigating the empirical world and is framed as a debate between positivist qualitative and quantitative orientations, which together constitute the vast majority of mainstream researchers within the discipline. The third logic, methodology, relates to the means by which research aspires to reach its scientific ends and is framed as a debate among positivist qualitative orientations. Additionally, the essay discusses the present state of qualitative research in the discipline of political science, reviews the various ways in which qualitative research is defined in the relevant literature, addresses the limitations and trade-offs that are inherently associated with the aforementioned logics of qualitative research, explores multimethod approaches to remedying these issues, and proposes avenues for acquiring further information on the topics discussed.

Keywords: qualitative research, epistemology, ontology, methodology

This paper examines the phenomenology of diagnostic crossover in eating disorders, the movement within or between feeding and eating disorder subtypes or diagnoses over time, in two young women who experienced multiple changes in eating disorder diagnosis over 5 years. Using interpretative phenomenological analysis, this study found that transitioning between different diagnostic labels, specifically between bulimia nervosa and anorexia nervosa binge/purge subtype, was experienced as disempowering, stigmatizing, and unhelpful. The findings in this study offer novel evidence that, from the perspective of individuals diagnosed with EDs, using BMI as an indicator of the presence, severity, or change of an ED may have adverse consequences for well-being and recovery and may lead to mischaracterization or misclassification of health status. The narratives discussed in this paper highlight the need for more person-centered practices in the context of diagnostic crossover. Including the perspectives of those with lived experience can help care providers working with individuals with eating disorders gain an in-depth understanding of the potential personal impact of diagnosis changing and inform discussions around developing person-focused diagnostic practices.

Keywords: feeding and eating disorders, bulimia nervosa, diagnostic labels, diagnostic crossover, illness narrative

Often among the first witnesses to child trauma, educators and therapists are on the frontline of an unfolding and multi-pronged occupational crisis. For educators, lack of support and secondary traumatic stress (STS) appear to be contributing to an epidemic in professional attrition. Similarly, therapists who do not prioritize self-care can feel depleted of energy and optimism. The purpose of this phenomenological study was to examine how bearing witness to the traumatic narratives of children impacts similar helping professionals. The study also sought to extrapolate the similarities and differences between compassion fatigue and secondary trauma across these two disciplines. Exploring the common factors and subjective individual experiences related to occupational stress across these two fields may foster a more complete picture of the delicate nature of working with traumatized children and the importance of successful self-care strategies. Utilizing Constructivist Self-Development Theory (CSDT) and focus group interviews, the study explores the significant risk of STS facing both educators and therapists.

Keywords: qualitative, secondary traumatic stress, self-care, child trauma, educators, therapists.

This study explored the lived experiences of residents of the Gulf Coast in the USA during Hurricane Katrina, which made landfall in August 2005 and caused insurmountable destruction throughout the area. A heuristic process and thematic analysis were employed to draw observations and conclusions about the lived experiences of each participant and make meaning through similar thoughts, feelings, and themes that emerged in the analysis of the data. Six themes emerged: (1) fear, (2) loss, (3) anger, (4) support, (5) spirituality, and (6) resilience. The results of this study allude to the possible psychological outcomes as a result of experiencing a traumatic event and provide an outline of what the psychological experience of trauma might entail. The current research suggests that preparedness and expectation are key to resilience and that people who feel that they have power over their situation fare better than those who do not.

Keywords: mass trauma, resilience, loss, natural disaster, mental health.

Women from rural, low-income backgrounds holding positions within the academy are the exception and not the rule. Most women faculty in the academy are from urban/suburban areas and middle- and upper-income family backgrounds. As women faculty who do not represent this norm, our primary goal with this article is to focus on the unique barriers we experienced as girls from rural, low-income areas in K-12 schools that influenced the possibilities for successfully transitioning to and engaging with higher education. We employed a qualitative duoethnographic and narrative research design to respond to the research questions, and we generated our data through semi-structured, critical, ethnographic dialogic conversations. Our duoethnographic-narrative analyses revealed six major themes: (1) independence and other   benefits of having a working-class mom; (2) crashing into middle-class norms and expectations; (3) lucking and falling into college; (4) fish out of water; (5) overcompensating, playing middle class, walking on eggshells, and pushing back; and (6) transitioning from a working-class kid to a working class academic, which we discuss in relation to our own educational attainment.

Keywords: rurality, working-class, educational attainment, duoethnography, higher education, women.

This article draws on the findings of a qualitative study that focused on the perspectives of four Indian American mothers of youth with developmental disabilities on the process of transitioning from school to post-school environments. Data were collected through in-depth ethnographic interviews. The findings indicate that in their efforts to support their youth with developmental disabilities, the mothers themselves navigate multiple transitions across countries, constructs, dreams, systems of schooling, and services. The mothers’ perspectives have to be understood against the larger context of their experiences as citizens of this country as well as members of the South Asian diaspora. The mothers’ views on services, their journey, their dreams for their youth, and their interpretation of the ideas anchored in current conversations on transition are continually evolving. Their attempts to maintain their resilience and their indigenous understandings while simultaneously negotiating their experiences in the United States with supporting their youth are discussed.  

Keywords: Indian-American mothers, transitioning, diaspora, disability, dreams.

This study explored the influence of yoga on practitioners’ lives ‘off the mat’ through a phenomenological lens. Central to the study was the lived experience of yoga in a purposive sample of self-identified New Zealand practitioners (n=38; 89.5% female; aged 18 to 65 years; 60.5% aged 36 to 55 years). The study’s aim was to explore whether habitual yoga practitioners experience any pro-health downstream effects of their practice ‘off the mat’ via their lived experience of yoga. A qualitative mixed methodology was applied via a phenomenological lens that explicitly acknowledged the researcher’s own experience of the research topic. Qualitative methods comprised an open-ended online survey for all participants (n=38), followed by in-depth semi-structured interviews (n=8) on a randomized subset. Quantitative methods included online outcome measures (health habits, self-efficacy, interoceptive awareness, and physical activity), practice component data (tenure, dose, yoga styles, yoga teacher status, meditation frequency), and socio-demographics. This paper highlights the qualitative findings emerging from participant narratives. Reported benefits of practice included the provision of a filter through which to engage with life and the experience of self-regulation and mindfulness ‘off the mat’. Practitioners experienced yoga as a self-sustaining positive resource via self-regulation guided by an embodied awareness. The key narrative to emerge was an attunement to embodiment through movement. Embodied movement can elicit self-regulatory pathways that support health behavior.

Keywords: embodiment, habit, interoception, mindfulness, movement practice, qualitative, self-regulation, yoga.

Historically and in the present day, Black women’s positionality in the U.S. has paradoxically situated them in a society where they are both intrinsically essential and treated as expendable. This positionality, known as gendered racism, manifests commonly in professional environments and results in myriad harms. In response, Black women have developed, honed, and practiced a range of coping styles to mitigate the insidious effects of gendered racism. While often effective in the short-term, these techniques frequently complicate Black women’s well-being. For Black female clinicians who experience gendered racism and work on the frontlines of community mental health, myriad bio-psycho-social-spiritual harms compound. This project provided an opportunity for Black female clinicians from across the U.S. to share their experiences during the dual pandemics of COVID-19 and anti-Black violence. I conducted in-depth interviews with clinicians (n=14) between the ages of 30 and 58. Using the Listening Guide voice-centered approach to data generation and analysis, I identified four voices to help answer this project’s central question: How do you experience being a Black female clinician in the U.S.? The voices of self, pride, vigilance, and mediating narrated the complex ways participants experienced their workplaces. This complexity seemed to be context-specific, depending on whether the clinicians worked in predominantly White workplaces (PWW), a mix of PWW and private practice, or private practice exclusively. Participants who worked only in PWW experienced the greatest stress, oppression, and burnout risk, while participants who worked exclusively in private practice reported more joy, more authenticity, and more job satisfaction. These findings have implications for mentoring, supporting, and retaining Black female clinicians.

Keywords: Black female clinicians, professional experiences, gendered racism, Listening Guide voice-centered approach.

The purpose of this article is to speak directly to the paucity of research regarding Dominican American women and identity narratives. To do so, this article uses the Listening Guide Method of Qualitative Inquiry (Gilligan, et al., 2006) to explore how 1.5 and second-generation Dominican American women narrated their experiences of individual identity within American cultural contexts and constructs. The results draw from the emergence of themes across six participant interviews and showed two distinct voices: The Voice of Cultural Explanation and the Tides of Dominican American Female Identity. Narrative examples from five participants are offered to illustrate where 1.5 and second-generation Dominican American women negotiate their identity narratives at the intersection of their Dominican and American selves. The article offers two conclusions. One, that participant women use the Voice of Cultural Explanation in order to discuss their identity as reflected within the broad cultural tensions of their daily lives. Two, that the Tides of Dominican American Female Identity are used to express strong emotions that manifest within their personal narratives as the unwanted distance from either the Dominican or American parts of their person.

Keywords: Dominican American, women, identity, the Listening Guide, narratives

An official website of the United States government

The .gov means it's official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you're on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings
• Browse Titles

NCBI Bookshelf. A service of the National Library of Medicine, National Institutes of Health.

StatPearls [Internet]. Treasure Island (FL): StatPearls Publishing; 2024 Jan-.

StatPearls [Internet].

Qualitative study.

Steven Tenny ; Janelle M. Brannan ; Grace D. Brannan .

Affiliations

Last Update: September 18, 2022 .

• Introduction

Qualitative research is a type of research that explores and provides deeper insights into real-world problems. [1] Instead of collecting numerical data points or intervene or introduce treatments just like in quantitative research, qualitative research helps generate hypotheses as well as further investigate and understand quantitative data. Qualitative research gathers participants' experiences, perceptions, and behavior. It answers the hows and whys instead of how many or how much. It could be structured as a stand-alone study, purely relying on qualitative data or it could be part of mixed-methods research that combines qualitative and quantitative data. This review introduces the readers to some basic concepts, definitions, terminology, and application of qualitative research.

Qualitative research at its core, ask open-ended questions whose answers are not easily put into numbers such as ‘how’ and ‘why’. [2] Due to the open-ended nature of the research questions at hand, qualitative research design is often not linear in the same way quantitative design is. [2] One of the strengths of qualitative research is its ability to explain processes and patterns of human behavior that can be difficult to quantify. [3] Phenomena such as experiences, attitudes, and behaviors can be difficult to accurately capture quantitatively, whereas a qualitative approach allows participants themselves to explain how, why, or what they were thinking, feeling, and experiencing at a certain time or during an event of interest. Quantifying qualitative data certainly is possible, but at its core, qualitative data is looking for themes and patterns that can be difficult to quantify and it is important to ensure that the context and narrative of qualitative work are not lost by trying to quantify something that is not meant to be quantified.

However, while qualitative research is sometimes placed in opposition to quantitative research, where they are necessarily opposites and therefore ‘compete’ against each other and the philosophical paradigms associated with each, qualitative and quantitative work are not necessarily opposites nor are they incompatible. [4] While qualitative and quantitative approaches are different, they are not necessarily opposites, and they are certainly not mutually exclusive. For instance, qualitative research can help expand and deepen understanding of data or results obtained from quantitative analysis. For example, say a quantitative analysis has determined that there is a correlation between length of stay and level of patient satisfaction, but why does this correlation exist? This dual-focus scenario shows one way in which qualitative and quantitative research could be integrated together.

Examples of Qualitative Research Approaches

Ethnography

Ethnography as a research design has its origins in social and cultural anthropology, and involves the researcher being directly immersed in the participant’s environment. [2] Through this immersion, the ethnographer can use a variety of data collection techniques with the aim of being able to produce a comprehensive account of the social phenomena that occurred during the research period. [2] That is to say, the researcher’s aim with ethnography is to immerse themselves into the research population and come out of it with accounts of actions, behaviors, events, etc. through the eyes of someone involved in the population. Direct involvement of the researcher with the target population is one benefit of ethnographic research because it can then be possible to find data that is otherwise very difficult to extract and record.

Grounded Theory

Grounded Theory is the “generation of a theoretical model through the experience of observing a study population and developing a comparative analysis of their speech and behavior.” [5] As opposed to quantitative research which is deductive and tests or verifies an existing theory, grounded theory research is inductive and therefore lends itself to research that is aiming to study social interactions or experiences. [3] [2] In essence, Grounded Theory’s goal is to explain for example how and why an event occurs or how and why people might behave a certain way. Through observing the population, a researcher using the Grounded Theory approach can then develop a theory to explain the phenomena of interest.

Phenomenology

Phenomenology is defined as the “study of the meaning of phenomena or the study of the particular”. [5] At first glance, it might seem that Grounded Theory and Phenomenology are quite similar, but upon careful examination, the differences can be seen. At its core, phenomenology looks to investigate experiences from the perspective of the individual. [2] Phenomenology is essentially looking into the ‘lived experiences’ of the participants and aims to examine how and why participants behaved a certain way, from their perspective . Herein lies one of the main differences between Grounded Theory and Phenomenology. Grounded Theory aims to develop a theory for social phenomena through an examination of various data sources whereas Phenomenology focuses on describing and explaining an event or phenomena from the perspective of those who have experienced it.

Narrative Research

One of qualitative research’s strengths lies in its ability to tell a story, often from the perspective of those directly involved in it. Reporting on qualitative research involves including details and descriptions of the setting involved and quotes from participants. This detail is called ‘thick’ or ‘rich’ description and is a strength of qualitative research. Narrative research is rife with the possibilities of ‘thick’ description as this approach weaves together a sequence of events, usually from just one or two individuals, in the hopes of creating a cohesive story, or narrative. [2] While it might seem like a waste of time to focus on such a specific, individual level, understanding one or two people’s narratives for an event or phenomenon can help to inform researchers about the influences that helped shape that narrative. The tension or conflict of differing narratives can be “opportunities for innovation”. [2]

Research Paradigm

Research paradigms are the assumptions, norms, and standards that underpin different approaches to research. Essentially, research paradigms are the ‘worldview’ that inform research. [4] It is valuable for researchers, both qualitative and quantitative, to understand what paradigm they are working within because understanding the theoretical basis of research paradigms allows researchers to understand the strengths and weaknesses of the approach being used and adjust accordingly. Different paradigms have different ontology and epistemologies . Ontology is defined as the "assumptions about the nature of reality” whereas epistemology is defined as the “assumptions about the nature of knowledge” that inform the work researchers do. [2] It is important to understand the ontological and epistemological foundations of the research paradigm researchers are working within to allow for a full understanding of the approach being used and the assumptions that underpin the approach as a whole. Further, it is crucial that researchers understand their own ontological and epistemological assumptions about the world in general because their assumptions about the world will necessarily impact how they interact with research. A discussion of the research paradigm is not complete without describing positivist, postpositivist, and constructivist philosophies.

Positivist vs Postpositivist

To further understand qualitative research, we need to discuss positivist and postpositivist frameworks. Positivism is a philosophy that the scientific method can and should be applied to social as well as natural sciences. [4] Essentially, positivist thinking insists that the social sciences should use natural science methods in its research which stems from positivist ontology that there is an objective reality that exists that is fully independent of our perception of the world as individuals. Quantitative research is rooted in positivist philosophy, which can be seen in the value it places on concepts such as causality, generalizability, and replicability.

Conversely, postpositivists argue that social reality can never be one hundred percent explained but it could be approximated. [4] Indeed, qualitative researchers have been insisting that there are “fundamental limits to the extent to which the methods and procedures of the natural sciences could be applied to the social world” and therefore postpositivist philosophy is often associated with qualitative research. [4] An example of positivist versus postpositivist values in research might be that positivist philosophies value hypothesis-testing, whereas postpositivist philosophies value the ability to formulate a substantive theory.

Constructivist

Constructivism is a subcategory of postpositivism. Most researchers invested in postpositivist research are constructivist as well, meaning they think there is no objective external reality that exists but rather that reality is constructed. Constructivism is a theoretical lens that emphasizes the dynamic nature of our world. “Constructivism contends that individuals’ views are directly influenced by their experiences, and it is these individual experiences and views that shape their perspective of reality”. [6] Essentially, Constructivist thought focuses on how ‘reality’ is not a fixed certainty and experiences, interactions, and backgrounds give people a unique view of the world. Constructivism contends, unlike in positivist views, that there is not necessarily an ‘objective’ reality we all experience. This is the ‘relativist’ ontological view that reality and the world we live in are dynamic and socially constructed. Therefore, qualitative scientific knowledge can be inductive as well as deductive.” [4]

So why is it important to understand the differences in assumptions that different philosophies and approaches to research have? Fundamentally, the assumptions underpinning the research tools a researcher selects provide an overall base for the assumptions the rest of the research will have and can even change the role of the researcher themselves. [2] For example, is the researcher an ‘objective’ observer such as in positivist quantitative work? Or is the researcher an active participant in the research itself, as in postpositivist qualitative work? Understanding the philosophical base of the research undertaken allows researchers to fully understand the implications of their work and their role within the research, as well as reflect on their own positionality and bias as it pertains to the research they are conducting.

Data Sampling 

The better the sample represents the intended study population, the more likely the researcher is to encompass the varying factors at play. The following are examples of participant sampling and selection: [7]

• Purposive sampling- selection based on the researcher’s rationale in terms of being the most informative.
• Criterion sampling-selection based on pre-identified factors.
• Convenience sampling- selection based on availability.
• Snowball sampling- the selection is by referral from other participants or people who know potential participants.
• Extreme case sampling- targeted selection of rare cases.
• Typical case sampling-selection based on regular or average participants. 

Data Collection and Analysis

Qualitative research uses several techniques including interviews, focus groups, and observation. [1] [2] [3] Interviews may be unstructured, with open-ended questions on a topic and the interviewer adapts to the responses. Structured interviews have a predetermined number of questions that every participant is asked. It is usually one on one and is appropriate for sensitive topics or topics needing an in-depth exploration. Focus groups are often held with 8-12 target participants and are used when group dynamics and collective views on a topic are desired. Researchers can be a participant-observer to share the experiences of the subject or a non-participant or detached observer.

While quantitative research design prescribes a controlled environment for data collection, qualitative data collection may be in a central location or in the environment of the participants, depending on the study goals and design. Qualitative research could amount to a large amount of data. Data is transcribed which may then be coded manually or with the use of Computer Assisted Qualitative Data Analysis Software or CAQDAS such as ATLAS.ti or NVivo. [8] [9] [10]

After the coding process, qualitative research results could be in various formats. It could be a synthesis and interpretation presented with excerpts from the data. [11] Results also could be in the form of themes and theory or model development.

Dissemination

To standardize and facilitate the dissemination of qualitative research outcomes, the healthcare team can use two reporting standards. The Consolidated Criteria for Reporting Qualitative Research or COREQ is a 32-item checklist for interviews and focus groups. [12] The Standards for Reporting Qualitative Research (SRQR) is a checklist covering a wider range of qualitative research. [13]

Examples of Application

Many times a research question will start with qualitative research. The qualitative research will help generate the research hypothesis which can be tested with quantitative methods. After the data is collected and analyzed with quantitative methods, a set of qualitative methods can be used to dive deeper into the data for a better understanding of what the numbers truly mean and their implications. The qualitative methods can then help clarify the quantitative data and also help refine the hypothesis for future research. Furthermore, with qualitative research researchers can explore subjects that are poorly studied with quantitative methods. These include opinions, individual's actions, and social science research.

A good qualitative study design starts with a goal or objective. This should be clearly defined or stated. The target population needs to be specified. A method for obtaining information from the study population must be carefully detailed to ensure there are no omissions of part of the target population. A proper collection method should be selected which will help obtain the desired information without overly limiting the collected data because many times, the information sought is not well compartmentalized or obtained. Finally, the design should ensure adequate methods for analyzing the data. An example may help better clarify some of the various aspects of qualitative research.

A researcher wants to decrease the number of teenagers who smoke in their community. The researcher could begin by asking current teen smokers why they started smoking through structured or unstructured interviews (qualitative research). The researcher can also get together a group of current teenage smokers and conduct a focus group to help brainstorm factors that may have prevented them from starting to smoke (qualitative research).

In this example, the researcher has used qualitative research methods (interviews and focus groups) to generate a list of ideas of both why teens start to smoke as well as factors that may have prevented them from starting to smoke. Next, the researcher compiles this data. The research found that, hypothetically, peer pressure, health issues, cost, being considered “cool,” and rebellious behavior all might increase or decrease the likelihood of teens starting to smoke.

The researcher creates a survey asking teen participants to rank how important each of the above factors is in either starting smoking (for current smokers) or not smoking (for current non-smokers). This survey provides specific numbers (ranked importance of each factor) and is thus a quantitative research tool.

The researcher can use the results of the survey to focus efforts on the one or two highest-ranked factors. Let us say the researcher found that health was the major factor that keeps teens from starting to smoke, and peer pressure was the major factor that contributed to teens to start smoking. The researcher can go back to qualitative research methods to dive deeper into each of these for more information. The researcher wants to focus on how to keep teens from starting to smoke, so they focus on the peer pressure aspect.

The researcher can conduct interviews and/or focus groups (qualitative research) about what types and forms of peer pressure are commonly encountered, where the peer pressure comes from, and where smoking first starts. The researcher hypothetically finds that peer pressure often occurs after school at the local teen hangouts, mostly the local park. The researcher also hypothetically finds that peer pressure comes from older, current smokers who provide the cigarettes.

The researcher could further explore this observation made at the local teen hangouts (qualitative research) and take notes regarding who is smoking, who is not, and what observable factors are at play for peer pressure of smoking. The researcher finds a local park where many local teenagers hang out and see that a shady, overgrown area of the park is where the smokers tend to hang out. The researcher notes the smoking teenagers buy their cigarettes from a local convenience store adjacent to the park where the clerk does not check identification before selling cigarettes. These observations fall under qualitative research.

If the researcher returns to the park and counts how many individuals smoke in each region of the park, this numerical data would be quantitative research. Based on the researcher's efforts thus far, they conclude that local teen smoking and teenagers who start to smoke may decrease if there are fewer overgrown areas of the park and the local convenience store does not sell cigarettes to underage individuals.

The researcher could try to have the parks department reassess the shady areas to make them less conducive to the smokers or identify how to limit the sales of cigarettes to underage individuals by the convenience store. The researcher would then cycle back to qualitative methods of asking at-risk population their perceptions of the changes, what factors are still at play, as well as quantitative research that includes teen smoking rates in the community, the incidence of new teen smokers, among others. [14] [15]

Qualitative research functions as a standalone research design or in combination with quantitative research to enhance our understanding of the world. Qualitative research uses techniques including structured and unstructured interviews, focus groups, and participant observation to not only help generate hypotheses which can be more rigorously tested with quantitative research but also to help researchers delve deeper into the quantitative research numbers, understand what they mean, and understand what the implications are.  Qualitative research provides researchers with a way to understand what is going on, especially when things are not easily categorized. [16]

• Issues of Concern

As discussed in the sections above, quantitative and qualitative work differ in many different ways, including the criteria for evaluating them. There are four well-established criteria for evaluating quantitative data: internal validity, external validity, reliability, and objectivity. The correlating concepts in qualitative research are credibility, transferability, dependability, and confirmability. [4] [11] The corresponding quantitative and qualitative concepts can be seen below, with the quantitative concept is on the left, and the qualitative concept is on the right:

• Internal validity--- Credibility
• External validity---Transferability
• Reliability---Dependability
• Objectivity---Confirmability

In conducting qualitative research, ensuring these concepts are satisfied and well thought out can mitigate potential issues from arising. For example, just as a researcher will ensure that their quantitative study is internally valid so should qualitative researchers ensure that their work has credibility.  

Indicators such as triangulation and peer examination can help evaluate the credibility of qualitative work.

• Triangulation: Triangulation involves using multiple methods of data collection to increase the likelihood of getting a reliable and accurate result. In our above magic example, the result would be more reliable by also interviewing the magician, back-stage hand, and the person who "vanished." In qualitative research, triangulation can include using telephone surveys, in-person surveys, focus groups, and interviews as well as surveying an adequate cross-section of the target demographic.
• Peer examination: Results can be reviewed by a peer to ensure the data is consistent with the findings.

‘Thick’ or ‘rich’ description can be used to evaluate the transferability of qualitative research whereas using an indicator such as an audit trail might help with evaluating the dependability and confirmability.

• Thick or rich description is a detailed and thorough description of details, the setting, and quotes from participants in the research. [5] Thick descriptions will include a detailed explanation of how the study was carried out. Thick descriptions are detailed enough to allow readers to draw conclusions and interpret the data themselves, which can help with transferability and replicability.
• Audit trail: An audit trail provides a documented set of steps of how the participants were selected and the data was collected. The original records of information should also be kept (e.g., surveys, notes, recordings).

One issue of concern that qualitative researchers should take into consideration is observation bias. Here are a few examples:

• Hawthorne effect: The Hawthorne effect is the change in participant behavior when they know they are being observed. If a researcher was wanting to identify factors that contribute to employee theft and tells the employees they are going to watch them to see what factors affect employee theft, one would suspect employee behavior would change when they know they are being watched.
• Observer-expectancy effect: Some participants change their behavior or responses to satisfy the researcher's desired effect. This happens in an unconscious manner for the participant so it is important to eliminate or limit transmitting the researcher's views.
• Artificial scenario effect: Some qualitative research occurs in artificial scenarios and/or with preset goals. In such situations, the information may not be accurate because of the artificial nature of the scenario. The preset goals may limit the qualitative information obtained.
• Clinical Significance

Qualitative research by itself or combined with quantitative research helps healthcare providers understand patients and the impact and challenges of the care they deliver. Qualitative research provides an opportunity to generate and refine hypotheses and delve deeper into the data generated by quantitative research. Qualitative research does not exist as an island apart from quantitative research, but as an integral part of research methods to be used for the understanding of the world around us. [17]

• Enhancing Healthcare Team Outcomes

Qualitative research is important for all members of the health care team as all are affected by qualitative research. Qualitative research may help develop a theory or a model for health research that can be further explored by quantitative research.  Much of the qualitative research data acquisition is completed by numerous team members including social works, scientists, nurses, etc.  Within each area of the medical field, there is copious ongoing qualitative research including physician-patient interactions, nursing-patient interactions, patient-environment interactions, health care team function, patient information delivery, etc. 

• Review Questions
• Access free multiple choice questions on this topic.
• Comment on this article.

Disclosure: Steven Tenny declares no relevant financial relationships with ineligible companies.

Disclosure: Janelle Brannan declares no relevant financial relationships with ineligible companies.

Disclosure: Grace Brannan declares no relevant financial relationships with ineligible companies.

This book is distributed under the terms of the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International (CC BY-NC-ND 4.0) ( http://creativecommons.org/licenses/by-nc-nd/4.0/ ), which permits others to distribute the work, provided that the article is not altered or used commercially. You are not required to obtain permission to distribute this article, provided that you credit the author and journal.

• Cite this Page Tenny S, Brannan JM, Brannan GD. Qualitative Study. [Updated 2022 Sep 18]. In: StatPearls [Internet]. Treasure Island (FL): StatPearls Publishing; 2024 Jan-.

In this Page

Bulk download.

• Bulk download StatPearls data from FTP

Related information

• PMC PubMed Central citations
• PubMed Links to PubMed

Similar articles in PubMed

• Suicidal Ideation. [StatPearls. 2024] Suicidal Ideation. Harmer B, Lee S, Duong TVH, Saadabadi A. StatPearls. 2024 Jan
• Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas. [Cochrane Database Syst Rev. 2022] Folic acid supplementation and malaria susceptibility and severity among people taking antifolate antimalarial drugs in endemic areas. Crider K, Williams J, Qi YP, Gutman J, Yeung L, Mai C, Finkelstain J, Mehta S, Pons-Duran C, Menéndez C, et al. Cochrane Database Syst Rev. 2022 Feb 1; 2(2022). Epub 2022 Feb 1.
• Macromolecular crowding: chemistry and physics meet biology (Ascona, Switzerland, 10-14 June 2012). [Phys Biol. 2013] Macromolecular crowding: chemistry and physics meet biology (Ascona, Switzerland, 10-14 June 2012). Foffi G, Pastore A, Piazza F, Temussi PA. Phys Biol. 2013 Aug; 10(4):040301. Epub 2013 Aug 2.
• Review Evidence Brief: The Effectiveness Of Mandatory Computer-Based Trainings On Government Ethics, Workplace Harassment, Or Privacy And Information Security-Related Topics [ 2014] Review Evidence Brief: The Effectiveness Of Mandatory Computer-Based Trainings On Government Ethics, Workplace Harassment, Or Privacy And Information Security-Related Topics Peterson K, McCleery E. 2014 May
• Review Public sector reforms and their impact on the level of corruption: A systematic review. [Campbell Syst Rev. 2021] Review Public sector reforms and their impact on the level of corruption: A systematic review. Mugellini G, Della Bella S, Colagrossi M, Isenring GL, Killias M. Campbell Syst Rev. 2021 Jun; 17(2):e1173. Epub 2021 May 24.

Recent Activity

• Qualitative Study - StatPearls Qualitative Study - StatPearls

Your browsing activity is empty.

Activity recording is turned off.

Turn recording back on

Connect with NLM

National Library of Medicine 8600 Rockville Pike Bethesda, MD 20894

Web Policies FOIA HHS Vulnerability Disclosure

Help Accessibility Careers

This paper is in the following e-collection/theme issue:

Published on 29.3.2024 in Vol 26 (2024)

Telehealth Care Through Internet Hospitals in China: Qualitative Interview Study of Physicians’ Views on Access, Expectations, and Communication

Authors of this article:

Original Paper

• Yuqiong Zhong 1, 2 , Mphil   ; 
• Jessica Hahne 3 , MA, MPH   ; 
• Xiaomin Wang 4, 5 , PhD   ; 
• Xuxi Wang 1 , Bphil   ; 
• Ying Wu 1 , MPhil   ; 
• Xin Zhang 2, 6 * , MD, PhD   ; 
• Xing Liu 6, 7 * , PhD  

1 School of Humanities, Central South University, Changsha, China

2 Xiangya Hospital, Central South University, Changsha, China

3 Department of Psychological & Brain Sciences, Washington University in St Louis, St Louis, MO, United States

4 Center for Clinical Pharmacology, The Third Xiangya Hospital of Central South University, Changsha, China

5 Center for Medical Ethics, Central South University, Changsha, China

6 Medical Humanities Research Center, Central South University, Changsha, China

7 Office of International Cooperation and Exchanges, Xiangya Hospital, Central South University, Changsha, China

*these authors contributed equally

Corresponding Author:

Xing Liu, PhD

Office of International Cooperation and Exchanges

Xiangya Hospital, Central South University

No 87 Xiangya Road, Kaifu District

Changsha, 410008

Phone: 86 18229765509

Email: [email protected]

Background: Internet hospitals in China are an emerging medical service model similar to other telehealth models used worldwide. Internet hospitals are currently in a stage of rapid development, giving rise to a series of new opportunities and challenges for patient care. Little research has examined the views of chronic disease physicians regarding internet hospitals in China.

Objective: We aimed to explore the experience and views of chronic disease physicians at 3 tertiary hospitals in Changsha, China, regarding opportunities and challenges in internet hospital care.

Methods: We conducted semistructured qualitative interviews with physicians (n=26) who had experience working in internet hospitals affiliated with chronic disease departments in 3 tertiary hospitals in Changsha, Hunan province, south central China. Interviews were transcribed verbatim and analyzed by content analysis using NVivo software (version 11; Lumivero).

Results: Physicians emphasized that internet hospitals expand opportunities to conduct follow-up care and health education for patients with chronic illnesses. However, physicians described disparities in access for particular groups of patients, such as patients who are older, patients with lower education levels, patients with limited internet or technology access, and rural patients. Physicians also perceived a gap between patients’ expectations and the reality of limitations regarding both physicians’ availability and the scope of services offered by internet hospitals, which raised challenges for doctor-patient boundaries and trust. Physicians noted challenges in doctor-patient communication related to comprehension and informed consent in internet hospital care.

Conclusions: This study explored the experience and views of physicians in 3 tertiary hospitals in Changsha, China, regarding access to care, patients’ expectations versus the reality of services, and doctor-patient communication in internet hospital care. Findings from this study highlight the need for physician training in telehealth communication skills, legislation regulating informed consent in telehealth care, public education clarifying the scope of internet hospital services, and design of internet hospitals that is informed by the needs of patient groups with barriers to access, such as older adults.

Introduction

As information technology develops rapidly in the current era, telehealth is growing exponentially in use [ 1 - 3 ]. Particularly in the wake of the COVID-19 pandemic, the use of telehealth for both primary and specialist care has accelerated around the globe [ 4 ]. In particular, telehealth is being implemented at an increasing scale in various countries with aging populations to improve health care access and quality for growing numbers of patients with chronic diseases [ 5 - 9 ].

The internet hospital is 1 major emerging telehealth model that is distinct to China, a country with a particularly large aging population and a high chronic disease burden [ 10 - 12 ]. Designed to make health care services more available, convenient, affordable, and efficient, internet hospitals are a type of online platform through which certain health care services can be conducted remotely. There are 3 main types of internet hospitals—those initiated by physical hospitals, those jointly established by physical hospitals and business enterprises, and those initiated by business enterprises relying on physical medical institutions. Research suggests that internet hospitals initiated solely by physical hospitals are the most widespread type [ 13 ]. In terms of the target patient population, internet hospitals primarily aim to facilitate services for patients with common illnesses requiring relatively simple treatment [ 14 ], patients with chronic diseases (diabetes, hypertension, and cancer) [ 15 ], and patients in remote and rural areas [ 16 ].

However, the scope of internet hospitals goes beyond telemedicine services for patients. Services provided by internet hospitals can be classified into three categories, (1) “core medical services,” which mainly include follow-up care for in-person medical services, telemedicine consultations, guidance on chronic disease management, and guidance on medication use; (2) “non-core medical services,” which mainly include medical consultations between health care providers and remote education for health care providers; and (3) “convenience services,” which mainly include health care appointment scheduling, mobile payment for health services, remote examination of medical test results, and dispensation and distribution of some medications [ 10 , 13 , 17 , 18 ]. Thus, the internet hospital model has the potential to increase access to health care for patients and training for providers, and to decrease costs across the health care system.

A number of recent policies by the Chinese national government have promoted rapid development and uptake of the internet hospital model. In 2015 [ 19 ] and 2018 [ 20 ], the State Council issued guidelines promoting “‘Internet +’ Healthcare,” which emphasized the development of internet hospitals as part of the “Health China” strategy for health care reform. Concurrently in 2018, the National Health Commission formulated specific regulations on internet hospital management, which officially authorized internet hospitals to facilitate a range of telehealth services and marked the start of their standardized development [ 21 - 23 ]. In 2020, the National Health Commission issued the “Notice on Strengthening Informatization to Support the Prevention and Control of the Novel Coronavirus Pneumonia Epidemic,” emphasizing the advantages of internet hospitals in controlling the spread of the COVID-19 pandemic [ 24 ]. In the wake of these policies, by June 2023, the number of internet hospitals had reached more than 3000, and 364 million of China’s 1.079 billion internet users were using online medical services [ 25 , 26 ]. However, research suggests that most internet hospitals are not yet fully developed or providing the full scope of services intended to achieve these goals [ 27 - 29 ].

At this early stage of the model’s development, little research to date has evaluated the views of Chinese medical professionals and patients regarding internet hospitals. However, research on telehealth in other countries reveals that telehealth raises many new concerns and challenges alongside the aforementioned opportunities [ 30 - 32 ]. One of the most common concerns raised by patients is the potential for misdiagnosis due to the inability to conduct physical examinations through telehealth [ 33 , 34 ]. Particular groups such as lower-income older adults also commonly report barriers to the use of telehealth such as lack of familiarity with technology or limited access to technological devices or internet connections [ 35 ]. Smartphone data or internet connection problems can also lower patient satisfaction and limit access among rural patient populations [ 36 , 37 ]. Various groups of patients also commonly report feeling concerned about patient privacy and the security and protection of medical data when using telehealth [ 38 ].

In order to guide the direction of internet hospital development in China, further research is needed to examine the emerging challenges and opportunities to patient care presented by this country-specific telehealth platform. The aim of this study was to explore the experience and views of chronic disease physicians at 3 tertiary hospitals in Changsha, China, regarding opportunities and challenges presented by internet hospital care.

The methodology whereby this study was designed and conducted is reported following the items in the Consolidated Criteria for Reporting Qualitative Research (COREQ) checklist [ 39 ]. See Multimedia Appendix 1 [ 39 ] for more information.

Setting, Participant Recruitment, and Eligibility Criteria

We conducted in-depth, semistructured interviews with physicians at 3 tertiary hospitals in Changsha, Hunan Province, south central China. Inclusion criteria for participants were 18 years of age or older, experience working in internet hospitals, and employment in a chronic disease department at one of the study hospitals. Our rationale for these inclusion criteria was to select doctors who had work experience relevant to the research questions. Enrollment occurred over a 2-month period from April to May 2022. Using a purposive sampling approach, we obtained a list of doctors who had previous experience working in internet hospitals. We then messaged or called the doctors on the list to briefly explain the primary and secondary objectives of the study, invited them to share their perspectives related to the study, and asked them to be available for interviews. Out of the 28 doctors contacted, 26 agreed to participate, while 2 physicians declined due to a lack of time. Those who responded positively to the invitation were subsequently contacted by the author, YZ, either via WeChat (Tencent Holdings Limited) or telephone to schedule an interview.

We recruited participants until reaching data saturation, at which point no new information about the meaning of codes or themes and the relationship between them continued to appear [ 40 ].

In order to allow spontaneous answers and mitigate bias, participants were given minimum information in advance about specific interview topics.

Ethical Considerations

In April 2022, the research protocol was approved by the institutional review board of Xiangya Hospital, Central South University (#202204092). No prior relationships existed between study participants and members of the research team. Verbal informed consent was recorded via an audio recorder for each participant before participation. Participants were informed in advance that their interviews would be recorded, with the assurance that these recordings would be subject to encryption for security purposes, and they provided their verbal consent accordingly. All participants received a compensation of 200 RMB (1 CNY=US $0.15 on May 2022) for their participation, which was disbursed through a WeChat transfer. To protect the information of the interviewees, the interview data were deidentified in the process of transcription from audio recordings.

Data Collection

The interview guide was collaboratively developed and then subjected to pilot-testing by the research team. Throughout the concurrent phases of data collection and analysis, the interview guide underwent iterative refinement in response to emerging insights and participant responses. This adaptive approach is considered vital to the robustness of qualitative research [ 41 ]. Revisions were implemented subsequent to discussions involving YZ, JH, and Xiaomin Wang, aiming to clarify, define, and critically examine emerging content from interviews as relevant to the research questions. All questions from the finalized interview guide are listed in Textbox 1 .

Q1: What are your views on internet hospitals?

Q2: Could you tell me about your experience working in internet hospitals?

Q3: What do you think are the biggest advantages of internet hospitals? Can you give some examples?

Q4: What do you think are the most troubling or difficult aspects of internet hospitals? Can you give some examples?

Q5: How do you inform the patients who come to the internet hospitals before treatment?

Q6: Do you think there are any differences between doctor-patient communication in internet hospitals and physical hospitals?

Q7: What impact do you think internet hospitals have on doctor-patient communication? Can you give some examples?

Q8: What training have you participated in regarding internet hospitals? What do you think of this training?

Q9: What do you think about the current status of the development of internet hospital laws and regulations in China? How could they be improved? What other aspects can promote the further development of internet hospitals?

Q10: Is there anything else you would like to add about doctor-patient communication in internet hospitals?

Data for this study were collected from April to May 2022. We carried out interviews through a combination of online and offline modalities, depending on each participant’s preference and availability. Online interviews were conducted remotely by video call, via the mobile app WeChat. Offline interviews were conducted in private rooms at the study hospitals. The interviews were conducted in Mandarin Chinese by the authors, YZ (a postgraduate student) and Xiaomin Wang (an associate professor). Both interviewers have received professional training in qualitative interviewing and had extensive experience conducting qualitative research prior to this study.

The research team discussed possible probes and follow-up questions before beginning interviews, and interviewers used them when necessary to draw out more information relevant to the main research question. Concurrently, a second interviewer assumed the role of an observer to ensure the standardization of interview methods and to mitigate potential biases.

Interviews were audio recorded, transcribed, and uploaded into qualitative data management NVivo software (version 11; Lumivero) on password-protected computers to facilitate the analysis. Field notes made by interviewers during the interview process were also stored on password-protected computers, to be used for reference by the research team during analysis. Interviews ranged from 20 to 50 minutes long. Transcripts were sent to participants upon request, but no corrections, comments, or notes were made to transcripts.

Data Analysis

Analysis of the data was performed through conventional content analysis, using guidelines described by Hsieh and Shannon [ 42 ]. An advantage of conventional content analysis is that it avoids using preconceived categories, to generate codes inductively from the data. This modality is considered appropriate when current knowledge of the phenomenon being researched is limited [ 42 ].

Authors YZ and Xuxi Wang transcribed all interviews verbatim and reviewed transcripts several times to acquire a thorough understanding of the whole data set. They then read transcripts line-by-line and highlighted keywords and sentences from a set of initial transcripts, to generate primary codes that captured key concepts. Primary codes were repeatedly reviewed and revised through discussion among the authors and comparison across the transcripts. A finalized codebook including 17 codes and 61 subcodes was used to code all interviews, using NVivo software (version 11). Data saturation was reached after 26 interviews, once the research team determined by the consensus that we had interviewed a sufficiently varied sample of physicians from the 3 study hospitals, while also having obtained sufficiently content-rich data.

Following the coding of all transcripts, all coded segments of the interview data were translated into English by authors YZ and Xuxi Wang, native Mandarin speakers, and double-checked for accuracy by author JH, a native English speaker. Codes and subcodes were repeatedly reviewed and were grouped into clusters according to similarities and differences. Clusters of codes were then treated as subcategories and aggregated into the main categories that were representative of the key findings. These categories were repeatedly reviewed until fully developed, through a process of identifying and comparing exemplary excerpts for each code, category, and subcategory.

This process of analysis culminated in three main categories describing the experiences and views of chronic disease physicians regarding the opportunities and challenges presented by internet hospital care, (1) advancements and shortcomings in care access due to internet hospitals, (2) patients’ expectations versus limitations on doctors’ availability and the scope of services—implications for doctor-patient boundaries and trust, and (3) advantages and downsides of online communication for comprehension and informed consent. These main categories are shown in Textbox 2 , alongside the subcategories from which they were aggregated, and further explained in the results narrative below.

Advancements and shortcomings in care access due to internet hospitals

• Enhanced ability to conduct follow-up care for patients with chronic illness
• More efficient channels for health education
• Disparities in access (ie, for older adults, patients with lower education levels, patients with limited internet or technology access, rural patients)

Patients’ expectations versus limitations on doctors’ availability and the scope of services

• Patients’ expectations of doctors’ availability create unclear professional boundaries.
• Patients’ expectations of the service scope of internet hospitals affect doctor-patient trust.

Advantages and downsides of online communication for comprehension and informed consent:

• Doctors value having extra time to think carefully about replies to patients’ messages, compared to in-person communication.
• Internet hospitals’ restrictions on consultation times, procedures, and arbitrary rules or schedules can hinder effective patient communication.
• Doctors have concerns about the quality of online diagnoses and advice, as well as patient accuracy and comprehension, due to the limitations of online care.
• Doctors have concerns about the completeness and uniformity of clinical informed consent in internet hospitals.

Description of Study Participants

The 26 participants came from 3 different affiliated hospitals with 10, 5, and 11 participants interviewed from each hospital, respectively. Participants ranged in age from 29 to 49 years, and all 26 participants had PhD degrees. Only 5 participants stated that they had received specific training for working in internet hospitals, and 1 of them stated that training included discussion of clinical ethics in internet hospital care. We interviewed doctors from several departments involved in care for patients with chronic disease—oncology, cardiovasology, hematology, endocrinology, gastroenterology, nephrology, and infection departments. Aggregated participant characteristics are presented in Table 1 .

a Some percentages may not add up to 100 due to rounding.

Advancements and Shortcomings in Care Access Due to Internet Hospitals: Follow-Up Care, Health Education, and Disparities

Most doctors stated that internet hospitals affiliated with their physical hospitals of employment were still in the early stages of development and that their internet hospital work experience mainly took place in enterprise-initiated internet hospitals. Doctors stated that internet hospitals initiated by physical hospitals were “not fully operational yet,” (Dr B) and “the consultation volume of patients is relatively small” (Dr C). They also suggested that there was currently a “lack of incentives” (Dr D) to work in internet hospitals initiated by physical hospitals, whereas enterprise-initiated internet hospitals offered “higher income” (Dr B) and a setting where “doctors set their own prices” (Dr C).

In both internet hospitals initiated by physical hospitals and enterprise-initiated internet hospitals, doctors stated that the majority of their work consisted of online consultation for common or easily diagnosable diseases, and follow-up services for patients with chronic diseases who had previously received care at physical hospitals, such as adjusting medications and ordering medical tests to be scheduled in person. Most doctors were motivated to work for internet hospitals particularly because of the opportunity to be part of expanding follow-up care for patients with chronic diseases.

Most of the patients who come to the internet hospitals are chronic disease patients, with conditions such as hypertension, diabetes, coronary heart disease, etc. These patients have been clearly diagnosed in our hospital, and some of them need to be guided or communicated with about what needs to be paid attention to in the process of home-based management. For example, patients' blood pressure might fluctuate, or they can consult online if they have any uncomfortable symptoms, which is quite common. [Dr X]

Some doctors also believed based on experience that internet hospitals could serve as a more efficient channel to provide health education for patients, particularly for the management of chronic diseases.

We also feel that doctors in tertiary hospitals do not have much time to do health education with patients, but through the internet hospitals platforms, we can explain to patients the concept of health or a healthy way of life. For example, for a patient with heart failure, he isn’t expected to come back to the hospital again and again, because I have instilled him with an understanding of healthy lifestyle and diet, and the workload of the doctor will be reduced in the long run. [Dr C]

Despite the ways in which doctors felt internet hospitals expanded access to care and services, they had also observed disparities in access to internet hospitals across several groups, including older adults and patients with lower levels of education or technological literacy: “Older patients may not use smartphones or might need assistance to do so from family members” (Dr E).

Relatively speaking, if the patients come to the internet hospital for consultation, the education level of these patients will be higher, otherwise they will not be able to fully communicate with their doctor. [Dr O]

Most doctors mentioned that internet hospitals are especially suitable for patients with chronic diseases. Doctors also stated that while older adults are one of the most common groups of patients with chronic diseases, many older adults have difficulties in using or accessing internet hospitals (Dr D and Dr X). Some doctors mentioned that internet hospitals currently have limited connections and overlap with local health services in rural areas. They believed moving toward more connection with local services was an important goal—particularly because the demand at tertiary hospitals frequently outstrips resources (Dr P and Dr Q), and because many rural patients travel long distances to receive care at tertiary hospitals.

Even for follow-up visits for chronic diseases or common diseases, many patients will still go to tertiary hospitals. Instead, the patient can go to a qualified local hospital and send us the results of the test, and then [through internet hospital care,] we can advise the patient or tell him how to adjust the medication, or refer the patient to a tertiary hospital for testing. But at present, internet hospitals have not played a big enough role in these aspects. [Dr E]

Patients’ Expectations Versus Limitations on Doctors’ Availability and the Scope of Services: Implications for Doctor-Patient Boundaries and Trust

Patients’ expectations of doctors’ availability create unclear professional boundaries.

When asked about new challenges in patient care posed by internet hospitals, only 1 doctor mentioned risks related to patient privacy and data security.

The internet hospital platform where I am located requires patients to provide their name, gender, age, ID number, and other information, which can be seen on the doctor's portal, but as a doctor I will definitely not disclose the patient's private information but just give him diagnostic advice according to the necessary information provided by the patient. [Dr G]

By contrast, many doctors expressed concerns about their own privacy. Some doctors shared stories from their work in physical hospitals of willingly sharing their personal WeChat with patients in case patients had questions after discharge (Dr D, Dr M, and Dr R). While some doctors did not seem to mind-bending this boundary with patients, others remembered negative experiences when patients had sent messages making demands of doctors’ time at all hours (Dr E, Dr M, Dr P, and Dr Z). They also recalled times when patients obtained the doctor’s personal contact information through their own means and contacted them after leaving the hospital without the doctor’s consent (Dr V and Dr Z). As a result, some doctors had positive views of internet hospitals because they can serve as a means for online communication with patients without requiring the doctor to disclose their own personal contact information.

I prefer to use the official platform to communicate with patients, rather than through private WeChat or phone, because I really don't want to receive phone calls or text messages from patients after I work. But if the phone does ring, I will take into account that he is an old patient of mine, and I will still answer it, because I am not sure if there is any emergency. But for patients on such online hospital platforms, I rarely give them my phone number and personal WeChat. [Dr P]

Several doctors were also uncomfortable that they were required to post information about themselves when working on internet hospital platforms, such as their name, location, and credentials (Dr P and Dr X). Because the audience of patients in internet hospitals is wider, they worried that patients who were dissatisfied with care may have the ability to post negative information about them in public forums online, citing their personal information. As a result, doctors stated that they would be more cautious in diagnosis and giving advice when dealing with patients in internet hospitals with whom they were less familiar (Dr J, Dr O, and Dr V).

Patients’ Expectations of the Service Scope of Internet Hospitals Affect Doctor-Patient Trust

Another concern expressed by many doctors was that patients held unrealistic expectations of the scope of services that internet hospital doctors provide. Some doctors mentioned that some patients feel that just because they spend money in an internet hospital, they should be able to get all their problems solved at once or get immediate treatment (Dr E and Dr G)—when in reality in many cases, the doctor might need to conduct tests over multiple online consultations or might recommend that patients seek further medical services in offline, physical settings. Doctors were concerned that patients’ dissatisfaction with unmet expectations might generate distrust toward the doctor.

What patients don't know is that in fact, most of the time, seeing a doctor is a step-by-step process, and it is necessary to do examinations step-by-step to exclude diseases or diagnose diseases. They often have high expectations for the effect of consultation in internet hospitals, and they think that doctors should be able to diagnose their diseases at one time; and not only to diagnose them, but also to propose a treatment plan. [Dr E]

Some doctors suggested that this gap between expectations and reality could be especially strong for new patients whom the doctor had not seen previously for in-person care. They described that they often recommend for new internet hospital patients to go to physical hospitals to be examined before receiving further internet hospital care or advice, and that patients who are expecting immediate solutions can find this disappointing (Dr U and Dr X). One doctor suggested the need to educate patients and the general public on the scope of internet hospital care, in light of this mismatch in patients’ and doctors’ expectations (Dr Y).

However, some doctors raised concerns about issues related to doctor-patient trust that had less to do with adjusting patients’ expectations and more to do with the format of online communication itself.

Doctor-patient trust will be better in physical hospitals. Because the doctor-patient relationship is a very special relationship, offline communication can observe the patient's expression, speed of speech, action, etc, and is more suitable for empathy with patients. When it comes to the doctor-patient relationship and trust, I think face-to-face consultation is still necessary. [Dr J]

Face-to-face communication in physical hospitals may be more detailed, because if it is through text messages or phone calls, I may be able to talk to the patient in a few words, but if the patient is communicating in our hospital, it may take me half an hour. Because there is unequal information in medicine itself, the patient himself is not very clear about medicine, and without adequate communication, there is no trust between doctors and patients. [Dr W]

Advantages and Downsides of Online Communication for Comprehension and Informed Consent

Doctors working in internet hospitals mainly used pictures and texts, and rarely video calls, to communicate with patients. Some doctors valued the extra time gained by this format to think carefully about their replies to patients’ messages (Dr E, Dr U, and Dr X). However, most doctors pointed out how the lack of nonverbal communication could increase miscommunication and misunderstandings.

Online communication is through typing, and some doctors can't see the facial expressions of patients, which is very inconvenient. The communication between doctors and patients may need body language, facial expressions and other aspects.... I want the patient to really understand me in terms of attitude or tone or feeling or whatever. [Dr G]

Doctors also expressed dissatisfaction with limitations on the time and procedures for consultation through various internet hospitals, and how sometimes arbitrary rules or schedules hindered communication with patients.

The doctors in our department need to be on duty every month in the internet hospitals. When it is my turn to be on duty, a patient will send his questions to me through the platform, but I think this mode is not good. For example, the patient might leave a message for me, but I am busy and don’t reply to him in time, and he may not see my reply in time when I reply. If I go back and forth with him several times, this problem will not be solved until I come back on duty next month, and then the patient's problem will not be solved at all. [Dr C]

The internet hospital at our hospital stipulates that patients can ask five questions at a time.... Sometimes doctors are not able to inquire in detail in order to understand the condition. [Dr G]

Doctors had concerns about the quality of diagnoses and advice that they provided online, due to the inability to do direct physical examination. These concerns were intensified by their perception that many patients could not describe their symptoms clearly and accurately.

Currently, a lot of people still lack of basic medical knowledge, which will lead to ineffective or inefficient consultation on the internet, because they cannot describe their own symptoms, or cannot collect their own data and then summarize it. Patients cannot provide information about their condition sufficiently and accurately, which will seriously affect the efficiency of consultation. [Dr E]

Two doctors also specifically mentioned the difficulty in internet hospital care of not being able to use the “four-diagnosis method”—a method used by doctors in traditional Chinese medicine for diagnosing illness, including diagnosis through observation, diagnosis through auscultation and olfaction, diagnosis through inquiry, and diagnosis through pulse feeling [ 43 ]. Although doctors in this study practiced mainly “Western” medicine, they described integrating certain traditional practices such as this method into their care at physical hospitals (Dr D and Dr H).

In light of concerns about the potential for miscommunication with patients, a few doctors also expressed uncertainty about the completeness and uniformity of clinical informed consent as it is currently practiced in internet hospitals. While they believed that a standardized process of online informed consent for medical advice and treatment was needed, they did not know of any relevant laws or procedures.

Because we have so little time to communicate online, and such a narrow scope of care services, we don't usually obtain informed consent online. I might listen to the patient explain his symptoms. I might tell him what tests he needs before I give my advice, or if I'm dealing with a familiar patient, I might just prescribe his medication, so there's no need for informed consent. However, I think how to issue online informed consent, whether online informed consent is legally effective, and how to sign online informed consent all need to be considered. This is also for the protection of medical staff. [Dr U]

Principal Findings

This study sheds light on previously underresearched aspects of internet hospitals in China, as both the first interview study to examine physicians’ perceptions of internet hospitals and one of the few studies on internet hospitals conducted in China outside of its most major cities. Our research revealed that physicians see enhanced opportunities in internet hospitals to conduct follow-up care for patients with chronic illnesses and to provide health education. However, physicians noted disparities in access for different groups, such as older adults, patients with lower education levels, patients with limited internet or technology access, and rural patients. One particularly novel finding was the conflict between patients’ expectations and the reality of limitations on doctors’ availability and the scope of services available through internet hospitals. Physicians perceived that this gap affected both boundaries and trust in the doctor-patient relationship. Physicians also discussed opportunities and challenges in doctor-patient communication, including issues of comprehension and informed consent. Considering that the development of internet hospitals involves multiple industries, including medical institutions, national policymaking departments, and technology providers, we raise several suggestions below on physician training, patient education, regulations, and design, as well as directions for future research.

Training for Doctors

Internet hospital care involves real-time online sharing of medical data. Information about both doctors and patients is centralized and easily accessible to authorized users on the internet hospital platform. Some doctors in our study were uncomfortable when required to publicly post their names, basic personal information, and credentials on internet hospital platforms because it might make them more vulnerable to public criticism. Doctors’ reasons for being concerned about this were in line with previous research showing a high degree of conflict in the doctor-patient relationship in China [ 44 , 45 ]. This underscores the importance of current efforts both locally and internationally that aim to rebuild trust in the doctor-patient relationship [ 46 - 48 ]. Considering doctors’ concerns about patients requesting for them to disclose their WeChat in both physical and internet hospital work, communication skills training for doctors should prepare doctors for how to interact with patients with empathy and care, while also maintaining their preferred professional boundaries.

It was also notable that only 1 doctor who was interviewed discussed concerns related to patient privacy and data security when asked about challenges presented by internet hospitals. By contrast, Li et al’s [ 49 ] study on the determinants of patients’ use of internet hospitals in China showed that while patients generally desire to use internet hospitals, they are apprehensive about the associated risk of their personal information being leaked. Due to the heightened potential for data leaks and breaches of patient health information associated with the use of internet hospitals, it is imperative that health care professionals undergo training to raise their awareness of data security precautions. For instance, physicians should be trained on proactive measures that they can take to guarantee that the internet hospital services they are affiliated with implement adequate security protocols around patient information. Furthermore, physicians should be trained to communicate with internet hospital patients or their legal proxies about potential risks related to data security and to apprise them of protective measures enacted to safeguard information. Future research should also evaluate the frequency with which data leaks and breaches in internet hospitals actually occur.

Findings from our study also suggest that internet hospitals have led to changes in doctor-patient communication. Doctors in our study considered it to be an advantage of internet hospital care that they generally had more time to communicate with patients compared to in-person care. However, a previous study on internet hospitals suggested that while doctors can obtain key information from patients within a few minutes through in-person communication and examination, information received in the same amount of time online tends to be more limited [ 43 ]. Research conducted by Deng et al [ 50 ] also highlights that engaging in online consultation work while simultaneously engaging in a main career providing in-person medical consultation may place excessive demands on doctors’ time and energy. This phenomenon of work overload could potentially impede the widespread adoption of internet hospitals and introduce added risk to medical practice.

Relatedly, doctors in our study mentioned that when working in internet hospitals, they could only communicate with patients in the form of text, pictures, or video-based consultations, and that they had to rely largely on patient self-report. Both of these factors caused doctors to worry about the accuracy of their diagnoses. This aligns with recent research showing that about 70% of surveyed health care providers believe communication difficulties between patients and health care providers result in online consultations being insufficient [ 51 ], and about 70% of providers report feeling apprehensive about the possibility of misdiagnosis when providing care through internet hospitals [ 51 ]. Recent research has also found that patients who use internet hospitals have more negative views on the doctor-patient relationship than nonusers—including both interpersonal factors such as the degree to which patients trust doctors and practical factors such as the degree to which patients agree with their doctors’ medical opinions. Studies from other countries have similarly shown that telehealth can present new challenges or deficiencies in communication [ 52 - 55 ].

To address such challenges, telehealth communication competencies need to become a core component of both future research and physician training for internet hospitals in China—just as similar competencies are emerging as a priority for telehealth enhancement around the world [ 56 ]. Physicians providing care through internet hospitals should undergo standardized training for web-based communication skills, as research from other countries suggests such training can adapt interpersonal skills to the telehealth environment [ 57 ] and enhance empathic expression. More training for physicians on this skill set might reduce their apprehension about communicating through internet hospitals and assist them in communicating in a manner that improves outcomes for patients. Considering that doctors in our study expressed concern about patient comprehension and diagnostic accuracy, further research is also needed to evaluate and establish methods for measuring patient satisfaction, patient comprehension of information communicated by doctors, and diagnostic accuracy in internet hospital care. Future research should also examine the feasibility of integrating traditional Chinese medical practices such as the four-diagnosis method into telehealth care in China.

Education for Patients or the Public

Findings from our study highlight new challenges in the doctor-patient relationship posed by internet hospital care. One especially novel finding in our study was doctors’ perception that patients subconsciously expected them to be online 24 hours a day, while doctors actually had limited hours working in the internet hospital and could not meet this expectation. Particularly when patients still needed to ask questions after the end of the physician’s available time for consultation, doctors described the risk of conflicts with patients. These findings suggest many patients may be unaware when message-based interactions with physicians in internet hospitals are discontinuous or asynchronous. Therefore, public information about internet hospitals should specify the boundaries of physicians’ availability for internet hospital consultations. While the scope of services may expand as internet hospitals continue to develop, information disseminated to the public should make it clear that internet hospital care is currently only intended for either follow-up care for previously diagnosed patients with chronic diseases, or for new patients with common and more easily diagnosable conditions. Finally, public education should equip patients or their proxies for distinct ways in which they might self-advocate for optimal care in the context of internet hospitals compared to in-person care. This may involve the development of interventions such as question-prompt lists that are specific to equipping patients for internet hospital consultations.

Regulations and Laws

Doctors in our study believed that difficulties with nonverbal communication in internet hospitals often led to miscommunication and misunderstanding, and many raised concerns that there were no specific laws regulating online doctor-patient communication. As a result, most doctors in our study expressed that they felt they were walking on eggshells concerning possible conflicts with patients. This builds on findings from the “2022 China E-hospital development research report” [ 51 ], in which one of the most common suggestions made by health care providers for the further development of internet hospitals was to standardize legal protection for doctors practicing in internet hospitals. Gaps in relevant laws and regulations may reduce the willingness of risk-conscious clinicians to provide medical services through internet hospitals.

Existing internet hospital laws and regulations in China are still mainly in the trial stage [ 51 , 58 ], and are being outpaced by evolving challenges in internet hospital care. The doctors in our study believed that internet hospitals may increase the difficulty of diagnosis and treatment, increase medical safety risks related to miscommunication, and increase the risk of medical malpractice liability. Research by Zhi et al describes how the inability of doctors to perform physical examinations or certain laboratory or imaging examinations through internet hospitals may compromise the accuracy of doctors’ judgments [ 59 ]. However, the legal responsibilities of physical medical institutions, internet hospitals, and doctors regarding issues such as these have not been fully clarified. We suggest that further refinement and clarification of these and other aspects of internet hospital law will help doctors feel more protected in their work and increase the motivation of doctors to work in internet hospitals.

Doctors in our study mentioned that China also lacks detailed legal provisions on the implementation of online informed consent. Internationally recognized ethics standards highlight 4 core elements of informed consent—capacity to consent, information disclosure, comprehension, and voluntary authorization [ 60 ]. Informed consent issues involved in telehealth in other countries are similar to those described by doctors working in internet hospitals in this study, namely, the degree of discernment required from providers to ensure that patients are sufficiently informed to provide consent increases dramatically in telehealth [ 61 ]. In the United States, different states have different regulations on remote informed consent, and no federal policy has been formed at present. Some states require patients to fill out and sign written consent forms, while others do not [ 62 ]. In China, the Administrative Measures for internet hospitals stipulate that “internet hospitals must warn patients of risks and obtain informed consent from patients” [ 22 ]. However, current laws in China do not provide clear rules regarding the validity of electronic signatures for informed consent in internet hospital care. Informed consent in internet hospital care also involves unique information security issues due to the use of electronic health records, but there is currently no specific legal guidance for internet hospital platform developers or doctors concerning data security protection of informed consent in internet hospital care.

Tackling Disparities

Our research revealed that while older adults are at higher risk for chronic illness and are the main target population for internet hospitals, they are also reported by doctors to experience a number of barriers to internet hospital use. This finding aligns with research from various countries showing that older adults are less likely than younger patients to express positive attitudes toward using telehealth [ 63 , 64 ]. Health care providers in China and other countries have observed that older adults may be apprehensive about telehealth due to difficulty in operating computers or smartphones [ 65 ], may need the help of care partners to log into telehealth accounts successfully, and may need more time on average to download and set up applications [ 43 , 66 ]. Previous surveys have also shown that medical personnel believe that the low efficiency of online communication between doctors and patients and the low internet use rate of some patient groups (such as older adults) are the main factors hindering the development of internet hospitals [ 51 ].

Previous research in various countries has shown that the ease of use and perceived usefulness of telehealth systems have a positive impact on the acceptance of telehealth in patients who are older [ 67 , 68 ]. However, to date, China has not established an effective quality control system for internet hospitals [ 27 , 69 ], and the aforementioned ways in which internet hospitals currently pose increased risks for patient safety may affect general patients’, let alone older adults’ willingness to use them [ 49 ]. We recommend that the needs of older adults be considered in the design and development of internet hospital platforms and that older adults participate in the system design process [ 70 , 71 ]. Community health workers may be a workforce that could be mobilized to support telehealth training efforts among patients who are older, assist individuals with limited telehealth literacy in attending online appointments, and provide culturally and linguistically appropriate information about telehealth to rural patients and communities [ 64 , 72 , 73 ]. In general, health care organizations should invest in developing internet hospitals that are functional and easy to use. Drawing from research on telehealth design improvement in other countries, internet hospitals could be designed with features in mind to help physicians communicate more clearly with patients, such as providing notifications to physicians when patients read messages [ 74 ]. In addition, it may be beneficial for platforms to provide training materials to patients when patients register and log into internet hospitals for the first time [ 75 ]. Considering that a major goal of internet hospital development is to expand health care access, it will be crucial to address disparities in internet hospital use through these and other educational and design considerations.

Limitations

This study should be interpreted in the light of certain limitations. As most participants interviewed were attending physicians, findings may not be generalizable to the perspective of other health care workers or patients. The generalizability of our study findings from a single region and time point may also be limited, as there may be variations in internet hospital features and practice in other regions in China, and over time as internet hospitals continue to develop rapidly.

Conclusions

This study explored the experience and views of physicians in 3 tertiary hospitals in Changsha, China regarding access to care, patients’ expectations versus the reality of services, and doctor-patient communication in internet hospital care. Findings from this study indicate that there is a need to train physicians in telehealth-specific communication skills. National policymaking departments should also further refine laws and regulations concerning internet hospitals, particularly those related to online informed consent. Technology developers should take the needs of older adults into particular account in the design of internet hospital platforms.

Acknowledgments

This study was supported by Major Program of National Social Science Fund of China, Research on Moral Issues in the Field of Contemporary Science and Technology (22&ZD044), the Xiangya Medical Humanities Series: Principles of Biomedical Ethics (monograph Award) Fund (KTZZPT019), Hunan Provincial Innovation Foundation for Postgraduate (CX20220133), the Fundamental Research Funds for the Central Universities of Central South University (2022ZZTS0041), the China Scholarship Council (CSC,202206370069), and the Natural Science of Changsha City (kq2202362).

Data Availability

The data generated and analyzed during this study are available from the corresponding author upon reasonable request.

Authors' Contributions

YZ and XL conceptualized this study and designed the methodology. YZ and Xiaomin Wang conducted the interviews for data collection. Xuxi Wang and YZ transcribed the interviews. YZ, Xuxi Wang, YW, and XZ conducted and provided resources for preliminary analysis of the data. YZ and JH wrote and edited the paper. JH, XL, and XZ oversaw the implementation of all study activities. All authors read and approved the final paper.

Conflicts of Interest

None declared.

COREQ (Consolidated Criteria for Reporting Qualitative Research) checklist.

• Barbosa W, Zhou K, Waddell E, Myers T, Dorsey ER. Improving access to care: telemedicine across medical domains. Annu Rev Public Health. Apr 01, 2021;42:463-481. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Kirkland EB, DuBose-Morris R, Duckett A. Telehealth for the internal medicine resident: a 3-year longitudinal curriculum. J Telemed Telecare. Oct 2021;27(9):599-605. [ CrossRef ] [ Medline ]
• Losorelli SD, Vendra V, Hildrew DM, Woodson EA, Brenner MJ, Sirjani DB. The future of telemedicine: revolutionizing health care or flash in the pan? Otolaryngol Head Neck Surg. Aug 2021;165(2):239-243. [ CrossRef ] [ Medline ]
• Hafner M, Yerushalmi E, Dufresne E, Gkousis E. The potential socio-economic impact of telemedicine in Canada. Rand Health Q. Jun 2022;9(3):6. [ FREE Full text ] [ Medline ]
• Alhamam NM, Buhalim RA, Almakhayitah IH, AlBahr AW, AlYaeesh IA. Telemedicine for musculoskeletal care during the COVID-19 pandemic: evaluating readiness of Saudi citizens. Cureus. Feb 16, 2021;13(2):e13380. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Bhaskar S, Bradley S, Chattu VK, Adisesh A, Nurtazina A, Kyrykbayeva S, et al. Telemedicine across the globe-position paper from the COVID-19 pandemic health system resilience PROGRAM (REPROGRAM) international consortium (part 1). Front Public Health. 2020;8:556720. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Cioti AM, Stanescu AMA, Grajdeanu IV, Serban B, Popescu E, Bratu OG, et al. Telemedicine in Europe—current status and future perspectives. Rev Med Mod. 2019;26(4):165-168. [ FREE Full text ] [ CrossRef ]
• Raja M, Bjerkan J, Kymre IG, Galvin KT, Uhrenfeldt L. Telehealth and digital developments in society that persons 75 years and older in European countries have been part of: a scoping review. BMC Health Serv Res. Oct 26, 2021;21(1):1157. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Brucksch S. Japan and its rapid ageing society: does e-health technology provide a solution? J Aging Sci. 2018;6(2):1-4. [ FREE Full text ] [ CrossRef ]
• Han Y, Lie RK, Guo R. The internet hospital as a telehealth model in China: systematic search and content analysis. J Med Internet Res. Jul 29, 2020;22(7):e17995. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Scott R, Mars M. Telehealth in the developing world: current status and future prospects. SHTT. Feb 2015;2015(3):25-37. [ FREE Full text ] [ CrossRef ]
• Yip W, Fu H, Chen AT, Zhai T, Jian W, Xu R, et al. 10 years of health-care reform in China: progress and gaps in Universal Health Coverage. Lancet. Sep 28, 2019;394(10204):1192-1204. [ CrossRef ] [ Medline ]
• 2021 China E-hospital development report. National Telemedicine and Connected Health Center and CN-Healthcare. 2021. URL: https://zk.cn-healthcare.com/doc-show-53644.html [accessed 2023-09-17]
• Chen X, Wu X, Zhang Q, Jing R, Cheng W, Tian J, et al. The construction and operational models of internet hospitals in China: a hospital-based survey study. BMC Health Serv Res. Jun 21, 2023;23(1):669. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Houston TK, Allison JJ. Users of Internet health information: differences by health status. J Med Internet Res. 2002;4(2):E7. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Lai Y, Chen S, Li M, Ung COL, Hu H. Policy interventions, development trends, and service innovations of internet hospitals in China: documentary analysis and qualitative interview study. J Med Internet Res. Jul 20, 2021;23(7):e22330. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Yu T, Jin C, Wu X, Yue D. Implementation of shared decision-making within internet hospitals in China based on patients' needs: feasibility study and content analysis. JMIR Form Res. Jan 06, 2023;7:e39965. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Tu J, Wang C, Wu S. The internet hospital: an emerging innovation in China. Lancet Glob Health. Aug 2015;3(8):e445-e446. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Guiding opinions of the State Council on actively promoting the "Internet +" action. The State Council of the People's Republic of China. 2015. URL: https://www.gov.cn/zhengce/content/2015-07/04/content_10002.htm [accessed 2023-09-16]
• Opinions on promoting the development of "Internet + medical health". General Office of the State Council. 2018. URL: https://www.gov.cn/zhengce/content/2018-04/28/content_5286645.htm [accessed 2023-09-16]
• Internet diagnosis and treatment management measures (trial implementation). National Health Commission of the People's Republic of China. 2018. URL: https://www.gov.cn/gongbao/content/2019/content_5358684.htm [accessed 2023-09-16]
• Internet hospital management measures (trial implementation). National Health Commission of the People's Republic of China. 2018. URL: https://www.gov.cn/gongbao/content/2019/content_5358684.htm [accessed 2023-09-16]
• Telemedicine service management standards (trial implementation). National Health Commission of the People's Republic of China. 2018. URL: https://www.gov.cn/gongbao/content/2019/content_5358684.htm [accessed 2023-09-16]
• Notice of the general office of the NHC on strengthening informatization to support the prevention and control of the novel coronavirus pneumonia epidemic. National Health Commission of China. 2020. URL: https://www.gov.cn/zhengce/zhengceku/2020-02/05/content_5474692.htm [accessed 2023-09-16]
• The 52nd statistical report on China's internet development. China Internet Network Information Center. 2023. URL: https://www.cnnic.cn/NMediaFile/2023/0908/MAIN1694151810549M3LV0UWOAV.pdf [accessed 2024-02-28]
• There are more than 3,000 internet hospitals, and it is necessary to explore a better development path. Health Times. 2023. URL: http://www.jksb.com.cn/index.php?m=content&c=index&a=show&catid=788&id=200853 [accessed 2024-02-28]
• Qiu Y, Liu Y, Ren W, Qiu Y, Ren J. Internet-based and mobile-based general practice: cross-sectional survey. J Med Internet Res. Sep 25, 2018;20(9):e266. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Xie X, Zhou W, Lin L, Fan S, Lin F, Wang L, et al. Internet hospitals in China: cross-sectional survey. J Med Internet Res. Jul 04, 2017;19(7):e239. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Yuan J, He F. Status quo and problems of the internet hospitals in China. Chin Rural Health Serv Adm. 2023;43(02):126-128+140. [ CrossRef ]
• Pogorzelska K, Chlabicz S. Patient satisfaction with telemedicine during the COVID-19 pandemic-a systematic review. Int J Environ Res Public Health. 2022;19(10):6113. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Sagaro GG, Battineni G, Amenta F. Barriers to sustainable telemedicine implementation in Ethiopia: a systematic review. Telemed Rep. 2020;1(1):8-15. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Şahin E, Yavuz Veizi BG, Naharci MI. Telemedicine interventions for older adults: a systematic review. J Telemed Telecare. Feb 2024;30(2):305-319. [ CrossRef ] [ Medline ]
• Imlach F, McKinlay E, Middleton L, Kennedy J, Pledger M, Russell L, et al. Telehealth consultations in general practice during a pandemic lockdown: survey and interviews on patient experiences and preferences. BMC Fam Pract. Dec 13, 2020;21(1):269. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Kumar S, Kumar A, Kumar M, Kumar A, Arora R, Sehrawat R. Feasibility of telemedicine in maintaining follow-up of orthopaedic patients and their satisfaction: a preliminary study. J Clin Orthop Trauma. Oct 2020;11(Suppl 5):S704-S710. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Latulipe C, Gatto A, Nguyen HT, Miller DP, Quandt SA, Bertoni AG, et al. Design considerations for patient portal adoption by low-income, older adults. Proc SIGCHI Conf Hum Factor Comput Syst. Apr 2015;2015:3859-3868. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Greenberg AJ, Haney D, Blake KD, Moser RP, Hesse BW. Differences in access to and use of electronic personal health information between rural and urban residents in the United States. J Rural Health. 2018;34(Suppl 1):s30-s38. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Johnson BA, Lindgren BR, Blaes AH, Parsons HM, LaRocca CJ, Farah R, et al. The new normal? Patient satisfaction and usability of telemedicine in breast cancer care. Ann Surg Oncol. 2021;28(10):5668-5676. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Solimini R, Busardò FP, Gibelli F, Sirignano A, Ricci G. Ethical and legal challenges of telemedicine in the era of the COVID-19 pandemic. Medicina (Kaunas). 2021;57(12):1314. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Tong A, Sainsbury P, Craig J. Consolidated Criteria for Reporting Qualitative Research (COREQ): a 32-item checklist for interviews and focus groups. Int J Qual Health Care. 2007;19(6):349-357. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Hennink MM, Kaiser BN, Marconi VC. Code saturation versus meaning saturation: how many interviews are enough? Qual Health Res. 2017;27(4):591-608. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Klem NR, Bunzli S, Smith A, Shields N. Demystifying qualitative research for musculoskeletal practitioners part 5: rigor in qualitative research. J Orthop Sports Phys Ther. 2022;52(2):60-62. [ CrossRef ] [ Medline ]
• Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15(9):1277-1288. [ CrossRef ] [ Medline ]
• Li Y, Hu H, Rozanova L, Fabre G. COVID-19 and internet hospital development in China. Epidemiologia (Basel). 2022;3(2):269-284. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Jiang MM, Wu ZY, Tu AX. Research on the cooperative governance path of multiple stakeholders in doctor-patient disputes under the environment of information asymmetry. Int J Environ Res Public Health. 2023;20(2):1597. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Zhao D, Zhang Z. Changes in public trust in physicians: empirical evidence from China. Front Med. 2019;13(4):504-510. [ CrossRef ] [ Medline ]
• Du L, Xu J, Chen X, Zhu X, Zhang Y, Wu R, et al. Rebuild doctor-patient trust in medical service delivery in China. Sci Rep. 2020;10(1):21956. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Fu Y, Tang T, Long J, Lin B, Li J, Quan G, et al. Factors associated with using the internet for medical information based on the doctor-patient trust model: a cross-sectional study. BMC Health Serv Res. 2021;21(1):1268. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Tucker JD, Wong B, Nie JB, Kleinman A, Patient-Physician Trust Team. Rebuilding patient-physician trust in China. Lancet. 2016;388(10046):755. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Li D, Hu Y, Pfaff H, Wang L, Deng L, Lu C, et al. Determinants of patients' intention to use the online inquiry services provided by internet hospitals: empirical evidence from China. J Med Internet Res. 2020;22(10):e22716. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Deng W, Yang T, Deng J, Liu R, Sun X, Li G, et al. Investigating factors influencing medical practitioners' resistance to and adoption of internet hospitals in China: mixed methods study. J Med Internet Res. 2023;25:e46621. [ FREE Full text ] [ CrossRef ] [ Medline ]
• 2022 China E-hospital development research report. Shanghai Jiao Tong University. 2022. URL: https://www.100ec.cn/detail--6620464.html [accessed 2023-01-08]
• Alpert JM, Dyer KE, Lafata JE. Patient-centered communication in digital medical encounters. Patient Educ Couns. 2017;100(10):1852-1858. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Alpert JM, Krist AH, Aycock RA, Kreps GL. Applying multiple methods to comprehensively evaluate a patient portal's effectiveness to convey information to patients. J Med Internet Res. May 17, 2016;18(5):e112. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Gerber DE, Beg MS, Duncan T, Gill M, Craddock Lee SJ. Oncology nursing perceptions of patient electronic portal use: a qualitative analysis. Oncol Nurs Forum. Mar 01, 2017;44(2):165-170. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Sieck CJ, Hefner JL, Schnierle J, Florian H, Agarwal A, Rundell K, et al. The rules of engagement: perspectives on secure messaging from experienced ambulatory patient portal users. JMIR Med Inform. 2017;5(3):e13. [ FREE Full text ] [ CrossRef ] [ Medline ]
• van Galen LS, Wang CJ, Nanayakkara PWB, Paranjape K, Kramer MHH, Car J. Telehealth requires expansion of physicians' communication competencies training. Med Teach. 2019;41(6):714-715. [ CrossRef ] [ Medline ]
• Wright HH, O'Shea MC, Sekula J, Mitchell LJ. Assessment of communication skills using telehealth: considerations for educators. Front Med (Lausanne). 2022;9:841309. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Huang M, Wang J, Nicholas S, Maitland E, Guo Z. Development, status quo, and challenges to China's health informatization during COVID-19: evaluation and recommendations. J Med Internet Res. 2021;23(6):e27345. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Zhi L, Yin P, Ren J, Wei G, Zhou J, Wu J, et al. Running an internet hospital in China: perspective based on a case study. J Med Internet Res. 2021;23(9):e18307. [ FREE Full text ] [ CrossRef ] [ Medline ]
• World Medical Association. World Medical Association declaration of Helsinki: ethical principles for medical research involving human subjects. JAMA. 2013;310(20):2191-2194. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Blake JH, Schwemmer MK, Sade RM. The patient-surgeon relationship in the cyber era: communication and information. Thorac Surg Clin. 2012;22(4):531-538. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Fields BG. Regulatory, legal, and ethical considerations of telemedicine. Sleep Med Clin. 2020;15(3):409-416. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Chiang KF, Wang HH, Chien IK, Liou JK, Hung CL, Huang CM, et al. Healthcare providers' perceptions of barriers in implementing of home telecare in Taiwan: a qualitative study. Int J Med Inform. 2015;84(4):277-287. [ CrossRef ] [ Medline ]
• Gray DM, Joseph JJ, Olayiwola JN. Strategies for digital care of vulnerable patients in a COVID-19 world-keeping in touch. JAMA Health Forum. 2020;1(6):e200734. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Miller DP, Latulipe C, Melius KA, Quandt SA, Arcury TA. Primary care providers' views of patient portals: interview study of perceived benefits and consequences. J Med Internet Res. 2016;18(1):e8. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Varsi C, Gammon D, Wibe T, Ruland CM. Patients' reported reasons for non-use of an internet-based patient-provider communication service: qualitative interview study. J Med Internet Res. 2013;15(11):e246. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Cimperman M, Brenčič MM, Trkman P. Analyzing older users' home telehealth services acceptance behavior-applying an extended UTAUT model. Int J Med Inform. 2016;90:22-31. [ CrossRef ] [ Medline ]
• Zhou M, Zhao L, Kong N, Campy KS, Qu S, Wang S. Factors influencing behavior intentions to telehealth by Chinese elderly: an extended TAM model. Int J Med Inform. 2019;126:118-127. [ CrossRef ] [ Medline ]
• 2020 research report on the development of internet hospitals in China. Institute of Healthcare. 2020. URL: http://zk.cn-healthcare.com/doc-show-39773.html [accessed 2023-09-17]
• Bhattarai P, Phillips JL. The role of digital health technologies in management of pain in older people: an integrative review. Arch Gerontol Geriatr. 2017;68:14-24. [ CrossRef ] [ Medline ]
• Cosco TD, Fortuna K, Wister A, Riadi I, Wagner K, Sixsmith A. COVID-19, social isolation, and mental health among older adults: a digital catch-22. J Med Internet Res. 2021;23(5):e21864. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Huang W, Long H, Li J, Tao S, Zheng P, Tang S, et al. Delivery of public health services by Community Health Workers (CHWs) in primary health care settings in China: a systematic review (1996-2016). Glob Health Res Policy. 2018;3:18. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Lohr AM, Ingram M, Nuñez AV, Reinschmidt KM, Carvajal SC. Community-clinical linkages with community health workers in the United States: a scoping review. Health Promot Pract. 2018;19(3):349-360. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Laukka E, Huhtakangas M, Heponiemi T, Kujala S, Kaihlanen AM, Gluschkoff K, et al. Health care professionals' experiences of patient-professional communication over patient portals: systematic review of qualitative studies. J Med Internet Res. 2020;22(12):e21623. [ FREE Full text ] [ CrossRef ] [ Medline ]
• Hefner JL, Sieck CJ, Walker DM. Patient and physician perspectives on training to improve communication through secure messaging: clarifying the rules of engagement. Health Care Manage Rev. 2022;47(1):3-11. [ CrossRef ] [ Medline ]

Abbreviations

Edited by T de Azevedo Cardoso; submitted 22.03.23; peer-reviewed by Y Cao, N Mungoli, A Gangadhara Rao; comments to author 06.09.23; revised version received 27.09.23; accepted 26.02.24; published 29.03.24.

©Yuqiong Zhong, Jessica Hahne, Xiaomin Wang, Xuxi Wang, Ying Wu, Xin Zhang, Xing Liu. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 29.03.2024.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Journal of Medical Internet Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.jmir.org/, as well as this copyright and license information must be included.