Change Password

Your password must have 8 characters or more and contain 3 of the following:.

  • a lower case character, 
  • an upper case character, 
  • a special character 

Password Changed Successfully

Your password has been changed

  • Sign in / Register

Request Username

Can't sign in? Forgot your username?

Enter your email address below and we will send you your username

If the address matches an existing account you will receive an email with instructions to retrieve your username

Fostering Metacognition to Support Student Learning and Performance

  • Julie Dangremond Stanton
  • Amanda J. Sebesta
  • John Dunlosky

*Address correspondence to: Julie Dangremond Stanton ( E-mail Address: [email protected] ).

Department of Cellular Biology, University of Georgia, Athens, GA 30602

Search for more papers by this author

Department of Biology, Saint Louis University, St. Louis, MO 63103

Department of Psychological Sciences, Kent State University, Kent, OH 44240

Metacognition is awareness and control of thinking for learning. Strong metacognitive skills have the power to impact student learning and performance. While metacognition can develop over time with practice, many students struggle to meaningfully engage in metacognitive processes. In an evidence-based teaching guide associated with this paper ( https://lse.ascb.org/evidence-based-teaching-guides/student-metacognition ), we outline the reasons metacognition is critical for learning and summarize relevant research on this topic. We focus on three main areas in which faculty can foster students’ metacognition: supporting student learning strategies (i.e., study skills), encouraging monitoring and control of learning, and promoting social metacognition during group work. We distill insights from key papers into general recommendations for instruction, as well as a special list of four recommendations that instructors can implement in any course. We encourage both instructors and researchers to target metacognition to help students improve their learning and performance.

INTRODUCTION

Supporting the development of metacognition is a powerful way to promote student success in college. Students with strong metacognitive skills are positioned to learn more and perform better than peers who are still developing their metacognition (e.g., Wang et al. , 1990 ). Students with well-developed metacognition can identify concepts they do not understand and select appropriate strategies for learning those concepts. They know how to implement strategies they have selected and carry out their overall study plans. They can evaluate their strategies and adjust their plans based on outcomes. Metacognition allows students to be more expert-like in their thinking and more effective and efficient in their learning. While collaborating in small groups, students can also stimulate metacognition in one another, leading to improved outcomes. Ever since metacognition was first described ( Flavell, 1979 ), enthusiasm for its potential impact on student learning has remained high. In fact, as of today, the most highly cited paper in CBE—Life Sciences Education is an essay on “Promoting Student Metacognition” ( Tanner, 2012 ).

Despite this enthusiasm, instructors face several challenges when attempting to harness metacognition to improve their students’ learning and performance. First, metacognition is a term that has been used so broadly that its meaning may not be clear ( Veenman et al. , 2006 ). We define metacognition as awareness and control of thinking for learning ( Cross and Paris, 1988 ). Metacognition includes metacognitive knowledge , which is your awareness of your own thinking and approaches for learning. Metacognition also includes metacognitive regulation , which is how you control your thinking for learning ( Figure 1 ). Second, metacognition includes multiple processes and skills that are named and emphasized differently in the literature from various disciplines. Yet upon examination, the metacognitive processes and skills from different fields are closely related, and they often overlap (see Supplemental Figure 1). Third, metacognition consists of a person’s thoughts, which may be challenging for that person to describe. The tacit nature of metacognitive processes makes it difficult for instructors to observe metacognition in their students, and it also makes metacognition difficult for researchers to measure. As a result, classroom intervention studies of metacognition—those that are necessary for making the most confident recommendations for promoting student metacognition—have lagged behind foundational and laboratory research on metacognitive processes and skills.

FIGURE 1. Metacognition framework commonly used in biology education research (modified from Schraw and Moshman, 1995 ). This theoretical framework divides metacognition into two components: metacognitive knowledge and metacognitive regulation. Metacognitive knowledge includes what you know about your own thinking and what you know about strategies for learning. Declarative knowledge involves knowing about yourself as a learner, the demands of the task, and what learning strategies exist. Procedural knowledge involves knowing how to use learning strategies. Conditional knowledge involves knowing when and why to use particular learning strategies. Metacognitive regulation involves the actions you take in order to learn. Planning involves deciding what strategies to use for a future learning task and when you will use them. Monitoring involves assessing your understanding of concepts and the effectiveness of your strategies while learning. Evaluating involves appraising your prior plan and adjusting it for future learning.

How do undergraduate students develop metacognitive skills?

To what extent do active learning and generative work 1 promote metacognition?

To what extent do increases in metacognition correspond to increases in achievement in science courses?

FIGURE 2. (A) Landing page for the Student Metacognition guide. The landing page provides a map with sections an instructor can click on to learn more about how to support students’ metacognition. (B) Example paper summary showing instructor recommendations. At the end of each summary in our guide, we used italicized text to point out what instructors should know based on the paper’s results.

The organization of this essay reflects the organization of our evidence-based teaching guide. In the guide, we first define terms and provide important background from papers that highlight the underpinnings and benefits of metacognition ( https://lse.ascb.org/evidence-based-teaching-guides/student-metacognition/benefits-definitions-underpinnings ). We then explore metacognition research by summarizing both classic and recent papers in the field and providing links for readers who want to examine the original studies. We consider three main areas related to metacognition: 1) student strategies for learning, 2) monitoring and control of learning, and 3) social metacognition during group work.

SUPPORTING STUDENTS TO USE EFFECTIVE LEARNING STRATEGIES

What strategies do students use for learning.

First our teaching guide examines metacognition in the context of independent study ( https://lse.ascb.org/evidence-based-teaching-guides/student-metacognition/supporting-student
-learning-strategies ). When students transition to college, they have increased responsibility for directing their learning, which includes making important decisions about how and when to study. Students rely on their metacognition to make those decisions, and they also use metacognitive processes and skills while studying on their own. Empirical work has confirmed what instructors observe about their own students’ studying—many students rely on passive strategies for learning. Students focus on reviewing material as it is written or presented, as opposed to connecting concepts and synthesizing information to make meaning. Some students use approaches that engage their metacognition, but they often do so without a full understanding of the benefits of these approaches ( Karpicke et al. , 2009 ). Students also tend to study based on exam dates and deadlines, rather than planning out when to study ( Hartwig and Dunlosky, 2012 ). As a result, they tend to cram, which is also known in the literature as massing their study. Students continue to cram because this approach is often effective for boosting short-term performance, although it does not promote long-term retention of information.

Which Strategies Should Students Use for Learning?

Here, we make recommendations about what students should do to learn, as opposed to what they typically do. In our teaching guide, we highlight three of the most effective strategies for learning: 1) self-testing, 2) spacing, and 3) interleaving ( https://lse.ascb.org/evidence-based-teaching-guides/student
-metacognition/supporting-student-learning-strategies/
#whatstudentsshould ). These strategies are not yet part of many students’ metacognitive knowledge, but they should know about them and be encouraged to use them while metacognitively regulating their learning. Students self-test when they use flash cards and answer practice questions in an attempt to recall information. Self-testing provides students with opportunities to monitor their understanding of material and identify gaps in their understanding. Self-testing also allows students to activate relevant knowledge and encode prompted information so it can be more easily accessed from their memory in the future ( Dunlosky et al. , 2013 ).

Students space their studying when they spread their learning of the same material over multiple sessions. This approach requires students to intentionally plan their learning instead of focusing only on what is “due” next. Spacing can be combined with retrieval practice , which involves recalling information from memory. For example, self-testing is a form of retrieval practice. Retrieval practice with spacing encourages students to actively recall the same content across several study sessions, which is essential for consolidating information from prior study periods ( Dunlosky et al. , 2013 ). Importantly, when students spread their learning over multiple sessions, they are less susceptible to superficial familiarity with concepts, which can mislead them into thinking they have learned concepts based on recognition alone ( Kornell and Bjork, 2008 ).

Students interleave when they alternate studying of information from one category with studying of information from another category. For example, when students learn categories of amino acid side groups, they should alternate studying nonpolar amino acids with polar amino acids. This allows students to discriminate across categories, which is often critical for correctly solving problems ( Rohrer et al. , 2020 ). Interleaving between categories also supports student learning because it usually results in spacing of study.

How are students enacting specific learning strategies, and do different students enact them in different ways?

To what extent do self-testing, spacing, and interleaving support achievement in the context of undergraduate science courses?

What can instructors do to increase students’ use of effective learning strategies?

What Factors Affect the Strategies Students Should Use to Learn?

Next, we examined the factors that affect what students should do to learn. Although we recommend three well-established strategies for learning, other appropriate strategies can vary based on the learning context. For example, the nature of the material, the type of assessment, the learning objectives, and the instructional methods can render some strategies more effective than others ( Scouller, 1998 ; Sebesta and Bray Speth, 2017 ). Strategies for learning can be characterized as deep if they involve extending and connecting ideas or applying knowledge and skills in new ways ( Baeten et al. , 2010 ). Strategies can be characterized as surface if they involve recalling and reproducing content. While surface strategies are often viewed negatively, there are times when these approaches can be effective for learning ( Hattie and Donoghue, 2016 ). For example, when students have not yet gained background knowledge in an area, they can use surface strategies to acquire the necessary background knowledge. They can then incorporate deep strategies to extend, connect, and apply this knowledge. Importantly, surface and deep strategies can be used simultaneously for effective learning. The use of surface and deep strategies ultimately depends on what students are expected to know and be able to do, and these expectations are set by instructors. Openly discussing these expectations with students can enable them to more readily select effective strategies for learning.

What Challenges Do Students Face in Using Their Metacognition to Enact Effective Strategies?

How can students address challenges they will face when using effective—but effortful—strategies for learning?

What approaches can instructors take to help students overcome these challenges?

ENCOURAGING STUDENTS TO MONITOR AND CONTROL THEIR LEARNING FOR EXAMS

Metacognition can be investigated in the context of any learning task, but in the sciences, metacognitive processes and skills are most often investigated in the context of high-stakes exams. Because exams are a form of assessment common to nearly every science course, in the next part of our teaching guide, we summarized some of the vast research focused on monitoring and control before, during, and after an exam ( https://lse.ascb.org/evidence-based-teaching-guides/student-metacognition/encouraging-students-monitor-control-learning ). In the following section, we demonstrate the kinds of monitoring and control decisions learners make by using an example of introductory biology students studying for an exam on cell division. The students’ instructor has explained that the exam will focus on the stages of mitosis and cytokinesis, and the exam will include both multiple-choice and short-answer questions.

How Should Students Use Metacognition while Preparing for and Taking an Exam?

As students prepare for an exam, they can use metacognition to inform their learning. Students can consider how they will be tested, set goals for their learning, and make a plan to meet their goals. It is expected that students who set specific goals while planning for an exam will be more effective in their studying than students who do not make specific goals. For example, a student who sets a specific goal to identify areas of confusion each week by answering end-of-chapter questions each weekend is expected to do better than a student who sets a more general goal of staying up-to-date on the material. Although some studies include goal setting and planning as one of many metacognitive strategies introduced to students, the influence of task-specific goal setting on academic achievement has not been well studied on its own in the context of science courses.

As students study, it is critical that they monitor both their use of learning strategies and their understanding of concepts. Yet many students struggle to accurately monitor their own understanding ( de Carvalho Filho, 2009 ). In the example we are considering, students may believe they have already learned mitosis because they recognize the terms “prophase,” “metaphase,” “anaphase,” and “telophase” from high school biology. When students read about mitosis in the textbook, processes involving the mitotic spindle may seem familiar because of their exposure to these concepts in class. As a result, students may inaccurately predict that they will perform well on exam questions focused on the mitotic spindle, and their overconfidence may cause them to stop studying the mitotic spindle and related processes ( Thiede et al. , 2003 ). Students often rate their confidence in their learning based on their ability to recognize, rather than recall, concepts.

Instead of focusing on familiarity, students should rate their confidence based on how well they can retrieve relevant information to correctly answer questions. Opportunities for practicing retrieval, such as self-testing, can improve monitoring accuracy. Instructors can help students monitor their understanding more accurately by encouraging students to complete practice exams and giving students feedback on their answers, perhaps in the form of a key or a class discussion ( Rawson and Dunlosky, 2007 ). Returning to the example, if students find they can easily recall the information needed to correctly answer questions about cytokinesis, they may wisely decide to spend their study time on other concepts. In contrast, if students struggle to remember information needed to answer questions about the mitotic spindle, and they answer these questions incorrectly, then they can use this feedback to direct their efforts toward mastering the structure and function of the mitotic spindle.

While taking a high-stakes exam, students can again monitor their performance on a single question, a set of questions, or an entire exam. Their monitoring informs whether they change an answer, with students tending to change answers they judge as incorrect. Accordingly, the accuracy of their monitoring will influence whether their changes result in increased performance ( Koriat and Goldsmith, 1996 ). In some studies, changing answers on an exam has been shown to increase student performance, in contrast to the common belief that a student’s first answer is usually right ( Stylianou-Georgiou and Papanastasiou, 2017 ). Changing answers on an exam can be beneficial if students return to questions they had low confidence in answering and make a judgment on their answers based on the ability to retrieve the information from memory, rather than a sense of familiarity with the concepts. Two important open questions are:

What techniques can students use to improve the accuracy of their monitoring, while preparing for an exam and while taking an exam?

How often do students monitor their understanding when studying on their own?

How Should Students Use Metacognition after Taking an Exam?

How do students develop metacognitive regulation skills such as evaluation?

To what extent does the ability to evaluate affect student learning and performance?

When students evaluate the outcome of their studying and believe their preparation was lacking, to what degree do they adopt more effective strategies for the next exam?

PROMOTING SOCIAL METACOGNITION DURING GROUP WORK

Next, our teaching guide covers a relatively new area of inquiry in the field of metacognition called social metacognition , which is also known as socially shared metacognition ( https://lse.ascb.org/evidence-based-teaching-guides/student
-metacognition/promoting-social-metacognition
-group-work ). Science students are expected to learn not only on their own, but also in the context of small groups. Understanding social metacognition is important because it can support effective student learning during collaborations both inside and outside the classroom. While individual metacognition involves awareness and control of one’s own thinking, social metacognition involves awareness and control of others’ thinking. For example, social metacognition happens when students share ideas with peers, invite peers to evaluate their ideas, and evaluate ideas shared by peers ( Goos et al. , 2002 ). Students also use social metacognition when they assess, modify, and enact one another’s strategies for solving problems ( Van De Bogart et al. , 2017 ). While enacting problem-solving strategies, students can evaluate their peers’ hypotheses, predictions, explanations, and interpretations. Importantly, metacognition and social metacognition are expected to positively affect one another ( Chiu and Kuo, 2009 ).

How do social metacognition and individual metacognition affect one another?

How can science instructors help students to effectively use social metacognition during group work?

CONCLUSIONS

We encourage instructors to support students’ success by helping them develop their metacognition. Our teaching guide ends with an Instructor Checklist of actions instructors can take to include opportunities for metacognitive practice in their courses ( https://lse.ascb.org/wp-content/uploads/sites/10/2020/12/Student-Metacognition-Instructor-Checklist.pdf ). We also provide a list of the most promising approaches instructors can take, called Four Strategies to Implement in Any Course ( https://lse.ascb.org/wp-content/uploads/sites/10/2020/12/Four
-Strategies-to-Foster-Student-Metacognition.pdf ). We not only encourage instructors to consider using these strategies, but given that more evidence for their efficacy is needed from classroom investigations, we also encourage instructors to evaluate and report how well these strategies are improving their students’ achievement. By exploring and supporting students’ metacognitive development, we can help them learn more and perform better in our courses, which will enable them to develop into lifelong learners.

1 Generative work “involves students working individually or collaboratively to generate ideas and products that go beyond what has been presented to them” ( Andrews et al. , 2019 , p2). Generative work is often stimulated by active-learning approaches.

ACKNOWLEDGMENTS

We are grateful to Cynthia Brame, Kristy Wilson, and Adele Wolfson for their insightful feedback on this paper and the guide. This material is based upon work supported in part by the National Science Foundation under grant number 1942318 (to J.D.S.). Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

  • Andrews, T. C., Auerbach, A. J. J., & Grant, E. F. ( 2019 ). Exploring the relationship between teacher knowledge and active-learning implementation in large college biology courses . CBE—Life Sciences Education , 18 (4), ar48. Link ,  Google Scholar
  • Baeten, M., Kyndt, E., Struyven, K., & Dochy, F. ( 2010 ). Using student-centred learning environments to stimulate deep approaches to learning: Factors encouraging or discouraging their effectiveness . Educational Research Review , 5 (3), 243–260. Google Scholar
  • Carr, M., & Taasoobshirazi, G. ( 2008 ). Metacognition in the gifted: Connections to expertise . In Shaughnessy, M. F.Veenman, M.Kleyn-Kennedy, C. (Eds.), Meta-cognition: A recent review of research, theory and perspectives (pp. 109–125). Hauppauge, NY: Nova Sciences Publishers. Google Scholar
  • Choi, M. M., & Kuo, S. W. ( 2009 ). Social metacognition in groups: Benefits, difficulties, learning and teaching . In Larson, C. B. (Ed.), Metacognition: New research developments (pp. 117–136). Hauppauge, NY: Nova Science Publishers. Google Scholar
  • Cross, D. R., & Paris, S. G. ( 1988 ). Developmental and instructional analyses of children’s metacognition and reading comprehension . Journal of Educational Psychology , 80 (2), 131–142. Google Scholar
  • de Carvalho Filho, M. K. ( 2009 ). Confidence judgments in real classroom settings: Monitoring performance in different types of tests . International Journal of Psychology , 44 (2), 93–108. Medline ,  Google Scholar
  • Dunlosky, J., Rawson, K. A., Marsh, E. J., Nathan, M. J., & Willingham, D. T. ( 2013 ). Improving students’ learning with effective learning techniques: Promising directions from cognitive and educational psychology . Psychological Science in the Public Interest , 14 (1), 4–58. Medline ,  Google Scholar
  • Dye, K. M., & Stanton, J. D. ( 2017 ). Metacognition in upper-division biology students: Awareness does not always lead to control . CBE—Life Sciences Education , 16 (2), ar31. Link ,  Google Scholar
  • Flavell, J. H. ( 1979 ). Meta-cognition and cognitive monitoring—New area of cognitive-developmental inquiry . American Psychologist , 34 (10), 906–911. Google Scholar
  • Goos, M., Galbraith, P., & Renshaw, P. ( 2002 ). Socially mediated metacognition: Creating collaborative zones of proximal development in small group problem solving . Educational Studies in Mathematics , 49 (2), 193–223. Google Scholar
  • Hartwig, M. K., & Dunlosky, J. ( 2012 ). Study strategies of college students: Are self-testing and scheduling related to achievement? Psychonomic Bulletin & Review , 19 (1), 126–134. Medline ,  Google Scholar
  • Hattie, J. A., & Donoghue, G. M. ( 2016 ). Learning strategies: A synthesis and conceptual model . Nature Partner Journal Science of Learning , 1 (1), 1–13. Google Scholar
  • Karpicke, J. D., Butler, A. C., & Roediger, H. L. , III . ( 2009 ). Metacognitive strategies in student learning: Do students practise retrieval when they study on their own? Memory , 17 (4), 471–479. Medline ,  Google Scholar
  • Koriat, A., & Bjork, R. A. ( 2005 ). Illusions of competence in monitoring one’s knowledge during study . Journal of Experimental Psychology: Learning, Memory, Cognition , 31 (2), 187–194. Medline ,  Google Scholar
  • Koriat, A., & Goldsmith, M. ( 1996 ). Monitoring and control processes in the strategic regulation of memory accuracy . Psychological Review , 103 (3), 490–517. Medline ,  Google Scholar
  • Kornell, N., & Bjork, R. A. ( 2008 ). Learning concepts and categories is spacing the “enemy of induction”? Psychological Science , 19 (6), 585–592. Medline ,  Google Scholar
  • Kuhbandner, C., & Emmerdinger, K. J. ( 2019 ). Do students really prefer repeated rereading over testing when studying textbooks? A reexamination . Memory , 27 (7), 952–961. Medline ,  Google Scholar
  • McGuire, S. Y. ( 2006 ). The impact of supplemental instruction on teaching students how to learn . New Directions for Teaching and Learning , 2006 (106), 3–10. Google Scholar
  • Miller, M., & Hadwin, A. F. ( 2015 ). Scripting and awareness tools for regulating collaborative learning: Changing the landscape of support in CSCL . Computers in Human Behavior , 52 , 573–588. Google Scholar
  • Nelson, T., & Narens, L. ( 1990 ). Metamemory: A theoretical framework and new findings . Psychology of Learning and Motivation , 26 , 125–141. Google Scholar
  • Rawson, K. A., & Dunlosky, J. ( 2007 ). Improving students’ self-evaluation of learning for key concepts in textbook materials . European Journal of Cognitive Psychology , 19 (4–5), 559–579. Google Scholar
  • Roediger, H. L., III, & Karpicke, J. D. ( 2006 ). Test-enhanced learning: Taking memory tests improves long-term retention . Psychological Science , 17 (3), 249–255. Medline ,  Google Scholar
  • Rohrer, D., Dedrick, R. F., Hartwig, M. K., & Cheung, C.-N. ( 2020 ). A randomized controlled trial of interleaved mathematics practice . Journal of Educational Psychology , 112 (1), 40. Google Scholar
  • Sabel, J. L., Dauer, J. T., & Forbes, C. T. ( 2017 ). Introductory biology students’ use of enhanced answer keys and reflection questions to engage in metacognition and enhance understanding . CBE—Life Sciences Education , 16 (3), ar40. Link ,  Google Scholar
  • Schraw, G., & Moshman, D. ( 1995 ). Metacognitive theories . Educational Psychology Review , 7 (4), 351–371. Google Scholar
  • Scouller, K. ( 1998 ). The influence of assessment method on students’ learning approaches: Multiple choice question examination versus assignment essay . Higher Education , 35 (4), 453–472. Google Scholar
  • Sebesta, A. J., & Bray Speth, E. ( 2017 ). How should I study for the exam? Self-regulated learning strategies and achievement in introductory biology . CBE—Life Sciences Education , 16 (2), ar30. Link ,  Google Scholar
  • Stanton, J. D., Dye, K. M., & Johnson, M. S. ( 2019 ). Knowledge of learning makes a difference: A comparison of metacognition in introductory and senior-level biology students . CBE—Life Sciences Education , 18 (2), ar24. Link ,  Google Scholar
  • Stanton, J. D., Neider, X. N., Gallegos, I. J., & Clark, N. C. ( 2015 ). Differences in metacognitive regulation in introductory biology students: When prompts are not enough . CBE—Life Sciences Education , 14 (2), ar15. Link ,  Google Scholar
  • Stylianou-Georgiou, A., & Papanastasiou, E. C. ( 2017 ). Answer changing in testing situations: The role of metacognition in deciding which answers to review . Educational Research and Evaluation , 23 (3–4), 102–118. Google Scholar
  • Tanner, K. D. ( 2012 ). Promoting student metacognition . CBE—Life Sciences Education , 11 (2), 113–120. Link ,  Google Scholar
  • Thiede, K. W., Anderson, M., & Therriault, D. ( 2003 ). Accuracy of metacognitive monitoring affects learning of texts . Journal of Educational Psychology , 95 (1), 66–73. Google Scholar
  • Van De Bogart, K. L., Dounas-Frazer, D. R., Lewandowski, H., & Stetzer, M. R. ( 2017 ). Investigating the role of socially mediated metacognition during collaborative troubleshooting of electric circuits . Physical Review Physics Education Research , 13 (2), 020116. Google Scholar
  • Veenman, M. V. J., van Hout-Wolters, B. H., & Afflerbach, P. ( 2006 ). Metacognition and learning: Conceptual and methodological considerations . Metacognition and Learning , 1 (1), 3–14. Google Scholar
  • Wang, M. C., Haertel, G. D., & Walberg, H. J. ( 1990 ). What influences learning? A content analysis of review literature . Journal of Educational Research , 84 (1), 30–43. Google Scholar
  • Stephanie M. Halmo ,
  • Kira A. Yamini , and
  • Elisabeth Schussler, Monitoring Editor
  • Stephanie M. Gardner ,
  • Aakanksha Angra , and
  • Joseph A. Harsh
  • Kristy J Wilson, Monitoring Editor
  • Diane K. Angell ,
  • Sharon Lane-Getaz ,
  • Taylor Okonek , and
  • Stephanie Smith
  • Jennifer Knight, Monitoring Editor
  • Jennifer K. Knight ,
  • Daniel C. Weaver ,
  • Melanie E. Peffer , and
  • Zachary S. Hazlett
  • Tessa C. Andrews, Monitoring Editor
  • Emily K. Bremers ,
  • Sammantha Fuller , and
  • Stephanie Gardner, Monitoring Editor
  • Undergraduates' Experiences with Online and in-Person Courses Provide Opportunities for Improving Student-Centered Biology Laboratory Instruction Journal of Microbiology & Biology Education, Vol. 23, No. 1
  • Student attitudes in an innovative active learning approach in calculus 4 February 2022 | International Journal of Mathematical Education in Science and Technology, Vol. 5
  • Lauren Hensley ,
  • Amy Kulesza ,
  • Joshua Peri ,
  • Anna C. Brady ,
  • Christopher A. Wolters ,
  • David Sovic , and
  • Caroline Breitenberger
  • Joel K. Abraham, Monitoring Editor
  • Persistent Miscalibration for Low and High Achievers despite Practice Test Feedback in an Introductory Biology Course Journal of Microbiology & Biology Education, Vol. 22, No. 2

metacognitive strategies research paper

© 2021 J. D. Stanton et al. CBE—Life Sciences Education © 2021 The American Society for Cell Biology. This article is distributed by The American Society for Cell Biology under license from the author(s). It is available to the public under an Attribution–Noncommercial–Share Alike 3.0 Unported Creative Commons License (http://creativecommons.org/licenses/by-nc-sa/3.0).

ORIGINAL RESEARCH article

Metacognitive strategies and development of critical thinking in higher education.

Silvia F. Rivas

  • 1 Departamento de Psicología Básica, Psicobiología y Metodología de CC, Facultad de Psicología, Universidad de Salamanca, Salamanca, Spain
  • 2 Departamento de Ciencias de la Educación, Facultad de Educación y Humanidades, Universidad del Bío-Bío, Sede Chillán, Chile

More and more often, we hear that higher education should foment critical thinking. The new skills focus for university teaching grants a central role to critical thinking in new study plans; however, using these skills well requires a certain degree of conscientiousness and its regulation. Metacognition therefore plays a crucial role in developing critical thinking and consists of a person being aware of their own thinking processes in order to improve them for better knowledge acquisition. Critical thinking depends on these metacognitive mechanisms functioning well, being conscious of the processes, actions, and emotions in play, and thereby having the chance to understand what has not been done well and correcting it. Even when there is evidence of the relation between metacognitive processes and critical thinking, there are still few initiatives which seek to clarify which process determines which other one, or whether there is interdependence between both. What we present in this study is therefore an intervention proposal to develop critical thinking and meta knowledge skills. In this context, Problem-Based Learning is a useful tool to develop these skills in higher education. The ARDESOS-DIAPROVE program seeks to foment critical thinking via metacognition and Problem-Based Learning methodology. It is known that learning quality improves when students apply metacognition; it is also known that effective problem-solving depends not only on critical thinking, but also on the skill of realization, and of cognitive and non-cognitive regulation. The study presented hereinafter therefore has the fundamental objective of showing whether instruction in critical thinking (ARDESOS-DIAPROVE) influences students’ metacognitive processes. One consequence of this is that critical thinking improves with the use of metacognition. The sample was comprised of first-year psychology students at Public University of the North of Spain who were undergoing the aforementioned program; PENCRISAL was used to evaluate critical thinking skills and the Metacognitive Activities Inventory (MAI) for evaluating metacognition. We expected an increase in critical thinking scores and metacognition following this intervention. As a conclusion, we indicate actions to incentivize metacognitive work among participants, both individually via reflective questions and decision diagrams, and at the interactional level with dialogues and reflective debates which strengthen critical thinking.

Introduction

One of the principal objectives which education must cover is helping our students become autonomous and effective. Students’ ability to use strategies which help them direct their motivation toward action in the direction of the meta-proposal is a central aspect to keep at the front of our minds when considering education. This is where metacognition comes into play—knowledge about knowledge itself, a component which is in charge of directing, monitoring, regulating, organizing, and planning our skills in a helpful way, once these have come into operation. Metacognition helps form autonomous students, increasing consciousness about their own cognitive processes and their self-regulation so that they can regulate their own learning and transfer it to any area of their lives. As we see, it is a conscious activity of high-level thinking which allows us to look into and reflect upon how we learn and to control our own strategies and learning processes. We must therefore approach a problem which is increasing in our time, that of learning and knowledge from the perspective of active participation by students. To achieve these objectives of “learning to learn” we must use adequate cognitive learning strategies, among which we can highlight those oriented toward self-learning, developing metacognitive strategies, and critical thinking.

Metacognition is one of the research areas, which has contributed the most to the formation of the new conceptions of learning and teaching. In this sense, it has advanced within the constructivist conceptions of learning, which have attributed an increasing role to student consciousness and to the regulation which they exercise over their own learning ( Glaser, 1994 ).

Metacognition was initially introduced by John Flavell in the early 1970s. He affirmed that metacognition, on one side, refers to “the knowledge which one has about his own cognitive processes products, or any other matter related with them” and on the other, “to the active supervision and consequent regulation and organization of these processes in relation with the objects or cognitive data upon which they act” ( Flavell, 1976 ; p. 232). Based on this, we can differentiate two components of metacognition: one of a declarative nature, which is metacognitive knowledge, referring to knowledge of the person and the task, and another of a procedural nature, which is metacognitive control or self-regulated learning, which is always directed toward a goal and controlled by the learner.

Different authors have pointed out that metacognition presents these areas of thought or skills, aimed knowledge or toward the regulation of thought and action, mainly proposing a binary organization in which attentional processes are oriented, on occasions, toward an object or subject, and the other hand, toward to interact with objects and/or subjects ( Drigas and Mitsea, 2021 ). However, it is possible to understand metacognition from another approach that establishes more levels of use of metacognitive thinking to promote knowledge, awareness, and intelligence, known as the eight pillars of metacognition model ( Drigas and Mitsea, 2020 ). These pillars allow thought to promote the use of deep knowledge, cognitive processes, self-regulation, functional adaptation to society, pattern recognition and operations, and even meaningful memorization ( Drigas and Mitsea, 2020 ).

In addition to the above, Drigas and Mitsea’s model establishes different levels where metacognition could be used, in a complex sequence from stimuli to transcendental ideas, in which each of the pillars could manifest a different facet of the process metacognitive, thus establishing a dialectical and integrative approach to learning and knowledge, allowing it to be understood as an evolutionary and complex process in stages ( Drigas and Mitsea, 2021 ).

All this clarifies the importance of and need for metacognition, not only in education but also in our modern society, since this need to “teach how to learn” and the capacity to “learn how to learn” in order to achieve autonomous learning and transfer it to any area of our lives will let us face problems more successfully. This becomes a relevant challenge, especially today where it is required to have a broad view regarding reflection and consciousness, and to transcend simplistic and reductionist models that seek to center the problem of knowledge only around the neurobiological or the phenomenological scope ( Sattin et al., 2021 ).

Critical thinking depends largely on these mechanisms functioning well and being conscious of the processes used, since this gives us the opportunity to understand what has not been done well and correct it in the future. Consciousness for critical thinking would imply a continuous process of reuse of thought, in escalations that allow thinking to be oriented both toward the objects of the world and toward the subjective interior, allowing to determine the ideas that give greater security to the person, and in that perspective, the metacognitive process, represents this use of Awareness, also allowing the generation of an identity of knowing being ( Drigas and Mitsea, 2021 ).

We know that thinking critically involves reasoning and deciding to effectively solve a problem or reach goals. However, effective use of these skills requires a certain degree of consciousness and regulation of them. The ARDESOS-DIAPROVE program seeks precisely to foment critical thinking, in part, via metacognition ( Saiz and Rivas, 2011 , 2012 , 2016 ).

However, it is not only centered on developing cognitive components, as this would be an important limitation. Since the 1990s, it has been known that non-cognitive components play a crucial role in developing critical thinking. However, there are few studies focusing on this relation. This intervention therefore considers both dimensions, where metacognitive processes play an essential role by providing evaluation and control mechanisms over the cognitive dimension.

Metacognition and Critical Thinking

Critical Thinking is a concept without a firm consensus, as there have been and still are varying conceptions regarding it. Its nature is so complex that it is hard to synthesize all its aspects in a single definition. While there are numerous conceptions about critical thinking, it is necessary to be precise about which definition we will use. We understand that “ critical thinking is a knowledge-seeking process via reasoning skills to solve problems and make decisions which allows us to more effectively achieve our desired results” ( Saiz and Rivas, 2008 , p. 131). Thinking effectively is desirable in all areas of individual and collective action. Currently, the background of the present field of critical thinking is also based in argumentation. Reasoning is used as the fundamental basis for all activities labeled as thinking. In a way, thinking cannot easily be decoupled from reasoning, at least if our understanding of it is “deriving something from another thing.” Inference or judgment is what we essentially find behind the concept of thinking. The question, though, is whether it can be affirmed that thinking is only reasoning. Some defend this concept ( Johnson, 2008 ), while others believe the opposite, that solving problems and making decisions are activities which also form part of thinking processes ( Halpern, 2003 ; Halpern and Dunn, 2021 , 2022 ). To move forward in this sense, we will return to our previous definition. In that definition, we have specified intellectual activity with a goal intrinsic to all mental processes, namely, seeking knowledge. Achieving our ends depends not only on the intellectual dimension, as we may need our motor or perceptive activities, so it contributes little to affirm that critical thinking allows us to achieve our objectives as we can also achieve them by doing other activities. It is important for us to make an effort to identify the mental processes responsible for thinking and distinguish them from other things.

Normally, we think to solve our problems. This is the second important activity of thought. A problem can be solved by reasoning, but also by planning course of action or selecting the best strategy for the situation. Apart from reasoning, we must therefore also make decisions to resolve difficulties. Choosing is one of the most frequent and important activities which we do. Because of this, we prefer to give it the leading role it deserves in a definition of thinking. Solving problems demands multiple intellectual activities, including reasoning, deciding, planning, etc. The final characteristic goes beyond the mechanisms peculiar to inference. What can be seen at the moment of delineating what it means to think effectively is that concepts are grouped together which go beyond the nuclear ideas of what has to do with inferring or reasoning. The majority of theoreticians in the field ( APA, 1990 ; Ennis, 1996 ; Halpern, 1998 , 2003 ; Paul and Elder, 2001 ; Facione, 2011 ; Halpern and Dunn, 2021 , 2022 ) consider that, in order to carry out this type of thinking effectively, apart from having this skill set, the intervention of other types of components is necessary, such as metacognition and motivation. This is why we consider it necessary to speak about the components of critical thinking, as we can see in Figure 1 :

www.frontiersin.org

Figure 1 . Components of critical thinking ( Saiz, 2020 ).

In the nature of thinking, there are two types of components: the cognitive and the non-cognitive. The former include perception, learning, and memory processes. Learning is any knowledge acquisition mechanism, the most important of which is thinking. The latter refer to motivation and interests (attitudes tend to be understood as dispositions, inclinations…something close to motives); with metacognition remaining as a process which shares cognitive and non-cognitive aspects as it incorporates aspects of both judgment (evaluation) and disposition (control/efficiency) about thoughts ( Azevedo, 2020 ; Shekhar and Rahnev, 2021 ). Both the cognitive and non-cognitive components are essential to improve critical thinking, as one component is incomplete without the other, that is, neither cognitive skills nor dispositions on their own suffice to train a person to think critically. In general, relations are bidirectional, although for didactic reasons only unidirectional relations appear in Figure 1 ( Rivas et al., 2017 ). This is because learning is a dynamic process which is subject to all types of influence. For instance, if a student is motivated, they will work more and better—or at least, this is what is hoped for. If they can achieve good test scores as well, it can be supposed that motivation is reinforced, so that they will continue existing behaviors in the same direction that is, working hard and well on their studies. This latter point appears to arise at least because of an adjustment between expectations and reality which the student achieves thanks to metacognition, which allows them to effectively attribute their achievements to their efforts ( Ugartetxea, 2001 ).

Metacognition, which is our interest in this paper, should also have bidirectional relations with critical thinking. Metacognition tends to be understood as the degree of consciousness which we have about our own mental processes and similar to the capacity for self-regulation, that is, planning and organization ( Mayor et al., 1993 ). We observe that these two ideas have very different natures. The former is simpler, being the degree of consciousness which we reach about an internal mechanism or process. The latter is a less precise idea, since everything which has to do with self-regulation is hard to differentiate from a way of understanding motivation, such as the entire tradition of intrinsic motivation and self-determination from Deci, his collaborators, and other authors of this focus (see, e.g., Deci and Ryan, 1985 ; Ryan and Deci, 2000 ). The important thing is to emphasize the executive dimension of metacognition, more than the degree of consciousness, for practical reasons. It can be expected that this dimension has a greater influence on the learning process than that of consciousness, although there is little doubt that we have to establish both as necessary and sufficient conditions. However, the data must speak in this regard. Due to all of this, and as we shall see hereinafter, the intervention designed incorporates both components to improve critical thinking skills.

We can observe, though, that the basic core of critical thinking continues to be topics related to skills, in our case, reasoning, problem-solving, and decision-making. The fact that we incorporate concepts of another nature, such as motivation, in a description of critical thinking is justified because it has been proven that, when speaking about critical thinking, the fact of centering solely on skills does not allow for fully gathering its complexity. The purpose of the schematic in Figure 2 is to provide conceptual clarity to the adjective “critical” in the expression critical thinking . If we understand critical to refer to effective , we should also consider that effectiveness is not, as previously mentioned, solely achieved with skills. They must be joined together with other mechanisms during different moments. Intellectual skills alone cannot achieve the effectiveness assumed within the term “critical.” First, for said skills to get underway, we must want to do so. Motivation therefore comes into play before skills and puts them into operation. For its part, metacognition allows us to take advantage of directing, organizing, and planning our skills and act once they have begun to work. Motivation thus activates our abilities, while metacognition lets them be more effective. The final objective should always be to gain proper knowledge of reality to resolve our problems.

www.frontiersin.org

Figure 2 . Purpose of critical thinking ( Saiz, 2020 , p.27).

We consider that the fact of referring to components of critical thinking while differentiating the skills of motivation and metacognition aids with the conceptual clarification we seek. On one side, we specify the skills which we discuss, and on another, we mention which other components are related to, and even overlap with them. We must be conscious of how difficult it is to find “pure” mental processes. Planning a course of action, an essential trait of metacognition, demands reflection, prediction, choice, comparison, and evaluation… And this, evidently, is thinking. The different levels or dimensions of our mental activity must be related and integrated. Our aim is to be able to identify what is substantial in thinking to know what we are able to improve and evaluate.

It is widely known that for our personal and professional functioning, thinking is necessary and useful. When we want to change a situation or gain something, all our mental mechanisms go into motion. We perceive the situation, identify relevant aspects of the problem, analyze all the available information, and appraise everything we analyze. We make judgments about the most relevant matters, decide about the options or pathways for resolution, execute the plan, obtain results, evaluate the results, estimate whether we have achieved our purpose and, according to the level of satisfaction following this estimation, consider our course of action good, or not.

The topic we must pose now is what things are teachable. It is useful to specify that what is acquired is clearly cognitive and some of the non-cognitive, because motivation can be stimulated or promoted, but not taught. The concepts of knowledge and wisdom are its basis. Mental representation and knowledge only become wisdom when we can apply it to reality, when we take it out of our mind and adequately situate it in the world. For our teaching purposes, we only have to take a position about whether knowledge is what makes critical thinking develop, or vice versa. For us, skills must be directly taught, and dominion is secondary. Up to now, we have established the components of critical thinking, but these elements still have to be interrelated properly. What we normally find are skills or components placed side by side or overlapping, but not the ways in which they influence each other. Lipman (2003) may have developed the most complete theory of critical and creative thinking, along Paul and his group, in second place, with their universal thought structures ( Paul and Elder, 2006 ). However, a proposal for the relation between the elements is lacking.

To try to explain the relation between the components of thought, we will use Figure 2 as an aid.

The ultimate goal of critical thinking is change that is, passing from one state of wellbeing into a better state. This change is only the fruit of results, which must be the best. Effectiveness is simple achieving our goals in the best way possible. There are many possible results, but for our ends, there are always some which are better than others. Our position must be for effectiveness, the best response, the best solution. Reaching a goal is resolving or achieving something, and for this, we have mechanisms available which tell us which are the best course of action. Making decisions and solving problems are fundamental skills which are mutually interrelated. Decision strategies come before a solution. Choosing a course of action always comes before its execution, so it is easy to understand that decisions contribute to solutions.

Decisions must not come before reflection, although this often can and does happen. As we have already mentioned, the fundamental skills of critical thinking, in most cases, have been reduced to reasoning, and to a certain degree, this is justified. There is an entire important epistemological current behind this, within which the theory of argumentation makes no distinction, at least syntactically, between argumentation and explanation. However, for us this distinction is essential, especially in practice ( Saiz, 2020 ). We will only center on an essential difference for our purpose. Argumentation may have to do with values and realities, but explanation only has to do with the latter. We can argue about beliefs, convictions, and facts, but we can only explain realities. Faced with an explanation of reality, any argumentation would be secondary. Thus, explanation will always be the central skill in critical thinking.

The change which is sought is always expressed in reality. Problems always are manifested and resolved with actions, and these are always a reality. An argument about realities aids in explaining them. An argument about values upholds a belief or a conviction. However, beliefs always influence behavior; thus, indirectly, the argument winds up being about realities. One may argue, for example, only for or against the death penalty, and reach the conviction that it is good or bad and ultimately take a position for or against allowing it. This is why we say that deciding always comes before resolving; furthermore, resolution always means deciding about something in a particular direction—it always means choosing and taking an option; furthermore, deciding is often only from two possibilities, the better or that which is not better, or which is not as good. Decisions are made based on the best option possible of all those which can be presented. Resolution is a dichotomy. Since our basic end lies within reality, explanation must be constituted as the basic pillar to produce change. Argumentation must therefore be at the service of causality (explanation), and both must be in the service of solid decisions leading us to the best solution or change of situation. We now believe that the relation established in Figure 2 can be better understood. From this relation, we propose that thinking critically means reaching the best explanation for an event, phenomenon, or problem in order to know how to effectively resolve it ( Saiz, 2017 , p.19). This idea, to our judgment, is the best summary of the nature of critical thinking. It clarifies details and makes explicit the components of critical thinking.

Classroom Activities to Develop Metacognition

We will present a set of strategies to promote metacognitive work in the classroom in this section, aimed at improving critical thinking skills. These strategies can be applied both at the university level and the secondary school level; we will thus focus on these two levels, although metacognitive strategies can be worked on from an earlier age ( Jaramillo and Osses, 2012 ; Tamayo-Alzate et al., 2019 ) and some authors have indicated that psychological maturity has a greater impact on effectively achieving metacognition ( Sastre-Riba, 2012 ; García et al., 2016 ).

At the individual level, metacognition can be worked on via applying questions aimed at the relevant tasks which must be undertaken regarding a task (meta-knowledge questions), for example:

- Do I know how much I know about this subject?

- Do I have clear instructions and know what action is expected from me?

- How much time do I have?

- Am I covering the proper and necessary subjects, or is there anything important left out?

- How do I know that my work is right?

- Have I covered every point of the rubric for the work to gain a good grade or a sufficient level?

These reflective questions facilitate supervising knowledge level, resource use, and the final product achieved, so that the decisions taken for said activities are the best and excellent learning results are achieved.

Graphs or decision diagrams can also be used to aid in organizing these questions during the different phases of executing a task (planning, progress, and final evaluation), which is clearly linked with the knowledge and control processes of metacognition ( Mateos, 2001 ). These diagrams are more complex and elaborate strategies than the questions, but are effective when monitoring the steps considered in the activity ( Ossa et al., 2016 ). Decision diagrams begin from a question or task, detailing the principal steps to take, and associating an alternative (YES or NO) to each step, which leads to the next step whenever the decision is affirmative, or to improve or go further into the step taken if the decision is negative.

Finally, we can work on thinking aloud, a strategy which facilitates making the thoughts explicit and conscious, allowing us to monitor their knowledge, decisions, and actions to promote conscious planning, supervision and evaluation ( Ávila et al., 2017 ; Dahik et al., 2019 ). For example:

- While asking a question, the student thinks aloud: I am having problems with this part of the task, and I may have to ask the teacher to know whether I am right.

Thinking aloud can be done individually or in pairs, allowing for active monitoring of decisions and questions arising from cognitive and procedural work done by the student.

Apart from the preceding strategies, it is also possible to fortify metacognitive development via personal interactions based on dialogue between both the students themselves and between the teacher and individual students. One initial strategy, similar to thinking out loud in pairs, is reflective dialogue between teacher and student, a technique which allows for exchanging deep questions and answers, where the student becomes conscious of their knowledge and practice thanks to dialogical interventions by the teacher ( Urdaneta, 2014 ).

Reflective dialogue can also be done via reflective feedback implemented by the teacher for the students to learn by themselves about the positive and negative aspects of their performance on a task.

Finally, another activity based on dialogue and interaction is related to metacognitive argumentation ( Sánchez-Castaño et al., 2015 ), a strategy which uses argumentative resources to establish a valid argumentative structure to facilitate responding to a question or applying it to a debate. While argumentative analysis is based on logic and the search for solid reasons, these can have higher or lower confidence and reliability as a function of the data which they provide. Thus, if a reflective argumentative process is performed, via questioning reasons or identifying counterarguments, there is more depth and density in the argumentative structure, achieving greater confidence and validity.

We can note that metacognition development strategies are based on reflective capacity, which allow thought to repeatedly review information and decisions to consider, without immediately taking sides or being carried away by superficial or biased ideas or data. Critical thought benefits strongly from applying this reflective process, which guides both data management and cognitive process use. These strategies can also be developed in various formats (written, graphic, oral, individual, and dialogical), providing teachers a wide range of tools to strengthen learning and thinking.

Metacognitive Strategies to Improve Critical Thinking

In this section, we will describe the fundamental metacognitive strategies addressed in our critical thinking skills development program ARDESOS-DIAPROVE.

First, one of the active learning methodologies applied is Problem-Based Learning (PBL). This pedagogical strategy is student-centered and encourages autonomous and participative learning, orienting students toward more active and decisive learning. In PBL each situation must be approached as a problem-solving task, making it necessary to investigate, understand, interpret, reason, decide, and resolve. It is presented as a methodology which facilitates joint knowledge acquisition and skill learning. It is also good for working on daily problems via relevant situations, considerably reducing the distance between learning context and personal/professional life and aiding the connection between theory and practice, which promote the highly desired transference. It favors organization and the capacity to decide about problem-solving, which also improves performance and knowledge about the students’ own learning processes. Because of all this, this methodology aids in reflection and analysis processes, which in turn promotes metacognitive skill development.

The procedure which we carried out in the classroom with all the activities is based on the philosophy of gradual learning control transference ( Mateos, 2001 ). During instruction, the teacher takes on the role of model and guide for students’ cognitive and metacognitive activity, gradually bringing them into participating in an increasing level of competency, and slowly withdrawing support in order to attain control over the students’ learning process. This methodology develops in four phases: (1) explicit instruction, where the teacher directly explains the skills which will be worked on; (2) guided practice, where the teacher acts as a collaborator to guide and aid students in self-regulation; and (3) cooperative practice, where cooperative group work facilitates interaction with a peer group collaborating to resolve the problem. By explaining, elaborating, and justifying their own points of view and alternative solutions, greater consciousness, reflection, and control over their own cognitive processes is promoted. Finally, (4) individual practice is what allows students to place their learning into practice in individual evaluation tasks.

Regarding the tasks, it is important to highlight that the activities must be aimed not only at acquiring declarative knowledge, but also at procedural knowledge. The objective of practical tasks, apart from developing fundamental knowledge, is to develop CT skills among students in both comprehension and expression in order to favor their learning and its transference. The problems used must be common situations, close to our students’ reality. The important thing in our task of teaching critical thinking is its usefulness to our students, which can only be achieved during application since we only know something when we are capable of applying it. We are not interested in students merely developing critical skills; they must also be able to generalize their intellectual skills, for which they must perceive them as useful in order to want to acquire them. Finally, they will have to actively participate to apply them to solving problems. Furthermore, if we study the different ways of reasoning without context, via overly academic problems, their application to the personal sphere becomes impossible, leading them to be considered hardly useful. This makes it important to contextualize skills within everyday problems or situations which help us get students to use them regularly and understand their usefulness.

Reflecting on how one carries things out in practice and analyzing mistakes are ways to encourage success and autonomy in learning. These self-regulation strategies are the properly metacognitive part of our study. The teacher has various resources to increase these strategies, particularly feedback oriented toward task resolution. Similarly, one of the most effective instruments to achieve it is using rubrics, a central tool for our methodology. These guides, used in student performance evaluations, describe the specific characteristics of a task at various performance levels, in order to clarify expectations for students’ work, evaluate their execution, and facilitate feedback. This type of technique also allows students to direct their own activity. We use them with this double goal in mind; on the one hand, they aid students in carrying out tasks, since they help divide the complex tasks they have to do into simpler jobs, and on the other, they help evaluate the task. Rubrics guide students in the skills and knowledge they need to acquire as well as facilitating self-evaluation, thereby favoring responsibility in their learning. Task rubrics are also the guide for evaluation which teachers carry out in classrooms, where they specify, review, and correctly resolve the tasks which students do according to the rubric criteria. Providing complete feedback to students is a crucial aspect for the learning process. Thus, in all sessions time is dedicated to carrying it out. This is what will allow them to move ahead in self-regulated skill learning.

According to what we have seen, there is a wide range of positions when it comes to defining critical thinking. However, there is consensus in the fact that critical thinking involves cognitive, attitudinal, and metacognitive components, which together favor proper performance in critical thinking ( Ennis, 1987 ; Facione, 1990 ). This important relation between metacognition and critical thinking has been widely studied in the literature ( Berardi-Coletta et al., 1995 ; Antonietti et al., 2000 ; Kuhn and Dean, 2004 ; Black, 2005 ; Coutinho et al., 2005 ; Orion and Kali, 2005 ; Schroyens, 2005 ; Akama, 2006 ; Choy and Cheah, 2009 ; Magno, 2010 ; Arslan, 2014 ) although not always in an applied way. Field studies indicate the existence of relations between teaching metacognitive strategies and progress in students’ higher-order thinking processes ( Schraw, 1998 ; Kramarski et al., 2002 ; Van der Stel and Veenman, 2010 ). Metacognition is thus considered one of the most relevant predictors of achieving a complex higher-order thought process.

Along the same lines, different studies show the importance of developing metacognitive skills among students as it is related not only with developing critical thinking, but also with academic achievement and self-regulated learning ( Klimenko and Alvares, 2009 ; Magno, 2010 ; Doganay and Demir, 2011 ; Özsoy, 2011 ). Klimenko and Alvares (2009) indicated that one way for students to acquire necessary tools to encourage autonomous learning is making cognitive and metacognitive strategies explicit and well-used and that teachers’ role is to be mediators and guides. Inspite of this evidence, there is less research about the use of metacognitive strategies in encouraging critical thinking. The principal reason is probably that it is methodologically difficult to gather direct data about active metacognitive processes which are complex by nature. Self-reporting is also still very common in metacognition evaluation, and there are few studies which have included objective measurements aiding in methodological precision for evaluating metacognition.

However, in recent years, greater importance has been assigned to teaching metacognitive skills in the educational system, as they aid students in developing higher-order thinking processes and improving their academic success ( Flavell, 2004 ; Larkin, 2009 ). Because of this, classrooms have seen teaching and learning strategies emphasizing metacognitive knowledge and regulation. Returning to our objective, which is to improve critical thinking via the ARDESOS-DIAPROVE program, we have achieved our goal in an acceptable way ( Saiz and Rivas, 2011 , 2012 , 2016 ).

However, we need to know which specific factors contribute to this improvement. We have covered significant ground through different studies, one of which we present here. In this one, we attempt to find out the role of metacognition in critical thinking. This is the central objective of the study. Our program includes motivational and metacognitive variables. Therefore, we seek to find out whether metacognition improves after this instruction program focused on metacognition. Therefore, our hypothesis is simple: we expect that the lesson will improve our students’ metacognition. The idea is to know whether applying metacognition helps us achieve improved critical thinking and whether after this change metaknowledge itself improves. In other words, improved critical thinking performance will make us think better about thinking processes themselves. If this can be improved, we can expect that in the future it will have a greater influence on critical thinking. The idea is to be able to demonstrate that applying specifically metacognitive techniques, the processes themselves will subsequently improve in quality and therefore contribute better volume and quality to reasoning tasks, decision-making and problem-solving.

Materials and Methods

Participants.

In the present study, we used a sample of 89 students in a first-year psychology course at Public University of the North of Spain. 82% (73) were women, and the other 18% (16) were men. Participants’ median age was 18.93 ( SD 1.744).

Instruments

Critical thinking test.

To measure critical thinking skills, we applied the PENCRISAL test ( Saiz and Rivas, 2008 ; Rivas and Saiz, 2012 ). The PENCRISAL is a battery consisting of 35 production problem situations with an open-answer format, composed of five factors: Deductive Reasoning , Inductive Reasoning , Practical Reasoning , Decision-Making , and Problem-Solving , with seven items per factor. Items for each factor gather the most representative structures of fundamental critical thinking skills.

The items’ format is open, so that the person has to answer a concrete question, adding a justification for the reasons behind their answer. Because of this, there are standardized correction criteria assigning values between 0 and 2 points as a function of answer quality. This test offers us a total score of critical thinking skills and another five scores referring to the five factors. The value range is located between 0 and 72 points as a maximum limit for total test scoring, and between 0 and 14 for each of the five scales. The reliability measures present adequate precision levels according to the scoring procedures, with the lowest Cronbach’s alpha values at 0.632, and the test–retest correlation at 0.786 ( Rivas and Saiz, 2012 ). PENCRISAL administration was done over the Internet via the evaluation platform SelectSurvey.NET V5: http://24.selectsurvey.net/pensamiento-critico/Login.aspx .

Metacognitive Skill Inventory

Metacognitive skill evaluation was done via the metacognitive awareness inventory from Schraw and Dennison (1994) (MAI; Huertas Bustos et al., 2014 ). This questionnaire has 52 Likert scale-type items with five points. The items are distributed in two general dimensions: cognitive knowledge (C) and regulation of cognition (R). This provides ample coverage for the two aforementioned ideas about metaknowledge. There are also eight defined subcategories within each general dimension. For C, these are: declarative knowledge (DK), procedural knowledge (PK), and conditional knowledge (CK). In R, we find: organization (O), monitoring (M), and evaluation (E). This instrument comprehensively, and fairly clearly, brings together essential aspects of metacognition. On one side, there is the level of consciousness, containing types of knowledge—declarative, procedural, and strategic. On the other, it considers everything important in the processes of self-regulation, planning, organization, direction or control (monitoring), adjustment (troubleshooting), and considering the results achieved (evaluation). It provides a very complete vision of everything important in this dimension. Cronbach’s alpha for this instrument is 0.94, showing good internal consistency.

Intervention Program

As previously mentioned, in this study, we applied the third version of the ARDESOS_DIAPROVE program ( Saiz and Rivas, 2016 ; Saiz, 2020 ), with the objective of improving thinking skills. This program is centered on directly teaching the skills which we consider essential to develop critical thinking and for proper performance in our daily affairs. For this, we must use reasoning and good problem-solving and decision-making strategies, with one of the most fundamental parts of our intervention being the use of everyday situations to develop these abilities.

DIAPROVE methodology incorporates three new and essential aspects: developing observation, the combined use of facts and deduction, and effective management of de-confirmation procedures, or discarding hypotheses. These are the foundation of our teaching, which requires specific teaching–learning techniques.

The intervention took place over 16 weeks and is designed to be applied in classrooms over a timeframe of 55–60 h. The program is applied in classes of around 30–35 students divided into groups of four for classwork in collaborative groups, and organized into six activity blocks: (1) nature of critical thinking, (2) problem-solving and effectiveness, (3) explanation and causality, (4) deduction and explanation, (5) argumentation and deduction, and (6) problem-solving and decision-making. These blocks are assembled maintaining homogeneity, facilitating a global integrated skill focus which helps form comprehension and use of the different structures in any situation as well as a greater degree of ability within the domain of each skill.

Our program made an integrated use of problem-based learning (PBL) and cooperative learning (CL) as didactic teaching and learning strategies in the critical thinking program. These methodologies jointly exert a positive influence on the students, allowing them to participate more actively in the learning process, achieve better results in contextualizing content and developing skills and abilities for problem-solving, and improve motivation.

To carry out our methodology in the classrooms, we have designed a teaching system aligned with these directives. Two types of tasks are done: (1) comprehension and (2) production. The materials we used to carry out these activities are the same for all the program blocks. One key element in our aim of teaching how to think critically must be its usefulness to our students, which is only achieved through application. This makes it important to contextualize reasoning types within common situations or problems, aiding students to use them regularly and understand their usefulness. Our intention with the materials we use is to face the problems of transference, usefulness, integrated skills, and how to produce these things. Accordingly, the materials used for the tasks are: (1) common situations and (2) professional/personal problems.

The tasks which the students perform take place over a week. They work in cooperative groups in class, and then review, correct, and clarify together, promoting reflection on their achievements and errors, which fortifies metacognition. Students get the necessary feedback on the work performed which will help them progressively acquire fundamental procedural contents. Our goal here is that students become conscious of their own thought processes in order to improve them. In this way, via the dialogue achieved between teachers and students as well as between the students themselves in their cooperative work, metacognition is developed. For conscious performance of tasks, the students will receive rubrics for each and every task to guide them in their completion.

Application of the ARDESOS-DIAPROVE program was done across a semester in the Psychology Department of the Public University of the North of Spain. One week before teaching began; critical thinking and metacognition evaluations were done. This was also done 1 week after the intervention ended, in order to gather the second measurement for PENCRISAL and MAI. The timelapse between the pre-treatment and post-treatment measurements was 4 months. The intervention was done by instructors with training and good experience in the program.

To test our objective, we used a quasi-experimental pre-post design with repeated measurements.

Statistical Analysis

For statistical analysis, we used the IBM SPSS Statistics 26 statistical packet. The statistical tools and techniques used were: frequency and percentage tables for qualitative variables, exploratory and descriptive analysis of quantitative variables with a goodness of fit test to the normal Gaussian model, habitual descriptive statistics (median, SD, etc.) for numerical variables, and Student’s t -tests for significance of difference.

To begin, a descriptive analysis of the study variables was carried out. Tables 1 , 2 present the summary of descriptions for the scores obtained by students in the sample, as well as the asymmetry and kurtosis coefficients for their distribution.

www.frontiersin.org

Table 1 . Description of critical thinking measurement (PENCRISAL).

www.frontiersin.org

Table 2 . Description of metacognition measurement (MAI).

As we see in the description of all study variables, the evidence is that the majority of them adequately fit the normal model, although some present significant deviations which can be explained by sample size.

Next, to verify whether there were significant differences in the metacognition variable based on measurements before and after the intervention, we contrasted medians for samples related with Student’s t -test (see Table 3 ).

www.frontiersin.org

Table 3 . Comparison of the METAKNOWLEDGE variable as a function of PRE-POST measurements.

The results show that there are significant differences in the metaknowledge scale total and in most of its dimensions, where all the post medians for both the scale overall and for the three dimensions of the knowledge factor (declarative, procedural, and conditional) are higher than the pre-medians. However, in the cognition regulation dimension, there are only significant differences in the total and in the planning, organization, and monitoring dimensions. The medians are also greater in the post-test than the pre-test. However, the troubleshooting and evaluation dimensions do not differ significantly after intervention.

Finally, for critical thinking skills, the results show significant differences in the scale total and in the five factors regarding the measurement time, where performance medians rise after intervention (see Table 4 ).

www.frontiersin.org

Table 4 . Comparison of the CRITICAL THINKING variable as a function of PRE-POST measurements.

These results show how metacognition improves due to CT intervention, as well as how critical thinking also improves with metacognitive intervention and CT skills intervention. Thus, it improves how people think about thinking as well as about the results achieved, since metacognition supports decision-making and final evaluation about proper strategies to solve problems.

Discussion and Conclusions

The general aim of our study was to know whether a critical thinking intervention program can also influence metacognitive processes. We know that our teaching methodology improves cross-sectional skills in argumentation, explanation, decision-making, and problem-solving, but we do not know if this intervention also directly or indirectly influences metacognition. In our study, we sought to shed light on this little-known point. If we bear in mind the centrality of how we think about thinking for our cognitive machinery to function properly and reach the best results possible in the problems we face, it is hard to understand the lack of attention given to this theme in other research. Our study aimed to remedy this deficiency somewhat.

As said in the introduction, metacognition has to do with consciousness, planning, and regulation of our activities. These mechanisms, as understood by many authors, have a blended cognitive and non-cognitive nature, which is a conceptual imprecision; what is known, though, is the enormous influence they exert on fundamental thinking processes. However, there is a large knowledge gap about the factors which make metacognition itself improve. This second research lacuna is what we have partly aimed to shrink here as well with this study. Our guide has been the idea of knowing how to improve metacognition from a teaching initiative and from the improvement of fundamental critical thinking skills.

Our study has shed light in both directions, albeit in a modest way, since its design does not allow us to unequivocally discern some of the results obtained. However, we believe that the data provide relevant information to know more about existing relations between skills and metacognition, something which has seen little contrast. These results allow us to better describe these relations, guiding the design of future studies which can better discern their roles. Our data have shown that this relation is bidirectional, so that metacognition improves thinking skills and vice versa. It remains to establish a sequence of independent factors to avoid this confusion, something which the present study has aided with to be able to design future research in this area.

As the results show, total differences in almost all metaknowledge dimensions are higher after intervention; specifically, we see how in the knowledge factor the declarative, procedural, and conditional dimensions improve in post-measurements. This improvement moves in the direction we predicted. However, the cognitive regulation dimension only shows differences in the total, and in the planning, organization, and regulation dimensions. We can see how the declarative knowledge dimensions are more sensitive than the procedural ones to change, and within the latter, the dimensions over which we have more control are also more sensitive. With troubleshooting and evaluation, no changes are seen after intervention. We may interpret this lack of effects as being due to how everything referring to evaluating results is highly determined by calibration capacity, which is influenced by personality factors not considered in our study. Regarding critical thinking, we found differences in all its dimensions, with higher scores following intervention. We can tentatively state that this improved performance can be influenced not only by interventions, but also by the metacognitive improvement observed, although our study was incapable of separating these two factors, and merely established their relation.

As we know, when people think about thinking they can always increase their critical thinking performance. Being conscious of the mechanisms used in problem-solving and decision-making always contributes to improving their execution. However, we need to go into other topics to identify the specific determinants of these effects. Does performance improve because skills are metacognitively benefited? If so, how? Is it only the levels of consciousness which aid in regulating and planning execution, or do other factors also have to participate? What level of thinking skills can be beneficial for metacognition? At what skill level does this metacognitive change happen? And finally, we know that teaching is always metacognitive to the extent that it helps us know how to proceed with sufficient clarity, but does performance level modify consciousness or regulation level of our action? Do bad results paralyze metacognitive activity while good ones stimulate it? Ultimately, all of these open questions are the future implications which our current study has suggested. We believe them to be exciting and necessary challenges, which must be faced sooner rather than later. Finally, we cannot forget the implications derived from specific metacognitive instruction, as presented at the start of this study. An intervention of this type should also help us partially answer the aforementioned questions, as we cannot obviate what can be modified or changed by direct metacognition instruction.

Data Availability Statement

The original contributions presented in the study are included in the article/supplementary material; further inquiries can be directed to the corresponding author.

Ethics Statement

Ethical review and approval was not required for the study on human participants in accordance with the local legislation and institutional requirements. The patients/participants provided their written informed consent to participate in this study.

Author Contributions

SR and CS contributed to the conception and design of the study. SR organized the database, performed the statistical analysis, and wrote the first draft of the manuscript. SR, CS, and CO wrote sections of the manuscript. All authors contributed to the article and approved the submitted version.

This study was partly financed by the Project FONDECYT no. 11220056 ANID-Chile.

Conflict of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s Note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Akama, K. (2006). Relations among self-efficacy, goal setting, and metacognitive experiences in problem solving. Psychol. Rep. 98, 895–907. doi: 10.2466/pr0.98.3.895-907

PubMed Abstract | CrossRef Full Text | Google Scholar

Antonietti, A., Ignazi, S., and Perego, P. (2000). Metacognitive knowledge about problem solving methods. Br. J. Educ. Psychol. 70, 1–16. doi: 10.1348/000709900157921

APA (1990). Critical thinking: A statement of expert consensus for purposes of educational assessment and instruction. Executive Summary “The Delphi Report.”

Google Scholar

Arslan, S. (2014). An investigation of the relationships between metacognition and self-regulation with structural equation. Int. Online J. Educ. Sci. 6, 603–611. doi: 10.15345/IOJES.2014.03.009

CrossRef Full Text | Google Scholar

Ávila, M., Bianchetti, M., and González, A. (2017). Uso del método “Think Aloud” en la investigación cualitativa. Pistas Educ. 39, 26–38.

Azevedo, R. (2020). Reflections on the field of metacognition: issues, challenges, and opportunities. Metacogn. Learn. 15, 91–98. doi: 10.1007/s11409-020-09231-x

Berardi-Coletta, B., Buyer, L. S., Dominowski, R. L., and Rellinger, E. R. (1995). Metacognition and problem solving: a process-oriented approach. J. Consult. Clin. Psychol. 21, 205–223.

Black, S. (2005). Teaching students to think critically. Educ. Digest 70, 42–47.

Choy, S. C., and Cheah, P. K. (2009). Teacher perceptions of critical thinking among students and its influence on higher education. Int. J. Teach. Learn. Higher Educ. 20, 198–206.

Coutinho, S., Wiemer-Hastings, K., Skowronski, J. J., and Britt, M. A. (2005). Metacognition, need for cognition and use of explanations during ongoing learning and problem solving. Learn. Individ. Differ. 15, 321–337. doi: 10.1016/j.lindif.2005.06.001

Dahik, S., Cáneppa, C., Dahik, C., and Feijoò, K. (2019). Estrategias de Think-Aloud para mejorar la habilidad de lectura en estudiantes en el centro de idiomas en la universidad técnica de Babahoyo. Rev. Magaz. Ciencias 4, 65–83. doi: 10.5281/zenodo.3239552

Deci, E. L., and Ryan, R. M. (1985). The general causality orientations scale: self-determination in personality. J. Res. Pers. 19, 109–134. doi: 10.1016/0092-6566(85)90023-6

Doganay, A., and Demir, O. (2011). Comparison of the level of using metacognitive strategies during study between high achieving and low achieving prospective teachers. Educ. Sci. Theor. Pract. 11, 2036–2043.

Drigas, A., and Mitsea, E. (2020). The 8 pillars of metacognition. Int. J. Emerg. Technol. Learn. 15, 162–178. doi: 10.3991/ijet.v15i21.14907

Drigas, A., and Mitsea, E. (2021). 8 pillars X 8 layers model of metacognition: educational strategies, exercises and trainings. Int. J. Online Biomed. Eng. 17, 115–134. doi: 10.3991/ijoe.v17i08.23563

Ennis, R. H. (1987). “A taxonomy of critical thinking dispositions and abilities,” in Teaching Thinking Skills. eds. J. B. Baron and R. J. Sternberg (New York: Freeman and Company), 9–26.

Ennis, R. H. (1996). Critical Thinking. Upper Saddle River, NJ: Prentice-Hall

Facione, P. A. (1990). Critical Thinking: A Statement of expert consensus for Purposes of Educational Assessment and Instruction—Executive Summary of the delphi Report. Millbrae: California Academic Press

Facione, P. A. (2011). Think Critically. New York: Prentice-Hall.

Flavell, J. H. (1976). “Metacognitive aspects of problem solving,” in The Nature of Intelligence. ed. L. B. Resnik (Hillsdale, N.J: Erlbaum), 231–235.

Flavell, J. H. (2004). Theory of the mind development: retrospect and prospect. Merrill-Palmer Q. 50, 274–290. doi: 10.1353/mpq.2004.0018

García, T., Rodríguez, C., González-Castro, P., Álvarez-García, D., and González-Pienda, J.-A. (2016). Metacognición y funcionamiento ejecutivo en Educación Primaria [Metacognition and executive functioning in Elementary School]. Ann. Psychol. 32, 474–483. doi: 10.6018/analesps.32.2.202891

Glaser, R. (1994). “Learning theory and instruction,” in International Perspectives on Psychological Science. Vol. 2. eds. G. D’Ydewalle, P. Eelen, and B. Bertelson (NJ: Erlbaum)

Halpern, D. (1998). Teaching critical thinking for transfer across domains—dispositions, skills, structure training, and metacognitive monitoring. Am. Psychol. 53, 449–455. doi: 10.1037/0003-066X.53.4.449

Halpern, D. (2003). Halpern Critical Thinking Assessment Using Everyday Situations: Background and Scoring Standards. Claremont, CA: Claremont McKenna College.

Halpern, D. F., and Dunn, D. S. (2021). Critical thinking: A model of intelligence for solving real-world problems. J. Intellig. 9:22. doi: 10.3390/jintelligence9020022

Halpern, D. F., and Dunn, D. S. (2022). Thought and Knowledge. An Introduction to Critical-Thinking . 6th Edn. New York: Taylor and Francis.

Huertas Bustos, A. P., Vesga Bravo, G. J., and Gilando León, M. (2014). Validación del instrumento “Inventario de Habilidades Metacognitivas (MAI)” con estudiantes colombianos. Praxis Saber 5, 55–74. doi: 10.19053/22160159.3022

Jaramillo, S., and Osses, S. (2012). Validación de un Instrumento sobre Metacognición para Estudiantes de Segundo Ciclo de Educación General Básica. Estud. Pedag. 38, 117–131. doi: 10.4067/S0718-07052012000200008

Johnson, R. H. (2008). “Critical thinking, logic and argumentation,” in Paper presented at the Conferencia Internacional: Lógica, Argumentación y Pensamiento Crítico. Santiago de Chile. January 8–11.

Klimenko, O., and Alvares, J. L. (2009). Aprender cómo aprendo: la enseñanza de estrategias metacognitivas. Educ. Educ. 12, 11–28.

Kramarski, B., Mevarceh, Z. R., and Arami, M. (2002). The effect of metacognitive instruction on solving mathematical authentic tasks. Educ. Stud. Math. 49, 225–250. doi: 10.1023/A:1016282811724

Kuhn, D., and Dean, D. (2004). Metacognition: a bridge between cognitive psychology and educational practice. Theory Pract. 43, 268–274. doi: 10.1207/s15430421tip4304_4

Larkin, S. (2009). Metacognition in Young Children. New York, NY: Routledge

Lipman, M. (2003). Thinking in Education (2nd Edn.). Cambridge, MA: Cambridge University Press

Magno, C. (2010). The role of metacognitive skills in developing critical thinking. Metacogn. Learn. 5, 137–156. doi: 10.1007/s11409-010-9054-4

Mateos, M. (2001). Metacognición y Educación. Buenos Aires: Aique

Mayor, J., Suengas, A., and González Marqués, J. (1993). Estrategias Metacognitivas. Aprender a Aprendery Aprender a Pensar. Madrid: Síntesis

Orion, N., and Kali, Y. (2005). The effect of an earth-science learning program on students’ scientific thinking skills. J. Geosci. Educ. 53, 387–394. doi: 10.5408/1089-9995-53.4.387

Ossa, C., Rivas, S.F., and Saiz, C. (2016). Estrategias metacognitivas en el desarrollo del análisis argumentativo En IV Seminário Internacional Cognição, aprendizagem e desempenho. eds. J. Casanova, C. Bisinoto, and L. Almeida (Braga: Livro de atas), 30–47.

Özsoy, G. (2011). An investigation of the relationship between metacognition and mathematics achievement. Asia Pac. Educ. Rev. 12, 227–235. doi: 10.1007/s12564-010-9129-6

Paul, R., and Elder, L. (2001). Critical Thinking Handbook: Basic Theory and Instructional Structures. Dillon Beach, CA: Foundation for Critical Thinking

Paul, R., and Elder, A. D. (2006). Critical Thinking. Learn the Tools the Best Thinkers Use. Upper Saddle River, NJ: Pearson/Prentice Hall

Rivas, S. F., and Saiz, C. (2012). Validación y propiedades psicométricas de la prueba de pensamiento crítico PENCRISAL . Rev. Electrón. Metodol. Aplic. 17, 18–34.

Rivas, S. F., Saiz, C., and Ossa, C. (2017). “ Desarrollo de las estrategias metacognitivas mediante el programa de instrucción en pensamiento crítico ARDESOS .” in II Seminario Internacional de 660 Pensamiento Crítico. Manizales (Colombia). de octubre de 11–13, 2017.

Ryan, R. M., and Deci, E. L. (2000). Intrinsic and extrinsic motivations: classic definitions and new directions. Contemp. Educ. Psychol. 21, 54–67. doi: 10.1006/ceps.1999.1020

Saiz, C. (2017). Pensamiento Crítico y Cambio. Madrid: Pirámide.

Saiz, C. (2020). Pensamiento Crítico y Eficacia. 2ª Edn. Madrid: Pirámide.

Saiz, C., and Rivas, S. F. (2008). Evaluación en pensamiento crítico: una propuesta para diferenciar formasde pensar. Ergo. Nueva Época 22-23, 25–66.

Saiz, C., and Rivas, S. F. (2011). Evaluation of the ARDESOS program: an initiative to improve criticalthinking skills. J. Scholar. Teach. Learn. 11, 34–51.

Saiz, C., and Rivas, S. F. (2012). Pensamiento crítico y aprendizaje basado en problemas. Rev. Docenc. Univ. 10, 325–346. doi: 10.4995/redu.2012.6026

Saiz, C., and Rivas, S. F. (2016). New teaching techniques to improve critical thinking. DIAPROVE Methodol. 40, 3–36.

Sánchez-Castaño, J. A., Castaño-Mejía, O. Y., and Tamayo-Alzate, O. E. (2015). La argumentación metacognitiva en el aula de ciencias. Rev. Latin. Cienc. Soc. 13, 1153–1168. doi: 10.11600/1692715x.13242110214

Sastre-Riba, S. (2012). Alta capacidad intelectual: perfeccionismo y regulación metacognitiva. Rev. Neurol. 54, S21–S29. doi: 10.33588/rn.54S01.2012011

Sattin, D., Magnani, F. G., Bartesaghi, L., Caputo, M., Fittipaldo, A. V., Cacciatore, M., et al. (2021). Theoretical models of consciousness: a scoping review. Brain Sci. 11:535. doi: 10.3390/brainsci11050535

Schraw, G. (1998). Promoting general metacognitive awareness. Instr. Sci. 26, 113–125. doi: 10.1023/A:1003044231033

Schraw, G., and Dennison, R. (1994). Assessing metacognitive awareness. Contemp. Educ. Psychol. 19, 460–475. doi: 10.1006/ceps.1994.1033

Schroyens, W. (2005). Knowledge and thought: an introduction to critical thinking. Exp. Psychol. 52, 163–164. doi: 10.1027/1618-3169.52.2.163

Shekhar, M., and Rahnev, D. (2021). Sources of metacognitive inefficiency. Trends Cogn. Sci. 25, 12–23. doi: 10.1016/j.tics.2020.10.007

Tamayo-Alzate, O., Cadavid-Alzate, V., and Montoya-Londoño, D. (2019). Análisis metacognitivo en estudiantes de básica, durante la resolución de dos situaciones experimentales en la clase de Ciencias Naturales. Rev. Colomb. Educ. 76, 117–141. doi: 10.17227/rce.num76-4188

Ugartetxea, J. (2001). Motivación y metacognición, más que una relación. Relieve 7:4442. doi: 10.7203/relieve.7.2.4442

Urdaneta, M. (2014). Diálogo para la reflexión: compartiendo la experiencia de aula desde el proyecto pedagógico. Innov. Educ. 16, 43–49. doi: 10.22458/ie.v16i21.902

Van der Stel, M., and Veenman, M. V. J. (2010). Development of metacognitive skillfulness: a longitudinal study. Learn. Individ. Differ. 20, 220–224. doi: 10.1016/j.lindif.2009.11.005

Keywords: critical thinking, instruction, evaluation, metacognition, problem-solving

Citation: Rivas SF, Saiz C and Ossa C (2022) Metacognitive Strategies and Development of Critical Thinking in Higher Education. Front. Psychol . 13:913219. doi: 10.3389/fpsyg.2022.913219

Received: 05 April 2022; Accepted: 19 May 2022; Published: 15 June 2022.

Reviewed by:

Copyright © 2022 Rivas, Saiz and Ossa. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY) . The use, distribution or reproduction in other forums is permitted, provided the original author(s) and the copyright owner(s) are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms.

*Correspondence: Silvia F. Rivas, [email protected]

Disclaimer: All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article or claim that may be made by its manufacturer is not guaranteed or endorsed by the publisher.

Book cover

Towards a Theory of Thinking pp 203–214 Cite as

The Development of Metacognitive Competences

  • Wolfgang Schneider 4  
  • First Online: 11 November 2009

2653 Accesses

6 Citations

Part of the book series: On Thinking ((ONTHINKING))

This paper describes historical and current trends in research on the development of metacognitive competencies. Stimulated by classic theoretical analyses of the concept of metacognition initiated by Ann Brown, John Flavell and their colleagues, contemporary extensions of the concept emphasize the important roles of both procedural and declarative metacognition for successful information processes. Major research findings on the development of these two components of metacognition are reviewed, and links between children’s early “theory of mind” and subsequent verbalizable metamemory are described. Next, new evidence on children’s metacognitive development in childhood and adolescence is summarized, indicating major shifts in children’s declarative metacognitive knowledge, in particular, their strategy knowledge, between the end of kindergarten and the end of elementary school. Although similarly fast developments could not be demonstrated for procedural metacognitive knowledge, several empirical studies suggest developmental changes in the relationship between monitoring and self-regulatory abilities, with older (but not younger) children being able to regulate their ­achievement-related behavior based on the outcome of their monitoring attempts. Finally, the paper reviews classic and contemporary applications of ­metacognitive theory to various educational settings, generally illustrating the importance of metacognition for various aspects of academic performance.

This is a preview of subscription content, log in via an institution .

Buying options

  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
  • Available as EPUB and PDF
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
  • Durable hardcover edition

Tax calculation will be finalised at checkout

Purchases are for personal use only

Artelt C, Schiefele U, Schneider W (2002) Predictors of reading literacy. Eur J Psychol Educ 16:363-383

Article   Google Scholar  

Astington JW, Jenkins JM (1999) A longitudinal study of the relation between language and theory of mind development. Dev Psychol 35:1311-1320

Article   CAS   PubMed   Google Scholar  

Borkowski JG, Milstead M, Hale C (1988) Components of children’s metamemory: implications for strategy generalization. In: Weinert FE, Perlmutter M (eds) Memory development: universal changes and individual differences. Erlbaum, Hillsdale, NJ, pp 73-100

Google Scholar  

Brown AL, Bransford JD, Ferrara RA, Campione JC (1983) Learning, remembering, and understanding. In: Flavell JH, Markham EM (eds) Handbook of child psychology. Cognitive development, vol 3 Wiley, New York, pp 77-166

Cultice JC, Somerville SC, Wellman HM (1983) Preschoolers’ memory monitoring: feeling-of-knowing judgments. Child Dev 54:1480-1486

DeLoache JS, Brown AL (1984) Where do I go next? Intelligent searching by very young children. Dev Psychol 20:37-44

Desoete A, Veenman M (eds) (2006) Metacognition in mathematics education. Nova Science, Haupauge, NY

Dufresne A, Kobasigawa A (1989) Children’s spontaneous allocation of study time: differential and sufficient aspects. J Exp Child Psychol 47:274-296

Efklides A (2001) Metacognitive experiences in problem solving: metacognition, motivation, and self-regulation. In: Efklides A, Kuhl J, Sorrentino RM (eds) Trends and prospects in motivation research. Kluwer, Dordrecht, The Netherlands, pp 297-323

Flavell JH (1979) Metacognition and cognitive monitoring a new area of cognitive-developmental inquiry. Am Psychol 34:906-911

Flavell JH (2000) Development of children’s knowledge about the mental world. Int J Behav Dev 24:15-23

Flavell JH, Wellman HM (1977) Metamemory. In: Kail R, Hagen J (eds) Perspectives on the development of memory and cognition. Erlbaum, Hillsdale, NJ, pp 3-33

Flavell JH, Miller PH, Miller SA (2002) Cognitive development, 4th edn. Prentice-Hall, Inc., Englewood Cliffs, NJ

Garner R (1987) Metacognition and reading comprehension. Ablex, Norwood, NJ

Ghatala ES, Levin JR, Pressley M, Goodwin D (1986) A componential analysis of effects of derived and supplied strategy-utility information on children’s strategy selections. J Exp Child Psychol 41:76-92

Goswami U (2008) Cognitive development - The learning brain, 2nd edn. Psychology Press, Hove, UK

Hasselhorn M (1990) The emergence of strategic knowledge activation in categorical clustering during retrieval. J Exp Child Psychol 50:59-80

Joyner MH, Kurtz-Costes B (1997) Metamemory development. In: Cowan N (ed) The development of memory in childhood. Psychology Press, Hove East Sussex, UK, pp 275-300

Justice EM (1985) Preschoolers’ knowledge and use of behaviors varying in strategic effectiveness. Merrill Palmer Q 35:363-377

Koriat A (1993) How do we know that we know? The accessibility model of the feeling of knowing. Psychol Rev 100:609-639

Kuhn D (1999) Metacognitive development. In: Balter L, Tamis-LeMonda CS (eds) Child psychology: a handbook of contemporary issues. Psychology Press, Philadelphia, PA, pp 259-286

Kuhn D (2000) Theory of mind, metacognition, and reasoning: a life-span perspective. In: Mitchell P, Riggs KJ (eds) Children’s reasoning and the mind. Psychology Press, Hove, UK, pp 301-326

Lockl K, Schneider W (2002) Developmental trends in children’s feeling-of-knowing judgements. Int J Behav Dev 26:327-333

Lockl K, Schneider W (2004) The effects of incentives and instructions on children’s allocation of study time. Eur J Dev Psychol 1:153-169

Lockl K, Schneider W (2006) Precursors of metamemory in young children: the role of theory of mind and metacognitive vocabulary. Metacognition Learn 1:15-31

Lockl K, Schneider W (2007) Knowledge about the mind: links between theory of mind and later metamemory. Child Dev 78:148-167

Article   PubMed   Google Scholar  

Masur EF, McIntyre CW, Flavell JH (1973) Developmental changes in apportionment of study time among items in a multitrial free recall task. J Exp Child Psychol 15:237-246

Metcalfe J (2002) Is study time allocated selectively to a region of proximal learning? J Exp Psychol Gen 131:349-363

Moely BE, Santulli KA, Obach MS (1995) Strategy instruction, metacognition, and motivation in the elementary school classroom. In: Weinert FE, Schneider W (eds) Memory performance and competencies: issues in growth and development. Erlbaum, Mahwah, NJ, pp 301-321

Nelson TO (1996) Consciousness and metacognition. Am Psychol 51:102-116

Nelson TO, Narens L (1990) Metamemory: a theoretical framework and new findings. In: Bower G (ed) The psychology of learning and motivation: advances in research and theory, vol 26. Academic Press, New York, pp 125-173

Nelson TO, Narens L (1994) Why investigate metacognition? In: Metcalfe J, Shimamura AP (eds) Metacognition. Knowing about knowing. MIT Press, Cambridge, MA, pp 1-25

Palincsar AS (1986) The role of dialogue in providing scaffolded instruction. Educ Psychol 21:73-98

Palincsar AS, Brown AL (1984) Reciprocal teaching of comprehension-fostering and comprehension-monitoring activities. Cognit Instruct 1:117-175

Paris SG, Oka ER (1986) Children’s reading strategies, metacognition, and motivation. Dev Rev 6:25-56

Perner J (1991) Understanding the representational mind. MIT Press, Cambridge, MA

Pressley M (1995) What is intellectual development about in the 1990s? In: Weinert FE, Schneider W (eds) Memory performance and competencies: issues in growth and development. Erlbaum, Hillsdale, NJ, pp 1-25

Pressley M, Afflerbach P (1995) Verbal protocols of reading: the nature of constructively responsive reading. Erlbaum, Hillsdale, NJ

Pressley M, Borkowski JG, Schneider W (1989) Good information processing: what it is and what education can do to promote it. Int J Educ Res 13:857-867

Roebers C, von der Linden N, Howie P, Schneider W (2007) Children’s metamemorial judgments in an event recall task. J Exp Child Psychol 97:117-137

Rosenshine B, Meister C (1994) Reciprocal teaching: a review of the research. Rev Educ Res 64:479-530

Ruffman T, Slade L, Crowe E (2002) The relation between children’s and mother’s mental state language and theory-of-mind understanding. Child Dev 73:734-751

Schneider W (1986) The role of conceptual knowledge and metamemory in the development of organizational processes in memory. J Exp Child Psychol 42:218-236

Schneider W, Lockl K (2002) The development of metacognitive knowledge in children and adolescents. In: Perfect TJ, Schwartz BL (eds) Applied metacognition. Cambridge University Press, Cambridge, UK, pp 224-257

Chapter   Google Scholar  

Schneider W, Lockl K (2008) Procedural metacognition in children: evidence for developmental trends. In: Dunlosky J, Bjork RA (eds) A handbook of metamemory and memory. Erlbaum, Mahwah, NJ

Schneider W, Pressley M (1997) Memory development between 2 and 20. Erlbaum, Hillsdale, NJ

Schneider W, Perner J, Bullock M, Stefanek J, Ziegler A (1999) Development of intelligence and thinking. In: Weinert FE, Schneider W (eds) Individual development from 3 to 12: findings from the munich longitudinal study. Cambridge University Press, Cambridge, MA, pp 9-28

Schneider W, Hünnerkopf M, Kron-Sperl V (2009) The development of young children’s memory strategies: evidence from the Würzburg Longitudinal Study. European Journal of Developmental Psychology 6:70-99

Schunk DH, Zimmerman BJ (eds) (1998) Self-regulated learning: from teaching to self-reflective practice. Guilford, New York

Shimamura AP (2000) Toward a cognitive neuroscience of metacognition. Conscious Cogn 9:313-323

Sodian B (2005) Theory of mind. the case for conceptual development. In: Schneider W, Schumann-Hengsteler R, Sodian B (eds) Interrelationships among working memory, theory of mind, and executive function. Erlbaum, Mahwah, NJ, pp 95-130

Sodian B, Schneider W, Perlmutter M (1986) Recall, clustering, and metamemory in young children. J Exp Child Psychol 41:395-410

Veenman M, Kok R, Blöte A (2005) The relation between intellectual and metacognitive skills in early adolescence. Instr Sci 33:193-211

Wellman HM (1977) Preschoolers’ understanding of memory-relevant variables. Child Dev 48:1720-1723

Wellman HM (1985) A child’s theory of mind: the development of conceptions of cognition. In: Yussen SR (ed) The growth of reflection in children. Academic Press, New York, pp 169-206

Zabrucky K, Ratner HH (1986) Children’s comprehension monitoring and recall of inconsistent stories. Child Dev 57:1401-1418

Download references

Author information

Authors and affiliations.

Department of Psychology, University of Würzburg, Wittelsbacherplatz 1, 97074, Würzburg, Germany

Wolfgang Schneider

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Wolfgang Schneider .

Editor information

Editors and affiliations.

Parmenides Foundation, Kardinal Faulhaber Str. 14 a, Munich, 80333, Germany

Britt Glatzeder

Dept. Psychology, York University, Keele Street 4700, Toronto, M3J 1P3, Canada

Albrecht Müller

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter.

Schneider, W. (2010). The Development of Metacognitive Competences. In: Glatzeder, B., Goel, V., Müller, A. (eds) Towards a Theory of Thinking. On Thinking. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03129-8_14

Download citation

DOI : https://doi.org/10.1007/978-3-642-03129-8_14

Published : 11 November 2009

Publisher Name : Springer, Berlin, Heidelberg

Print ISBN : 978-3-642-03128-1

Online ISBN : 978-3-642-03129-8

eBook Packages : Biomedical and Life Sciences Biomedical and Life Sciences (R0)

Share this chapter

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

  • Publish with us

Policies and ethics

  • Find a journal
  • Track your research

U.S. flag

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

  • Publications
  • Account settings
  • Advanced Search
  • Journal List
  • Front Psychol

A questionnaire-based validation of metacognitive strategies in writing and their predictive effects on the writing performance of English as foreign language student writers

Ruru Zhang, https://orcid.org/0000-0002-5654-2402

Yanling Xiao, https://orcid.org/0000-0003-0025-2024

Associated Data

The original contributions presented in the study are included in the article/ Supplementary material , further inquiries can be directed to the corresponding author.

Introduction

This study—drawing upon data from a questionnaire—examined 503 Chinese university students’ metacognitive strategies in writing (MSW). The focus was on Chinese student writers who are learning English as a foreign language (EFL).

The examination was conducted through a survey on MSW and a writing test administered at the end of the semester. We employed exploratory factor analysis (EFA) and confirmatory factor analysis (CFA) for data analysis. Multiple regression analysis was also adopted for understanding the predictive effects of strategies on writing performance.

The findings provided validity to MSW, including person, task, strategies, planning, monitoring, and evaluating. The different components of MSW were reported to significantly affect the participants’ writing performance. The findings highlight that EFL student writers were aware of metacognitive writing strategies. The MSW survey could be used to assess EFL students’ metacognitive writing strategies and develop curricula in writing strategy training.

Writing instruction can direct learners’ ability to acquire metacognitive writing strategies, particularly those of planning, monitoring, and evaluating, to build their awareness as agents in EFL writing. Relevant pedagogical implications are discussed.

Metacognitive strategies are essential to the process of learning to write when learning English as a foreign language (EFL; Nguyen and Gu, 2013 ; Teng, 2016 , 2019 ; Teng and Yue,2022 ). However, in the Chinese EFL context, for which English writing instruction typically emphasizes grammatical correctness rather than idea development, learners may find it difficult to build an awareness of using metacognitive writing strategies ( Ruan, 2014 ). Through a mixed-methods study, Amani (2014) found that explicit metacognitive strategy instruction had a positive impact on the writing competence of L2 writing students. However, in terms of EFL writing, university EFL students may find it challenging because of their lack of awareness of metacognitive writing strategies ( Teng, 2019 ). In addition, EFL learners in the Chinese context receive limited English language input, making it more challenging to learn to write. Student writers are expected to have repertoires of strategies when learning to write ( Raimes, 1987 ). In particular, they need to build an advanced level of “self-initiated thoughts, feelings, and actions” for them to “attain various literary goals” ( Zimmerman and Risemberg, 1997 , p.76). Hence, metacognitive writing strategies are essential to possible improvements in EFL writing.

Nevertheless, even though students are taught how to plan, monitor, and evaluate their own writing, students may know little about themselves as writers ( Leung and Hicks, 2014 ). They may also not recognize their own writing strengths or weaknesses, tending to overemphasize the latter and overlook any progress they have made or can make in their writing ( Teng, 2016 ). Wenden (1998) argued that metacognitive knowledge is a prerequisite for self-regulation, and metacognitive knowledge is essential to learner autonomy because it “informs planning decisions taken at the outset of learning and the monitoring processes that regulate the completion of a learning task and decisions to remediate; it also provides the criteria for evaluation made once a learning task is completed” (p. 528). Teng and Zhang (2021) argued that there is a dynamic and longitudinal relationship between metacognitive knowledge and reading and writing in a foreign language context. However, teachers may not recognize the importance of metacognitive knowledge in Chinese EFL writing contexts, wherein teaching academic writing is product oriented ( Teng and Zhang, 2016 ). The student writers were passive and found it difficult to keep positive beliefs in writing ( Bruning and Horn, 2000 ). This may be related to learners’ lack of awareness of self-regulation in writing. They may exert more effort learning vocabulary knowledge and grammar for writing, rather than being an agent for writing ( Graham and Harris, 2000 ). Student writers need self-awareness, motivation, and positive behavioral skills for writing ( Zimmerman, 2002 , p.65–66). Metacognitive writing strategies are thus essential to EFL students’ writing performance.

Self-regulation principles, measurements, and practices have a solid ground for enriching second and foreign language learning and teaching ( Teng and Zhang, 2022 ). Through a socio-cognitive approach to writing, Nishino and Atkinson (2015) argued that writing is primarily a cognitive activity and that cognition plays a vital role in writing and its development. To help students become competent English writers and autonomous learners, instructors need to support their development of metacognitive strategies. However, scarce attention was paid to writing strategies from the perspective of metacognition, particularly for low-achieving students in the EFL context. The present study examined Chinese university EFL students’ metacognitive strategies in EFL writing. We aim for the following purposes: (a) to assess the reliability of a new scale, which we named it as metacognitive strategies in writing (MSW) and (b) to explore how different components of MSW predict EFL students’ writing performance. The findings are insightful in helping researchers and classroom practitioners to diagnose the needs of metacognitive strategies in writing and develop guidelines for instructing writing courses for university EFL students. The findings shed lights on how to teach EFL writing and deliver more effective program for writing teacher preparation.

Literature review

Language learning strategies.

Oxford (1990) classified a list of language learning strategies based on cognitive learning theory. These strategies include memory, cognitive, compensatory, affective, social, and metacognitive strategies. Past studies have documented differences in strategy use between more and less successful learners. For example, successful learners use these strategies in larger numbers and at higher frequencies ( Magogwe and Oliver, 2007 ). Most importantly, cognitive and metacognitive strategies are associated with a higher level of language proficiency ( Peacock and Ho, 2003 ). However, contradictory findings were also reported, showing that less successful learners used more strategies than more successful learners did because the former automatized their language learning process ( Oxford and Cohen, 1992 ). Another point worth noting is that unsuccessful learners may adopt a large number of strategies frequently, but it does not necessarily mean that they are able to identify appropriate strategy use. In fact, it was reported that successful learners were able to identify appropriate strategies depending on the task requirements, but unsuccessful learners failed to choose the most appropriate and efficient strategies during the task ( Chamot and El-Dinary, 1999 ).

Although ample research has been reported relating to learners’ proficiency level and strategy use, learner variables, such as cultural background and national origin, could have a strong influence on learners’ strategy use ( Oxford and Nyikos, 1989 ). Therefore, their findings might not be generalizable to learners with completely different cultural backgrounds. In light of this, Lai (2009) conducted a questionnaire survey that investigated the relationships between the language learning strategies used by 418 EFL learners in Taiwan based on learners’ language proficiency and their use of strategies. While the more proficient learners used metacognitive strategies and cognitive strategies most frequently and memory strategies least frequently, the less proficient learners preferred social and memory strategies to cognitive and metacognitive strategies. This finding partially echoes Wu (2008) , who reported that higher-proficiency EFL students in Taiwan used learning strategies more often than lower-proficiency EFL students did, especially the cognitive, metacognitive and social strategies.

Although research documented in the literature examines general language learning strategy use, it is possible that these summarized findings could serve as a reference for the specific examination of metacognitive strategy use during English writing.

Understanding metacognition

Metacognition is multidimensional and domain-general. When we talk about metacognition, we may need to mention the theory of mind ( Flavell, 1979 ). Such theory is the foundation of understanding metacognition. Generally, metacognition is related to self-regulatory capacity because metacognition provides individuals with domain knowledge and regulatory skills that are essential to become an agentive learner in relevant domains ( Schraw, 2001 , p. 7). Metacognition refers to how learners build an awareness of their own thinking processes and executive processes ( Flavell, 1979 ). Metacognition is essential to helping learners regulate their cognitive processes, and finally, becoming an independent thinker and learner. Zhang and Zhang (2019) applied metacognition in second and foreign language learning, and posited that EFL learners need to plan, monitor, and evaluate their cognitive processes for better language learning performance.

Metacognition includes metacognitive knowledge and metacognitive regulation. Flavell (1985) suggested that person, task, and strategy knowledge are three key elements of metacognitive knowledge. Wenden (1998) explained the three elements. For example, person knowledge is the knowledge for the learners to control their cognitive processes. Task knowledge is the knowledge that can be helpful for the learners to understand the purpose, nature, and demands of different task conditions. Strategy knowledge is the knowledge of different important strategies that are helpful for realizing the pre-determined goals. Metacognitive regulation entails three skills: planning, monitoring, and evaluating ( Schraw, 1998 ). Planning refers to the ability to appropriately select the strategies and adequately allocate the resources for completing tasks. Monitoring refers to learners’ capacity to observe their task performance. Evaluating means learners’ capacity to reflect on their learning outcome and the use of different strategies for self-regulation.

Teng et al. (2022) summarized the procedures of understanding metacognition. First, monitoring function and control of cognition are two important functions of metacognition. In order to realize the functions, individuals need to process three major stages, i.e., acquisition, retention, and retrieval. Second, learners need metacognitive knowledge and metacognitive experiences to process the monitoring function. In contrast, they need metacognitive strategies or metacognitive skills to fulfill the needs of control of cognition. Third, metacognitive knowledge, metacognitive experiences, and metacognitive skills are interconnected with each other. Metacognitive knowledge includes person, task, and strategies. Metacognitive experiences include feelings and judgments. Metacognitive skills are important for their metacognitive regulation, which needs learners to plan, monitor, and evaluate their learning process. Finally, reflection is the outcome of the interconnected process of planning, monitoring, and evaluating ( Figure 1 ).

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-1071907-g001.jpg

The multifaceted elements of metacognition ( Teng et al., 2022 , p. 171).

Metacognitive strategies in EFL writing

Macaro (2010) maintains that strategic behavior plays a vital role in second language learning success and proposes that strategic behavior should be essential to linguistic knowledge resources. Dornyei (2010) emphasizes that students need a repertoire of appropriate task-related plans, scripts, and self-regulatory strategies that are activated by their ideal L2 selves; that is, learners’ aptitude, motivation, goals, and self-regulatory strategies all interact and affect one another in the SLA process. Writing strategies include rhetorical strategies, metacognitive strategies, cognitive strategies, and social/affective strategies ( Wenden, 1991 ; Riazi, 1997 ). Writers explore rhetorical strategies to organize and present their ideas based on the writing conventions of the target language. Metacognitive strategies are used to monitor the writing process consciously and evaluate the effectiveness of writing actions. Cognitive strategies are used to implement actual writing actions. Social/affective strategies are employed to interact with others and to regulate emotions, motivation, and attitudes in writing.

Wenden (1991) classifies writing strategies based on metacognitive and cognitive frameworks. She distinguishes general executive metacognitive strategies of planning, self-monitoring, and self-evaluating from more specific cognitive strategies, such as clarification, retrieval, resourcing, avoidance, and verification. Each of these metacognitive strategies is discussed below.

Planning for writing involves thinking and self-questioning strategies such as identifying one’s purpose, activating background knowledge, and organizing ideas. Planning is not limited to a specific stage of writing but rather appears recursively throughout the writing process. Flower and Hayes (1981) identified three different types of planning strategies based on the focus of the goal: (1) generating ideas; (2) setting procedural goals; and (3) organizing. Generating ideas includes retrieving information from long-term memory, revising old ideas to incorporate new information, drawing inferences, making connections, and looking for examples, contradictions, and objections. Setting procedural goals includes content goals (e.g., plans for content, text structure and audience, and criteria for evaluation) and process goals (how to proceed, generated by the writer, done at any time during the composing process, followed or preceded by generating ideas, revising strategies, etc.). The third strategy (organizing) includes selecting the most useful materials produced during the generating process and organizing them in the writing plan. Organizing strategies include grouping and sequencing ideas, deciding on the presentation of the text, planning the introduction and conclusions, and structuring the text based on a particular genre. Furthermore, in using these strategies, it is essential to consider the audience, topic, and rhetorical knowledge. Planning in EFL writing determines how writers write in subsequent stages. It engages them in metacognitive activities that allow them to consider the purpose and goals for writing, identify their audience, decide upon voice, and generate a framework for their essays.

Monitoring involves conscious control and regulation of the writing process. Hayes and Flower (1980) include self-monitoring in their model of the cognitive processes of writing, noting that the ability to self-monitor the composing process is an important part of writing strategies. Charles (1990) claims that self-monitoring makes it easier for L2 students to avoid uncertainty about any part of their text, to find direct answers to their queries and to encourage them “to look critically and analytically at their writing and to place themselves in the position of readers” (p. 289). The more important functions of self-monitoring are controlling, directing, and sequencing the composing processes and one’s progress in the task. Monitoring allows the writer to decide whether something needs to be retrieved, whether new ideas need to be further generated, or whether a given subprocess has ended. Monitoring allows L2 writers to evaluate the effectiveness of writing strategies and how and when to check the outcomes of problem-solving processes and strategically regulate the processes according to cognitive goals ( Mayer, 1999 ).

Self-evaluating—experiencing the quality of one’s writing in relation to one’s goals—is crucial for developing an individual’s perception of writing. In self-evaluation, students can recognize weaknesses, identify needs, and make changes ( Zimmerman, 2002 ). In cognitive research, evaluation has been characterized as a strategy for considering the outcome of the undertaken task, an essential metacognitive strategy that successful learners need to execute and control.

Empirical studies on the use of metacognitive writing strategies

Various studies have been conducted on EFL students’ use of metacognitive writing strategies. Employing think-aloud protocols and immediate retrospective interviews, Chien (2012) investigated the differences in writing strategies and English writing achievements of 20 low-achieving and 20 high-achieving student writers in Taiwan. Chien found that high-achieving student writers were more aware of and focused more on, formulating their position statements when planning, generating, revising, and editing their essays and focused more on correcting grammatical and spelling errors. Teng and Zhang (2016) validated questionnaire-based self-regulated strategies in EFL writing and highlighted planning, monitoring, and evaluating in EFL writing. Teng and Huang (2019) also suggested that learners’ self-regulated strategies in writing, as well as their English proficiency and language learning experiences, and significantly influenced their EFL writing. In a recent publication ( Teng et al., 2022 ), two experimental studies were reported. Study 1 adopted a factorial design using exploratory and confirmatory factor analysis to validate a self-regulatory writing strategy questionnaire. Study 2 assessed the predictive effects of the different components of the scale on students’ writing performance. The results supported the construct validity for the six strategy factors, i.e., writing planning, goal-oriented monitoring, goal-oriented evaluation, emotional control, memorization, and metacognitive judgment. The factors also predicted writing performance. Zhang and Qin (2018) also validated the newly developed scale on metacognitive strategies in a multimedia writing context. The results provided evidence for the validation of planning, monitoring, and evaluating strategies. In an early empirical study on the importance of planning in EFL writing, Graham et al. (1995) examined differences between expert and less-skilled L2 writers. They found that expert L2 writers spent considerable time planning and appeared to have higher-level plans and self-conscious control of their planning. In contrast, less-skilled EFL writers were less likely to use knowledge of textual structure in planning, to use heuristic strategies in searching their memory for content, or to establish goals to direct the writing process and were more likely to engage in “knowledge telling” (i.e., writing everything they knew about a topic and stopping when they felt that they had written down everything they knew). Less-skilled writers did not write with goals or plans in mind; rather, they tended to generate ideas through free writing and usually did not organize those ideas. As shown in a longitudinal study ( Teng and Zhang, 2021 ), learners’ L2 writing development was dependent on their initial level of metacognitive knowledge. This is evidence for the strong correlation between metacognitive knowledge and writing.

Nguyen and Gu (2013) explored the impact of strategy-based instruction on promoting learner autonomy (operationally defined as learner self-initiation and learner self-regulation) of students at a Vietnamese university; 37 students were in an experimental group, and 54 students were in two control groups. After an 8-week metacognition training intervention, students in the experimental group were found to have improved their planning, monitoring, and evaluating of a writing task more than those in the two control groups. The findings suggest that strategy-based instruction on task-specific metacognitive self-regulation improves learner autonomy and writing performance. Teng (2020) also incorporated training of metacognitive strategies for EFL learners. There were two groups of learners, i.e., those with group feedback guidance and those with self-explanation guidance. The results supported the positive effects of group metacognitive support on EFL students’ writing. EFL students need to build a certain level of metacognitive awareness to manage themselves as writers.

Bai et al. (2014) conducted a questionnaire survey to explore the relationship between 1,618 Singapore primary school pupils’ reported use of strategies in learning to write and the correlation with their English language proficiency. They found that participants used a wide range of writing strategies at medium frequency. They also reported a significant correlation between the participants’ English language proficiency and the use of writing strategies such as planning, text-generating, revising, monitoring and evaluating, and resourcing. Similar results were also found in Bai and Guo (2021) , wherein high achievers reported higher levels of motivation (i.e., growth mindset, self-efficacy, and interest) and self-regulated learning strategy use than the average achievers, and average achievers reported more strategy use than the low achievers, Ma and Teng (2021) collected qualitative data from two undergraduate university students learning English as L2 in Hong Kong to explore their use of writing strategies. They reported that both students realized the importance of self-evaluation and revision. It seems that the students perceived affordances in the kind of writing that enabled them to play an active role in seeking, interpreting, and using teacher feedback to perform the evaluation and modification of their own work. However, variations in engagement in the process of learning to write and their metacognitive knowledge development were also detected. For example, students’ varying degrees of engagement may result in various degrees of developing metacognitive awareness. Teng et al. (2022) validated a new instrument, i.e., the Metacognitive Academic Writing Strategies Questionnaire (MAWSQ). Analyses were conducted through a series of Confirmatory factor analyses (CFA). Results supported two hypothesized models, i.e., an eight-factor correlated model and a one-factor second-order model. Model comparisons supported the role of metacognition as a higher-order construct. Metacognition also explains the eight metacognitive strategies, including declarative knowledge, procedural knowledge, conditional knowledge, planning, monitoring, evaluating, information management, and debugging strategies. Those strategies also significantly influenced EFL writing performance.

Overall, the studies on metacognition development reviewed in this section highlight the importance of the high-level cognitive processes involved in composing, the development of the autonomous and self-regulated use of effective writing strategies, and the formation of positive attitudes about writing. Metacognitively oriented learners are aware of both their own learner characteristics and the writing task and are able to select, employ, monitor, and evaluate their use of metacognitive strategies.

The present study

Metacognition functions as an important predictor in EFL writing performance. We aim for two purposes in the present study. First, we attempted to validate a questionnaire on metacognitive strategies in writing. Second, we assessed the predictive effects of different metacognitive strategies in the outcome EFL writing. The present study sheds light on learners’ awareness and use of metacognitive writing strategies. The present study includes two questions:

  • What is the evidence to support the validity and reliability of metacognitive strategies in writing?
  • What is the evidence for the predictive effects of metacognitive strategies on EFL writing proficiency?

Materials and methods

Participants.

The present study included 503 participants. They were undergraduate students at a university in China. They were first-year students with Chinese as their first language and English as a foreign language. They had received at least 6 years of formal English instruction. Writing is a subject to be taught in college English and a compulsory course for all the participants. We selected the participants because they were all enrolled in a university English course. The first author was teaching the participants, and the sample of participants was a convenient sample. Among the 503 students, 351 were men and 152 were women. An unequal gender balance may be because most of the students were from science and engineering majors. Originally, there were 700 students who responded to the questionnaire. We finally selected data from 503 students for data analysis. Some participants’ data were excluded because of missing values or because some were unable to take the writing test. They attended the study voluntarily by signing the consent form.

Questionnaire development

The questionnaire, which was named Metacognitive Strategies in Writing (MSW), was developed through item generation, reference consultation, initial piloting, psychometric evaluation, and exploratory factor analysis (EFA) in a pilot study. We first invited 10 students to reflect on their writing practices and strategies. The students were mainly interviewed about the strategies they adopted for writing. We generated approximately 50 items based on analyzing the transcriptions of learners’ interviews. In the next stage, we consulted relevant literature on metacognition, self-regulation, and language learning strategies ( Schraw and Dennison, 1994 ; Oxford, 2013 ; Teng et al., 2022 ). We selected the items that fit with metacognition theories. In the third stage, we invited the 10 students to check the items. In the fourth stage, which was psychometric evaluation, we invited two researchers in L2 writing to assess the items. Based on the comments, we finally removed 10 items. In the final stage, we ran an EFA with a sample of 360 students with similar backgrounds. We deleted 10 items with unsatisfactory factor loading values. The final questionnaire includes 30 items, which are in the Appendix .

This questionnaire was a novel one as it was based on metacognition theory, through which the focus was on understanding metacognitive knowledge and regulation in learning to write. We adopted a seven-point Likert scale (i.e., from 1, Strongly disagree to 7, Strongly agree). MSW focuses on metacognitive knowledge and metacognitive regulation. Metacognitive knowledge includes three factors, i.e., person, task, and strategies. Metacognitive regulation includes three factors: planning, monitoring, and evaluating. Cronbach’s alpha, which ranged from 0.81 to 0.90 for the six factors, ensured the internal consistency of responses to the items. The questionnaires were administered to the participants in Chinese. The author translated into Chinese while a research assistant was invited to check the translated items through back translation.

Writing test

A writing test from IELTS (writing task 2) was adopted to measure learners’ writing proficiency. Students were required to write at least 250 words within 1 h. Students were asked to respond to the topic provided by giving and justifying an opinion, discussing the topic, summarizing details, outlining problems, identifying possible solutions and supporting what they wrote with reasons, arguments and relevant examples. The topic proposed the possible influence of social media sites on personal relationships.

The marking scheme was consistent with the writing rubrics in IELTS. However, we adjusted it to fit with our school assessment needs. Each learner was awarded with six marks for task response, coherence and cohesion, lexical resource, and grammatical range and accuracy. The maximum possible score was 24 points. A total of 40 English teachers were paid to rate the writing. The teachers did not know the participants’ identities. They also joined a training session on the marking scheme. Disagreements on marking were subject to further discussion. The Cronbach’s alpha for the test was.85, indicating acceptable reliability.

We invited 20 EFL teachers to help us distribute a QR code to the students through WeChat group. The students spent an average of 6 min completing the questionnaire. The writing test was administered as an exercise for all students during class. They needed to complete it within 1 h. The format for the writing test was a paper-and-pencil format. All participants received the same format for the questionnaire and the writing test.

Data analysis

The final dataset was run through a series of confirmatory factor analyses (CFAs). STATA was used for data analysis. CFA is used to test a theoretical model by confirming factors, correlations, covariance patterns, and residual or error values within a data matrix ( Byrne, 2016 ). We used the maximum likelihood (ML) estimation method. The model fit was evaluated through the following statistics: a chi-square statistic, the degrees of freedom (df), p value, the ratio of chi-square χ 2 divided by the df, the root mean square error of approximation (RMSEA), the standardized root mean square residual (SRMR), the comparative fit index (CFI), and the Tucker–Lewis Index (TLI; DiStefano and Hess, 2005 ). The following criteria are a relatively good fit between the hypothesized model and the observed data: the value of RMSEA should be close to 0.06, the value of SRMR should be close to 0.08, and the values for CFI and TLI should be close to 0.95 ( Hu and Bentler, 1999 ). Finally, multiple regression analysis was adopted to evaluate the predictive effects of MSW on students’ writing proficiency.

Descriptive statistics

The kurtosis and skewness values for the metacognitive strategies in writing, as well as the mean and standard deviation, are shown in Table 1 . The means of the six factors ranged from 3.346 to 4.079, with the two factors, monitoring and evaluating, greater than 4. There were no noticeable variations based on the standard deviation values.

Means, standard deviations. and normality test.

Exploratory factor analysis in the pilot study

Exploratory factor analysis was conducted on a sample of 360 learners from similar background in the pilot study. We examined the adequacy of the sample. The Kaiser-Meyer-Olkin value was 0.914, which appropriate for EFA ( Tabachnick and Fidell, 2001 ). Bartlett’s test of sphericity was significant, p < 0 .001; thus, the matrix was adequate for factor analysis. We adopted principal component analysis as a factor extraction method. We finally extracted six factors that explained 57.411% of the variance ( Table 2 ). The scree plot showed a considerable drop after the sixth factor, for which we excluded other possible factors. Based on key theories in metacognition, we named the six factors as following: person, task, strategies, planning, monitoring, and evaluating.

Extraction results for the six factors.

The six factors’ eigenvalues exceeded 1. The next step was to examine the factor loadings. We deleted 10 items with factor loadings lower than 0.4. The final version included 30 items across six factors ( Table 3 ). Items’ factor loadings ranged from 0.534 to 0.772, while communality ranged from 0.531 to 0.754. The items hence fit their respective factors well.

Results on factor loadings and the communality.

Construct validity of metacognitive strategies in writing through CFA

The data fitness metrics for metacognitive strategies in writing are displayed in Table 4 . Table 4 shows that the RMSEA was 0.073, less than 0.08, indicating a good fit; CFI, TLI, CNFI, IFI, and GFI all exceeded 0.9, which was ideal for adaptability. Although the χ 2 /df was 7.916, larger than 3, the scale on metacognitive strategies in writing still showed reliability when taken as a whole.

Model fit indices for metacognitive writing strategies.

According to Figure 2 and Table 5 , the factor loadings for Person, Task, Strategy, Planning and Evaluating were all greater than 0.5, while Monitoring was 0.41. Additionally, the average variance extracted (AVE) for each variable was 0.47, and the model’s convergent validity was good, as evidenced by the composite reliability (CR) being 0.84, indicating that the model had satisfactory convergent validity.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-1071907-g002.jpg

A first-order model of metacognitive strategies in writing. Prs, Person; Tsk, Task; Str, Strategy; Pln, Planning; Mnt, Monitoring; and Evl, Evaluating.

Convergent validity of the model.

Predictive effect of metacognitive strategies in writing on EFL writing

Figure 3 presents the correlations between metacognitive strategies in writing and L2 learners’ writing proficiency in English. The findings indicated that each of the six metacognitive strategies was significantly correlated with learners’ English writing performance. Writing performance (WP) was correlated with Person ( r  = 0.264), Task ( r  = 0.500), Planning ( r  = 0.584), and Monitoring ( r  = 0.408). Strategy ( r  = 0.470) and Evaluating ( r  = 0.470) were significantly correlated with WP.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-1071907-g003.jpg

Spearman correlation for metacognitive writing strategies and L2 learners’ proficiency in English. Persontotal, Person; Tasktotal, Task; Strategytotal, Strategy; Planningtotal, Planning; Monitoringtotal, Monitoring; and Evaluatingtotal, Evaluating.

Moreover, we adopted a structural equation model to investigate the degree to which metacognitive strategies in writing predicted learners’ L2 writing proficiency. Table 6 presents the model fitness indices. For our model, seven indices (i.e., χ 2 /df, RMSEA, CFI, TLI, NFI, WIFI, and GFI) indicated acceptable model fit ( Table 6 ). Figure 4 shows a structural equation model of the relationship between metacognitive strategies in writing and writing proficiency. The six variables on the left side of the model represent the six factors of metacognitive strategies in writing. The only rectangular variable on the right side of the model was EFL learners’ writing proficiency. The findings demonstrated that metacognitive strategies in writing had a predictive power of 0.65 for L2 learners’ writing proficiency, indicating that it could account for 65% of the variances in writing performance.

Model fit indices for metacognitive writing strategies on writing performance.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-1071907-g004.jpg

The structural equation model of metacognitive strategies in writing proficiency.

Regression analysis was employed in the study to show the extent to which each factor impacts writing performance. The results presented in Table 7 demonstrate that all factors significantly predicted writing competence ( p  < 0.001), with the exception of Strategy ( p  = 0.344). Planning had the greatest effect on writing abilities, and Task had the least effect. Notably, monitoring and evaluating also had a great effect on EFL learners’ writing proficiency. According to the findings, there was no multicollinearity among the strategies, as indicated by the variance inflation factor (VIF), which was less than 3. In addition, the residuals adhered to a normal distribution, as shown in Figure 5 . This offered a trustworthy foundation for the regression analysis results.

Linear regression results.

An external file that holds a picture, illustration, etc.
Object name is fpsyg-13-1071907-g005.jpg

Normal P–P plot of regression standardized residual.

Discussion and conclusion

Overall, the present study aims to answer two research questions. The first research question entails the validation of a newly developed scale, which we named Metacognitive Strategies in Writing (MSW). The scale was developed based on metacognition theory. The findings supported the factorial structure of the scale. The second research question aims to answer the predictive effects of different factors of MSW in writing performance. Overall, the findings provided evidence for the factorial structure of MSW. The findings also suggested the predictive effects of different factors on writing performance.

Validation of MSW

First, MSW is with satisfactory psychometric properties. The six factors were reliable in terms of conceptual and empirical evidence. The six factors were distinct but correlated with each other. Consistent with previous studies ( Teng et al., 2022 ), metacognition is an important construct that can explain the significant correlations of different lower-order metacognitive dimensions in writing. In line with Schraw and Moshman (1995) , metacognition is a domain that can explain self-regulatory capacity. The present study thus provides insights into metacognition theory, which can entail person, task, strategies, planning, monitoring, and evaluating ( Schraw and Dennison, 1994 ). These strategies are interconnected and reflect the metacognitive process in writing. To build metacognitive awareness, learners need to be engaged in self-reflection and controlling of cognition ( Paris and Winograd, 1990 ). In terms of writing, student writers need to assess their knowledge states and executive abilities to orchestrate different dimensions of metacognitive awareness. Overall, the sum of the six strategies in writing indicates EFL student writers’ overall level of metacognitive awareness in writing.

The six factors were interpreted through metacognitive knowledge and regulation. The two paradigms were also conceptualized in early studies ( Flavell, 1979 ; Schraw, 1998 ; Wenden, 1998 ). In the present study, the two paradigms can represent key elements of metacognition. Person, task, and strategies represent learners’ beliefs and knowledge about themselves. Planning, monitoring, and evaluating reflect the process of cultivating one’ self-regulatory capacity for learning to write ( Teng and Zhang, 2016 ; Teng et al., 2022 ). The findings showed a positive and significant relationship between metacognitive knowledge and regulation ( Pugalee, 2001 ; Teng, 2016 ). We may need to reconsider the strong connection between metacognitive knowledge and regulation. The positive correlation may reflect the need of both knowledge and regulation in learning to write. For example, EFL students may need cognitive, metacognitive, and regulatory skills and strategies for writing ( Teng, 2020 ). The importance of metacognitive knowledge and regulation may reflect the argument by Wolters (1999) that learners’ engagement, effort, and achievement are influenced by their metacognitive knowledge and regulation. Hence, metacognition is essential to the development of self-regulated capacity ( Efklides, 2008 ), build identity as a student writer ( Zimmerman and Risemberg, 1997 , p.76), and develop self-awareness in processing their second and foreign language learning ( Zhang and Zhang, 2019 ).

Overall, the MSW data suggest that the student writers adopted metacognitive knowledge, i.e., person, task, and strategies, to understand their strengths and weakness in writing, demands in writing, and solutions for solving problems in writing. The data also suggest that the planning strategy should be used. In the planning stage, the student writers directed their attention to fulfilling the goal of the task, planning thoroughly, evaluating the relevance and effectiveness of ideas, and eliminating inappropriate examples. Data regarding the second subscale (monitoring) reflected that students tended to use some metacognitive monitoring strategies. During the monitoring stage, the student writers focused on the overall essay development, concentrating on expanding and developing their initial ideas, evaluating their essay for clear development and focus/unity, and ignoring interruptions posed by language constraints, such as grammar and vocabulary. For the third subscale (self-evaluating), student writers tended to use certain metacognitive strategies. Student writers prioritized their attention to evaluating the unity and effectiveness of their writing before editing local errors, such as grammar, vocabulary, mechanics, and sentence variation.

Predictive effects of metacognitive strategies in writing

The findings suggest the predictive effects of metacognitive strategies in writing. The results confirmed that the metacognitive strategies significantly predicted learners’ writing performance, which was consistent with previous studies ( Teng and Huang, 2019 ; Teng et al., 2022 ). One reason is that student writers’ meager metacognitive knowledge base could result in unsatisfactory cognitive monitoring of production and progress toward the writing task goal, which, in turn, may also affect their writing performance ( Teng et al., 2022 ). For example, lower-level writers tended to be bound to the local areas of writing, focusing on language correctness, while higher-level writers tended to focus on developing ideas and revising at the discourse level, saving editing until later ( Teng and Huang, 2019 ). As supported in previous studies ( Chien, 2012 ; Bai et al., 2014 ), higher level student writers were more aware of metacognitive strategies and used them more frequently in writing.

The argument revealed, at least for this particular sample and the chosen test, a strong and significant link between the writing abilities of EFL students and the factors of person, task, strategy, planning, monitoring, and evaluation. The EFL learners’ writing performance variations were accounted for by the six metacognitive components. The findings complement cognitive writing model of Flower and Hayes (1981) , which recognizes the abilities in process writing such as planning, monitoring, and reviewing. Writing necessitates the adaptive use of emotional strategies, performance strategies, and cognitive strategies ( Teng et al., 2022 ). The effectiveness of the strategies highlights the personal, behavioral, and environmental impacts on the regulatory capacity in learning to write ( Zimmerman and Risemberg, 1997 ).

In our study, person and task significantly predicted writing performance with a large effect size. According to earlier research ( Brown, 1987 ; Schraw, 2001 ), learners who have declarative, procedural, and conditional knowledge are more likely to become strategic learners. These results provide evidence for the idea that to master writing, EFL learners need to be able to distinguish among the various strategies, employ the appropriate strategies, and apply these strategies in their writing. The results also support earlier research that metacognitive knowledge is crucial for encouraging active involvement in applying their understanding of the writing process, recognizing the kinds of strategies useful in the growth of writing, and improving students’ writing outputs ( Ruan, 2014 ).

In terms of metacognitive regulation, planning, monitoring, and evaluating are also important for writing performance. The effect size was quite large in the current study, for which we can detect similar results in previous studies ( Teng, 2019 ; Teng et al., 2022 ). The writing abilities of students who were more self-controlled in their writing were higher in terms of goal setting, time management, and planning for writing resources ( Teng and Zhang, 2016 ). We argue that Chinese EFL students need an awareness of planning ahead and monitoring and evaluating their planning tactics to produce successful written essays. The success of EFL academic writing depends heavily on this method. Academic writing development may be seen as a complex process for student writers because it depends on how strategically they seek information and modify their planning techniques. Students who have prepared well for academic writing are typically those who have a high level of metacognitive awareness of their writing-related objectives ( Zhang and Qin, 2018 ). When composing their essays, lower-level writers often experienced difficulty in transferring ideas to paper during the planning, monitoring, and self-evaluating stages. The constraints in the lower-level writers’ knowledge system, including their limited linguistic competence (grammar and vocabulary), their confusion about their role as writers, their lack of knowledge strategies for overcoming writing difficulties, and their lack of knowledge of how and when to apply those strategies, impeded their composition of a meaningful essay. Consequently, many students tended to simultaneously engage in a few different stages of writing—planning, composing, revising, and editing—without any extra attention resources to monitor the overall unity and coherence of the essay, thus making the essay messy and confusing.

Limitations and implications

Despite the positive findings, we still need to acknowledge some limitations of this study. First, the strategies described in the questionnaire were still scarce, although we showed excellent content validity. Due to the limited amount of time the learners could invest in data collection, we did not assess metacognitive experiences, another crucial component of metacognition. Interview data with students were not conducted to yield adequate methods connected to metacognitive experiences. Second, a self-report questionnaire served as the foundation for this study. Because they are dependent on the use of self-reported information, surveys may not fully reflect learners’ actual metacognitive awareness and activities. The quantitative data in future studies should be triangulated with interview data. Third, the writing test should include additional activity categories that can gauge various writing abilities. We only used one writing performance indicator. The performance of student writers may also be impacted by individual characteristics, including their language learning experiences and English proficiency level ( Teng and Huang, 2019 ). Future studies might look at learners’ individual differences and their use of different metacognitive strategies.

However, there are also some implications based on the findings. Our findings suggest directions for pedagogy as well as future research. Considerations include issues of focus on form, development of metacognitive awareness to support metacognitive knowledge and strategies, and appreciation of the many aspects of metacognitive awareness that good L2 writing entails.

Data collected from the surveys suggest a strong connection between EFL student writers’ metacognitive knowledge and the regulation strategies they employ. Helping students become more aware of themselves as writers and the metacognitive resources upon which they can draw during the writing process may help them develop their writing competence. Language teachers and instructors should clearly instruct the importance of metacognitive strategies for EFL student writers. Related to this, metacognitive training should help students develop such awareness in learning to write. However, an important step in developing productive pedagogy for metacognitive training is assessing learners’ needs and understandings of their metacognitive strategies. The MSW might potentially contribute to EFL writing assessment in China. The MSW monitoring subscale identified the important first step in writing—planning—as a potential problem. So far as these Chinese EFL non-English major student writers were concerned, regardless of their level of English class or their majors, it seems that many of them may need to faster a metacognitive awareness. As a result, it might be helpful to provide these students with additional lessons on metacognitive strategies to address their concerns and the problems evident in their English writing. While dealing with grammatical errors is essential to writing instruction, the students should focus not only on identifying the errors and fixing them but also on finding out why they make those mistakes and how to avoid making them again. In other words, instead of correcting the errors, they should also develop their awareness of metacognitive strategies to improve their overall language competence. The instructors may also explicitly teach and demonstrate effective strategies to enhance vocabulary acquisition, such as making learners aware of lexical morphology (including word roots and suffixes), synonyms, antonyms, word categories, and similar spellings.

Clearly, it should not be assumed that learners who do not score high on norm-referenced assessments of their L2 writing need to focus exclusively on their metacognitive strategies, even though that is where they may think they need to work. Rather, these learners need to consider not only metacognitive strategies but also discourse organization and considerations of audience, voice, and genre ( Hyland, 2007 ). It is only through an approach raising their awareness of the various aspects that contribute to good writing and through work on writing and revision strategies that they will progress optimally. Additionally, to implement these recommendations for pedagogy, teachers themselves must have substantial knowledge, professional development, and practice regarding approaches to support L2 writing. In the Chinese context, knowledge must be processed and understood in light of the metacognition and experiences of students, colleagues, and the community.

Data availability statement

Ethics statement.

The studies involving human participants were reviewed and approved by Hainan University. The patients/participants provided their written informed consent to participate in this study.

Author contributions

CQ: Coordinated the study, drafted, and revised the manuscript. RZ: Data collection, drafted literature review. YX: Participated in the design of the study, revised the manuscript and performed the statistical analysis and data interpretation. All authors proofread and approved the final manuscript.

This article is supported by the Project from the Education Department of Hainan Province, Project number: Hnky2020ZD-9.

Conflict of interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Publisher’s note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

Supplementary material

The Supplementary material for this article can be found online at: https://www.frontiersin.org/articles/10.3389/fpsyg.2022.1071907/full#supplementary-material

  • Amani S. (2014). Metacognitive strategy instruction and pre-task planning: Impact on L2 argumentative writing ability . Unpublished doctoral thesis. University of Auckland, Auckland, New Zealand. Available at: https://researchspace.auckland.ac.nz/handle/2292/21750
  • Bai B., Guo W. (2021). Motivation and self-regulated strategy use: relationships to primary school students’ English writing in Hong Kong . Lang. Teach. Res. 25 , 378–399. doi: 10.1177/1362168819859921 [ CrossRef ] [ Google Scholar ]
  • Bai R., Hu G., Gu P. Y. (2014). The relationship between use of writing strategies and English proficiency in Singapore primary schools . Asia Pac. Educ. Res. 23 , 355–365. doi: 10.1007/s40299-013-0110-0 [ CrossRef ] [ Google Scholar ]
  • Brown A. (1987). “ Metacognition, executive control, self-regulation, and other more mysterious mechanisms ” in Metacognition, Motivation, and Understanding . eds. Weinert F., Kluwe R. (Hillsdale, NJ: Erlbaum; ), 65–116. [ Google Scholar ]
  • Bruning R., Horn C. (2000). Developing motivation to write . Educ. Psychol. 35 , 25–37. doi: 10.1207/S15326985EP3501_4 [ CrossRef ] [ Google Scholar ]
  • Byrne B. M. (2016). Structural Equation Modelling With AMOS: Basic Concepts, Applications, and Programming (3rd Edn.). New York: Routledge [ Google Scholar ]
  • Chamot A. U., El-Dinary P. B. (1999). Children's learning strategies in immersion classrooms . Mod. Lang. J. 83 , 319–338. doi: 10.1111/0026-7902.00025 [ CrossRef ] [ Google Scholar ]
  • Charles M. (1990). Responding to problems in written English using a student self-monitoring technique . ELT J. 44 , 286–293. doi: 10.1093/elt/44.4.286 [ CrossRef ] [ Google Scholar ]
  • Chien S.-C. (2012). Students’ use of writing strategies and their English writing achievements in Taiwan . Asia Pacif. J. Educ. 32 , 93–112. doi: 10.1080/02188791.2012.655240 [ CrossRef ] [ Google Scholar ]
  • DiStefano C., Hess B. (2005). Using confirmatory factor analysis for construct. Validation: an empirical review . J. Psychoeduc. Assess. 23 , 225–241. doi: 10.1177/073428290502300303 [ CrossRef ] [ Google Scholar ]
  • Dornyei Z. (2010). “ Language aptitude and language learning motivation ” in Continuum Companion to Second Language Acquisition . ed. Macaro E. (London: Continuum; ), 268–299. [ Google Scholar ]
  • Efklides A. (2008). Metacognition: defining its facets and levels of functioning in relation to self-regulation and co-regulation . Eur. Psychol. 13 , 277–287. doi: 10.1027/1016-9040.13.4.277 [ CrossRef ] [ Google Scholar ]
  • Flavell J. H. (1979). Metacognition and cognitive monitoring: a new area of cognitive-developmental inquiry . Am. Psychol. 34 , 906–911. doi: 10.1037/0003-066X.34.10.906 [ CrossRef ] [ Google Scholar ]
  • Flavell J. H. (1985). Cognitive Development (2nd Edn.). Englewood Cliffs, N.J: Prentice-Hall [ Google Scholar ]
  • Flower L., Hayes J. (1981). A cognitive process theory of writing . Coll. Compos. Commun. 32 , 365–387. doi: 10.2307/356600 [ CrossRef ] [ Google Scholar ]
  • Graham S., Harris R. K. (2000). The role of self-regulation and transcription skills in writing and writing development . Educ. Psychol. 35 , 3–12. doi: 10.1207/S15326985EP3501_2 [ CrossRef ] [ Google Scholar ]
  • Graham S., MacArthur C., Schwartz S. (1995). The effects of goal setting and procedural facilitation on the revising behavior and writing performance of students with writing and learning problems . J. Educ. Psychol. 87 , 230–240. doi: 10.1037/0022-0663.87.2.230 [ CrossRef ] [ Google Scholar ]
  • Hayes J., Flower L. (1980). The cognition of discovery: defining a rhetorical problem . Coll. Compos. Commun. 31 , 21–32. [ Google Scholar ]
  • Hu L. T., Bentler P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives . Struct. Equ. Model. Multidiscip. J. 6 , 1–55. doi: 10.1080/10705519909540118 [ CrossRef ] [ Google Scholar ]
  • Hyland K. (2007). Genre pedagogy: language, literacy, and L2 writing instruction . J. Second. Lang. Writ. 16 , 148–164. doi: 10.1016/j.jslw.2007.07.005 [ CrossRef ] [ Google Scholar ]
  • Lai P. F. (2009). Attitudes of adult Chinese-background learners and an ESL teacher towards L1 use in an Australian AMEP class in Australia . Univ. Sydney Papers TESOL 4 , 57–84. [ Google Scholar ]
  • Leung C. B., Hicks J. (2014). Writer identity and writing workshop: a future teacher and teacher educator critically reflect . Writ. Pedagog. 6 , 583–605. doi: 10.1558/wap.v6i3.583 [ CrossRef ] [ Google Scholar ]
  • Ma J., Teng F. (2021). “ Metacognitive knowledge development of students with differing levels of writing proficiency in a process-oriented course: an action research study ” in Innovative Approaches in Teaching Writing to Chinese Speakers . eds. Reynolds B. L., Teng F. (Berlin: DeGruyter Mouton; ), 92–117. [ Google Scholar ]
  • Macaro E. (2010). “ The relationship between strategic behaviour and language learning success ” in Continuum Companion to Second Language Acquisition . ed. Macaro E. (London: Continuum; ), 268–299. [ Google Scholar ]
  • Magogwe J. M., Oliver R. (2007). The relationship between language learning strategies, proficiency, age and self-efficacy beliefs: a study of language learners in Botswana . System 35 , 338–352. doi: 10.1016/j.system.2007.01.003 [ CrossRef ] [ Google Scholar ]
  • Mayer C. (1999). Shaping at the point of utterance: an investigation of the composing processes of the deaf student writer . J. Deaf. Stud. Deaf. Educ. 4 , 37–49. doi: 10.1093/deafed/4.1.37, PMID: [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Nguyen L. T. C., Gu Y. (2013). Strategy-based instruction: a learner-focused approach to developing learner autonomy . Lang. Teach. Res. 17 , 9–30. doi: 10.1177/1362168812457528 [ CrossRef ] [ Google Scholar ]
  • Nishino T., Atkinson D. (2015). Second-language writing as sociocognitive alignment . J. Second. Lang. Writ. 27 , 37–54. doi: 10.1016/j.jslw.2014.11.002 [ CrossRef ] [ Google Scholar ]
  • Oxford R. L. (1990). Language Learning Strategies: What Every Teacher Should Know . New York: Newbury House/Harper & Row [ Google Scholar ]
  • Oxford R. L. (2013). Teaching and Researching Language Learning Strategies (2nd Edn.). Harlow, UK: Pearson [ Google Scholar ]
  • Oxford R. L., Cohen A. D. (1992). Language learning strategies: crucial issues in concept and classification . Appl. Lang. Learn. 3 , 1–35. [ Google Scholar ]
  • Oxford R. L., Nyikos M. (1989). Variables affecting choice of language learning strategies by university students . Mod. Lang. J. 73 , 291–300. doi: 10.1111/j.1540-4781.1989.tb06367.x [ CrossRef ] [ Google Scholar ]
  • Paris S., Winograd P. (1990). “ How metacognition can promote academic learning and instruction ” in Dimensions of Thinking and Cognitive Instruction . eds. Jones B. F., Idol L. (Hillsdale, NJ: Erlbaum Associates; ), 15–51. [ Google Scholar ]
  • Peacock M., Ho B. (2003). Student language learning strategies across eight disciplines . Int. J. Appl. Linguist. 13 , 179–200. doi: 10.1111/1473-4192.00043 [ CrossRef ] [ Google Scholar ]
  • Pugalee D. K. (2001). Writing, mathematics, and metacognition: looking for connections through students’ work in mathematical problem solving . Sch. Sci. Math. 101 , 236–245. doi: 10.1111/j.1949-8594.2001.tb18026.x [ CrossRef ] [ Google Scholar ]
  • Raimes A. (1987). Language proficiency, writing ability, and composing strategies: a study of ESL college student writers . Lang. Learn. 37 , 439–468. doi: 10.1111/j.1467-1770.1987.tb00579.x [ CrossRef ] [ Google Scholar ]
  • Riazi A. (1997). Acquiring disciplinary literacy: a social-cognitive analysis of text production and learning among Iranian graduate students of education . J. Second. Lang. Writ. 6 , 105–137. doi: 10.1016/S1060-3743(97)90030-8 [ CrossRef ] [ Google Scholar ]
  • Ruan Z. (2014). Metacognitive awareness of EFL student writers in a Chinese ELT context . Lang. Aware. 23 , 76–91. doi: 10.1080/09658416.2013.863901 [ CrossRef ] [ Google Scholar ]
  • Schraw G. A. (1998). Promoting general metacognitive awareness . Instr. Sci. 26 , 113–125. doi: 10.1023/A:1003044231033 [ CrossRef ] [ Google Scholar ]
  • Schraw G. A. (2001). “ Promoting general metacognitive awareness ” in Metacognition in Learning and Instruction: Theory, Research and Practice . ed. Hartman H. J. (London: Springer; ), 3–16. [ Google Scholar ]
  • Schraw G., Dennison R. S. (1994). Assessing metacognitive awareness . Contemp. Educ. Psychol. 19 , 460–475. doi: 10.1006/ceps.1994.1033 [ CrossRef ] [ Google Scholar ]
  • Schraw G., Moshman D. (1995). Metacognitive theories . Educ. Psychol. Rev. 7 , 351–371. doi: 10.1007/BF02212307 [ CrossRef ] [ Google Scholar ]
  • Tabachnick B. G., Fidell L. S. (2001). Using Multivariate Statistics . Needham Heights, MA: Allyn & Bacon [ Google Scholar ]
  • Teng F. (2016). Immediate and delayed effects of embedded metacognitive instruction on Chinese EFL students’ English writing and regulation of cognition . Think. Skills Creat. 22 , 289–302. doi: 10.1016/j.tsc.2016.06.005 [ CrossRef ] [ Google Scholar ]
  • Teng F. (2019). The role of metacognitive knowledge and regulation in mediating university EFL learners’ writing performance . Innov. Lang. Learn. Teach. 14 , 436–450. doi: 10.1080/17501229.2019.1615493 [ CrossRef ] [ Google Scholar ]
  • Teng F. (2020). Tertiary-level students' English writing performance and metacognitive awareness: a group metacognitive support perspective . Scand. J. Educ. Res. 64 , 551–568. doi: 10.1080/00313831.2019.1595712 [ CrossRef ] [ Google Scholar ]
  • Teng F., Huang J. (2019). Predictive effects of writing strategies for self-regulated learning on secondary school learners’ EFL writing proficiency . TESOL Q. 53 , 232–247. doi: 10.1002/tesq.462 [ CrossRef ] [ Google Scholar ]
  • Teng F., Qin C., Wang C. (2022). Validation of metacognitive academic writing strategies and the predictive effects on academic writing performance in a foreign language context . Metacogn. Learn. 17 , 167–190. doi: 10.1007/s11409-021-09278-4, PMID: [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Teng F., Wang C., Zhang L. J. (2022). Assessing self-regulatory writing strategies and their predictive effects on young EFL learners’ writing performance . Assess. Writ. 51 :100573. doi: 10.1016/j.asw.2021.100573 [ CrossRef ] [ Google Scholar ]
  • Teng F., Yue M. (2022). Metacognitive writing strategies, critical thinking skills, and academic writing performance: a structural equation modeling approach . Metacogn. Learn . doi: 10.1007/s11409-022-09328-5 [ PMC free article ] [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Teng L. S., Zhang L. J. (2016). A questionnaire-based validation of. Multidimensional models of self-regulated learning strategies . Mod. Lang. J. 100 , 674–701. doi: 10.1111/modl.12339 [ CrossRef ] [ Google Scholar ]
  • Teng F., Zhang L. J. (2021). Development of children’s metacognitive knowledge, and reading and writing proficiency in English as a foreign language: longitudinal data using multilevel models . Br. J. Educ. Psychol. 91 , 1202–1230. doi: 10.1111/bjep.12413, PMID: [ PubMed ] [ CrossRef ] [ Google Scholar ]
  • Teng L. S., Zhang L. J. (2022). Can self-regulation be transferred to second/foreign language learning and teaching? Current status, controversies, and future directions . Appl. Linguis. 43 , 587–595. doi: 10.1093/applin/amab032 [ CrossRef ] [ Google Scholar ]
  • Wenden A. L. (1991). Learner Strategies for Learner Autonomy: Planning and Implementing Learner Training for Language Learners . Cambridge: Prentice Hall International [ Google Scholar ]
  • Wenden A. L. (1998). Metacognitive knowledge and language learning . Appl. Linguist. 19 , 515–537. [ Google Scholar ]
  • Wolters C. A. (1999). The relation between high school students’ motivational regulation and their use of learning strategies, effort, and classroom performance . Learn. Individ. Differ. 11 , 281–299. doi: 10.1016/S1041-6080(99)80004-1 [ CrossRef ] [ Google Scholar ]
  • Wu Y. L. (2008). Language learning strategies used by students at different proficiency levels . Asian EFL J. 10 , 75–95. [ Google Scholar ]
  • Zhang L. J., Qin L. (2018). “ Validating a questionnaire on EFL writers’ metacognitive awareness of writing strategies in multimedia environments ” in Metacognition in Language Learning and Teaching . eds. Haukås Å., Bjørke C., Dypedahl M. (New York: Routledge; ), 157–178. [ Google Scholar ]
  • Zhang D., Zhang L. J. (2019). “ Metacognition and self-regulated learning (SRL) in second/foreign language teaching ” in Second Handbook of English Language Teaching (Singapore: Springer; ), 883–897. [ Google Scholar ]
  • Zimmerman B. J. (2002). Becoming a self-regulated learner: an overview . Theory Pract. 41 , 64–70. doi: 10.1207/s15430421tip4102_2 [ CrossRef ] [ Google Scholar ]
  • Zimmerman B. J., Risemberg R. (1997). Becoming a self-regulated writer: a social cognitive perspective . Contemp. Educ. Psychol. 22 , 73–101. doi: 10.1006/ceps.1997.0919 [ CrossRef ] [ Google Scholar ]

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • View all journals
  • Explore content
  • About the journal
  • Publish with us
  • Sign up for alerts
  • Perspective
  • Published: 06 March 2024

Artificial intelligence and illusions of understanding in scientific research

  • Lisa Messeri   ORCID: orcid.org/0000-0002-0964-123X 1   na1 &
  • M. J. Crockett   ORCID: orcid.org/0000-0001-8800-410X 2 , 3   na1  

Nature volume  627 ,  pages 49–58 ( 2024 ) Cite this article

16k Accesses

3 Citations

669 Altmetric

Metrics details

  • Human behaviour
  • Interdisciplinary studies
  • Research management
  • Social anthropology

Scientists are enthusiastically imagining ways in which artificial intelligence (AI) tools might improve research. Why are AI tools so attractive and what are the risks of implementing them across the research pipeline? Here we develop a taxonomy of scientists’ visions for AI, observing that their appeal comes from promises to improve productivity and objectivity by overcoming human shortcomings. But proposed AI solutions can also exploit our cognitive limitations, making us vulnerable to illusions of understanding in which we believe we understand more about the world than we actually do. Such illusions obscure the scientific community’s ability to see the formation of scientific monocultures, in which some types of methods, questions and viewpoints come to dominate alternative approaches, making science less innovative and more vulnerable to errors. The proliferation of AI tools in science risks introducing a phase of scientific enquiry in which we produce more but understand less. By analysing the appeal of these tools, we provide a framework for advancing discussions of responsible knowledge production in the age of AI.

This is a preview of subscription content, access via your institution

Access options

Access Nature and 54 other Nature Portfolio journals

Get Nature+, our best-value online-access subscription

24,99 € / 30 days

cancel any time

Subscribe to this journal

Receive 51 print issues and online access

185,98 € per year

only 3,65 € per issue

Rent or buy this article

Prices vary by article type

Prices may be subject to local taxes which are calculated during checkout

metacognitive strategies research paper

Crabtree, G. Self-driving laboratories coming of age. Joule 4 , 2538–2541 (2020).

Article   CAS   Google Scholar  

Wang, H. et al. Scientific discovery in the age of artificial intelligence. Nature 620 , 47–60 (2023). This review explores how AI can be incorporated across the research pipeline, drawing from a wide range of scientific disciplines .

Article   CAS   PubMed   ADS   Google Scholar  

Dillion, D., Tandon, N., Gu, Y. & Gray, K. Can AI language models replace human participants? Trends Cogn. Sci. 27 , 597–600 (2023).

Article   PubMed   Google Scholar  

Grossmann, I. et al. AI and the transformation of social science research. Science 380 , 1108–1109 (2023). This forward-looking article proposes a variety of ways to incorporate generative AI into social-sciences research .

Gil, Y. Will AI write scientific papers in the future? AI Mag. 42 , 3–15 (2022).

Google Scholar  

Kitano, H. Nobel Turing Challenge: creating the engine for scientific discovery. npj Syst. Biol. Appl. 7 , 29 (2021).

Article   PubMed   PubMed Central   Google Scholar  

Benjamin, R. Race After Technology: Abolitionist Tools for the New Jim Code (Oxford Univ. Press, 2020). This book examines how social norms about race become embedded in technologies, even those that are focused on providing good societal outcomes .

Broussard, M. More Than a Glitch: Confronting Race, Gender, and Ability Bias in Tech (MIT Press, 2023).

Noble, S. U. Algorithms of Oppression: How Search Engines Reinforce Racism (New York Univ. Press, 2018).

Bender, E. M., Gebru, T., McMillan-Major, A. & Shmitchell, S. On the dangers of stochastic parrots: can language models be too big? in Proc. 2021 ACM Conference on Fairness, Accountability, and Transparency 610–623 (Association for Computing Machinery, 2021). One of the first comprehensive critiques of large language models, this article draws attention to a host of issues that ought to be considered before taking up such tools .

Crawford, K. Atlas of AI: Power, Politics, and the Planetary Costs of Artificial Intelligence (Yale Univ. Press, 2021).

Johnson, D. G. & Verdicchio, M. Reframing AI discourse. Minds Mach. 27 , 575–590 (2017).

Article   Google Scholar  

Atanasoski, N. & Vora, K. Surrogate Humanity: Race, Robots, and the Politics of Technological Futures (Duke Univ. Press, 2019).

Mitchell, M. & Krakauer, D. C. The debate over understanding in AI’s large language models. Proc. Natl Acad. Sci. USA 120 , e2215907120 (2023).

Kidd, C. & Birhane, A. How AI can distort human beliefs. Science 380 , 1222–1223 (2023).

Birhane, A., Kasirzadeh, A., Leslie, D. & Wachter, S. Science in the age of large language models. Nat. Rev. Phys. 5 , 277–280 (2023).

Kapoor, S. & Narayanan, A. Leakage and the reproducibility crisis in machine-learning-based science. Patterns 4 , 100804 (2023).

Hullman, J., Kapoor, S., Nanayakkara, P., Gelman, A. & Narayanan, A. The worst of both worlds: a comparative analysis of errors in learning from data in psychology and machine learning. In Proc. 2022 AAAI/ACM Conference on AI, Ethics, and Society (eds Conitzer, V. et al.) 335–348 (Association for Computing Machinery, 2022).

Rudin, C. Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead. Nat. Mach. Intell. 1 , 206–215 (2019). This paper articulates the problems with attempting to explain AI systems that lack interpretability, and advocates for building interpretable models instead .

Crockett, M. J., Bai, X., Kapoor, S., Messeri, L. & Narayanan, A. The limitations of machine learning models for predicting scientific replicability. Proc. Natl Acad. Sci. USA 120 , e2307596120 (2023).

Article   CAS   PubMed   PubMed Central   Google Scholar  

Lazar, S. & Nelson, A. AI safety on whose terms? Science 381 , 138 (2023).

Article   PubMed   ADS   Google Scholar  

Collingridge, D. The Social Control of Technology (St Martin’s Press, 1980).

Wagner, G., Lukyanenko, R. & Paré, G. Artificial intelligence and the conduct of literature reviews. J. Inf. Technol. 37 , 209–226 (2022).

Hutson, M. Artificial-intelligence tools aim to tame the coronavirus literature. Nature https://doi.org/10.1038/d41586-020-01733-7 (2020).

Haas, Q. et al. Utilizing artificial intelligence to manage COVID-19 scientific evidence torrent with Risklick AI: a critical tool for pharmacology and therapy development. Pharmacology 106 , 244–253 (2021).

Article   CAS   PubMed   Google Scholar  

Müller, H., Pachnanda, S., Pahl, F. & Rosenqvist, C. The application of artificial intelligence on different types of literature reviews – a comparative study. In 2022 International Conference on Applied Artificial Intelligence (ICAPAI) https://doi.org/10.1109/ICAPAI55158.2022.9801564 (Institute of Electrical and Electronics Engineers, 2022).

van Dinter, R., Tekinerdogan, B. & Catal, C. Automation of systematic literature reviews: a systematic literature review. Inf. Softw. Technol. 136 , 106589 (2021).

Aydın, Ö. & Karaarslan, E. OpenAI ChatGPT generated literature review: digital twin in healthcare. In Emerging Computer Technologies 2 (ed. Aydın, Ö.) 22–31 (İzmir Akademi Dernegi, 2022).

AlQuraishi, M. AlphaFold at CASP13. Bioinformatics 35 , 4862–4865 (2019).

Jumper, J. et al. Highly accurate protein structure prediction with AlphaFold. Nature 596 , 583–589 (2021).

Article   CAS   PubMed   PubMed Central   ADS   Google Scholar  

Lee, J. S., Kim, J. & Kim, P. M. Score-based generative modeling for de novo protein design. Nat. Computat. Sci. 3 , 382–392 (2023).

Gómez-Bombarelli, R. et al. Design of efficient molecular organic light-emitting diodes by a high-throughput virtual screening and experimental approach. Nat. Mater. 15 , 1120–1127 (2016).

Krenn, M. et al. On scientific understanding with artificial intelligence. Nat. Rev. Phys. 4 , 761–769 (2022).

Extance, A. How AI technology can tame the scientific literature. Nature 561 , 273–274 (2018).

Hastings, J. AI for Scientific Discovery (CRC Press, 2023). This book reviews current and future incorporation of AI into the scientific research pipeline .

Ahmed, A. et al. The future of academic publishing. Nat. Hum. Behav. 7 , 1021–1026 (2023).

Gray, K., Yam, K. C., Zhen’An, A. E., Wilbanks, D. & Waytz, A. The psychology of robots and artificial intelligence. In The Handbook of Social Psychology (eds Gilbert, D. et al.) (in the press).

Argyle, L. P. et al. Out of one, many: using language models to simulate human samples. Polit. Anal. 31 , 337–351 (2023).

Aher, G., Arriaga, R. I. & Kalai, A. T. Using large language models to simulate multiple humans and replicate human subject studies. In Proc. 40th International Conference on Machine Learning (eds Krause, A. et al.) 337–371 (JMLR.org, 2023).

Binz, M. & Schulz, E. Using cognitive psychology to understand GPT-3. Proc. Natl Acad. Sci. USA 120 , e2218523120 (2023).

Ornstein, J. T., Blasingame, E. N. & Truscott, J. S. How to train your stochastic parrot: large language models for political texts. Github , https://joeornstein.github.io/publications/ornstein-blasingame-truscott.pdf (2023).

He, S. et al. Learning to predict the cosmological structure formation. Proc. Natl Acad. Sci. USA 116 , 13825–13832 (2019).

Article   MathSciNet   CAS   PubMed   PubMed Central   ADS   Google Scholar  

Mahmood, F. et al. Deep adversarial training for multi-organ nuclei segmentation in histopathology images. IEEE Trans. Med. Imaging 39 , 3257–3267 (2020).

Teixeira, B. et al. Generating synthetic X-ray images of a person from the surface geometry. In Proc. IEEE Conference on Computer Vision and Pattern Recognition 9059–9067 (Institute of Electrical and Electronics Engineers, 2018).

Marouf, M. et al. Realistic in silico generation and augmentation of single-cell RNA-seq data using generative adversarial networks. Nat. Commun. 11 , 166 (2020).

Watts, D. J. A twenty-first century science. Nature 445 , 489 (2007).

boyd, d. & Crawford, K. Critical questions for big data. Inf. Commun. Soc. 15 , 662–679 (2012). This article assesses the ethical and epistemic implications of scientific and societal moves towards big data and provides a parallel case study for thinking about the risks of artificial intelligence .

Jolly, E. & Chang, L. J. The Flatland fallacy: moving beyond low–dimensional thinking. Top. Cogn. Sci. 11 , 433–454 (2019).

Yarkoni, T. & Westfall, J. Choosing prediction over explanation in psychology: lessons from machine learning. Perspect. Psychol. Sci. 12 , 1100–1122 (2017).

Radivojac, P. et al. A large-scale evaluation of computational protein function prediction. Nat. Methods 10 , 221–227 (2013).

Bileschi, M. L. et al. Using deep learning to annotate the protein universe. Nat. Biotechnol. 40 , 932–937 (2022).

Barkas, N. et al. Joint analysis of heterogeneous single-cell RNA-seq dataset collections. Nat. Methods 16 , 695–698 (2019).

Demszky, D. et al. Using large language models in psychology. Nat. Rev. Psychol. 2 , 688–701 (2023).

Karjus, A. Machine-assisted mixed methods: augmenting humanities and social sciences with artificial intelligence. Preprint at https://arxiv.org/abs/2309.14379 (2023).

Davies, A. et al. Advancing mathematics by guiding human intuition with AI. Nature 600 , 70–74 (2021).

Peterson, J. C., Bourgin, D. D., Agrawal, M., Reichman, D. & Griffiths, T. L. Using large-scale experiments and machine learning to discover theories of human decision-making. Science 372 , 1209–1214 (2021).

Ilyas, A. et al. Adversarial examples are not bugs, they are features. Preprint at https://doi.org/10.48550/arXiv.1905.02175 (2019)

Semel, B. M. Listening like a computer: attentional tensions and mechanized care in psychiatric digital phenotyping. Sci. Technol. Hum. Values 47 , 266–290 (2022).

Gil, Y. Thoughtful artificial intelligence: forging a new partnership for data science and scientific discovery. Data Sci. 1 , 119–129 (2017).

Checco, A., Bracciale, L., Loreti, P., Pinfield, S. & Bianchi, G. AI-assisted peer review. Humanit. Soc. Sci. Commun. 8 , 25 (2021).

Thelwall, M. Can the quality of published academic journal articles be assessed with machine learning? Quant. Sci. Stud. 3 , 208–226 (2022).

Dhar, P. Peer review of scholarly research gets an AI boost. IEEE Spectrum spectrum.ieee.org/peer-review-of-scholarly-research-gets-an-ai-boost (2020).

Heaven, D. AI peer reviewers unleashed to ease publishing grind. Nature 563 , 609–610 (2018).

Conroy, G. How ChatGPT and other AI tools could disrupt scientific publishing. Nature 622 , 234–236 (2023).

Nosek, B. A. et al. Replicability, robustness, and reproducibility in psychological science. Annu. Rev. Psychol. 73 , 719–748 (2022).

Altmejd, A. et al. Predicting the replicability of social science lab experiments. PLoS ONE 14 , e0225826 (2019).

Yang, Y., Youyou, W. & Uzzi, B. Estimating the deep replicability of scientific findings using human and artificial intelligence. Proc. Natl Acad. Sci. USA 117 , 10762–10768 (2020).

Youyou, W., Yang, Y. & Uzzi, B. A discipline-wide investigation of the replicability of psychology papers over the past two decades. Proc. Natl Acad. Sci. USA 120 , e2208863120 (2023).

Rabb, N., Fernbach, P. M. & Sloman, S. A. Individual representation in a community of knowledge. Trends Cogn. Sci. 23 , 891–902 (2019). This comprehensive review paper documents the empirical evidence for distributed cognition in communities of knowledge and the resultant vulnerabilities to illusions of understanding .

Rozenblit, L. & Keil, F. The misunderstood limits of folk science: an illusion of explanatory depth. Cogn. Sci. 26 , 521–562 (2002). This paper provided an empirical demonstration of the illusion of explanatory depth, and inspired a programme of research in cognitive science on communities of knowledge .

Hutchins, E. Cognition in the Wild (MIT Press, 1995).

Lave, J. & Wenger, E. Situated Learning: Legitimate Peripheral Participation (Cambridge Univ. Press, 1991).

Kitcher, P. The division of cognitive labor. J. Philos. 87 , 5–22 (1990).

Hardwig, J. Epistemic dependence. J. Philos. 82 , 335–349 (1985).

Keil, F. in Oxford Studies In Epistemology (eds Gendler, T. S. & Hawthorne, J.) 143–166 (Oxford Academic, 2005).

Weisberg, M. & Muldoon, R. Epistemic landscapes and the division of cognitive labor. Philos. Sci. 76 , 225–252 (2009).

Sloman, S. A. & Rabb, N. Your understanding is my understanding: evidence for a community of knowledge. Psychol. Sci. 27 , 1451–1460 (2016).

Wilson, R. A. & Keil, F. The shadows and shallows of explanation. Minds Mach. 8 , 137–159 (1998).

Keil, F. C., Stein, C., Webb, L., Billings, V. D. & Rozenblit, L. Discerning the division of cognitive labor: an emerging understanding of how knowledge is clustered in other minds. Cogn. Sci. 32 , 259–300 (2008).

Sperber, D. et al. Epistemic vigilance. Mind Lang. 25 , 359–393 (2010).

Wilkenfeld, D. A., Plunkett, D. & Lombrozo, T. Depth and deference: when and why we attribute understanding. Philos. Stud. 173 , 373–393 (2016).

Sparrow, B., Liu, J. & Wegner, D. M. Google effects on memory: cognitive consequences of having information at our fingertips. Science 333 , 776–778 (2011).

Fisher, M., Goddu, M. K. & Keil, F. C. Searching for explanations: how the internet inflates estimates of internal knowledge. J. Exp. Psychol. Gen. 144 , 674–687 (2015).

De Freitas, J., Agarwal, S., Schmitt, B. & Haslam, N. Psychological factors underlying attitudes toward AI tools. Nat. Hum. Behav. 7 , 1845–1854 (2023).

Castelo, N., Bos, M. W. & Lehmann, D. R. Task-dependent algorithm aversion. J. Mark. Res. 56 , 809–825 (2019).

Cadario, R., Longoni, C. & Morewedge, C. K. Understanding, explaining, and utilizing medical artificial intelligence. Nat. Hum. Behav. 5 , 1636–1642 (2021).

Oktar, K. & Lombrozo, T. Deciding to be authentic: intuition is favored over deliberation when authenticity matters. Cognition 223 , 105021 (2022).

Bigman, Y. E., Yam, K. C., Marciano, D., Reynolds, S. J. & Gray, K. Threat of racial and economic inequality increases preference for algorithm decision-making. Comput. Hum. Behav. 122 , 106859 (2021).

Claudy, M. C., Aquino, K. & Graso, M. Artificial intelligence can’t be charmed: the effects of impartiality on laypeople’s algorithmic preferences. Front. Psychol. 13 , 898027 (2022).

Snyder, C., Keppler, S. & Leider, S. Algorithm reliance under pressure: the effect of customer load on service workers. Preprint at SSRN https://doi.org/10.2139/ssrn.4066823 (2022).

Bogert, E., Schecter, A. & Watson, R. T. Humans rely more on algorithms than social influence as a task becomes more difficult. Sci Rep. 11 , 8028 (2021).

Raviv, A., Bar‐Tal, D., Raviv, A. & Abin, R. Measuring epistemic authority: studies of politicians and professors. Eur. J. Personal. 7 , 119–138 (1993).

Cummings, L. The “trust” heuristic: arguments from authority in public health. Health Commun. 29 , 1043–1056 (2014).

Lee, M. K. Understanding perception of algorithmic decisions: fairness, trust, and emotion in response to algorithmic management. Big Data Soc. 5 , https://doi.org/10.1177/2053951718756684 (2018).

Kissinger, H. A., Schmidt, E. & Huttenlocher, D. The Age of A.I. And Our Human Future (Little, Brown, 2021).

Lombrozo, T. Explanatory preferences shape learning and inference. Trends Cogn. Sci. 20 , 748–759 (2016). This paper provides an overview of philosophical theories of explanatory virtues and reviews empirical evidence on the sorts of explanations people find satisfying .

Vrantsidis, T. H. & Lombrozo, T. Simplicity as a cue to probability: multiple roles for simplicity in evaluating explanations. Cogn. Sci. 46 , e13169 (2022).

Johnson, S. G. B., Johnston, A. M., Toig, A. E. & Keil, F. C. Explanatory scope informs causal strength inferences. In Proc. 36th Annual Meeting of the Cognitive Science Society 2453–2458 (Cognitive Science Society, 2014).

Khemlani, S. S., Sussman, A. B. & Oppenheimer, D. M. Harry Potter and the sorcerer’s scope: latent scope biases in explanatory reasoning. Mem. Cognit. 39 , 527–535 (2011).

Liquin, E. G. & Lombrozo, T. Motivated to learn: an account of explanatory satisfaction. Cogn. Psychol. 132 , 101453 (2022).

Hopkins, E. J., Weisberg, D. S. & Taylor, J. C. V. The seductive allure is a reductive allure: people prefer scientific explanations that contain logically irrelevant reductive information. Cognition 155 , 67–76 (2016).

Weisberg, D. S., Hopkins, E. J. & Taylor, J. C. V. People’s explanatory preferences for scientific phenomena. Cogn. Res. Princ. Implic. 3 , 44 (2018).

Jerez-Fernandez, A., Angulo, A. N. & Oppenheimer, D. M. Show me the numbers: precision as a cue to others’ confidence. Psychol. Sci. 25 , 633–635 (2014).

Kim, J., Giroux, M. & Lee, J. C. When do you trust AI? The effect of number presentation detail on consumer trust and acceptance of AI recommendations. Psychol. Mark. 38 , 1140–1155 (2021).

Nguyen, C. T. The seductions of clarity. R. Inst. Philos. Suppl. 89 , 227–255 (2021). This article describes how reductive and quantitative explanations can generate a sense of understanding that is not necessarily correlated with actual understanding .

Fisher, M., Smiley, A. H. & Grillo, T. L. H. Information without knowledge: the effects of internet search on learning. Memory 30 , 375–387 (2022).

Eliseev, E. D. & Marsh, E. J. Understanding why searching the internet inflates confidence in explanatory ability. Appl. Cogn. Psychol. 37 , 711–720 (2023).

Fisher, M. & Oppenheimer, D. M. Who knows what? Knowledge misattribution in the division of cognitive labor. J. Exp. Psychol. Appl. 27 , 292–306 (2021).

Chromik, M., Eiband, M., Buchner, F., Krüger, A. & Butz, A. I think I get your point, AI! The illusion of explanatory depth in explainable AI. In 26th International Conference on Intelligent User Interfaces (eds Hammond, T. et al.) 307–317 (Association for Computing Machinery, 2021).

Strevens, M. No understanding without explanation. Stud. Hist. Philos. Sci. A 44 , 510–515 (2013).

Ylikoski, P. in Scientific Understanding: Philosophical Perspectives (eds De Regt, H. et al.) 100–119 (Univ. Pittsburgh Press, 2009).

Giudice, M. D. The prediction–explanation fallacy: a pervasive problem in scientific applications of machine learning. Preprint at PsyArXiv https://doi.org/10.31234/osf.io/4vq8f (2021).

Hofman, J. M. et al. Integrating explanation and prediction in computational social science. Nature 595 , 181–188 (2021). This paper highlights the advantages and disadvantages of explanatory versus predictive approaches to modelling, with a focus on applications to computational social science .

Shmueli, G. To explain or to predict? Stat. Sci. 25 , 289–310 (2010).

Article   MathSciNet   Google Scholar  

Hofman, J. M., Sharma, A. & Watts, D. J. Prediction and explanation in social systems. Science 355 , 486–488 (2017).

Logg, J. M., Minson, J. A. & Moore, D. A. Algorithm appreciation: people prefer algorithmic to human judgment. Organ. Behav. Hum. Decis. Process. 151 , 90–103 (2019).

Nguyen, C. T. Cognitive islands and runaway echo chambers: problems for epistemic dependence on experts. Synthese 197 , 2803–2821 (2020).

Breiman, L. Statistical modeling: the two cultures. Stat. Sci. 16 , 199–215 (2001).

Gao, J. & Wang, D. Quantifying the benefit of artificial intelligence for scientific research. Preprint at arxiv.org/abs/2304.10578 (2023).

Hanson, B. et al. Garbage in, garbage out: mitigating risks and maximizing benefits of AI in research. Nature 623 , 28–31 (2023).

Kleinberg, J. & Raghavan, M. Algorithmic monoculture and social welfare. Proc. Natl Acad. Sci. USA 118 , e2018340118 (2021). This paper uses formal modelling methods to demonstrate that when companies all rely on the same algorithm to make decisions (an algorithmic monoculture), the overall quality of those decisions is reduced because valuable options can slip through the cracks, even when the algorithm performs accurately for individual companies .

Article   MathSciNet   CAS   PubMed   PubMed Central   Google Scholar  

Hofstra, B. et al. The diversity–innovation paradox in science. Proc. Natl Acad. Sci. USA 117 , 9284–9291 (2020).

Hong, L. & Page, S. E. Groups of diverse problem solvers can outperform groups of high-ability problem solvers. Proc. Natl Acad. Sci. USA 101 , 16385–16389 (2004).

Page, S. E. Where diversity comes from and why it matters? Eur. J. Soc. Psychol. 44 , 267–279 (2014). This article reviews research demonstrating the benefits of cognitive diversity and diversity in methodological approaches for problem solving and innovation .

Clarke, A. E. & Fujimura, J. H. (eds) The Right Tools for the Job: At Work in Twentieth-Century Life Sciences (Princeton Univ. Press, 2014).

Silva, V. J., Bonacelli, M. B. M. & Pacheco, C. A. Framing the effects of machine learning on science. AI Soc. https://doi.org/10.1007/s00146-022-01515-x (2022).

Sassenberg, K. & Ditrich, L. Research in social psychology changed between 2011 and 2016: larger sample sizes, more self-report measures, and more online studies. Adv. Methods Pract. Psychol. Sci. 2 , 107–114 (2019).

Simon, A. F. & Wilder, D. Methods and measures in social and personality psychology: a comparison of JPSP publications in 1982 and 2016. J. Soc. Psychol. https://doi.org/10.1080/00224545.2022.2135088 (2022).

Anderson, C. A. et al. The MTurkification of social and personality psychology. Pers. Soc. Psychol. Bull. 45 , 842–850 (2019).

Latour, B. in The Social After Gabriel Tarde: Debates and Assessments (ed. Candea, M.) 145–162 (Routledge, 2010).

Porter, T. M. Trust in Numbers: The Pursuit of Objectivity in Science and Public Life (Princeton Univ. Press, 1996).

Lazer, D. et al. Meaningful measures of human society in the twenty-first century. Nature 595 , 189–196 (2021).

Knox, D., Lucas, C. & Cho, W. K. T. Testing causal theories with learned proxies. Annu. Rev. Polit. Sci. 25 , 419–441 (2022).

Barberá, P. Birds of the same feather tweet together: Bayesian ideal point estimation using Twitter data. Polit. Anal. 23 , 76–91 (2015).

Brady, W. J., McLoughlin, K., Doan, T. N. & Crockett, M. J. How social learning amplifies moral outrage expression in online social networks. Sci. Adv. 7 , eabe5641 (2021).

Article   PubMed   PubMed Central   ADS   Google Scholar  

Barnes, J., Klinger, R. & im Walde, S. S. Assessing state-of-the-art sentiment models on state-of-the-art sentiment datasets. In Proc. 8th Workshop on Computational Approaches to Subjectivity, Sentiment and Social Media Analysis (eds Balahur, A. et al.) 2–12 (Association for Computational Linguistics, 2017).

Gitelman, L. (ed.) “Raw Data” is an Oxymoron (MIT Press, 2013).

Breznau, N. et al. Observing many researchers using the same data and hypothesis reveals a hidden universe of uncertainty. Proc. Natl Acad. Sci. USA 119 , e2203150119 (2022). This study demonstrates how 73 research teams analysing the same dataset reached different conclusions about the relationship between immigration and public support for social policies, highlighting the subjectivity and uncertainty involved in analysing complex datasets .

Gillespie, T. in Media Technologies: Essays on Communication, Materiality, and Society (eds Gillespie, T. et al.) 167–194 (MIT Press, 2014).

Leonelli, S. Data-Centric Biology: A Philosophical Study (Univ. Chicago Press, 2016).

Wang, A., Kapoor, S., Barocas, S. & Narayanan, A. Against predictive optimization: on the legitimacy of decision-making algorithms that optimize predictive accuracy. ACM J. Responsib. Comput. , https://doi.org/10.1145/3636509 (2023).

Athey, S. Beyond prediction: using big data for policy problems. Science 355 , 483–485 (2017).

del Rosario Martínez-Ordaz, R. Scientific understanding through big data: from ignorance to insights to understanding. Possibility Stud. Soc. 1 , 279–299 (2023).

Nussberger, A.-M., Luo, L., Celis, L. E. & Crockett, M. J. Public attitudes value interpretability but prioritize accuracy in artificial intelligence. Nat. Commun. 13 , 5821 (2022).

Zittrain, J. in The Cambridge Handbook of Responsible Artificial Intelligence: Interdisciplinary Perspectives (eds. Voeneky, S. et al.) 176–184 (Cambridge Univ. Press, 2022). This article articulates the epistemic risks of prioritizing predictive accuracy over explanatory understanding when AI tools are interacting in complex systems.

Shumailov, I. et al. The curse of recursion: training on generated data makes models forget. Preprint at arxiv.org/abs/2305.17493 (2023).

Latour, B. Science In Action: How to Follow Scientists and Engineers Through Society (Harvard Univ. Press, 1987). This book provides strategies and approaches for thinking about science as a social endeavour .

Franklin, S. Science as culture, cultures of science. Annu. Rev. Anthropol. 24 , 163–184 (1995).

Haraway, D. Situated knowledges: the science question in feminism and the privilege of partial perspective. Fem. Stud. 14 , 575–599 (1988). This article acknowledges that the objective ‘view from nowhere’ is unobtainable: knowledge, it argues, is always situated .

Harding, S. Objectivity and Diversity: Another Logic of Scientific Research (Univ. Chicago Press, 2015).

Longino, H. E. Science as Social Knowledge: Values and Objectivity in Scientific Inquiry (Princeton Univ. Press, 1990).

Daston, L. & Galison, P. Objectivity (Princeton Univ. Press, 2007). This book is a historical analysis of the shifting modes of ‘objectivity’ that scientists have pursued, arguing that objectivity is not a universal concept but that it shifts alongside scientific techniques and ambitions .

Prescod-Weinstein, C. Making Black women scientists under white empiricism: the racialization of epistemology in physics. Signs J. Women Cult. Soc. 45 , 421–447 (2020).

Mavhunga, C. What Do Science, Technology, and Innovation Mean From Africa? (MIT Press, 2017).

Schiebinger, L. The Mind Has No Sex? Women in the Origins of Modern Science (Harvard Univ. Press, 1991).

Martin, E. The egg and the sperm: how science has constructed a romance based on stereotypical male–female roles. Signs J. Women Cult. Soc. 16 , 485–501 (1991). This case study shows how assumptions about gender affect scientific theories, sometimes delaying the articulation of what might be considered to be more accurate descriptions of scientific phenomena .

Harding, S. Rethinking standpoint epistemology: What is “strong objectivity”? Centen. Rev. 36 , 437–470 (1992). In this article, Harding outlines her position on ‘strong objectivity’, by which clearly articulating one’s standpoint can lead to more robust knowledge claims .

Oreskes, N. Why Trust Science? (Princeton Univ. Press, 2019). This book introduces the reader to 20 years of scholarship in science and technology studies, arguing that the tools the discipline has for understanding science can help to reinstate public trust in the institution .

Rolin, K., Koskinen, I., Kuorikoski, J. & Reijula, S. Social and cognitive diversity in science: introduction. Synthese 202 , 36 (2023).

Hong, L. & Page, S. E. Problem solving by heterogeneous agents. J. Econ. Theory 97 , 123–163 (2001).

Sulik, J., Bahrami, B. & Deroy, O. The diversity gap: when diversity matters for knowledge. Perspect. Psychol. Sci. 17 , 752–767 (2022).

Lungeanu, A., Whalen, R., Wu, Y. J., DeChurch, L. A. & Contractor, N. S. Diversity, networks, and innovation: a text analytic approach to measuring expertise diversity. Netw. Sci. 11 , 36–64 (2023).

AlShebli, B. K., Rahwan, T. & Woon, W. L. The preeminence of ethnic diversity in scientific collaboration. Nat. Commun. 9 , 5163 (2018).

Campbell, L. G., Mehtani, S., Dozier, M. E. & Rinehart, J. Gender-heterogeneous working groups produce higher quality science. PLoS ONE 8 , e79147 (2013).

Nielsen, M. W., Bloch, C. W. & Schiebinger, L. Making gender diversity work for scientific discovery and innovation. Nat. Hum. Behav. 2 , 726–734 (2018).

Yang, Y., Tian, T. Y., Woodruff, T. K., Jones, B. F. & Uzzi, B. Gender-diverse teams produce more novel and higher-impact scientific ideas. Proc. Natl Acad. Sci. USA 119 , e2200841119 (2022).

Kozlowski, D., Larivière, V., Sugimoto, C. R. & Monroe-White, T. Intersectional inequalities in science. Proc. Natl Acad. Sci. USA 119 , e2113067119 (2022).

Fehr, C. & Jones, J. M. Culture, exploitation, and epistemic approaches to diversity. Synthese 200 , 465 (2022).

Nakadai, R., Nakawake, Y. & Shibasaki, S. AI language tools risk scientific diversity and innovation. Nat. Hum. Behav. 7 , 1804–1805 (2023).

National Academies of Sciences, Engineering, and Medicine et al. Advancing Antiracism, Diversity, Equity, and Inclusion in STEMM Organizations: Beyond Broadening Participation (National Academies Press, 2023).

Winner, L. Do artifacts have politics? Daedalus 109 , 121–136 (1980).

Eubanks, V. Automating Inequality: How High-Tech Tools Profile, Police, and Punish the Poor (St. Martin’s Press, 2018).

Littmann, M. et al. Validity of machine learning in biology and medicine increased through collaborations across fields of expertise. Nat. Mach. Intell. 2 , 18–24 (2020).

Carusi, A. et al. Medical artificial intelligence is as much social as it is technological. Nat. Mach. Intell. 5 , 98–100 (2023).

Raghu, M. & Schmidt, E. A survey of deep learning for scientific discovery. Preprint at arxiv.org/abs/2003.11755 (2020).

Bishop, C. AI4Science to empower the fifth paradigm of scientific discovery. Microsoft Research Blog www.microsoft.com/en-us/research/blog/ai4science-to-empower-the-fifth-paradigm-of-scientific-discovery/ (2022).

Whittaker, M. The steep cost of capture. Interactions 28 , 50–55 (2021).

Liesenfeld, A., Lopez, A. & Dingemanse, M. Opening up ChatGPT: Tracking openness, transparency, and accountability in instruction-tuned text generators. In Proc. 5th International Conference on Conversational User Interfaces 1–6 (Association for Computing Machinery, 2023).

Chu, J. S. G. & Evans, J. A. Slowed canonical progress in large fields of science. Proc. Natl Acad. Sci. USA 118 , e2021636118 (2021).

Park, M., Leahey, E. & Funk, R. J. Papers and patents are becoming less disruptive over time. Nature 613 , 138–144 (2023).

Frith, U. Fast lane to slow science. Trends Cogn. Sci. 24 , 1–2 (2020). This article explains the epistemic risks of a hyperfocus on scientific productivity and explores possible avenues for incentivizing the production of higher-quality science on a slower timescale .

Stengers, I. Another Science is Possible: A Manifesto for Slow Science (Wiley, 2018).

Lake, B. M. & Baroni, M. Human-like systematic generalization through a meta-learning neural network. Nature 623 , 115–121 (2023).

Feinman, R. & Lake, B. M. Learning task-general representations with generative neuro-symbolic modeling. Preprint at arxiv.org/abs/2006.14448 (2021).

Schölkopf, B. et al. Toward causal representation learning. Proc. IEEE 109 , 612–634 (2021).

Mitchell, M. AI’s challenge of understanding the world. Science 382 , eadm8175 (2023).

Sartori, L. & Bocca, G. Minding the gap(s): public perceptions of AI and socio-technical imaginaries. AI Soc. 38 , 443–458 (2023).

Download references

Acknowledgements

We thank D. S. Bassett, W. J. Brady, S. Helmreich, S. Kapoor, T. Lombrozo, A. Narayanan, M. Salganik and A. J. te Velthuis for comments. We also thank C. Buckner and P. Winter for their feedback and suggestions.

Author information

These authors contributed equally: Lisa Messeri, M. J. Crockett

Authors and Affiliations

Department of Anthropology, Yale University, New Haven, CT, USA

Lisa Messeri

Department of Psychology, Princeton University, Princeton, NJ, USA

M. J. Crockett

University Center for Human Values, Princeton University, Princeton, NJ, USA

You can also search for this author in PubMed   Google Scholar

Contributions

The authors contributed equally to the research and writing of the paper.

Corresponding authors

Correspondence to Lisa Messeri or M. J. Crockett .

Ethics declarations

Competing interests.

The authors declare no competing interests.

Peer review

Peer review information.

Nature thanks Cameron Buckner, Peter Winter and the other, anonymous, reviewer(s) for their contribution to the peer review of this work.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Cite this article.

Messeri, L., Crockett, M.J. Artificial intelligence and illusions of understanding in scientific research. Nature 627 , 49–58 (2024). https://doi.org/10.1038/s41586-024-07146-0

Download citation

Received : 31 July 2023

Accepted : 31 January 2024

Published : 06 March 2024

Issue Date : 07 March 2024

DOI : https://doi.org/10.1038/s41586-024-07146-0

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

This article is cited by

Ai is no substitute for having something to say.

Nature Reviews Physics (2024)

Perché gli scienziati si fidano troppo dell'intelligenza artificiale - e come rimediare

Nature Italy (2024)

Why scientists trust AI too much — and what to do about it

Nature (2024)

By submitting a comment you agree to abide by our Terms and Community Guidelines . If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Quick links

  • Explore articles by subject
  • Guide to authors
  • Editorial policies

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

metacognitive strategies research paper

IMAGES

  1. 7 Practical Steps For Metacognition In The Classroom

    metacognitive strategies research paper

  2. PPT

    metacognitive strategies research paper

  3. 3. Mapping of Metacognitive Strategies

    metacognitive strategies research paper

  4. Conceptual Framework of Metacognition [6]

    metacognitive strategies research paper

  5. 8 WAYS TO DEVELOP METACOGNITIVE SKILLS ?

    metacognitive strategies research paper

  6. Metacognition Strategies

    metacognitive strategies research paper

VIDEO

  1. Metacognition: A Tool to Learning Better

  2. Metacognitive Strategies

  3. Metacognitive Strategies

  4. METACOGNITION

  5. KN Metacognition Learning

  6. 1.3 Metacognition

COMMENTS

  1. (PDF) Metacognitive Strategies

    Abstract. This chapter promotes teachers' use of metacognitive strategies to help students reflect on how to improve their learning. It also provides insight into the research and theory behind ...

  2. Metacognition: ideas and insights from neuro- and educational ...

    Metacognition is defined as "thinking about thinking" or the ability to monitor and control one's cognitive processes 1 and plays an important role in learning and education 2,3,4.For ...

  3. Fostering Metacognition to Support Student Learning and Performance

    We then explore metacognition research by summarizing both classic and recent papers in the field and providing links for readers who want to examine the original studies. We consider three main areas related to metacognition: 1) student strategies for learning, 2) monitoring and control of learning, and 3) social metacognition during group work.

  4. An Analysis of Research on Metacognitive Teaching Strategies

    As in the case of modelling, researchers have suggested that consistent practice is one of the characteristics of effective metacognitive strategy instruction (Leon-Guerrero, 2008; Kistner et al., 2010). Four additional strategies were reported, including mnemonics, answer checking, checklist, and goal attainment.

  5. The use of metacognitive strategies for undisrupted online learning

    The paper starts with a literature review of the main concepts which are metacognition and learning performance to formulate the research hypotheses. This is followed by the research method, data analysis and results, and discussion. ... An analysis of research on metacognitive teaching strategies. Procedia - Social and Behavioral Sciences ...

  6. (PDF) A Journey into the Metacognitive Learning Strategies

    The primary grammar-learning method that predominates is metacognitive strategy. The list of several learning methods provided by Mitsea & Drigas (2019) and Ali & Razali (2019) includes problem ...

  7. PDF METACOGNITIVE STRATEGIES AND LEARNING QUALITY: A SYSTEMATIC ...

    The purpose of this study was to identify, analyze, synthesize and evaluate research papers aimed at the application of metacognitive strategies to improve the quality of learning in secondary school students. This document is a systematic mapping (SM) which offers a comprehensive overview of the methods, indicators, strategies, techniques and ...

  8. Metacognitive strategies awareness and success in ...

    Maleki, B. (2005). The effect of cognitive and metacognitive strategies on improvement of different school subjects. New findings in cognitive science, 7(3),42-49. Meshkat, M., and Nasirifirouz, A. (2009). Self-assessment metacognitive strategy in increasing language learners’ grammar knowledge. Journal of Education Technology, 44, 29-36.

  9. PDF Learning Strategies as Metacognitive Factors: A Critical Review

    for a research paper; managing personal time to juggle multiple priorities and complete a complex task during several days or weeks; or seeking help when ... Cognitive Strategies • Metacognitive strategies • Rehearsal • Self-regulated learning • Elaboration • Time management • Organization • Goal-setting

  10. Frontiers

    Metacognition, which is our interest in this paper, should also have bidirectional relations with critical thinking. Metacognition tends to be understood as the degree of consciousness which we have about our own mental processes and similar to the capacity for self-regulation, that is, planning and organization (Mayor et al., 1993). We observe ...

  11. Metacognitive reading strategies and its relationship with ...

    The PISA 2018 assessment framework also underscored the importance of metacognitive research strategies in the overall assessment of reading proficiency (Organisation for Economic Co-operation and ...

  12. Reflections on the field of metacognition: issues, challenges, and

    Lastly, neuropsychological research on metacognition continues to be limited and focuses on very specific metacognitive processes (e.g., Rahnev and Fleming 2019). The field would benefit tremendously by increasing this kind of research extended to other components of metacognition and SRL such as planning, reflection, and so forth.

  13. PDF The Development of Metacognitive Competencies

    due to the fact that metacognition is crucial for concepts of everyday reasoning and those assessing scientific thinking as well as social interactions. 2 Classic Research on the Development of Metamemory 2.1 Declarative Metamemory From the very beginning, research on the development of metacognitive knowledge has focused on the domain of memory.

  14. PDF metacognition From the general to the situated: three decades of

    Research in metacognition has covered mainly three components: (a) 'knowl-edge about strategies', which refers to knowledge about when, where and why different strategies should be used; (b) 'strategy use', referring to the children's actual use of metacognitive strategies without instruction or prompts; and (c)

  15. The Instruction of Writing Strategies: The Effect of the Metacognitive

    This study is novel in that no national research has been conducted on the effect of the metacognitive strategy on writing skills, although there have been many studies on the relationship between this strategy and writing skills (Karahroudi & Reddy, 2014; Lv & Chen, 2010; Maftoon, Birjandi, & Farahian, 2014; Magogwe, 2013; Mekala et al., 2016).

  16. EJIHPE

    This article examines the impact of applied metacognition on the development of geographical causal structures by students in the geography classroom. For that, three different metacognitive strategies were designed: a. action plan, activating meta-knowledge prior to problem-solving and simultaneously visualizing action steps for dealing with the task (A); b. circular thinking (C), a loop-like ...

  17. PDF Metacognition and its Relationship with Students' Academic P

    possible directions for research on metacognition in learning process are proposed. Keywords: Metacognition, metacognitive awareness, metacognitive knowledge, metacognitive regulation. 1.0 Introduction Metacognition is simply and commonly defined as "thinking about thinking". Metacognition refers to the knowledge

  18. The effect of cognitive and metacognitive strategies in academic

    The results of different research indicated that learning strategies such as cognitive and metacognitive strategies have had the most effects on academic achievement of school and university ...

  19. Assessing metacognitive writing strategies and the predictive effects

    He was the recipient of the 2017 Best Paper Award from the Hong Kong Association for Applied Linguistics (HAAL), as well as the Science Science Research Awards by the Education Ministry of China (2023). His research portfolio mainly focuses on L2 vocabulary acquisition, and metacognition in L2 writing.

  20. Assessing metacognitive writing strategies and the predictive effects

    DOI: 10.1080/02188791.2024.2325132 Corpus ID: 268343961; Assessing metacognitive writing strategies and the predictive effects on multimedia writing @article{Teng2024AssessingMW, title={Assessing metacognitive writing strategies and the predictive effects on multimedia writing}, author={Mark Feng Teng and Chenghai Qin}, journal={Asia Pacific Journal of Education}, year={2024}, url={https://api ...

  21. Metacognitive Strategies and Development of Critical Thinking in Higher

    Field studies indicate the existence of relations between teaching metacognitive strategies and progress in students' higher-order thinking processes ( Schraw, 1998; Kramarski et al., 2002; Van der Stel and Veenman, 2010 ). Metacognition is thus considered one of the most relevant predictors of achieving a complex higher-order thought process.

  22. Metacognition: ideas and insights from neuro- and educational sciences

    Metacognition comprises both the ability to be aware of one's cognitive processes (metacognitive knowledge) and to regulate them (metacognitive control). Research in educational sciences has amassed a large body of evidence on the importance of metacognition in learning and academic achievement. More recently, metacognition has been studied ...

  23. Fostering Metacognition to Support Student Learning and Performance

    We then explore metacognition research by summarizing both classic and recent papers in the field and providing links for readers who want to examine the original studies. We consider three main areas related to metacognition: 1) student strategies for learning, 2) monitoring and control of learning, and 3) social metacognition during group work.

  24. [PDF] An Action Research on Metacognitive Reading Strategies

    DOI: 10.18488/journal.23.2020.92.86.94 Corpus ID: 214639088; An Action Research on Metacognitive Reading Strategies Instruction to Improve Reading Comprehension @article{Kung2020AnAR, title={An Action Research on Metacognitive Reading Strategies Instruction to Improve Reading Comprehension}, author={Lian Yong Kung and Azlina Abdul Aziz}, journal={International Journal of English Language and ...

  25. A questionnaire-based validation of metacognitive strategies in writing

    Introduction. Metacognitive strategies are essential to the process of learning to write when learning English as a foreign language (EFL; Nguyen and Gu, 2013; Teng, 2016, 2019; Teng and Yue,2022).However, in the Chinese EFL context, for which English writing instruction typically emphasizes grammatical correctness rather than idea development, learners may find it difficult to build an ...

  26. (PDF) Meta-cognitive reading strategies

    PDF | University Students' Awareness of Meta-cognitive Reading Strategies and Reading Comprehension 1Mussarrat Azhar, 2Riffat un Nisa Awan & 3Shaista... | Find, read and cite all the research ...

  27. Artificial intelligence and illusions of understanding in scientific

    Illusions of understanding that arise from an overreliance on AI in science (Fig. 1) cannot be overcome by using more sophisticated AI models or by preventing errors such as hallucinations. Rather ...