From the original studies introducting the pedagogical strategies behind our 4 dimensions (Pedagogy), to other related surveys (Related work, limitations), you will find on this page several works revelevant to giving feedback in argumentation.
Teaching how to argue through NLP systems holds significant promise for enhancing students' learning process. However, existing research in this area presents various open issues. In this section, we also explore some difficulties in designing and evaluating computational models for argumentation (Open issues). Please refer to the original paper for more discussion on some methods for mitigating these open issues.
| Subsection | Title | Date | Author | Reference |
|---|---|---|---|---|
| Introduction | Cross-domain mining of argumentative text through distant supervision | 2016 | Khalid Al-Khatib, Henning Wachsmuth, Matthias Hagen, Jonas Köhler, and Benno Stein | In Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pages 1395--1404, San Diego, California. Association for Computational Linguistics. |
| Introduction | Teaching critical thinking skills in higher education: A review of the literature | 2011 | Linda Behar-Horenstein and Lian Niu | Journal of College Teaching and Learning, 8. |
| Introduction | Challenge or empower: Revisiting argumentation quality in a news editorial corpus | 2018 | Roxanne El Baff, Henning Wachsmuth, Khalid Al-Khatib, and Benno Stein | In Proceedings of the 22nd Conference on Computational Natural Language Learning, pages 454--464, Brussels, Belgium. Association for Computational Linguistics. |
| Introduction | Argotario: Computational argumentation meets serious games | 2017 | Ivan Habernal, Raffael Hannemann, Christian Pollak, Christopher Klamm, Patrick Pauli, and Iryna Gurevych | In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 7--12, Copenhagen, Denmark. Association for Computational Linguistics. |
| Introduction | The argument reasoning comprehension task: Identification and reconstruction of implicit warrants | 2018 | Ivan Habernal, Henning Wachsmuth, Iryna Gurevych, and Benno Stein | In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pages 1930--1940, New Orleans, Louisiana. Association for Computational Linguistics. |
| Introduction | Scientia potentia Est--On the role of knowledge in computational argumentatio | 2022 | Anne Lauscher, Henning Wachsmuth, Iryna Gurevych, and Goran Glavas | Transactions of the Association for Computational Linguistics, 10:1392--1422. |
| Introduction | TYPIC: A corpus of template-based diagnostic comments on argumentation | 2022 | Shoichi Naito, Shintaro Sawada, Chihiro Nakagawa, Naoya Inoue, Kenshi Yamaguchi, Iori Shimizu, Farjana Sultana Mim, Keshav Singh, and Kentaro Inui | In Proceedings of the 13th Language Resources and Evaluation Conference, pages 5916--5928, Marseille, France. European Language Resources Association. |
| Introduction | Critical thinking in education: a review | 2000 | RT Pithers and Rebecca Soden | Educational Research, 42(3):237--249. |
| Introduction | Computer-supported argumentation: A review of the state of the art | 2010 | Oliver Scheuer, Frank Loll, Niels Pinkwart, and Bruce Mclaren | I. J. Computer-Supported Collaborative Learning, 5:43--102. |
| Introduction | The Uses of Arguments, 1 edition. | 1958 | Stephen Toulmin | Cambridge University Press. |
| Introduction | Argument maps improve critical thinking | 2004 | Charles Twardy | Teaching Philosophy, 27. |
| Introduction | Computational argumentation quality assessment in natural language | 2017 | Henning Wachsmuth, Nona Naderi, Yufang Hou, Yonatan Bilu, Vinodkumar Prabhakaran, Tim Alberdingk Thijm, Graeme Hirst, and Benno Stein | In Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: Volume 1, Long Papers, pages 176--187, Valencia, Spain. Association for Computational Linguistics. |
| Introduction | Arguetutor: An adaptive dialog-based learning system for argumentation skills | 2021 | Thiemo Wambsganß, Tobias Kueng, Matthias Söllner, and Jan Marco Leimeister | In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems (CHI 2021), pages 1--13. |
| Related Work | Automated evaluation of writing -- | 2020 | Beata Beigman Klebanov and Nitin Madnani | In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 7796--7810, Online. Association for Computational Linguistics. |
| Related Work | A survey of the state of explainable ai for natural language processing | 2020 | Marina Danilevsky, Kun Qian, Ranit Aharonov, Yannis Katsis, Ban Kawas, and Prithviraj Sen | In Proceedings of the 1st Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 10th International Joint Conference on Natural Language Processing, pages 447–459, Suzhou, China. Association for Computational Linguistics. |
| Related Work | Argumentation mining in user-generated web discourse | 2016 | Ivan Habernal and Iryna Gurevych | CoRR, abs/1601.02403. |
| Related Work | A survey on improving nlp models with human explanations | 2022 | Mareike Hartmann and Daniel Sonntag | In Proceedings of the 1st Workshop on Learning with Natural Language Supervision, pages 40–47, Dublin, Ireland. Association for Computational Linguistics. |
| Related Work | Explainable artificial intelligence approaches: A survey | 2021 | Sheikh Rabiul Islam, William Eberle, Sheikh Khaled Ghafoor, and Mohiuddin Ahmed | |
| Related Work | Automated essay scoring: A survey of the state of the art | 2019 | Zixuan Ke and Vincent Ng | In Proceedings of the 28th International Joint Conference on Artificial Intelligence IJCAI 2019, pages 6300--6308. International Joint Conferences on Artificial Intelligence Organization. |
| Related Work | Argument Mining: A Survey | 2020 | John Lawrence and Chris Reed | Computational Linguistics, 45(4):765--818. |
| Related Work | The imminence of... grading essays by computer | 1966 | Ellis Page | The Phi Delta Kappan, 47(5):238--243. |
| Related Work | ExplaGraphs: An explanation graph generation task for structured commonsense reasoning | 2021 | Swarnadeep Saha, Prateek Yadav, Lisa Bauer, and Mohit Bansal | In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 7716--7740, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics. |
| Related Work | Argumentation and explainable artificial intelligence: a survey | 2021 | Alexandros Vassiliades, Nick Bassiliades, and Theodore Patkos | The Knowledge Engineering Review, 36:e5. |
| Related Work | Automated evaluation for student argumentative writing: A survey | 2022 | Xinyu Wang, Yohan Lee, and Juneyoung Park | |
| Related Work | Argumentative xai: A survey | 2021 | Kristijonas Čyras, Antonio Rago, Emanuele Albini, Pietro Baroni, and Francesca Toni | In Proceedings of the 30th International Joint Conference on Artificial Intelligence (IJCAI 2021) |
| Related Work | Computer-supported argumentation: A review of the state of the art | 2010 | Oliver Scheuer, Frank Loll, Niels Pinkwart, and Bruce Mclaren | I. J. Computer-Supported Collaborative Learning, 5:43--102. |
| Pedagogy - Socratic questioning | Reframing the socratic method | 2015 | Jamie Abrams | Journal of Legal Education, 64(4):562--585. |
| Pedagogy - Socratic questioning | Socratic questioning of novice debuggers: A benchmark dataset and preliminary evaluations | 2023 | Erfan Al-Hossami, Razvan Bunescu, Ryan Teehan, Laurel Powell, Khyati Mahajan, and Mohsen Dorodchi | In Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2023), pages 709--726, Toronto, Canada. Association for Computational Linguistics. |
| Pedagogy - Socratic questioning | Socratic question generation: A novel dataset, models, and evaluation | 2023 | Beng Heng Ang, Sujatha Das Gollapalli, and See-Kiong Ng | In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 147--165, Dubrovnik, Croatia. Association for Computational Linguistics. |
| Pedagogy - Collaborative argumentation | Collaborative Argumentation-Based Learning | 2019 | Michael Baker, Jerry Andriessen, and Baruch Schwarz | pages pp. 76--88. Routledge. |
| Pedagogy - Socratic questioning | What critique have been made of the socratic method in legal education | 2010 | Christie A Linskens Christie | European Journal of Law Reform, 12. |
| Pedagogy - Toulmin Model | Effect of scientific argumentation on the development of critical thinking | 2020 | Vetti Giri and M U Paily | Science & Education, 29. |
| Pedagogy - Rhetorical structure theory | Rhetorical structure theory: A comprehensive review of theory, parsing methods and applications | 2020 | Shengluan Hou, Shuhan Zhang, and Chaoqun Fei | Expert Systems with Applications, 157:113421. |
| Pedagogy - Socratic questioning | The decline of the socratic method at harvard. | 1999 | Orin Kerr | Nebraska law review, 78:113. |
| Pedagogy - Rhetorical structure theory | Rhetorical structure theory: Toward a functional theory of text organization | 1988 | William Mann and Sandra Thompson | Text - Interdisciplinary Journal for the Study of Discourse, 8(3):243--281. |
| Pedagogy - Rhetorical structure theory | A structure analysis of japenese efl students' argumentative paragraph writings with a tool for annotating discourse relations | 2021 | Kana Matsumura and Teruyo Sakamoto | Bulletin of the JACET Kansai Branch Writing Guidance Study Group, 14:pp. 31--50. |
| Pedagogy - Socratic questioning | Socratic pretraining: Question-driven pretraining for controllable summarization | 2023 | Artidoro Pagnoni, Alex Fabbri, Wojciech Kryscinski, and Chien-Sheng Wu | In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023), pages 12737--12755, Toronto, Canada. Association for Computational Linguistics. |
| Pedagogy - Rhetorical structure theory | TIARA: A tool for annotating discourse relations and sentence reordering | 2020 | Jan Wira Gotama Putra, Simone Teufel, Kana Matsumura, and Takenobu Tokunaga | In Proceedings of the 12th Language Resources and Evaluation Conference, pages 6912--6920, Marseille, France. European Language Resources Association. |
| Pedagogy - Toulmin Model | Applying toulmin: Teaching logical reasoning and argumentative writing | 2010 | Lesley Rex, Ebony Thomas, and Steven Engel | The English Journal, 99. |
| Pedagogy - Socratic questioning | Thinking like a Lawyer. | 2012 | Frederick Schauer | Harvard University Press. |
| Pedagogy - Socratic questioning | Automatic generation of socratic subquestions for teaching math word problems | 2022 | Kumar Shridhar, Jakub Macina, Mennatallah El-Assady, Tanmay Sinha, Manu Kapur, and Mrinmaya Sachan | In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 4136--4149, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics. |
| Pedagogy - Collaborative argumentation | Collaborative argumentation in academic education | 2002 | Arja Veerman, Jerry Andriessen, and Gellof Kanselaar | Instructional Science, 40(3). |
| Pedagogy - Collaborative argumentation | A framework to analyze argumentative knowledge construction in computer-supported collaborative learning | 2006 | Armin Weinberger and Frank Fischer | Methodological Issues in Researching CSCL. Computers & Education, 46(1):71--95. |
| Pedagogy - Toulmin Model | Empowering education: Teaching argumentative writing to cultural minority middle-school students. research in the teaching of english. | 1998 | Stuart Yeh | Research in the Teaching of English, 33(1):49--83. |
| Pedagogy - Toulmin Model | The Uses of Arguments, 1 edition. | 1958 | Stephen Toulmin | Cambridge University Press. |
| Open Issues - Domain Adaptation | Reducing the cost: Cross-prompt pre-finetuning for short answer scoring | 2023 | Hiroaki Funayama, Yuya Asazuma, Yuichiroh Matsubayashi, Tomoya Mizumoto, and Kentaro Inui | In Lecture Notes in Computer Science, page 78–89, Berlin, Heidelberg. Springer-Verlag. |
| Open Issues - Evaluating different systems | Methods for the design and evaluation of HCI+NLP systems | 2021 | Hendrik Heuer and Daniel Buschek | In Proceedings of the 1st Workshop on Bridging Human--Computer Interaction and Natural Language Processing, pages 28--33, Online. Association for Computational Linguistics. |
| Open Issues - Ethics | In Proceedings of the 1st ACL Workshop on Ethics in Natural Language Processing | 2017 | Dirk Hovy, Shannon Spruit, Margaret Mitchell, Emily M Bender, Michael Strube, and Hanna Wallach, editors | Association for Computational Linguistics, Valencia, Spain, edition. |
| Open Issues - Ethics | Ethical by design: Ethics best practices for natural language processing | 2017 | Jochen L Leidner and Vassilis Plachouras | In Proceedings of the 1st ACL Workshop on Ethics in Natural Language Processing, pages 30--40, Valencia, Spain. Association for Computational Linguistics. |
| Open Issues - Ethics | Editorial: Chatgpt: Challenges, opportunities, and implications for teacher education | 2023 | Torrey Trust, Jeromie Whalen, and Chrystalla Mouza | Contemporary Issues in Technology and Teacher Education, 23(1):1--23. |
| Limitations - Paper selection | Virtual pre-service teacher assessment and feedback via conversational agents | 2021 | Debajyoti Datta, Maria Phillips, James P Bywater, Jennifer Chiu, Ginger S Watson, Laura Barnes, and Donald Brown | In Proceedings of the 16th Workshop on Innovative Use of NLP for Building Educational Applications, pages 185--198, Online. Association for Computational Linguistics. |
| Limitations - Paper selection | ChatBack: Investigating methods of providing grammatical error feedback in a GUI-based language learning chatbot | 2023 | Kai-Hui Liang, Sam Davidson, Xun Yuan, Shehan Panditharatne, Chun-Yen Chen, Ryan Shea, Derek Pham, Yinghua Tan, Erik Voss, and Luke Fryer | In Proceedings of the 18th Workshop on Innovative Use of NLP for Building Educational Applications (BEA 2023), pages 83--99, Toronto, Canada. Association for Computational Linguistics. |