LLM-based Code-Switched Text Generation for Grammatical Error Correction

Tom Potter, Zheng Yuan


Abstract
With the rise of globalisation, code-switching (CSW) has become a ubiquitous part of multilingual conversation, posing new challenges for natural language processing (NLP), especially in Grammatical Error Correction (GEC). This work explores the complexities of applying GEC systems to CSW texts. Our objectives include evaluating the performance of state-of-the-art GEC systems on an authentic CSW dataset from English as a Second Language (ESL) learners, exploring synthetic data generation as a solution to data scarcity, and developing a model capable of correcting grammatical errors in monolingual and CSW texts. We generated synthetic CSW GEC data, resulting in one of the first substantial datasets for this task, and showed that a model trained on this data is capable of significant improvements over existing systems. This work targets ESL learners, aiming to provide educational technologies that aid in the development of their English grammatical correctness without constraining their natural multilingualism.
Anthology ID:
2024.emnlp-main.942
Volume:
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
16957–16965
Language:
URL:
https://aclanthology.org/2024.emnlp-main.942
DOI:
Bibkey:
Cite (ACL):
Tom Potter and Zheng Yuan. 2024. LLM-based Code-Switched Text Generation for Grammatical Error Correction. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 16957–16965, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
LLM-based Code-Switched Text Generation for Grammatical Error Correction (Potter & Yuan, EMNLP 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.emnlp-main.942.pdf