Annotation of Grammatical Errors in the COWS-L2H Spanish Learner Corpus
DOI:
https://doi.org/10.58859/resla.1553Keywords:
learner corpus research, errors anotations, Spanish as a Foreign Language (ELE), GrammarAbstract
Spanish learner corpora have attracted increasing interest in recent years due to their diversity of applications in the field of second language acquisition, as well as in foreign language teaching. Within the methodological studies on the creation and use of corpora, one of the least explored aspects is the manual annotation of errors, a process that involves high human and time costs, but exponentially increases the possibilities of corpus exploitation. The main aim of this paper is to present the design, development and reliability tests of the grammatical error tagging in the COWS-L2H corpus and to show one of its most relevant applications, analyzing the learners' interlanguage through the analysis of the errors tags in a selection of pseudolongitudinal texts related to five morphosyntactic phenomena concerning the noun phrase (gender and number inflection, use of the article and the subject personal pronoun, and adjective placement). The results not only provide data on the progression of the errors analyzed, but also contribute to the methodological development of annotation systems and error analysis in learner corpora.
Global Statistics ℹ️
|
29
Views
|
6
Downloads
|
|
35
Total
|
|
References
Alonso Ramos, M. (2016). Spanish learner corpus research: Achievements and challenges. En M. Alonso Ramos (Ed.), Spanish Learner Corpus Research: current trends and future perspectives (pp. 3-31). John Benjamins. DOI: https://doi.org/10.1075/scl.78.01alo
Artstein, R., y Poesio, M. (2008). Survey Article: Inter-Coder Agreement for Computational Linguistics. Computational Linguistics, 34(4), 555–596. DOI: https://doi.org/10.1162/coli.07-034-R2
Bailini, S. (2018). Corpus del Español de los Italianos. Recuperado de https://corespiycorite.altervista.org/?doing_wp_cron=1671141855.4830360412597656250000.
Blanco Canales, A. (2011). Fono.Ele, una herramienta Web para la investigación de la competencia fónica y la formación de profesores. En C. Hernández González, A. Carrasco Santana y E. Álvarez Ramos (Eds.), La Red y sus aplicaciones en la enseñanza-aprendizaje del español como lengua extranjera (pp. 129¬-140). ASELE.
Bueso Fernández, I., y Casamián Sorrosa, P. (2001). Diferencias de usos gramaticales entre el español y el inglés. Gramática contrastiva. Edinumen.
Bullock, B. E. y Toribio, A. J. (2013). The Spanish in Texas corpus project. Center for open education resources and language learning (COERLL).
Buyse, C., y González Melón, E. (2013). El corpus de aprendices Aprescrilov y su utilidad para la didáctica de ELE en la Bélgica multilingüe. En S. Borrell, B. Blecua Falgueras, B. Crous y F. Sierra (Eds.), Plurilingüismo y enseñanza de ELE en contextos multiculturales: XXIII Congreso Internacional ASELE (pp. 247-252). ASELE.
Calero Fernández, M. A., Serrano Zapata, M., y Gómez Devís, M. B. (2020). Codificación y etiquetado en los corpus de aprendices y su aplicación didáctica: la propuesta del Corpus de Interlegua Española de Aprendices Sinohablantes (CINEAS). E-Aesla. Revista digital de lingüística aplicada, 6, 206-222.
Campillos Llanos, L. (2014). Análisis de errores pragmático-discursivos en un corpus oral de español como lengua extranjera. Círculo de Lingüística Aplicada a la Comunicación, 58, 23–59. DOI: https://doi.org/10.5209/rev_CLAC.2014.v58.45469
Campillos Llanos, L. (2016). PoS-tagging a Spanish oral learner corpus: criteria, procedure, and a sample análisis. En M. Alonso Ramos (Ed.), Spanish Learner Corpus Research: current trends and future perspectives (pp. 89-116). John Benjamins. DOI: https://doi.org/10.1075/scl.78.04cam
Carando, A., Minnillo, S., Fernández-Mira, P., Davidson, S., Sagae, K., y Sánchez-Gutiérrez, C. (2023). Writing development in Spanish as a second and heritage language: a corpus study on complexity, Journal of Spanish Language Teaching, 10:1, 59-71. https://doi.org/10.1080/23247797.2023.2201989 DOI: https://doi.org/10.1080/23247797.2023.2201989
Carletta, J. (1996). Assessing Agreement on Classification Tasks: The Kappa Statistic. Computational Linguistics, 22(2), 249–254.
Castello, E., Arckeley, K., y Coccetta, F. (2015). Studies in Learner Corpus Linguistics Research and Applications for Foreign Language Teaching and Assessment. Peter Lang.
Cestero, A. M., y Penadés, A. I. (2009). Corpus de textos escritos para el análisis de errores de aprendices de E/LE (CORANE). Ediciones Universidad de Alcalá de Henares.
Chiapello, S., y González Royo C. (2020). Oral narrative in Italian as a Foreign Language at an intermediate level (B1). En R. Roig-Vila (Ed.), La docencia en la Enseñanza Superior. Nuevas aportaciones desde la investigación e innovación educativas (pp. 1152-1161). Octaedro.
Cohen, J. (1960). A Coefficient of Agreement for Nominal Scales. Educational and Psychological Measurement, 20(1), 37–46. DOI: https://doi.org/10.1177/001316446002000104
Corder, S. P. (1967). The Significance of Learners’ Errors. International Review of Applied Linguistics in Language Teaching, 5, 161-170. DOI: https://doi.org/10.1515/iral.1967.5.1-4.161
Dagneaux, E., Denness, S., y Granger, S. (1998). Computer-aided error analysis. System, 26(2), 163-174. DOI: https://doi.org/10.1016/S0346-251X(98)00001-3
Dahlmeier, D., Ng, H. T., y Wu, S. M. (2013). Building a Large Annotated Corpus of Learner English: The NUS Corpus of Learner English. Proceedings of the Eighth Workshop on Innovative Use of NLP for Building Educational Applications, Atlanta, Georgia. Association for Computational Linguistics, 22–31.
Davidson, S., Yamada, A., Fernández Mira, P., Carando, A., Sánchez-Gutiérrez, C. H., y Sagae, K. (2020). Developing NLP Tools with a New Corpus of Learner Spanish. Proceedings of the Twelfth Language Resources and Evaluation Conference, 7238–7243.
Díaz Negrillo, A., y Fernández Domínguez, J. (2006). Error Tagging Systems for Learner Corpora. Revista española de lingüística aplicada, RESLA, 19, 83–102.
Díaz Sánchez, P., Fernández-Pampillón, A. M., y Amenós Pons, J. (sf.). Indexador de Corpus de Aprendices de Español. Recuperado de http://repositorios.fdi.ucm.es/corpus_aprendices_espa%c3%b1ol/view/paginas/view_paginas.php?id=1
Díez Bedmar, M. B. (2015). Dealing with Errors in Learner Corpora to Describe, Teach and Assess EFL Writing: Focus on Article Use. En E. Castello, K. Arckeley, y F. Coccetta (Eds.), Studies in Learner Corpus Linguistics Research and Applications for Foreign Language Teaching and Assessment (pp. 37-70). Peter Lang.
Díez Bedmar, M. B. (2021). Error Analysis. En N. Tracy-Ventura y M. Paquot (Eds.), The Routledge Handbook of Second Language Acquisition and Corpora (pp. 90-104). Routledge. DOI: https://doi.org/10.4324/9781351137904-9
Dobrić, N. (2023). Identifying errors in a learner corpus –the two stages of error location vs. error description and consequences for measuring and reporting inter-annotator agreement, Applied Corpus Linguistics, 3. https://doi.org/10.1016/j.acorp.2022.100039. DOI: https://doi.org/10.1016/j.acorp.2022.100039
Domínguez, L. (2013). Understanding Interfaces: Second Language acquisition and first language attrition of Spanish subject realization and word order variation. Amsterdam: John Benjamins. DOI: https://doi.org/10.1075/lald.55
Domínguez, L. y Arche M. J. (2022). Early use od null and overt subjects in L2 Spanish. Evidence from two oral tasks. En K. McManus y M. S. Schmid. How special are early birds? Foreign language teaching and learning. Berlin: Freie Universität Berlin/Languace Science Press. 189-225.
Dulay, H., Burt, M., y Krashen, S.D. (1982). Language Two. Rowley.
Fernández-Mira, P., Morgan, E., Davidson, S., Yamada, A., Carando, A., Sagae, K., y Sánchez-Gutiérrez, C. H. (2021). Lexical diversity in an L2 Spanish learner corpus. The effect of topic-related variables. International Journal of Learner Corpus Research, 7(2), 230–258. DOI: https://doi.org/10.1075/ijlcr.20017.fer
Ferreira Cabrera, A. A., Elejalde Gómez, J., y Blanco San Martín, L. (2022). Diseño e implementación del Corpus de Aprendientes de Español como Lengua Extranjera (CAELE). Círculo de lingüística aplicada a la comunicación, 90, 137-155. DOI: https://doi.org/10.5209/clac.71174
Fuchs, R., y Werner, V. (2018). The use of statives progresives by school learners of English and the importance of the variable context. En Y. Tono, Y. Kawaguchi y M. Minegishi (Eds.) Developmental and crosslinguistic perspective in learner corpus research. John Benjamins. 195–224. DOI: https://doi.org/10.1075/ijlcr.17010.fuc
Granger, S. (1996). From CA to CIA and back: an integrated approach to computerized bilingual an learner corpora, en K. Aijmer, N. Altengerg y M. Johansson (Eds.) Langeuges in Contrast. Text-based Cross-linguistic Studies. Lund University Press. 37–51.
Granger, S. (ed.) (1998). Learner English on computer. Longman.
Granger, S. (2003). Error-tagged Learner Corpora and CALL: A Promising Synergy. CALICO Journal, 20(3), 465–480. DOI: https://doi.org/10.1558/cj.v20i3.465-480
Granger, S. (2009). The contribution of learner corpora to second language acquisition and foreign language teaching: A critical evaluation. En K. Aijmer (Ed.) Corpora and Language Teaching. Amsterdam: John Benjamins. 13–32. DOI: https://doi.org/10.1075/scl.33.04gra
Granger, S., Gilquin, G., y Meunier, F. (2015). Introduction: Learner corpus research–past, present and future. En S. Granger, G. Gilquin, y F. Meunier (Eds.), The Cambridge Handbook of Learner Corpus Research. Cambridge University Press. DOI: https://doi.org/10.1017/CBO9781139649414
Granger, S., Hung, J., y Pech-Tyson, S. (2002). Computer Learner Corpora, Second Language Acquisition, and Foreign Language Teaching. John Benjamins. DOI: https://doi.org/10.1075/lllt.6
Granger, S., Kraif, O., Ponton, C., Antoniadis, G., y Zampa, V. (2007). Integrating learner corpora and natural language processing: A crucial step towards reconciling technological sophistication and pedagogical effectiveness. ReCALL, 19(3), 252–268. DOI: https://doi.org/10.1017/S0958344007000237
Guijarro-Fuentes, P., Amenos-Pons, J., y Ahern, A. (2023). Acquisition of estar + adjective in L2 Spanish by L1 French and Portuguese speakers. Spanish in Context, 20(2), 282-312. https://doi.org/10.1075/SIC.00085.GUI DOI: https://doi.org/10.1075/sic.00085.gui
Gutiérrez Araus, M. L. (2022). Problemas fundamentales de la gramática del español 2/L. Arco/ Libros. 8ª edición.
Hidalgo, M. (2023). Estudio del género gramatical en el COWS-L2H Aspectos lingüísticos y extralingüísticos. Trabajo final de máster. Universidad de Salamanca.
Hincapié, D. (2018). Corpus de aprendientes de español como lengua extranjera y segunda lengua (CÁELE/2): el componente escrito. Forma y Función, 31(2), 129–143. DOI: https://doi.org/10.15446/fyf.v31n2.74659
Koike, D., y Witte, J. (2016). Spanish Corpus Proficiency Level Training Website and Corpus: An open-source, online resource for corpus linguistics studies. En M. Alonso Ramos (Ed.), Spanish Learner Corpus Research: current trends and future perspectives (pp. 169-196). John Benjamins. DOI: https://doi.org/10.1075/scl.78.07koi
Le Bruyn, B., y Paquot, M. (2020). Learner Corpus Research and Second Language Acquisition: an attempt at bridging the gap. Cambridge University Press. DOI: https://doi.org/10.1017/9781108674577
Leech, G. (1997). Teaching and language corpora: A convergence. En A. Wichmann, S. Fligelstone, T. McEnery, y G. Knowles (Eds.), Teaching and Language Corpora (pp. 1-23). Longman. DOI: https://doi.org/10.4324/9781315842677-1
Lozano, C., y Fernández Mira, M. (2022). Designing, compiling and interrogating corpora in L2 Spanish acquisition research. Journal of Spanish Language Teaching, 9, 190-206. DOI: https://doi.org/10.1080/23247797.2022.2157086
Lozano, C. y Quesada “. (2023). What corpus data reveal about the Position of Antecedent Strategy: anaphora resolution in Spanish monolinguals and L1 English-L2 Spanish bilinguals. Frontiers in Psychology, 14. https://doi.org/10.3389/fpsyg.2023.1246710 DOI: https://doi.org/10.3389/fpsyg.2023.1246710
Lüdeling, A., y Hirschmann, H. (2015). Error annotation systems. En S. Granger, G. Gilquin, y F. Meunier (Eds.), The Cambridge Handbook of Learner Corpus Research (pp. 135-158). Cambridge University Press. DOI: https://doi.org/10.1017/CBO9781139649414.007
Lüdeling, A., Walter, M., Kroymann, E., y Adolphs, P. (2005). Multi-level error annotation in learner corpora. Proceedings of corpus linguistics, 1, 14-17.
Maraschin Bruscato, A. y Baptista, J. (2022). The synchronous and asynchronous learning of anaphora: A corpus-based analysis with learners of English and Spanish. Research in Corpus Linguistics, 11(1), 1-28. https://doi.org/10.32714/ricl.11.01.01 DOI: https://doi.org/10.32714/ricl.11.01.01
Marsily, A. (2022). La conciencia pragmática de los estudiantes nativos y no nativos del español: el caso de las peticiones hacia profesores. Revista Signos. Estudios De Lingüística, 55(108), 338–362. DOI: https://doi.org/10.4067/S0718-09342022000100338
Miaschi, A., Davidson, S., Brunato, D., Dell’Orletta, F., Sagae, K., Sanchez-Gutierrez, C. H., y Venturi, J. (2020). Tracking the Evolution of Written Language Competence in L2 Spanish Learners. Proceedings of the Fifteenth Workshop on Innovative Use of NLP for Building Educational Applications, 92–101. DOI: https://doi.org/10.18653/v1/2020.bea-1.9
Minnillo, S., Sánchez-Gutiérrez, C. H., Carando, A., Davidson, S., Fernández Mira, P., y Sagae, K. (2022). Preterit-imperfect acquisition in L2 Spanish writing: Moving beyond lexical aspect. Research in Corpus Linguistics, 10(1), 156–184. DOI: https://doi.org/10.32714/ricl.10.01.08
Palacios, N., Barcala, A., y Rojo, V. (2019). El Corpus de Aprendices de Español (CAES) y sus aplicaciones para la enseñanza/aprendizaje del español como lengua extranjera. En M. Blanco, H. Olbertz, y V. Vázquez Rozas (Eds.), Corpus y construcciones. Perspectivas hispánicas (pp. 273-303). Universidade de Santiago de Compostela.
Parodi, G., Cantos-Gómez, P., y Howe, C. (2022). Lingüística de corpus en español / The Routledge Handbook of Spanish Corpus Linguistics. Routledge. DOI: https://doi.org/10.4324/9780429329296
Pino Rodríguez, A. (2012). El uso de combinaciones de palabras con que en un corpus de aprendices suecos de español como lengua extranjera. Anuari de Filologia. Estudis de Lingüística, 2, 211–212.
RAE y ASALE (2005). Diccionario panhispánico de dudas [en línea]. Recuperado de https://www.rae.es/dpd/.
RAE y ASALE (2009). Nueva gramática de la lengua española. Madrid: Espasa.
Rojo, G. y Palacios, I. (2022). Los corpus de aprendices de español como L2. En G. Parodi y P. Cantos Gómez, Lingüística de corpus en español. Árbol académico/Chad Howe, 74-88. DOI: https://doi.org/10.4324/9780429329296-7
Rojo, G., Palacios, I., Sampedro, M., y Marsily, A. (2022). Los corpus de aprendices de español LE/L2: panorama actual y perspectivas futuras. Journal of Spanish Language Teaching, 9(2), 174–189. DOI: https://doi.org/10.1080/23247797.2022.2157085
Rothman, J., González Alonso, J., y Miller, D. (2018). The acquisition of second language Spanish morphosyntax. En K. L. Geeslin (Ed.), The Cambridge Handbook of Spanish Linguistics (pp. 689-715). Cambridge University Press. DOI: https://doi.org/10.1017/9781316779194.032
Sampedro Mella, M. (2022). Corpus de aprendices y cuestiones de discurso en la interlengua: un nuevo acercamiento aplicado a la enseñanza. Foro de profesores de E/LE, 18, 163–182. DOI: https://doi.org/10.7203/foroele.18.24965
Sánchez-Gutiérrez, C., Davidson, S., Minnillo, S., Carando, S., Hernández Muñoz, N., Tomé Cornejo, C., Recio Diego, A., y Belío Apaolaza, H. (2024) Spanish learner corpus design decisions and their implications for SLA research: The affordances of CEDEL2, CAES, and COWS-L2H. LIDIL. Revue de Linguistique et de Didactique des langues, 70.
Sánchez-Gutiérrez, C., y Fernández Mira, P. (2022). Datos longitudinales en corpus de aprendientes de español. En G. Parodi et al. (Eds.), Lingüística de corpus en español, The Routledge Handbook of Spanish Corpus Linguistics (pp. 374-387). Routledge. DOI: https://doi.org/10.4324/9780429329296-28
Sánchez-Gutiérrez, C., De Cock, B., y Tracy-Ventura, N. (2022). Spanish corpora and their pedagogical uses: challenges and opportunities. Journal of Spanish Language Teaching, 9(2), 105–115. DOI: https://doi.org/10.1080/23247797.2022.2157078
Sánchez Rufat, A. (2015). Análisis contrastivo de interlengua y corpus de aprendientes: precisiones metodológicas. Pragmalingüística, 23, 191–210. DOI: https://doi.org/10.25267/Pragmalinguistica.2015.i23.11
Selinker, L. (1972). Interlanguage. Product Information. International Review of Applied Linguistics in Language Teaching, 10, 209–241. DOI: https://doi.org/10.1515/iral.1972.10.1-4.209
Thewissen, J. (2015). Accuracy accross proficiency levels. A learner corpus aproach. Presses Universitaires de Louvain.
van Rooy, B. (2015). Annotating learner corpora. En S. Granger, G. Gilquin, y F. Meunier (Eds.), The Cambridge Handbook of Learner Corpus Research. (pp. 79-105). Cambridge University Press. DOI: https://doi.org/10.1017/CBO9781139649414.005
Yamada, A., Davidson, S., Fernández-Mira, P., Carando, A., Sagae, K., y Sánchez-Gutiérrez, C. (2020). COWS-L2H: A corpus of Spanish learner writing. Research in Corpus Linguistics, 8(1), 17–32. DOI: https://doi.org/10.32714/ricl.08.01.02
Yonekawa, K., y San Mateo Valdehíta, A. (2022). Análisis de errores en el uso del artículo en textos de aprendientes japoneses de español L2. Estudio de corpus. Cuadernos CANELA, 33, 71-89. DOI: https://doi.org/10.2107/canela.33.0_71
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 Natividad Hernández Muñoz

This work is licensed under a Creative Commons Attribution 4.0 International License.
Public licensing terms for published work
All articles published in {$contextName} are distributed under a Creative Commons Attribution 4.0 International (CC BY 4.0) License, unless otherwise stated.
This means that authors retain copyright and that anyone is free to:
- Share – copy and redistribute the material in any medium or format.
- Adapt – remix, transform, and build upon the material for any purpose, even commercially.
Provided that the following conditions are met:
- Attribution – Proper credit must be given to the authors and the journal, a link to the license must be provided, and any changes must be indicated.
- No additional restrictions – No legal terms or technological measures may be applied that restrict others from using the work.
For more information, please refer to the full license text at: https://creativecommons.org/licenses/by/4.0/








