… Abstract: This work presents MarIA, a family of Spanish language models and … , MarIA
includes RoBERTa-base, RoBERTa-large, GPT2 and GPT2-large Spanish language models, …

… are certain biases in Spanish language models, as we found … the most important
models such as BETO or the recent MarIA, … For example, in the MarIA base model (BSC-TeMU/roberta-…

… RigoBERTa performance is assessed over 13 NLU tasks in comparison with other available
Spanish language models, namely, MarIA, BERTIN and BETO. RigoBERTa outperformed …

… available for Spanish and are much more efficient in … We hope this work will expand the
availability of pretrained language models based on the Spanish language to gather a wider …

… of language technology for Spanish is to be welcomed, but our results show that building
language models … If we look at the number of steps in training, MarIA uses a strategy which is …

… This work presents the first large-scale biomedical Spanish language models trained from
… specific models for Spanish on three clinical NER tasks. As main results, our models are …

… domain for the Spanish language. Then, in Section 4, we list the best Spanish language
models (both … The next general Spanish language model is MarIA [70]. Released in 2021, …

… models for the NLP community in Spanish, we present BARTO and T5S, which are the
Spanish versions of the BART and T5 models. We pre-train these models exclusively on Spanish …

Clinical natural language processing aims to tackle language and prediction tasks using
text from medical practice, such as clinical notes, prescriptions, and discharge summaries. …

… language technology for Spanish is to be welcomed, but our results show that building
language models … Our experimental setup follows the one proposed by MarIA (Gutiérrez-Fandino …