Grounding the comparative turn in communications: A framework for validating multilingual computational text analysis

Author(s)
Fabienne Lind, Martijn Schoonvelde, Christian Baden, Alona O. Dolinksy, Christian Pipal, Mariken A.C.G. van der Velden
Abstract

Following the progressing internationalisation of social science research and the computational turn in the field, researchers are increasingly adopting computational text analysis (CTA) methods to compare textual data across multiple cases and languages. In these settings, it is not only the mapping between construct and measures that requires validation, but also the equivalence of this mapping across languages and cases. However, although the validation requirements in multilingual analyses exceed those in monolingual studies, current research shows that validation is often insufficiently and inconsistently addressed in comparative multilingual CTA. To support more robust comparative research, this article presents a framework for validating findings obtained from multilingual textual data. The framework outlines validation strategies for four key stages of a typical multilingual CTA workflow: corpus, input data, process, and output. It directly tackles the challenge of approaching equivalence across contexts and languages in these stages and moves beyond the common practice of identifying problems only at the final stage of research.

Organisation(s)
Department of Communication
External organisation(s)
University College Dublin, University of Groningen, Universität Zürich (UZH)
Journal
Computational Communication Research
Volume
7
ISSN
2665-9085
DOI
https://doi.org/10.5117/CCR2025.1.13.LIND
Publication date
01-2025
Peer reviewed
Yes
Austrian Fields of Science 2012
508007 Communication science
Keywords
ASJC Scopus subject areas
Communication
Portal url
https://ucrisportal.univie.ac.at/en/publications/78c8d874-dca8-4daf-ad3f-09fba6bf4b71