Proposing the Emotional Consistency Index (ECI): A Quantitative Metric for Emotional Alignment in Cross-Cultural Subtitle Translation

Anni Li; Yilin Liu; Ye Liu

doi:10.64583/qexdbg86

Authors

Anni Li Central South University Author
Yilin Liu Bangor University Author
Ye Liu Shanghai Lida University Author

DOI:

https://doi.org/10.64583/qexdbg86

Keywords:

Emotional Consistency Index, Cross-Cultural Subtitling, Emotional Alignment, Affect Analysis, Transmedia Communication, BERT, VADER

Abstract

This paper centers on the development and validation of the Emotional Consistency Index (ECI), a novel quantitative metric designed to address a critical gap in translation studies: the lack of tools to measure emotional alignment between subtitled content and audience feedback in cross-cultural transmedia contexts. Traditional subtitle evaluation frameworks prioritize lexical or syntactic accuracy (e.g., BLEU scores, TER), while existing statistical methods (e.g., Pearson’s correlation coefficient) fail to leverage the unique properties of standardized emotional data—undermining their utility for studying how subtitles mediate affect across cultures. Derived from Pearson’s coefficient but simplified to account for the inherent centering of emotional scores (generated via tools like BERT and VADER), ECI streamlines the quantification of emotional resonance while retaining theoretical rigor. Through controlled simulated data experiments, we demonstrate ECI’s ability to distinguish between varying degrees of emotional alignment, validate its computational efficiency, and situate it within translation studies’ broader shift toward transmedia-focused, audience-centric research. This work contributes a practical, theory-driven metric that reorients subtitle evaluation from “linguistic calibration” to the measurement of emotional negotiation—a core dimension of effective cross-cultural communication.

Downloads

Download data is not yet available.

Author Biography

Anni Li, Central South University

Corresponding Author: Anni Li. E-mail: lianni0125@gmail.com; Address: 932 South Lushan Road, Yuelu District, Changsha, Hunan 410083, P.R. China

References

Baltrušaitis, T., et al. (2018). OpenFace 2.0: Facial behavior analysis toolkit. In 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018) (pp. 59–66). IEEE.

Devlin, J., et al. (2019). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) (pp. 4171–4186). Association for Computational Linguistics.

Gambier, Y. (2013). Translation studies and media studies: A need for interdisciplinarity. Target, 25(1), 1–18.

Hutto, C. J., & Gilbert, E. (2014). VADER: A parsimonious rule-based model for sentiment analysis of social media text. In Proceedings of the International AAAI Conference on Web and Social Media, 8(1) (pp. 216–225).

Jenkins, H. (2006). Convergence culture: Where old and new media collide. New York University Press.

Papineni, K., et al. (2002). BLEU: A method for automatic evaluation of machine translation. In Proceedings of the 40th Annual Meeting of the Association for Computational Linguistics (pp. 311–318). Association for Computational Linguistics.

Pearson, K. (1896). Mathematical contributions to the theory of evolution. III. Regression, heredity, and panmixia. Philosophical Transactions of the Royal Society of London. Series A, Containing Papers of a Mathematical or Physical Character, 187, 253–318.

Snover, M., et al. (2006). A study of translation edit rate with targeted human annotation. In Proceedings of the 7th Conference of the Association for Machine Translation in the Americas (pp. 223–231). Association for Machine Translation in the Americas.

Virtanen, P., et al. (2020). SciPy 1.0: Fundamental algorithms for scientific computing in Python. Nature Methods, 17(3), 261–272.

Wang, M., & Xu, J. (2019). Emotional analysis and comparative study of bullet-screen comments and subtitles. Intelligence, Information & Sharing, 37(5), 109–117.

Ivarsson, J., & Carroll, M. (1998). Subtitling. Trans Edit HB.

Sousa, R. M., Collares, C. F., & Pereira, V. H. (2024). Longitudinal variation of correlations between different components of assessment within a medical school. BMC Medical Education, 24(1), 1–11.