SYNCHRONY IN CONSECUTIVE INTERPRETATION: PRACTICE IN MULTIMODAL ANALYSIS OF NON-VERBAL COMMUNICATION
DOI: 10.23951/1609-624X-2022-1-123-131
Introduction. The non-verbal component in interpretation as a unit of analysis is a scientific gap. This paper studies the three-way interaction between speaker, interpreter and listener for the interpretation of gestures, body position (and its parts), which are characterized as repetitive. It is focused on the multichannel system of the information processed by the interpreter during the work and the ways of processing it. A synchrony occurs between the interpreter and the speaker during the interpretation. It shows on what extent the participants of the communication are involved in this communication. Such involvement allows the speaker to verify the result of the interpretation. It gives an understanding of the transmitted meaning and its appropriateness, since the speaker can judge by the non-verbal communication and the response of the listener. The goal is to study the non-verbal interaction between the speaker and the interpreter in the context of consecutive interpretation using the example of the emerging mimicry phenomenon of synchrony. Materials and methods. The material of the research is video clips with the participation of Krasnoyarsk interpreters with a total duration of 1 hour 57 minutes 29 seconds. Each video is an interview with the participants of the World Junior Curling Championships that was held in Krasnoyarsk in January 2020. A specialized program ELAN was used for marking up videos, which allows annotating media files according to various parameters. The method of annotation according to A. Kibrik was used to process and graphically display the results. Results and discussion. The study shows that the synchrony occurs between the interpreter and the speaker. It means that the connection was established between the participants of the communication that leads to the adoption of certain interpreting decisions. However, we managed to see the opposite situation when there is no synchrony, but there are inaccuracies in the translation or incomplete translation. Conclusion. On the basis of the analysis, an understanding of the principles of three-way interaction in conditions of multichannel information acquisition was formed. The similarity of movements, gestures and body position of the participants in communication is the adaptation of the interlocutors to the behavior of each other, which indicates their involvement and coordination of the communicative behavior of the participants. The more the communication participants are immersed in communication, the greater the level of synchrony they demonstrate. The phenomenon of synchrony is clearly demonstrated. Situations in which the interaction of the translator and the speaker turned out to be ineffective and the goal of communication was not achieved or was not fully achieved are shown using examples of emblematic, illustrative and regulatory gestures.
Keywords: translation theory, intercultural communication, non-verbal communication, multimodality, gestures
References:
1. Moshchanskaay Ye. Yu. Neverbal’ny component obshcheniya v ustnom perevodcheskom diskurse: uchebno-metodicheskoye posobiye [The non-verbal component of communication in interpretation discourse, teaching aid]. Perm, Perm National Research Polytechnic University Publ., 2016. 122 p. (in Russian).
2. Cooper K. Nonverbal Communication for business success. New York, AMACOM Publ., 1979.
3. Chistova E. V. Mul’tikanal’nost’ i mul’timodal’nost’ vospriyatiya v kognitivnoy deyatel’nosti perevodchika-sinkhronista [Multichannel and multimodality of perception in the cognitive activity of a simultaneous interpreter]. Filologicheskiye nauki. Voprosy teorii i praktiki – Philology. Theory and Practice, 2019, vol. 12, no. 9, pp. 337–342 (in Russian).
4. Wickens C. D. Processing resources in attention. In: Varieties of Attention. Ed. by R. Parasuraman, R. Davies. N. Y., Academic Рress Publ., 1984. Pp. 63–101.
5. Lu S. A., Wickens C. D., Prinet J. C., Hutchins S. D., Sarter N., Sebok A. Supporting interpretation management and multimodal interface design: Three meta-analyses of task performance as a function of interrupting task modality. Human Factors, 2013, vol. 55 (4), pp. 697–724
6. Kibrik A. A. Russky mul’timodal’ny diskurs. Chast’ 1. Postanovka problem [Russian multichannel discourse. Part 1. Statement of problems]. Psikhologicheskiy zhurnal – Psychological Journal, 2018, vol. 39, no. 1, pp. 70–80 (in Russian).
7. Kreydlin G. Ye. Neverbal’naya semiotika: Yazyk tela i yestestvenny yazyk [Non-Verbal Semiotics: Body Language and Natural Language]. Moscow, Novoye literaturnoye obozreniye Publ., 2002. 592 p. (in Rusian).
8. Poyatos F. The reality of multichannel verbal-nonverbal communication in simultaneous and consecutive interpretation. In: Nonverbal Communication and Translation, New Perspectives and challenges in literature, interpretation and media. Amsterdam, Philadelphia, John Benjamins Publishing Company Publ., 1997. Pp. 249–282.
9. Bernieri F. J., Rosenthal R. Interpersonal coordination: behavior matching and interactional synchrony, Fundamentals of nonverbal behavior. Cambridge University Press; Editions de la Maison des Sciences de l’Homme, 1991. P. 401–432.
10. Pickering M. J., Garrod S. Towards a Mechanistic Psychology of Dialogue. Behavioral and Brain Sciences, 2004, vol. 27, issue 2, pp. 169–226.
11. Yasuhiro Katagiri, Interactional alignment in collaborative problem solving dialogues. In: Proceedings of the 9th International Pragmatics Conference, Riva del Garda Italy, 2005.
12. Caridakis G., Raouzaiou A., Bevacqua E., Mancini M., Karpouzis K., Malatesta L., Pelachaud C. Virtual Agent Multi-modal Mimicry of Humans. Language Resources and Evaluation, 2007, no. 41 (3-4), pp. 367–388.
13. Jokinen K., Parkson S. Synchrony and Copying in Conversational Interactions. The 3rd Nordic Symposium on Multimodal Communication, Helsinki, 2011, vol. 15, pp. 18–24.
14. Sebanz N., Bekkering H., Knoblich G. Joint Action: Bodies and Minds Moving Together. Trends in Cognitive Sciences, 2006, vol. 10, no. 2, pp. 70–76 p.
15. Chistova E. V. Modeli vzaimodeystviya sinkhroyykh perevodchikov kak aktorov kognitivnogo sobytiya [Interactivity of simultaneous interpreters as actors of a cognitive event]. Zhurnal Sibirskogo federalm’nog universiteta. Gumanitarnye nauki – Journal of Siberian Federal University. Humanities and Social Sciences, 2020, vol. 13, no. 3, pp. 375–384 (in Russian).
16. Chistova E. V. Predmetnoye pole otechestvennogo kognitivnogo perevodovedeniya: klyuchevye tochki i vektory razvitiya [The subject field of Russian cognitive translation studies: key points and vectors of development]. Vestnik Tomskogo gosudarstvennogo pedagogicheskogo universiteta – TSPU Bulletin, 2019, vol. 9 (206), pp. 64–71 (in Russian).
17. Kreydlin G. Ye. Semioticheskaya kontseptualizatsiya tela i problema mul’timodal’nosti [The semiotic conceptualization of the human body and the question of multimodality]. Ecologiya yazyka i kommunikativnaya praktika – Ecology of language and communicative practice, 2014, no. 2, pp. 100–120 (in Russian).
18. Pease A., Pease B. The Definitive Book of Body Language: The Hidden Meaning Behind People’s Gestures and Expressions [Russ. ed.: Piz A., Piz B. Yazyk telodvizheniy. Kak chitat’ mysli po zhestam. Moscow, Eksmo Publ. 2010. 448 p.].
( 4.86 MB ) 
( 4.61 MB )
Issue: 1, 2022
Series of issue: Issue 1
Rubric: COMPARATIVE LINGUISTICS
Pages: 123 — 131
Downloads: 622