Multimodal turn management in Danish dyadic first encounters

Costanza Navarretta; Patrizia Paggio

Title:

Author:

Costanza Navarretta: University of Copenhagen, Copenhagen, Denmark Patrizia Paggio: University of Copenhagen, Denmark and University of Malta, Valletta, Malta

Download:

Full text (pdf)

Year:

2013

Conference:

NEALT Proceedings. Northern European Association for Language and Technology; 4th Nordic Symposium on Multimodal Communication; November 15-16; Gothenburg; Sweden

Issue:

093

Article no.:

002

Pages:

5-12

No. of pages:

Publication type:

Abstract and Fulltext

Published:

2013-10-29

ISBN:

978-91-7519-461-5

Series:

Linköping Electronic Conference Proceedings

ISSN (print):

1650-3686

ISSN (online):

1650-3740

Series:

NEALT Proceedings Series

Publisher:

Linköping University Electronic Press; Linköpings universitet

Export in BibTex, RIS or text

This paper presents studies of multimodal turn management in a Danish corpus of video recorded conversations between two young people who meet for the first time. More specifically; we investigate multi-modal behaviours by which the conversation participants indicate whether they wish to give; take or keep the turn. In this study we present quantitative analyses of such cues; as well as an investigation of the length of the individual participants’ speech contributions. The quantitative studies comprise body behaviours which have not been previously investigated with respect to turn management; so that it not only confirms preceding studies on turn management in English but also provides new insight on how speech and body behaviours are used synchronously in communication. The investigation of the participants’ vocal contributions shows gender differences in that male participants talked more when interacting with a female than they did when their inter- locutor was a male; while female participants talked more when interacting with a female than when they interacted with a male.

Keywords: multimodal communication; multimodal corpora; turn management; annotation

NEALT Proceedings. Northern European Association for Language and Technology; 4th Nordic Symposium on Multimodal Communication; November 15-16; Gothenburg; Sweden

Author:

Costanza Navarretta, Patrizia Paggio

Title:

Multimodal turn management in Danish dyadic first encounters

References:

Allwood; J.; Cerrato; L.; Jokinen; K.; Navarretta; C. & Paggio; P. (2007). The MUMIN coding scheme for the annotation of feedback; turn management and sequencing. Multimodal Corpora for Modelling Human Multimodal Behaviour. Special Issue of the International Journal of Language Resources and Evaluation; 41(3–4); 273–287.

Argyle; M. & Cook; M. (1976). Gaze and mutual gaze. Cambridge University Press; Cambridge; UK.

Boersma; P. & Weenink; D. (2009). Praat: doing pho- netics by computer. Retrieved May 1; 2009; from http://www.praat.org/.

Campbell. N. (2009). An audio-visual approach to mea- suring discourse synchrony in m ultimodal conversa- tion data. In Proceedings of Interspeech 2009; pp. 12–14.

Cohen. J. (1960). A coefficient of agreement for nom- inal scales. Educational and Psychological Mea- surement; 20(1):37–46.

Cowley; S. J. (1998). Of Timing; Turn-Taking; and Conversations. Journal of Psycholinguistic Research; 27(5); 541–571.

Du-Babcock; B. (2003). A comparative analysis of individual communication processes in small group behavior between homogeneous and heterogeneous groups. In Proceedings of the 68th Association of Business Communication Convention; pages 1–16; Albuquerque; New Mexico; USA.

Duncan; S. Jr. and D.W. Fiske; D. W. (1977). Face-to-face in- teraction. Erlbaum; Hillsdale; NJ.

Duncan; S. Jr. (1972). Some Signals and Rules for Taking Speaking Turns in Conversations. Journal of Personality and Social Psychology; 23(2); 283–292.

Esposito; A.; Campbell; N.; Vogel; C.; Hussain; A. & Nijholt; A. (eds). (2010). Development of Multi- modal Interfaces: Active Listening and Synchrony; volume 5967 of LNCS. Springer Verlag.

Ford; C. E. & Thompson; S. A. (1996). Interactional Units in Conversation: Syntactic; Intonational; and Pragmatic Resources for the Management of Turns. In E. Ochs; E.A. Schegloff; and S.A. Thompson; editors; Interaction and Grammar; pp. 134–184. Cambridge University Press; Cambridge.

Hadar; U. Steiner; T. J. & Clifford Rose; F. (1984). The timing of shifts of head postures during conversation. Human Movement Science; 3(3); 237–245.

Jokinen; K. (2011). Turn taking; utterance density; and gaze patterns as cues to conversational activ- ity. In Proceedings of ICMI-MMI; Alicante; Spain; November.

Kendon; A. (1967). Some functions of gaze-direction in social interaction. Acta Psychologica; 26; 22–63.

Kipp; M. (2004). Gesture Generation by Imitation - From Human Behavior to Computer Character Animation. Ph.D. thesis; Saarland University; Saar- bruecken; Germany; Boca Raton; Florida; disserta- tion.com.

Lu; J.; Allwood; J.& Ahlsén; E. Under publication. A study on cultural variations of smile based on em- pirical recordings of Chinese and Swedish first en- counters. In D. Heylen; M. Kipp; and P. Paggio; editors; Proceedings of the workshop on Multimodal Corpora at ICMI-MLMI 2011; Alicante; Spain; Nov.

Maynard; S. (1987). Interactional functions of a nonver- bal sign: Head movement in Japanese dyadic casual conversation. Journal of Pragmatics; 11:589–606.

Navarretta; C. & Paggio; P. (2012). Verbal and non-verbal feedback in different types of interactions. In Proceedings of LREC 2012; pp. 2338–2342; Is- tanbul Turkey; May.

Navarretta; C.; Ahlsén; E.; Allwood; J.; Jokinen; K. &; Paggio; P. (2011). Creating Comparable Multimodal Corpora for Nordic Languages. In Proceedings of the 18th Conference Nordic Conference of Computational Linguistics; pages 153–160; Riga; Latvia; May 11-13.

Navarretta; C.; Ahlsén; E.; Allwood; J.; Jokinen; K. & Paggio; P. (2012) Feedback in Nordic firstencounters: a comparative study. In Proceedings of LREC 2012; pp. 2494–2499; Istanbul Turkey; May.

O’Connell; D. C.; Kowal; S. & Kaltenbacher; E. (1990). Turn-Taking: A Critical Analysis of the Research Tradition. Journal of Psycholinguistic Research; 19(6):345–373.

Paggio; P. & Navarretta; C. (2011). Head movements; facial expressions and feedback in Danish first en- counters interactions: a culture-specific analysis. In C. Stephanidis; editor; Universal Access in Human- Computer Interaction. Users Diversity. Proceedings of 6th International Conference; UAHCI 2011; Held as Part of HCI International 2011; pp. 583–590; Orlando; FL; USA; July. Springer.

Paggio; P.; Ahlsén; E.; Allwood; J.; Jokinen; K. & Navarretta; C. (2010). The NOMCO multimodal Nordic resource - goals and characteristics. In Proceedings of LREC 2010; pp. 2968–2973; Malta; May 17-23.

Peirce.; C. S. (1931). Collected Papers of Charles Sanders Peirce; 1931-1958; 8 vols. Harvard University Press; Cambridge; MA.

Paggio; P. & Navarretta; C. (2012). Head movements; facial expressions and feedback in conversations - empirical evidence from danish multimodal data. Journal on Multimodal User Interfaces - Special Issue on Multimodal Corpora.

Sacks; H.; Schegloff; E. & Jefferson; G.. (1974). A sim- plest systematics for the organization of turn-taking for conversation. Language; 50(4); 696–735.

Schegloff; E. (2000). Overlapping talk and the orga- nization of turn-taking for conversation. Language in Society; 29:1–63.

Tanaka; H. (2008). Communication strategies and cul- tural assumptions: An analysis of French-Japanese business meetings. In S. Tietze; editor; International Management and Language; pp 154–170. Routledge; New York; NY.

Yngve; V. (1970). On getting a word in edgewise. In Pa- pers from the sixth regional meeting of the Chicago Linguistic Society; pp. 567–578.

NEALT Proceedings. Northern European Association for Language and Technology; 4th Nordic Symposium on Multimodal Communication; November 15-16; Gothenburg; Sweden

Author:

Costanza Navarretta, Patrizia Paggio

Title:

Multimodal turn management in Danish dyadic first encounters

Note: the following are taken directly from CrossRef

Citations:

No citations available at the moment