Keywords: multimodal communication; multimodal corpora; turn management; annotation
NEALT Proceedings. Northern European Association for Language and Technology; 4th Nordic Symposium on Multimodal Communication; November 15-16; Gothenburg; Sweden
Allwood; J.; Cerrato; L.; Jokinen; K.; Navarretta; C. & Paggio; P. (2007). The MUMIN coding scheme for the annotation of feedback; turn management and sequencing.  Multimodal Corpora for Modelling Human Multimodal Behaviour. Special Issue of the International Journal of Language Resources and Evaluation; 41(3–4); 273–287.
Argyle; M. & Cook; M. (1976). Gaze and mutual gaze. Cambridge University Press; Cambridge; UK.
Boersma; P. & Weenink; D. (2009). Praat: doing pho- netics by computer. Â Retrieved May 1; 2009; from http://www.praat.org/.
Campbell. N. (2009). An audio-visual approach to mea- suring discourse synchrony in m ultimodal conversa- tion data. In Proceedings of Interspeech 2009; pp. 12–14.
Cohen. J. (1960). A coefficient of agreement for nom- inal scales. Educational and Psychological Mea- surement; 20(1):37–46.
Cowley; S. J. (1998). Of Timing; Turn-Taking; and Conversations. Journal of Psycholinguistic Research; 27(5); 541–571.
Du-Babcock; B. (2003). A comparative analysis of individual communication processes in small group behavior between homogeneous and heterogeneous groups.  In Proceedings of the 68th Association of Business Communication Convention; pages 1–16; Albuquerque; New Mexico; USA.
Duncan; S. Jr. and D.W. Fiske; D. W. (1977). Face-to-face in- teraction. Erlbaum; Hillsdale; NJ.
Duncan; S. Jr. (1972). Some Signals and Rules for Taking Speaking Turns in Conversations.  Journal of Personality and Social Psychology; 23(2); 283–292.
Esposito; A.; Campbell; N.; Vogel; C.; Hussain; A. & Nijholt; A. (eds). (2010). Development of Multi- modal Interfaces: Active Listening and Synchrony; volume 5967 of LNCS. Springer Verlag.
Ford; C. E. & Thompson; S. A. (1996).  Interactional Units in Conversation: Syntactic; Intonational; and Pragmatic Resources for the Management of Turns. In E. Ochs; E.A. Schegloff; and S.A. Thompson; editors; Interaction and Grammar; pp. 134–184. Cambridge University Press; Cambridge.
Hadar; U. Steiner; T. J. & Clifford Rose; F. (1984). The timing of shifts of head postures during conversation. Human Movement Science; 3(3); 237–245.
Jokinen; K. (2011). Turn taking; utterance density; and gaze patterns as cues to conversational activ- ity. Â In Proceedings of ICMI-MMI; Alicante; Spain; November.
Kendon; A. (1967). Some functions of gaze-direction in social interaction. Acta Psychologica; 26; 22–63.
Kipp; M. (2004). Gesture Generation by Imitation - From Human Behavior to Computer Character Animation. Ph.D. thesis; Saarland University; Saar- bruecken; Germany; Boca Raton; Florida; disserta- tion.com.
Lu; J.; Allwood; J.& Ahlsén; E. Under publication. A study on cultural variations of smile based on em- pirical recordings of Chinese and Swedish first en- counters.  In D. Heylen; M. Kipp; and P. Paggio; editors; Proceedings of the workshop on Multimodal Corpora at ICMI-MLMI 2011; Alicante; Spain; Nov.
Maynard; S. (1987). Interactional functions of a nonver- bal sign: Head movement in Japanese dyadic casual conversation. Journal of Pragmatics; 11:589–606.
Navarretta; C. & Paggio; P. (2012).  Verbal and non-verbal feedback in different types of interactions. In Proceedings of LREC 2012; pp. 2338–2342; Is- tanbul Turkey; May.
Navarretta; C.; Ahlsén; E.; Allwood; J.; Jokinen; K. &; Paggio; P. (2011). Creating Comparable Multimodal Corpora for Nordic Languages.  In Proceedings of the 18th Conference Nordic Conference of Computational Linguistics; pages 153–160; Riga; Latvia; May 11-13.
Navarretta; C.; Ahlsén; E.; Allwood; J.; Jokinen; K. & Paggio; P. (2012) Feedback in Nordic firstencounters:  a comparative study. In Proceedings of LREC 2012; pp. 2494–2499; Istanbul Turkey; May.
O’Connell; D. C.; Kowal; S. & Kaltenbacher; E. (1990). Turn-Taking:  A Critical Analysis of the Research Tradition. Journal of Psycholinguistic Research; 19(6):345–373.
Paggio; P. & Navarretta; C. (2011). Head movements; facial expressions and feedback in Danish first en- counters interactions: a culture-specific analysis. In C. Stephanidis; editor; Universal Access in Human- Computer Interaction. Users Diversity. Proceedings of 6th International Conference; UAHCI 2011; Held as Part of HCI International 2011; pp. 583–590; Orlando; FL; USA; July. Springer.
Paggio;  P.; Ahlsén;  E.; Allwood; J.; Jokinen;  K. & Navarretta; C. (2010). The NOMCO multimodal Nordic resource - goals and characteristics. In Proceedings of LREC 2010; pp. 2968–2973; Malta; May 17-23.
Peirce.; C. S. (1931). Collected Papers of Charles Sanders Peirce; 1931-1958; 8 vols.  Harvard University Press; Cambridge; MA.
Paggio; P. & Navarretta; C. (2012). Head movements; facial expressions and feedback in conversations - empirical evidence from danish multimodal data. Journal on Multimodal User Interfaces - Special Issue on Multimodal Corpora.
Sacks; H.; Schegloff; E. & Jefferson; G.. (1974). A sim- plest systematics for the organization of turn-taking for conversation. Language; 50(4); 696–735.
Schegloff; E. (2000). Overlapping talk and the orga- nization of turn-taking for conversation. Language in Society; 29:1–63.
Tanaka; H. (2008). Communication strategies and cul- tural assumptions: An analysis of French-Japanese business meetings. In S. Tietze; editor; International Management and Language; pp 154–170. Routledge; New York; NY.
Yngve; V. (1970). On getting a word in edgewise. In Pa- pers from the sixth regional meeting of the Chicago Linguistic Society; pp. 567–578.