Research

I deal with multimodal dialogue, paralinguistic component of communication, perception of prosody in multimodal context, prosody in speech and music, and some other topics that can be found below in the list of my publications and projects.

Current projects:

  • Borderland: Language of boundaries – boundaries of language. Paralinguistic aspects of intercultural communication. An NPRH-funded research project (Head of the Project)
  • NeuroPerKog: Development of the phonematic hearing and working memory in infants and children (Head of the UAM Poznań Team).
  • I’ve participated in the development of and I support AnnotationPro

Previous/closed projects:

  • PAGE: Prosodic and gestural entrainment in conversational interaction across diverse languages (Principal Investigator; project funded by Volkswagen Stiftung);
  • Linguistic Heritage of Rzeczpospolita: Database of Endangered Languages (led by T. Wicherkiewicz) where I worked on the multimodal data collection and annotation as well as on some suprasegmental analyses.
  • INNET: Innovative Networking in Infrastructure for Endangered Languages (Member of the Polish Team);
  • Acquisition and processing of verbal information in military and police systems for crime and terrorism prevention (led by G. Demenko) where I worked on the role of paralinguistic features in speaker and speaker’s state identification/recognition.
  • DiaGest2: Modelling Dialogue Acts in Task-oriented Dialogues (2009-2010; Head of the Project)
  • Multilingual and Intercultural Database of Gestures (within COST2102 Action, 2008-2009)
  • DiaGest: Speech and Gesture in Task-oriented Dialogues (a pilot study) (2007)
  • Pol’n’Asia: A comparative study of intonation and tone in Korean, Polish, Thai and Vietnamese (based on a quasi-parallel corpus of map task dialogues; Head of the Project)
  • PoInt – Polish Intonational Database (based on read texts, quasi-spontanoues monologues and three types of task-oriented dialogues; Head of the Project)

Some publications (for pdfs, go to academia.edu)

Czoska, A., Klessa, K., Karpinski, M., Jarmolowicz-Nowikow, E. 2015. Prosody and gesture in dialogue: Cross-modal interactions. Proceedings of GESPIN 2015 Conference, Nantes, France.

Karpiński, M., Jarmołowicz-Nowikow, E., Czoska, A. 2015. Gesture annotation
scheme development and application for entrainment analysis in task-oriented dialogues in diverse cultures. Proceedings of GESPIN 2015 Conference, Nantes, France.

Czoska, A., Klessa, K., Karpiński, M. 2015. Polish Infant Directed vs. Adult Directed Speech Selected Acoustic-Phonetic Differences. Proceedings of the 18th International Congress of Phonetic Sciences, Glasgow, UK.

Karpinski, M. 2014. New challenges in psycholinguistics: Interactivity and alignment in interpersonal communication. Lingua Posnaniensis, vol. 54, issue 1, pp. 97-106.

Bonacchi, S. & Karpiński, M. 2014. Remarks about the use of the term “multimodality”. Journal of Multimodal Communication Studies, vol 1, pp. 1-7.

Karpinski, M., Klessa, K., Czoska, A. 2014. Local and global convergence in the temporal domain in Polish task‑oriented dialogue. [In:] N. Campbell, D. Gibbon, and D. Hirst (Eds.) Speech Prosody 7, 2014, Dublin, pp. 743-747. ISSN 2333-2042

Nicole, N., Michael, M., Karpiński, M., Klessa, K., Wicherkiewicz, T., Wójtowicz, R. 2014.
Języki w niebezpieczeństwie: księga wiedzy. (wydanie internetowe)

Nicole, N., Michael, M., Karpiński, M., Klessa, K., Wicherkiewicz, T., Wójtowicz, R. 2014.
Languages in Danger: Book of Knowledge (web edition)

Klessa, K., Karpiński, M., Wagner, A. 2013. Annotation Pro – a new software tool for annotation of linguistic and paralinguistic features [forthcoming in:] Proceedings of TRASP: Tools and Resources for the Analysis of Speech Prosody, a satellite event for Interspeech 2013, Aix-en-Provence.

Klessa, K., Wagner, A., Oleśkowicz-Popiel, M., Karpiński, M. 2013. Paralingua – a new speech corpus for the studies of paralinguistic features. Procedia – Social and Behavioral Science. Elsevier ISSN: 1877-0428

Karpiński, M. 2013. О дискурс-аналитической практике (пер. с англ. Т.И. Свищук, Е.В. Савич) [w:] Le Table Ronde, БГ У, ISSN 2218-8002.

Karpiński, M. 2013. Acoustic Features of Filled Pauses in Polish Task-Oriented Dialogues. Archives of Acoustics, vol. 38, pp. 63-73.

Karpiński, M. Szalkowska-Kim, E 2012. On Intonation of Korean and Polish Questions. Speech and Language Technology, vol. 14/15, pp. 137-148.

Karpiński, M. 2012. The Boundaries of Language: Dealing with Paralinguistic Features. Lingua Posnaniensis, vol. LIV (2)/2012. PL ISSN 0079-4740, ISBN 978-83-7654-252-2, pp. 37-54.

Karpiński, M.  2012. Language in Action: The review of: Reinterpreting Gesture as Language “in Action”, Avant, vol. 3(1), pp. 403—417, ISSN: 2082-6710.

Karpiński, M. 2011/12. Acoustic properties and functions of phrase-final rises in Polish task-oriented dialogues. [in:] Ed. D. Gibbon, N. Campbell & D. Hirst (Eds.) Speech and Language Technology Special Issue: Festschrift for Prof. Wiktor Jassem, vol. 14/15, pp. 147-156.

Jarmołowicz-Nowikow, E. & Karpiński, M. 2011. Communicative intentions behind pointing gestures in task-oriented dialogues. [in:] P. Wagner, Z. Malisz, C. Kirchhof (Eds.) Proceedings of GESPIN 2011: Gesture and Speech in Interaction Conference.

Szczyszek, M., Karpiński, M. 2010. Jakościowa i ilościowa analiza słownictwa oraz jednostek quasi- i nieleksykalnych wypowiedzi w dialogach zadaniowych „origami”. Investigationes Linguisticae, vol. XXII, pp. 139-156.

Klessa, K., Karpiński, M., Bałdys, O., Demenko, G. 2009/2010. Architecture for Creating and Development of Lexical  Databases for Speech Technology. Speech and Language Technology , vol. 12/13.

Karpiński, M., Jarmołowicz-Nowikow, E. 2010. Prosodic and Gestural Features of Phrase-internal Disfluencies in Polish Spontaneous Utterances. Proceedings of Speech Prosody 2010, Chicago.

Malisz, Z. & Karpiński, M. 2010. Multimodal Aspects of Positive and Negative Responses in Polish Task-oriented Dialogues. Proceedings of Speech Prosody 2010, Chicago.

Karpiński, M. 2009. From Speech and Gestures to Dialogue Acts. [In:] A. Esposito, A. Hussain, M. Marinaro, R. Martone (Eds.) Multimodal Signals: Cognitive and Algorithmic Issues, Springer LNAI Series 5398, pp. 164-169.

Karpiński, M. 2009. Preliminary Prosodic and Gestural Characteristics of Instructing Acts in Polish Task-Oriented Dialogues [In:] A. Esposito and R. Vích (Eds.): Cross-Modal Analysis of Communication, Springer LNAI Series 5641, pp. 227–238.

Karpiński, M., Jarmołowicz-Nowikow, E., Malisz, Z., Szczyszek, M., Juszczyk, K. 2010. Rejestracja, transkrypcja i tagowanie mowy oraz gestów w narracji dzieci i dorosłych (Recording and transcription of speech and gesture in the narration of Polish adults and children), Investigationes Linguisticae, vol. XVI, pp. 83-98.

Karpiński, M., Jarmołowicz-Nowikow, E. & Malisz, Z. 2008. Aspects of Gestural and Prosodic Structure of Multimodal Utterances in Polish Task-oriented Dialogues. [In:] G. Demenko, K. Jassem, St. Szpakowicz (Eds.) Speech and Language Technology, vol. XI, pp. 113-122.

Kleśta, J., Karpiński, M. 2006/2007. Disfluences in Polish and Thai task-oriented dialogues. Proceedings of Speech Signal Annotation, Processing and Synthesis Conference, September 2006, Poznań.

Jarmołowicz, E., Karpiński, M., Malisz, Z., Szczyszek, M. 2007. Gesture, Prosody and Lexicon in Task-oriented Dialogues: Multimedia Corpus Recording and Labelling. [w:] Verbal and Nonverbal Communication Behaviours, LNAI 4775, Berlin: Springer Verlag, str. 99-110.

Karpiński, M. 2007. The Intonational Realization of Requests in Polish Task-Oriented Dialogues. [w:] V.Matousek, P. Mautner et al. (red.) Text, Speech and Dialogue, Plzen. LNAI 4629, str. 556-563.

Karpiński, M. 2007. Selected quasi-lexical and non-lexical units in Polish map task dialogues, Archives of Acoustics, 32, 1, str. 51-65.

Karpiński, M. (editor) and co-author (with K. Juszczyk J. Kleśta, E. Szalkowska and M. Włodarczak) 2007. Pol’n’Asia Corpus of Korean, Polish, Thai and Vietnamese Map Task Dialogues. ISBN 978-83-926446-0-6.

Karpiński, M. (editor) and co-author (with K. Juszczyk J. Kleśta, E. Szalkowska and M. Włodarczak) A Brief Guide to Intonation and Tone in Korean, Polish, Thai and Vietnamese Dialogues.  ISBN 978-83-926446-1-3.

Karpiński, M., Juszczyk, K., Kleśta, J., Szalkowska, E., Włodarczak, M. 2007. Categorization and Labelling of Dialogue Acts in Pol’n’Asia Project (extended abstract in PLM 2007 Book of Abstracts).

Karpiński, M., Jarmołowicz, E., Malisz, Z., Szczyszk, M. 2007. Gesture, Prosody and Lexicon in Task-oriented Dialogues: Progress Report. (extended abstract in PLM 2007 Book of Abstracts).

Karpiński, M. 2006. Struktura i intonacja polskiego dialogu zadaniowego. Poznań: Wydawnictwo Naukowe UAM, ISBN 83-232-1662-2.

Karpiński, M., Kleśta, J., Szalkowska, E. 2006. Non- and Quasi-lexical Realizations of “Positive Response” in Korean, Polish and Thai. Proceedings of Speech Prosody 2006 Conference, Dresden.

Karpiński, M. 2005. The form and function of selected non-lexical and quasi-lexical units in Polish map task dialogues. Proceedings of SASR Conference, Kraków.

Francuzik, K., Karpiński, M., Kleśta, J., Szalkowska, E. 2004. Nuclear Melody in Polish Semi-spontaneous and Read Speech; Evidence from the Polish Intonational Database PoInt. Studia Phonetica Posnaniensia, str. 97–128.

Karpiński, M. 2004. Segmentacja, transkrypcja i anotacja dialogu zadaniowego. [w:] G. Demenko, M. Karpiński (red.) Speech and Language Technology, vol. VIII.

Karpiński, M. & Kleśta, J. 2004. Interphrase Pause Realization Rules for the Purpose of High Quality Polish Speech Synthesis [in:] Proceedings of SASR Workshop in Szczyrk.

Grabe, E. & Karpiński, M. 2003. Universal and Language-specific Aspects of Intonation in English and Polish. [w:] E. Grabe i D. G. S. Wright: Oxford University Working Papers in Linguistics, Philology & Phonetics, vol. 8.

Karpiński, M., Baranowska, E., Francuzik, K., Kleśta, J. 2003. Identification of Nuclear Melody Placement in Polish Read Texts [w:] A. Mettouchi i G. Ferre (red.) Interfaces Prosodiques, Nantes.

Grabe, E. & Karpiński, M. 2003. Universal and language-specific aspects of intonation in English and Polish. M. J. Sole, D. Recasens i J. Romero (red.) The Proceedings of ICPhS 2003. Barcelona.

Baranowska, E., Francuzik, K., Karpiński, M., Kleśta, J. 2003. Determining Phrase Boundaries in Written Texts for the Purpose of Polish Speech  Synthesis. [w:] Speech and Language Technology, vol. VII, Poznań: Polskie Towarzystwo Fonetyczne.

Karpiński, M. 2002: POLENG: Polish-English Machine Translation (a review). CEEC EUROMAP Newsletter, Issue 2, December.

Karpiński, M. 2002. Szukając partnera do rozmowy. Computerworld Polska, No 37.

Karpiński, M. 2002. The Corpus of the Polish Intonational Database: Technical Specifications. Investigationes Linguisticae, vol. VIII.

Francuzik, K., Karpiński, M., Kleśta, J. 2002. A Preliminary Study of the Intonational Phrase, Nuclear Melody and Pauses in Polish Semi-Spontaneous Narration. Speech Prosody 2002 Proceedings. Aix-en-Provence.

Karpiński, M. 2001. Humor as a means of stratifying the web community. Stylistyka, vol. X, Uniwersytet Opolski.

Karpiński, M. &  Kleśta, J. 2001. The Project of Intonational Database for the Polish Language [w:] St. Puppel, G. Demenko (red.), Prosody 2000. Poznań: Faculty of Modern Languages and Literature, UAM.

Karpiński, M. 2001. The prosodic expression of surprise and astonishment in jokes: A listening task. [w:] St. Puppel, G. Demenko (red.) Prosody 2000. Poznań: Faculty of Modern Languages and Literature, UAM.

Karpiński, M. 2000. Prozodyczne wykładniki zaskoczenia i zdziwienia w narracji dowcipów. [w:] St. Gajda, D. Brzozowska (red.): Świat Humoru, Uniwersytet Opolski.

Karpiński, M. 2000. Speech Technology in Poland. Proceedings of WERA Workshop. Technical University of Cluj: Cluj-Napoca.

Karpiński, M. 1999. Operowanie środkami fonetycznymi w wypowiedziach skierowanych do komputera [w:] W. Jassem, Cz. Basztura, G. Demenko, K. Jassem (red.) Speech and Language Technology, vol. III, Poznań: Polskie Towarzystwo Fonetyczne.

Karpiński, M. 1999. Badania dyskursu a komunikacja człowiek-komputer, Investigationes Linguisticae, vol. VII. Instytut Językoznawstwa UAM.

Karpiński, M. 1998: Coherence and redundancy in human-computer communication. The Proceedings of Speech and Hearing Conference, Windermere.

Karpiński, M. 1998. Psycholingwistyczne aspekty komunikacji człowiek-komputer. (niepublikowana rozprawa doktorska, dostępna w Bibliotece Uniwersyteckiej w Poznaniu).

Karpiński, M. 1997. Conversational Devices in Human-Computer Communication Using WIMP UI. [w:] R. Murawski, J. Pogonowski (red.) Euphony and Logos. Amsterdam – Atlanta: Rodopi, str. 245 – 362.

Karpiński, M. 1995. Kohortalna struktura leksykonu umysłowego użytkownika języka polskiego. Weryfikacja hipotezy Marslena-Wilsona. [w:] J. Pogonowski (red.) Eufonia i Logos. Poznań: Wydawnictwo Naukowe UAM.

Karpiński, M. 1993. Z historii badań indologicznych na Uniwersytecie im. Adama Mickiewicza w Poznaniu. Acta Universitatis Wratislaviensis, No 1465, vol. XVI, str. 55 – 60.

Comments are closed.