by Kondyli, Vasiliki and Bhatt, Mehul
Abstract:
We propose an evidence based methodology for the systematic analysis and cognitive characterisation of multimodal interactions in naturalistic roadside situations such as driving, crossing a street etc. Founded on basic human modalities of embodied interaction, the proposed methodology utilises three key characteristics crucial to roadside situations, namely: explicit and implicit mode of interaction, formal and informal means of signalling, and levels of context-specific (visual) attention. Driven by the fine-grained interpretation and modelling of human behaviour in naturalistic settings, we present an application of the proposed model with examples from a work-in-progress dataset consisting of baseline multimodal interaction scenarios and variations built therefrom with a particular emphasis on joint attention and diversity of modalities employed. Our research aims to open up an interdisciplinary frontier for the human-centred design and evaluation of artificial cognitive technologies (e.g., autonomous vehicles, robotics) where embodied (multimodal) human interaction and normative compliance are of central significance.
Reference:
Multimodality on the Road: Towards Evidence-Based Cognitive Modelling of Everyday Roadside Human Interactions (Kondyli, Vasiliki and Bhatt, Mehul), In Advances in Transdisciplinary Engineering, IOS Press, 2020.
Bibtex Entry:
@article{DHM2020-multimodality-driving,
author = {Kondyli, Vasiliki and Bhatt, Mehul},
journal = {Advances in Transdisciplinary Engineering},
pages = {131--142},
publisher = {IOS Press},
title = {{Multimodality on the Road: Towards Evidence-Based Cognitive Modelling of Everyday Roadside Human Interactions}},
DOI = {10.3233/ATDE200018},
abstract = {We propose an evidence based methodology for the systematic analysis and cognitive characterisation of multimodal interactions in naturalistic roadside situations such as driving, crossing a street etc. Founded on basic human modalities of embodied interaction, the proposed methodology utilises three key characteristics crucial to roadside situations, namely: explicit and implicit mode of interaction, formal and informal means of signalling, and levels of context-specific (visual) attention. Driven by the fine-grained interpretation and modelling of human behaviour in naturalistic settings, we present an application of the proposed model with examples from a work-in-progress dataset consisting of baseline multimodal interaction scenarios and variations built therefrom with a particular emphasis on joint attention and diversity of modalities employed. Our research aims to open up an interdisciplinary frontier for the human-centred design and evaluation of artificial cognitive technologies (e.g., autonomous vehicles, robotics) where embodied (multimodal) human interaction and normative compliance are of central significance. },
url = {pdfs/cognitive_vision/DHM2020-MultimodalityRoad.pdf},
year = {2020}
}