The anatomy of an Active Multimodal Presentation in educational contexts

Hartley, Roger, Elsayed, Adel and Pesheva, Milena (2005) The anatomy of an Active Multimodal Presentation in educational contexts. Fifth International Conference on Advanced Learning Technologies. Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies . IEEE, p. 762. ISBN 0-7695-2338-2 (Submitted)

[img] PDF
gcct_conference-2.pdf

Download (87kB)
Official URL: http://ieeexplore.ieee.org/Xplore/login.jsp?url=/i...

Abstract

This paper presents a methodology for analyzing gestures within Active Multimodal Presentations (AMP) which are designed to produce coherently integrated communications within educational contexts. The methodology is focused on a semantic integration of the visual, verbal and gestural modalities. We identify three representational forms - a time based transcript, that is extracted from presentations to produce a speech mark-up; a concept based semantic analysis of the content; and a representation of gestures which distinguishes visual depictions of their icons, their trajectories, referents, and functions that link the verbal and visual modalities of the presentations. Our experiments are showing the utility of the analyses giving guidelines that can aid the design of AMPs within educational contexts.

Item Type: Book Section
Additional Information: This paper was presented at the Fifth International Conference on Advanced Learning Technologies, 5-8 July 2005 and published by IEEE as the Proceedings of the Fifth IEEE International Conference on Advanced Learning Technologies. The published version is available at http://ieeexplore.ieee.org/Xplore/login.jsp?url=/iel5/10084/32317/01508809.pdf?temp=x
Divisions: School of Creative Technologies > Games Computing and software engineering
Depositing User: Scott Wilson
Date Deposited: 26 Nov 2013 12:49
Last Modified: 14 Jan 2014 11:50
Identification Number: 10.1109/ICALT.2005.256
URI: http://ubir.bolton.ac.uk/id/eprint/228

Actions (login required)

Edit Item Edit Item

Downloads

Downloads per month over past year

View more statistics

>