Speech, Ink, and Slides: The Interaction of Content Channels
by
Jonathan Su
In this talk, we will discuss empirical exploration of digital ink and
speech usage in lecture presentation. Our interest in understanding how
ink and speech are used together is to inform the development of future
tools for supporting classroom presentation, distance education, and
viewing of archived lectures. We want to make it easier to interact with
electronic materials and to extract information from them. Furthermore,
we want to provide an empirical basis for addressing challenging problems
such as automatically generating full text transcripts of lectures,
matching speaker audio with slide content, and recognizing the meaning of
the instructor's ink. Our results include an evaluation of handwritten
word recognition in the lecture domain, an approach for associating
attentional marks with content, an analysis of linkage between speech and
ink, and an application of recognition techniques to infer speaker
actions.
Advised by Richard Anderson
CSE 403
Wednesday
January 19, 2005
3:30 - 4:20 pm