NPTEL : NOC:Multimodal Interaction (Computer Science and Engineering)

Co-ordinators : Dr. Stefan Hillmann, Prof. Dr. Sebastian Moller


Lecture 1 - Introduction

Lecture 2 - Medium vs. Modality

Lecture 3 - Multimedia and Multimodality

Lecture 4 - Modality Relations

Lecture 5 - Characteristics of Multimodal Systems

Lecture 6 - Introduction

Lecture 7 - Speech Production

Lecture 8 - Hearing - Ear

Lecture 9 - Hearing - Perception

Lecture 10 - Introduction

Lecture 11 - The Human Eye

Lecture 12 - Gestlat Perception

Lecture 13 - Resolution and Sensitivity

Lecture 14 - Depth Perception

Lecture 15 - Reading

Lecture 16 - Introduction

Lecture 17 - Haptics

Lecture 18 - Smell

Lecture 19 - Taste

Lecture 20 - Memory

Lecture 21 - Motorsystem

Lecture 22 - Introduction

Lecture 23 - Processing Multiple Signals

Lecture 24 - Multimodal Dual-Tasks

Lecture 25 - Effects of Discongurent Signals

Lecture 26 - Relevance

Lecture 27 - Introduction 1

Lecture 28 - Introduction 2

Lecture 29 - Gesture to Space

Lecture 30 - Turn Taking

Lecture 31 - Conclusion

Lecture 32 - Introduction

Lecture 33 - Overview

Lecture 34 - Automatic Speech Recognition

Lecture 35 - Emotion Recognition

Lecture 36 - Text Recognition

Lecture 37 - Introduction1

Lecture 38 - Icons

Lecture 39 - Text Generation

Lecture 40 - Text to Speech

Lecture 41 - Speech Generation

Lecture 42 - Introduction .

Lecture 43 - Multimodal Interactive Systems Development

Lecture 44 - Introduction . .

Lecture 45 - Virtual Reality

Lecture 46 - Introduction to Audio for Virtual Reality

Lecture 47 - Spatial Hearing

Lecture 48 - Dummy Heads

Lecture 49 - Individuality of HRTFs

Lecture 50 - Sterophony

Lecture 51 - Crosstalk Cancelation

Lecture 52 - Ambisonics

Lecture 53 - Sound Field Synthesis

Lecture 54 - Challenges with Projection-based Systems

Lecture 55 - Capturing of Sound Scenes

Lecture 56 - Closing Remarks