Vision-based user interfaces: methods and applications

Marco Porta

Dipartimento di Informatica e Sistemistica - Università di Pavia
Via Ferrata, 1 - 27100 - Pavia - Italy

Published in International Journal of Human-Computer Studies, Vol. 57 (2002), pp. 27-73, Elsevier Science - Academic Press.


Within the class of perceptive user interfaces (i.e.interfaces providing the computer with perceptive capabilities), artificial vision is being exploited more and more as a new input modality, in addition to or in replacement of standard interaction paradigms. The aim of this paper is to provide a global view on the field of vision-based interfaces (VBIs), through the analysis of the methods used for their implementation and the exploration of the practical systems in which they have been employed. The focus will mostly be on techniques and prototypes intended for of office and home PC-based use,as we are mainly interested in vision technology applied to ordinary computing environments. After a brief introduction to basic concepts about interfaces and image processing,the attention will be shifted to the four main areas in which VBIs find their maximum expression, namely head tracking, face/facial expression recognition, eye tracking and gesture recognition.


 perceptive interfaces; vision-based interfaces; head tracking; face/facial expression recognition; eye tracking; gesture recognition