Maja Pantic     Imperial College Department of Computing 180 Queen’s Gate London SW7 2AZ U.K.     Tel: +44-207-594-8195 Fax: +44-207-581-8024	University of Twente EEMCS Drienerlolaan 5 7522 NB Enschede The Netherlands     Tel: +31-53-489-3740 Fax: +31-53-489-3503
	E-mail: m.pantic@[remove-this]imperial.ac.uk   PanticM@[remove-this]cs.utwente.nl   mpantic@[remove-this]ieee.org

Position:	Imperial College London: Reader in Multimodal Human-Computer Interaction University of Twente: Professor in Affective & Behavioural Computing
Teaching (Imperial College):	Machine Learning (course 395) Software Engineering Design II: Human-Computer Interaction Design (course 222) Individual Final Projects
HCI2 Group:	Human-Centered, Intelligent, Human-Computer Interaction Group (HCI2 Group): Leader: Maja Pantic Research Associates: Hatice Gunes, Michel Valstar, Jeroen Lichtenauer PhD Students: Antonis Oikonomopoulos, Stavros Petridis, Jie Shen, Ognjen Rudovic, Konstantinos Bousmalis Affiliated PhD Students: Brais Martinez Past Members: Sander Koelstra, Danijela Vukadinovic Publications
Imperial College:	Imperial College London, Computing Department, Visual Information Processing Imperial College London Distinguished Seminar Series in Computing
University of Twente:	University of Twente, EEMCS, Human-Media Interaction
Research interests:	face and body gesture recognition, human-computer interaction (HCI), multimodal HCI, context-sensitive HCI, affective computing, educational software, e-learning tools, intelligent systems, machine learning

General Information

I was born in April 1970 in the city of Belgrade. I received the MSc and PhD degrees in Computer Science from Delft University of Technology, The Netherlands, in 1997 and 2001. Both degrees have been obtained under the supervision of Prof. Henk Koppelaar. From 2001 to 2005, I was an Assistant and then an Associate Professor at the Electrical Engineering, Mathematics and Computer Science at Delft University of Technology, The Netherlands, where I was doing research in the areas of image and video analysis of face and body gestures, affective computing, behavioural and contextual interfaces, and multimodal HCI. In April 2006, I joined the Imperial College Department of Computing, UK, where I am Reader in Multimodal Human-Computer Interaction and where I continued my work on machine analysis of human non-verbal behaviour. From November 2006, I also hold an appointment as the Professor of Affective & Behavioural Computing in the Department of Computer Science at the University of Twente, the Netherlands.

My current research addresses the problem of sensing and understanding users interactive actions and intentions for achieving multimodal human-machine interaction in natural settings. A critical issue here is that human face and body exhibit complex and rich dynamic behaviour that is all non-linear, time varying, and context dependent(person, task, mood/ affect dependent). Thus, the main focus of my research is on machine learning for modelling multimodal human-machine interactive modes from multi-sensory observations. The related research areas include realizing spatiotemporal analysis of human interactive actions, integrating multiple sensors and pertinent modalities according to the model of the human sensory system, and establishing individual- and context- dependent human behavioural models valid for specific human-machine interactive modes. These models will be further used for seamless and proactive design of home and health support appliances, living and working spaces, and interactive devices including automobiles and robots.

My research aimed at automatic analysis of human facial expressions, called Facial Information For Advanced Interaction (FIFAI), has been funded by the Innovational Research Grant of the Dutch Scientific Organisation (EW-639.021.202) for a period of three years (02-01-2003 to 02-01-2006). This grant has been awarded to me as to one of the seven best young researchers of exact sciences in The Netherlands in 2002 (EW-VENI-2002-awards).

My research aimed at multimodal analysis of human naturalistic non-verbal behaviour, titled MAHNOB, has been funded by the European Research Council within the Starting Grant Programme for a period of five years (01-09-2008 to 01-09-2013). This grant has been awarded to me as to one of as one of 2,5% best junior scientists in any research field in Europe in 2007(ERC-StG-2007-awards).

Scientific Output

·       Research on Automatic Facial Expression Analysis (2001) – PhD Thesis

·       Fiducial Facial Point Detector (2005/2007) – Some Results (Cohn-Kanade Database, MMI Database), Rector of the Imperial College London, Some Other Results

·       CODE Fiducial Facial Point Detector (2005/2007) – The original Matlab implementation was written by Danijela Vukadinovic, which was further optimized by Michel Valstar. The detector includes Viola & Jones face detector and will work fine for any near-frontal-view face image. The code has been compiled on a Windows machine, hence this downloadable version of our detector will work only on a Windows machine. You will need Matlab Component Runtime installed at your computer for the program to run. Description of the Detector (pdf file), Compiled Matlab code of the Detector (ffpd.zip; follow the instructions in ReadMe), and Matlab Component Runtime (MCRInstaller.exe).

·       CODE Salient Point Detector (2006/2008) – The Matlab implementation was written by Antonis Oikonomopoulos. The code has been compiled on a Windows machine, hence this downloadable version of our detector will work only on a Windows machine. You will need Matlab Component Runtime installed at your computer for the program to run. Description of the Detector (pdf file), Compiled Matlab code of the Detector and an example of human-action video sequence from the Weizmann dataset (STPdetector.zip; follow the instructions in ReadMe), and Matlab Component Runtime (MCRInstaller.exe).

·       Tracking head and hand using Adapted Auxiliary Particle Filtering (2005) – Great Dictator

·       Tracking face profile points using Adapted Auxiliary Particle Filtering (2005) – MMI Database Samples

·       Tracking facial points using Particle Filtering with Factorized Likelihoods (PFFL) inposed facial expressions (2005/2006) – MMI Database Samples, Cohn-Kanade Database Samples

·       Tracking facial points using PFFL in spontaneous facial expressions, detecting spontaneous vs. posed smile (2006/2007) – MMI Database (Spontaneous Expressions), MMI Database(Spontaneous Expressions with Occlusion)

·      MMI Facial Expression Database (2005/2009)

·      Publications

Past Activities

·     Associate Editor Computer Journal

·     Guest Editor Int’l Journal of Image and Video Processing (IJIVP), Special Issue on Anthropocentric Video Analysis: Tools and Applications (vol 2008–si.2) (together with N. Nikolaidis and I. Pitas)

·     Guest Editor Lecture Notes on Artificial Intelligence (LNAI),Special Volume on AI for Human Computing (LNAI-AI4HC) (together with T.S. Huang, A. Nijholt and A. Pentland)

·        Guest Editor IEEE Trans. Systems, Man, and Cybernetics – Part B (TSMC-B), Special Issue on Human Computing (vol. 39, no. 1, 2009) (together with A. Nijholt and A. Pentland)

·     Guest Editor Image and Vision Computing Journal (IVCJ), Special Issue on Visual Analysis of Human Naturalistic Behaviour (vol. 27, no. 12, 2009) (together with J.F. Cohn)

·      June-Aug. 2005 -- Visiting Associate Professor at Face Group, Robotics Institute, Carnegie Mellon University, USA

·      June 2006 -- Key Note Speaker at IFIP Conf. Artificial Intelligence Applications & Innovations 2006 (AIAI’06)

·      Jan. 2007 -- Workshop Chair of the AI for Human Computing Workshop (AI4HC’07) in conjunction with Int’l Joint Conf. on Artificial Intelligence 2007 (IJCAI’07) (together with T.S. Huang, A. Nijholt and A. Pentland) (AI4HC’07 Proceedings (pdf file))

·      June 2008 -- Key Note Speaker at Annual Symposium of the German Association for Pattern Recognition 2008 (DAGM’08)

·      July 2008 -- Key Note Speaker at Int’l Conf. Articulated Motion & Deformable Objects 2008 (AMDO’08)

·      Sep. 2008 -- Workshop Chair of the Workshop on Implicit Human-Centered Tagging (HCT) in conjunction with the PetaMedia project meeting in London, September 2008 (PetaMedia) (together with A. Vinciarelli and I. Patras)

·      Sep. 2008 -- Key Note Speaker at 5^th Joint Workshop on Machine Learning and Multimodal Interaction (MLMI’08)

·      Sep. 2008 -- General Chair of IEEE Int'l Conf. on Face and Gesture Recognition 2008 (FG’08)

·      Nov. 2008 -- General Chair of Belgian-Dutch Conf. on Artificial Intelligence 2008 (BNAIC’08)

Projects

• (2009 - 2014) EC FP7 SSPNet: Social Signal Processing Network of Excellence (SSPNet)
• (2008 - 2013) ERC Starting Grant MAHNOB: Multimodal Analysis of Human Nonverbal Behaviour in Real-World Settings (MAHNOB)
• (2008 - 2011) EC FP7 SEMAINE: Sustained Emotionally coloured Machine-human Interaction using Nonverbal Expression (SEMAINE)
• (2004 - 2006) Dutch BSIC MultimediaN - Project 2: Context-aware Multimodal Interaction
• (2003 - 2006) Dutch NWO VENI - FIFAI: Facial Information For Advanced Interaction

Other Information

• CV
• More about me
• Page statistics

 

This page was last modified on October 6, 2009 by Maja Pantic