Human Perception in Multimedia Computing

Our Goal

Our goal is to demonstrate how human perception of multimedia can lead to enhanced practical systems, and how human study and user experience innovation can foster the multimedia computing system development. Human perception has been studied extensively and for a long time in psychology, but only in the late twentieth century has it emerged as a research area in computer graphics, image processing, computer vision, multimedia communication, and related disciplines. From the human-computer interface (HCI) perspective, audio and visual data can trigger conscious and unconscious user responses. The perceptual approach assumes that perceived quality is essential provided it is noticeable to the human visual system (HVS); details that do not enhance perceived quality only waste computational and network resources. Experiments assessing the limitation of the human visual system show that multimedia applications can take advantage of these human perceptual limits. With the emerging areas of social computing, mobile sensing, crowdsourcing, and so on, the perceptual approach and QoE optimization technology can be applied in conjunction to achieve higher system efficiency. The following are some of the topics that fall within the scope of our TC:

Human Perception and Visual Quality

  • Human perceptual quality measurement
  • Quality metrics for multimedia (image, graphics, video…)
  • Perceptual quality aware visual processing and rendering
  • Perceptual quality aware visual data compression
  • Perceptual quality aware visual communications
  • Perceptual factors in multimedia education
  • Panoramic view perception, capture and rendering

Human-Oriented Multimedia Computing

  • Human factors in 3D and multimedia systems
  • Human behavior modeling and understanding
  • Computer vision and media data analysis
  • Social multimedia computing
  • Media recommender systems
  • Human-based sensing and data mining

Advanced Multimedia User Experiences

  • Quality of Experiences (QoE) models
  • Novel interactive multimedia systems
  • Multimodal user interfaces and interaction models
  • Augmented reality algorithms and applications
  • Gesture and touch based systems and applications

Human and Mobile Media

  • Mobile sensing for media capturing and processing
  • Low-power media processing and communications
  • Human interaction with mobile applications
  • Seamless Human centric computing and communications
  • Crowdsourcing in media applications

We play significant roles in a variety of important conferences and journals related to TC scope, including IEEE International Conference on Systems, Man, and Cybernetics (SMC), IEEE International Conference on Multimedia and Expo (ICME), IEEE International Symposium on Multimedia (ISM), IEEE Global Communications Conference (GLOBECOM), ACM Symposium on Applied Perception (ACM SAP), ACM International Conference on Multimedia (ACM MM), ACM International Conference on 3D Web Technology (Web3D), Eurographics, Shape Modeling International (SMI), International Conference on Computing, Networking and Communications (ICNC), International Conference on Computer Communications and Networks (ICCCN), IEEE Transactions on Systems, Man, and Cybernetics, IEEE Transactions on Multimedia, IEEE Communications Magazine, IEEE SMC eNewsletter, ACM Multimedia Systems Journal, ACM Transactions on Applied Perception, Computer Graphics Forum, Journal of Communications.

Learn More

These tutorial materials provide more information on topics of interest to our technical committee.

Join Us

The Technical Committee on Human Perception and Multimedia Computing provides opportunities to continue professional and personal development, such as:

  • Interactions with experts from different disciplines related to human perception and multimedia
  • Participation in interesting conferences and workshops
  • Publication in high-quality journals
  • Exchanges of research ideas and sharing of research resources