Understanding the Emotional Impact of Images Jia JIA

  • Slides: 10
Download presentation

Understanding the Emotional Impact of Images Jia JIA Computer Science, Tsinghua University Joint work

Understanding the Emotional Impact of Images Jia JIA Computer Science, Tsinghua University Joint work with Xiaohui WANG, Peiyun HU, Sen WU, Jie TANG and Lianhong CAI

Ø Framework: Images -Aesthetic Effects -Emotions Ø Model: Factor Graphs for images in Social

Ø Framework: Images -Aesthetic Effects -Emotions Ø Model: Factor Graphs for images in Social Networks

App 1: Emotion Distribution on Flickr Before Thanksgiving 2011 VS 100, 000 Images from

App 1: Emotion Distribution on Flickr Before Thanksgiving 2011 VS 100, 000 Images from Flickr During Thanksgiving holiday Happy, Cheerful, and Peaceful

App 2: Modify Images with Emotional Words Happy Summer? More than 180 different effects

App 2: Modify Images with Emotional Words Happy Summer? More than 180 different effects Natural Autumn? Original Image Clear Winter?

“Emotion Modifier” Welcome to download from i. Tunes Store! https: //itunes. apple. com/us/app/emotion-modifier/id 571639316

“Emotion Modifier” Welcome to download from i. Tunes Store! https: //itunes. apple. com/us/app/emotion-modifier/id 571639316

Thank you for your attention! Any Question? APP for i. Pad (support IOS 5.

Thank you for your attention! Any Question? APP for i. Pad (support IOS 5. x ) : Emotion Modifier. Free Download! From https: //itunes. apple. com/us/app/emotion-modifier/id 571639316

Modeling Emotions via Aesthetic Effects How to characterize levels of emotional impact? Middle Level

Modeling Emotions via Aesthetic Effects How to characterize levels of emotional impact? Middle Level High Level We propose a novel notion of using aesthetic effects (quantified in image-scale space) as an intermediate layer to model the high level emotional semantics of images.

Modeling Social Network via Factor Graphs What affective model to predict the emotional impact?

Modeling Social Network via Factor Graphs What affective model to predict the emotional impact? Ø Large-scale Dataset: 100, 000 images in social networks with comments as emotional tag. Ø Model: semi-supervised factor graph model to incorporate color-based features, aesthetic effect, social features and emotional impact. Jie Tang, et al. , Learning to Infer Social Ties in Large Networks. In proceeding of ECML-PKDD 2011