about
VIP: Finding Important People in Images [pdf] (arxiv.org)
2 points by mhb on Mar 11, 2015 | hide | past | pdf | discuss on HN

In plain words: A system scores how important each person in a group photo is, using only visual cues. Adding these scores to photo-describing software made its sentences about groups significantly better than the usual approach.

Abstract · VIP: Finding Important People in Images

People preserve memories of events such as birthdays, weddings, or vacations by capturing photos, often depicting groups of people. Invariably, some individuals in the image are more important than others given the context of the event. This paper analyzes the concept of the importance of individuals in group photographs. We address two specific questions -- Given an image, who are the most important individuals in it? Given multiple images of a person, which image depicts the person in the most important role? We introduce a measure of importance of people in images and investigate the correlation between importance and visual saliency. We find that not only can we automatically predict the importance of people from purely visual cues, incorporating this predicted importance results in significant improvement in applications such as im2text (generating sentences that describe images of groups of people).

Clint Solomon Mathialagan, Andrew C. Gallagher, Dhruv Batra
arXiv:1502.05678 · cs.CV · submitted Feb 19, 2015 · updated Jul 26, 2026
abstract · pdf · html

add comment on HN