about
The Kinetics Human Action Video Dataset (arxiv.org)
2 points by panarky on Jun 10, 2017 | hide | past | pdf | discuss on HN

In plain words: A collection of 10-second YouTube clips for teaching computers to recognize human actions: 400 kinds, from playing instruments to shaking hands, with at least 400 clips each. It reports accuracy numbers for standard video-recognizing networks and checks whether uneven class sizes skew their predictions.

Abstract

We describe the DeepMind Kinetics human action video dataset. The dataset contains 400 human action classes, with at least 400 video clips for each action. Each clip lasts around 10s and is taken from a different YouTube video. The actions are human focussed and cover a broad range of classes including human-object interactions such as playing instruments, as well as human-human interactions such as shaking hands. We describe the statistics of the dataset, how it was collected, and give some baseline performance figures for neural network architectures trained and tested for human action classification on this dataset. We also carry out a preliminary analysis of whether imbalance in the dataset leads to bias in the classifiers.

Will Kay, Joao Carreira, Karen Simonyan, Brian Zhang, Chloe Hillier, Sudheendra Vijayanarasimhan, Fabio Viola, Tim Green, Trevor Back, Paul Natsev, Mustafa Suleyman, Andrew Zisserman
arXiv:1705.06950 · cs.CV · submitted May 19, 2017
abstract · pdf · html

add comment on HN