about
Anime Popularity Prediction: A Multimodal Approach Using Deep Learning (arxiv.org)
1 point by PaulHoule on Jul 8, 2024 | hide | past | pdf | discuss on HN

In plain words: A deep network reads an upcoming anime's text and images together to guess its popularity score before money is spent, using a new dataset built from free internet sources. Its error was 0.011, versus 0.412 for the usual approach of feeding word counts and pixels.

Abstract · Anime Popularity Prediction Before Huge Investments: a Multimodal Approach Using Deep Learning

In the japanese anime industry, predicting whether an upcoming product will be popular is crucial. This paper presents a dataset and methods on predicting anime popularity using a multimodal textimage dataset constructed exclusively from freely available internet sources. The dataset was built following rigorous standards based on real-life investment experiences. A deep neural network architecture leveraging GPT-2 and ResNet-50 to embed the data was employed to investigate the correlation between the multimodal text-image input and a popularity score, discovering relevant strengths and weaknesses in the dataset. To measure the accuracy of the model, mean squared error (MSE) was used, obtaining a best result of 0.011 when considering all inputs and the full version of the deep neural network, compared to the benchmark MSE 0.412 obtained with traditional TF-IDF and PILtotensor vectorizations. This is the first proposal to address such task with multimodal datasets, revealing the substantial benefit of incorporating image information, even when a relatively small model (ResNet-50) was used to embed them.

Jesús Armenta-Segura, Grigori Sidorov
arXiv:2406.16961 · cs.LG, cs.AI · submitted Jun 21, 2024
abstract · pdf · html · 13 pages, 6 figures, 11 tables

add comment on HN