about
MPG: A Multi-Ingredient Pizza Image Generator with Conditional StyleGANs [pdf] (arxiv.org)
14 points by contingencies on Dec 9, 2020 | hide | past | pdf | 6 comments on HN

In plain words: A system that turns a list of toppings into a realistic pizza image, teaching each layer of the network to handle ingredient details at the right size and checking it matches the request. On a 10-topping pizza dataset it made pizzas with the requested toppings.

Abstract · MPG: A Multi-ingredient Pizza Image Generator with Conditional StyleGANs

Multilabel conditional image generation is a challenging problem in computer vision. In this work we propose Multi-ingredient Pizza Generator (MPG), a conditional Generative Neural Network (GAN) framework for synthesizing multilabel images. We design MPG based on a state-of-the-art GAN structure called StyleGAN2, in which we develop a new conditioning technique by enforcing intermediate feature maps to learn scalewise label information. Because of the complex nature of the multilabel image generation problem, we also regularize synthetic image by predicting the corresponding ingredients as well as encourage the discriminator to distinguish between matched image and mismatched image. To verify the efficacy of MPG, we test it on Pizza10, which is a carefully annotated multi-ingredient pizza image dataset. MPG can successfully generate photo-realist pizza images with desired ingredients. The framework can be easily extend to other multilabel image generation scenarios.

Fangda Han, Guoyao Hao, Ricardo Guerrero, Vladimir Pavlovic
arXiv:2012.02821 · cs.CV, cs.CL · submitted Dec 4, 2020 · updated Oct 6, 2021
abstract · pdf · html

add comment on HN
Also discussed: Dec 2020 (3 points, 0 comments)

Now if it can generate different styles of pies (detroit, chicago, NYC, neapolitan) instead of what looks like Pizza Hut fare (not an insult, just a fact), then Instagram pizzaporn account here we come!
The trick would be to hook this up to some kind of automatic biological feedback loop so that it could measure how delicious the pizza seems _to you_ and iterate until it has produced your perfect slice.
Hawaiian will always win for me
You are a person of fine tastes
Back in the 90s, I semi-seriously considered building a pizza order module into our software. On Fridays our 25-person office usually got pizza, and I usually wound up spending a good 20 minutes going around and tabulating how many of what kinds of pizza we needed to suit everyone.
That's pretty cool paper.