about
OpenAI Shap-E: 3D Shape Generation (arxiv.org)
6 points by crakenzak on May 5, 2023 | hide | past | pdf | 2 comments on HN

In plain words: From a text prompt, it builds a 3D shape as a function describing its surface and look, which can become a mesh or a detailed 3D view. Unlike a point-cloud generator, it trains faster and makes shapes of similar or better quality in seconds.

Abstract · Shap-E: Generating Conditional 3D Implicit Functions

We present Shap-E, a conditional generative model for 3D assets. Unlike recent work on 3D generative models which produce a single output representation, Shap-E directly generates the parameters of implicit functions that can be rendered as both textured meshes and neural radiance fields. We train Shap-E in two stages: first, we train an encoder that deterministically maps 3D assets into the parameters of an implicit function; second, we train a conditional diffusion model on outputs of the encoder. When trained on a large dataset of paired 3D and text data, our resulting models are capable of generating complex and diverse 3D assets in a matter of seconds. When compared to Point-E, an explicit generative model over point clouds, Shap-E converges faster and reaches comparable or better sample quality despite modeling a higher-dimensional, multi-representation output space. We release model weights, inference code, and samples at https://github.com/openai/shap-e.

Heewoo Jun, Alex Nichol
arXiv:2305.02463 · cs.CV, cs.LG · submitted May 3, 2023
abstract · pdf · html · 23 pages, 13 figures

add comment on HN
Also discussed: May 2023 (1 point, 0 comments)

Create a silicone mold for epoxy resin, which has the dimensions of 100 cm x 75 cm, and which has inside the entire shema israel prayer in Hebrew characters
a throne in heaven and God sitting on the throne. His body sparkled like precious stones of jasper and carnelian. A rainbow that looked like an emerald surrounded the throne. Before the throne was a sea of glass that looked like crystal