about
Implicit Neural Image Stitching with Enhanced and Blended Feature Reconstruction (arxiv.org)
3 points by PaulHoule on Oct 27, 2023 | hide | past | pdf | discuss on HN

In plain words: It stitches photos by predicting their fine frequency details and blending the two images in a hidden feature space before turning the result back into pixels, so edges stay sharp. Compared with earlier deep stitching, it fixes the usual blur and color mismatch while running faster.

Abstract · Implicit Neural Image Stitching

Existing frameworks for image stitching often provide visually reasonable stitchings. However, they suffer from blurry artifacts and disparities in illumination, depth level, etc. Although the recent learning-based stitchings relax such disparities, the required methods impose sacrifice of image qualities failing to capture high-frequency details for stitched images. To address the problem, we propose a novel approach, implicit Neural Image Stitching (NIS) that extends arbitrary-scale super-resolution. Our method estimates Fourier coefficients of images for quality-enhancing warps. Then, the suggested model blends color mismatches and misalignment in the latent space and decodes the features into RGB values of stitched images. Our experiments show that our approach achieves improvement in resolving the low-definition imaging of the previous deep image stitching with favorable accelerated image-enhancing methods. Our source code is available at https://github.com/minshu-kim/NIS.

Minsu Kim, Jaewon Lee, Byeonghun Lee, Sunghoon Im, Kyong Hwan Jin
arXiv:2309.01409 · cs.CV · submitted Sep 4, 2023 · updated Jan 22, 2024
abstract · pdf · html

add comment on HN