Enhancing Clothed Human Reconstruction from Single-view Image with Diffusion Models and Parameterized Mesh Guidance
Author Names:
Jian He, Fantoz Jack, Changlong Zhou
Author Affiliation:
Author Email:
meshenzcl@163.com
Publication Date:
February 26, 2026
Page numbers:
DOI Number:
https://doi.org/10.1177/14727978251385191
Abstract:
Reconstructing clothed human models from single-view images is a critical research topic within computer vision and computer graphics. The primary goal is to generate a geometrically accurate and visually realistic 3D representation of a person—including detailed body morphology and garment structure—based solely on a 2D image captured from one perspective. The fundamental challenge in this domain is the reliable inference and reconstruction of body shape, surface texture, and intricate clothing attributes, particularly for regions occluded or absent in the observed view. To overcome these limitations, we introduce a novel clothed human reconstruction method that incorporates two core components: a back-view generation module and a clothed human reconstruction module. The back-view generation module leverages a state-of-the-art image diffusion technique to produce a plausible back-view image that aligns with the semantic and perceptual characteristics of the input image, thereby enriching the available information for subsequent reconstruction. In the clothed human reconstruction module, we use an estimated human parameterized mesh as a 3D prior to guide the reconstruction, alleviating the depth ambiguity typically caused by relying solely on 2D image information. Experimental results on the publicly available 3D human datasets CAPE and CustomHumans highlight the fact that our method produces more realistic back-view images, and the reconstructed human models exhibit higher similarity in terms of shape, pose, and texture to the input images.
Keywords:
clothed human reconstruction, single-view image, image diffusion model, human parameterized mesh
You need to register before accessing this content.