VideoMat: Extracting PBR Materials from Video Diffusion Models

📝 Original Info

• Title: VideoMat: Extracting PBR Materials from Video Diffusion Models
• ArXiv ID: 2506.09665
• Date: 2025-06-11
• Authors: ** 논문에 저자 정보가 제공되지 않았습니다. (가능하면 원문 PDF 혹은 arXiv 페이지에서 확인 바랍니다.) **

📝 Abstract

We leverage finetuned video diffusion models, intrinsic decomposition of videos, and physically-based differentiable rendering to generate high quality materials for 3D models given a text prompt or a single image. We condition a video diffusion model to respect the input geometry and lighting condition. This model produces multiple views of a given 3D model with coherent material properties. Secondly, we use a recent model to extract intrinsics (base color, roughness, metallic) from the generated video. Finally, we use the intrinsics alongside the generated video in a differentiable path tracer to robustly extract PBR materials directly compatible with common content creation tools.

💡 Deep Analysis

📄 Full Content

Reference