Luce: Relightable Gaussians for 3D Asset Generation
Apple's Luce unifies 3D geometry and PBR materials in a single Gaussian representation—closing a gap between image-to-3D speed and rendering-pipeline compatibility.
Why it matters
A research breakthrough in 3D asset generation that combines geometry capture with physically based rendering properties in one model, enabling faster integration into professional creative workflows. Practitioners building 3D tools and content pipelines would adopt this if it ships as open weights or accessible API.
The key facts
11 to knowApple Research paper on relightable 3D Gaussian representation
Unified voxelized multimodal Gaussian cloud for geometry + PBR (albedo, metallic-roughness, normals)
Variational autoencoder compression into material-aware latent space
Image-to-3D generation with rendering-pipeline compatibility
Addresses gap between fast 3D capture and professional asset requirements
Voxelized multimodal Gaussian cloud representation
Unified PBR modalities: albedo, metallic-roughness, surface normals
Variational autoencoder for material-aware latent compression
Apple Research authorship
Image-to-3D generation with relighting capability
Published August 2026
Go to the source
Apple Machine Learningmachinelearning.apple.com
Publisher excerpt: High-fidelity image-to-3D generation requires a 3D representation that captures both geometry and appearance. To support relighting and integration into standard rendering pipelines, the representation should include physically based rendering (PBR) modalities such as albedo, metallic-roughness,…