Threads (@sw_ai_life)
creative-aiai-tools
Original source

Marigold V2 — 單張照片深度估計 (Monocular Depth Estimation)

Summary

Marigold V2 by Huawei BayerLab — a diffusion transformer approach to monocular depth estimation from a single photo.

Key features:

  • Sharper boundary detection on fine/complex edges: hair, fur, grass blades
  • Based on Qwen-Image-Edit-2509 architecture
  • Trainable on a single 32GB GPU
  • Applications: convert regular photos to 3D, shift video camera angles, spatial understanding for AR, gaming, robotics

The original Marigold (prs-eth) won CVPR 2024 Oral + Best Paper Award Candidate. V2 extends the approach using diffusion transformers instead of the original UNet-based diffusion.