Misplaced Pages

3D Morphable Model

Article snapshot taken from Wikipedia with creative commons attribution-sharealike license. Give it a read and then ask your questions in the chat. We can research this topic together.
Statistical generative model for 3D textured objects
It has been suggested that 3D Face Morphable Model be merged into this article. (Discuss) Proposed since August 2024.

In computer vision and computer graphics, the 3D Morphable Model (3DMM) is a generative technique that uses methods of statistical shape analysis to model 3D objects. The model follows an analysis-by-synthesis approach over a dataset of 3D example shapes of a single class of objects (e.g., face, hand). The main prerequisite is that all the 3D shapes are in a dense point-to-point correspondence, namely each point has the same semantical meaning over all the shapes. In this way, we can extract meaningful statistics from the dataset and use it to represent new plausible shapes of the object's class. Given a 2D image, we can represent its 3D shape via a fitting process or generate novel shapes by directly sampling from the statistical shape distribution of that class.

The question that initiated the research on 3DMMs was to understand how a visual system could handle the vast variety of images produced by a single class of objects and how these can be represented. The primary assumption in developing 3DMMs was that prior knowledge about object classes was crucial in vision. 3D Face Morphable Models are the most popular 3DMMs since they were the first to be developed in the field of facial recognition. It has also been applied to the whole human body, the hand, the ear, cars, and animals.

See also

References

  1. Luthi, Marcel; Gerig, Thomas; Jud, Christoph; Vetter, Thomas (2018-08-01). "Gaussian Process Morphable Models". IEEE Transactions on Pattern Analysis and Machine Intelligence. 40 (8): 1860–1873. arXiv:1603.07254. doi:10.1109/TPAMI.2017.2739743. ISSN 0162-8828. PMID 28816655.
  2. Egger, Bernhard; Smith, William A. P.; Tewari, Ayush; Wuhrer, Stefanie; Zollhoefer, Michael; Beeler, Thabo; Bernard, Florian; Bolkart, Timo; Kortylewski, Adam; Romdhani, Sami; Theobalt, Christian; Blanz, Volker; Vetter, Thomas (2020-06-09). "3D Morphable Face Models—Past, Present, and Future". ACM Trans. Graph. 39 (5): 157:1–157:38. doi:10.1145/3395208. hdl:21.11116/0000-0007-1CF5-6. ISSN 0730-0301.
  3. Allen, Brett; Curless, Brian; Popović, Zoran (2003-07-01). "The space of human body shapes: reconstruction and parameterization from range scans". ACM Trans. Graph. 22 (3): 587–594. doi:10.1145/882262.882311. ISSN 0730-0301.
  4. Khamis, Sameh; Taylor, Jonathan; Shotton, Jamie; Keskin, Cem; Izadi, Shahram; Fitzgibbon, Andrew (June 2015). "Learning an efficient model of hand shape variation from depth images". 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. pp. 2540–2548. doi:10.1109/CVPR.2015.7298869. ISBN 978-1-4673-6964-0.
  5. Dai, Hang; Pears, Nick; Smith, William (May 2018). "A Data-Augmented 3D Morphable Model of the Ear". 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018). IEEE. pp. 404–408. doi:10.1109/FG.2018.00065. ISBN 978-1-5386-2335-0.
  6. Jones, M.J.; Poggio, T. (1998). "Multidimensional morphable models". Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271). Narosa Publishing House. pp. 683–688. doi:10.1109/ICCV.1998.710791. ISBN 978-81-7319-221-0.
  7. Sun, Yifan; Murata, Noboru (March 2020). "CAFM: A 3D Morphable Model for Animals". 2020 IEEE Winter Applications of Computer Vision Workshops (WACVW). IEEE. pp. 20–24. doi:10.1109/WACVW50321.2020.9096941. ISBN 978-1-7281-7162-3.

External links

Stub icon

This computer graphics–related article is a stub. You can help Misplaced Pages by expanding it.

Categories: