Huawei 3D Modeling Kit is another
technological opening of Huawei in the field of graphics and images. For
application developers with 3D models and animation production capabilities, it
provides automatic generation of 3D object models and PBR material generation
functions based on AI technology to achieve efficient production of 3D digital
content. In this blog post, we will discuss some of the details of 3D modeling.
Some Details of 3D Modeling
Sources of 3D models
Derived from Huawei's
self-developed algorithm, the 3D Modeling Kit not only supports all Android
models but also greatly reduces the hardware threshold dependence. Users can
also estimate the depth information and complete the collection by using the
common view information matching between the captured images without special
hardware (RGBD\LiDAR, etc.). With an ordinary RGB mobile phone, you can
generate high-precision 3D geometric models up to 2K-4K with one click.
Compared with traditional manual production methods by professionals, simple
integration can realize data acquisition, upload, model download, preview, and
other work, saving modeling content costs and improving modeling efficiency.
What is the Difference between 3D Modeling
and AR Technology?
The concept of 3D modeling itself
is very broad, the object of modeling can be an object, a human body, or even a
large scene. Focusing on object modeling, 3D object reconstruction is the
generation of digital three-dimensional geometric structures, as well as
high-precision textures. Meet the input requirements of virtual reality VR and
augmented reality AR. AR is a specific application scenario of 3D technology,
and 3D modeling can provide digital resources for these scenarios.
What Techniques are Behind the 3D
Modeling Kit?
3D Modeling Kit In the main modules
including camera pose estimation, geometric structure generation, texture
generation and so on, through Huawei's advanced 3D artificial intelligence
technology, it can complete the reconstruction of 3D objects based on pure RGB
images. Camera pose estimation can solve the correlation and transformation
relationship between cameras. The geometry structure generation can estimate
the depth of the object by matching the information of the overlapping regions
of multiple perspectives, which is the most important step in generating the
topological information of the object's surface. The texture generation adds
high-precision, clear color texture to the surface of the object, giving the
user the best visual experience.
In What Fields and Scenarios can
the 3D Modeling Kit Work?
3D Modeling Kit supports background
segmentation of objects, which can reconstruct high-quality models without
background. Developers can apply it in the field of e-commerce, the production
of commodity models, etc. In the cultural industry, cultural relics can be
applied to digital preservation and multimedia exhibition after 3D digital
modeling; Developers can also use the 3D Modeling Kit to innovate in teaching
demonstrations, game animation, short video production, and many other fields.
What are the Future Trends of 3D
Modeling Kit?
In terms of object Modeling, the 3D
Modeling Kit will support more types of modeling in the future, such as human
modeling, scene modeling, etc.; At the same time, in the future, material
segmentation technology will be gradually opened to help make material
production more intelligent and convenient. The 3D Modeling Kit will also
actively explore animation production, opening up motion capture and
emotion-driven capabilities in the future.
Successful Case
GoAct is a 3D scanning creation
application that everyone can use, integrating 3D Modeling Kit capabilities to
create high-quality 3D models by taking photos, creating 3D social sharing
applications, and making 3D scanning creation easier, and 3d modelling app on the huawei
phones can particularly accept lower equipment (only rely on mobile devices
(phones/tablets, etc.) with RGB cameras Comprehensive coverage of the variety
(support for rich objects, materials and action types, to meet a variety of
application scenarios.) it is also easy to operate (simple shooting can obtain
3D model or PBR material mapping or human 3D bone key point data, to achieve
"what you see is what you get").
Conclusion
In general, Huawei's 3D modeling
kit is the product of technology upgrading, and it can also be easily used by
people. Just a mobile phone can connect to 3D. Is this not cyberpunk? Perhaps,
as technology matures, our world will indeed become a meta-universe.