- PII
- S3034584725030036-1
- DOI
- 10.7868/S3034584725030036
- Publication type
- Article
- Status
- Published
- Authors
- Volume/ Edition
- Volume / Issue number 3
- Pages
- 27-39
- Abstract
- This paper presents a method for reconstructing the optical properties of objects in a real scene, based on a series of its images with the use of differentiable rendering. The main goal of this study is to develop an approach that enables the high-accuracy reconstruction of the optical characteristics of scene objects while minimizing the computational costs. Introduction considers the relevance of creating realistic models of virtual scenes for computer graphics, as well as their application in virtual reality, augmented reality, and animation. It is noted that, in order to achieve image realism, it is necessary to take into account the scene geometry, illumination parameters, and optical properties of objects. In this study, it is assumed that the scene geometry and light sources are known, and the main task is to reconstruct the optical properties of objects. Section 3 describes the main stages of the proposed approach. The first stage involves data preprocessing, during which the key image points characterized by high brightness and uniform distribution over scene objects are selected. This significantly reduces the amount of data required for optimization. Next, using numerical differentiation and backward ray tracing, luminance gradients are calculated based on the model parameters. The proposed algorithm takes into account both primary and secondary illumination, which improves the accuracy of reconstructing the optical characteristics of the scene. At the final stage, the parameters of the optical models are reconstructed using the ADAM method, improved with the Optuna library for automatic hyperparameter selection. Section 4 describes the experiments carried out on the Cornell Box scene. The result of reconstructing the optical properties is considered and the original and reconstructed luminances are compared. Certain limitations due to the duration of calculations and the sensitivity to data outliers are identified and discussed in detail. In Conclusions, the results are summarized and directions for further development are outlined, including the transfer of calculations to the GPU and the use of more complex models of optical properties to improve the accuracy and speed of the algorithm.
- Keywords
- рендеринг дифференцируемый рендеринг трассировка лучей рассеивание света реконструкция оптических свойств
- Date of publication
- 02.06.2025
- Year of publication
- 2025
- Number of purchasers
- 0
- Views
- 61
References
- 1. Veach E. Robust monte carlo methods for light transport simulation. Ph.D. Dissertation, Stanford University. 1998. P. 406.
- 2. Bogolepov D.K., Ulyanov D. GPU-Optimized Bidirectional Path Tracing. In Proc. of the 21th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision. 2013. P. 15.
- 3. Veach E., Guibas L.J. Metropolis Light Transport. In Proc. of the of the 24th Annual Conference on Computer Graphics and Interactive Techniques. 1997. P. 65-76.
- 4. Bitterli B., Jakob W., Novak J., Jarosz W. Reversible Jump Metropolis Light Transport Using Inverse Mappings. ACM Transactions on Graphics. 2017. T. 37. № 1. P. 1-12.
- 5. Gruson A., West R., Hachisuka T. Stratified Markov Chain Monte Carlo Light Transport. Computer Graphics Forum. 2020. V. 39. № 2. P. 351-362.
- 6. Jensen H.W. Global illumination using photon maps. Eurographics workshop on Rendering techniques. Springer, Vienna. 1996. P. 21-30.
- 7. Kato H., Beker D., Morariu M., Ando T., Matsuoka T., Kehl W., Gaidon A. Differentiable Rendering: A Survey. 2015.
- 8. Phong B.T. Illumination for computer generated pictures. Communications of ACM 18. 1975. V. 6. -P. 311-317.
- 9. Cook R.L., Torrance K.E. A Reflectance Model for Computer Graphics. ACM Transactions on Graphics. 1981. V. 1. № 3. P. 301-316.
- 10. Burley B. Physically Based Shading at Disney. ACM Transactions on Graphics (ACM SIGGRAPH). 2012. P. 7.
- 11. Loper M.M., Black M.J. OpenDR: An approximate differ entiable renderer. in ECCV. 2014.
- 12. Kato H., Ushiku Y., Harada T. Neural 3D Mesh Renderer. in CVPR. 2018.
- 13. Genova T., Cole F., Maschinot A., Sarna A., Vlasic D., Freeman W.T. Unsupervised Training for 3D Morphable Model Regression. in CVPR. 2018.
- 14. Rhodin H., Robertini N., Richardt C., Seidel H.-P., Theobalt C. A. Versatile Scene Model with Differentiable Visibility Applied to Generative Pose Estimation. in ICCV. 2015.
- 15. Kajiya, J.T. The rendering equation. ACM SIGGRAPH Computer Graphics. 1986. V. 20. № 4. P. 143-150.
- 16. Li T.M., Aittala M., Durand F., Lehtinen J. Differentiable monte carlo ray tracing through edge sampling. ACM Trans. Graph. 2018. V. 37. № 6. P. 11.
- 17. Zhang C., Wu L., Zheng C., Gkioulekas I., Ramamoorthi R., Zhao S. A differential theory of radiative transfer. ACM Trans. Graph. 2019. V. 38. № 6. P. 16.
- 18. Shuang Z., Wenzel J., Tzu-Mao L. Physics-Based Differentiable Rendering: From Theory to Implementation. 2020.
- 19. Merlin N., Delio V., Tizian Z., Wenzel J. Mitsuba 2: A Retargetable Forward and Inverse Renderer. 2019.
- 20. Сорокин М.И., Жданов Д.Д., Жданов А.Д., Потемин И.С., Богданов Н.Н. Восстановление параметров освещения в системах смешанной реальности с помощью технологии сверточных нейронных сетей по RGBD-изображениям. Программирование. 2020. № 3. С. 24-34.
- 21. Кинёв И.Е., Куприянов С.И. Восстановление оптических свойств объектов сцены методом дифференцируемого рендеринга с применением оптимизации выбора наиболее важных точек. Труды конференции ГрафиКон - 2024. 2024. C. 179-193.
- 22. Zhdanov D.D., Guskov K.S., Zhdanov A.D., Potemin I.S., Kulbako A.Y., Alexandrov Y.V., Lopatin A.V., Sokolov V.G. Using a Federated Approach to Synthesize Images of Confidential Scene Models. Light & Engineering. 2024. V. 32. № 4. P. 89-102.
- 23. Optuna - Ahyperparameter Optimization framework. https://optuna.org.2024
- 24. Adam - PyToch 2.5 documentation. https://pytorch.org/docs/stable/generated/torch.optim.Adam.html.2024
