3D Object Positioning Using Differentiable Multimodal Learning
S Zanyk-McLean, K Kumar, P Navratil - arXiv preprint arXiv:2309.03177, 2023 - arxiv.org
S Zanyk-McLean, K Kumar, P Navratil
arXiv preprint arXiv:2309.03177, 2023•arxiv.orgThis article describes a multi-modal method using simulated Lidar data via ray tracing and
image pixel loss with differentiable rendering to optimize an object's position with respect to
an observer or some referential objects in a computer graphics scene. Object position
optimization is completed using gradient descent with the loss function being influenced by
both modalities. Typical object placement optimization is done using image pixel loss with
differentiable rendering only, this work shows the use of a second modality (Lidar) leads to …
image pixel loss with differentiable rendering to optimize an object's position with respect to
an observer or some referential objects in a computer graphics scene. Object position
optimization is completed using gradient descent with the loss function being influenced by
both modalities. Typical object placement optimization is done using image pixel loss with
differentiable rendering only, this work shows the use of a second modality (Lidar) leads to …
This article describes a multi-modal method using simulated Lidar data via ray tracing and image pixel loss with differentiable rendering to optimize an object's position with respect to an observer or some referential objects in a computer graphics scene. Object position optimization is completed using gradient descent with the loss function being influenced by both modalities. Typical object placement optimization is done using image pixel loss with differentiable rendering only, this work shows the use of a second modality (Lidar) leads to faster convergence. This method of fusing sensor input presents a potential usefulness for autonomous vehicles, as these methods can be used to establish the locations of multiple actors in a scene. This article also presents a method for the simulation of multiple types of data to be used in the training of autonomous vehicles.
arxiv.org
Showing the best result for this search. See all results