Speed Matters, a robust infrared and visible image matching method at real-time speed
R Chang, C Yang, H Zhang, H Xie, C Zhou… - Journal of Real-Time …, 2024 - Springer
R Chang, C Yang, H Zhang, H Xie, C Zhou, A Pan, Y Yang
Journal of Real-Time Image Processing, 2024•SpringerImage matching is a crucial step in executing many complex visual tasks, which involve
identifying the same or similar visual patterns across various images. Matching images
between infrared and visible becomes quite challenging due to the significant non-linear
intensity differences. In this paper, we propose using a lightweight network for feature
matching of infrared and visible images, combining global and local feature information, and
reducing computational costs, enabling real-time inference on most desktop-level GPUs. To …
identifying the same or similar visual patterns across various images. Matching images
between infrared and visible becomes quite challenging due to the significant non-linear
intensity differences. In this paper, we propose using a lightweight network for feature
matching of infrared and visible images, combining global and local feature information, and
reducing computational costs, enabling real-time inference on most desktop-level GPUs. To …
Abstract
Image matching is a crucial step in executing many complex visual tasks, which involve identifying the same or similar visual patterns across various images. Matching images between infrared and visible becomes quite challenging due to the significant non-linear intensity differences. In this paper, we propose using a lightweight network for feature matching of infrared and visible images, combining global and local feature information, and reducing computational costs, enabling real-time inference on most desktop-level GPUs. To fully leverage the powerful matching capabilities of existing state-of-the-art models, we introduce knowledge distillation to obtain more robust features. Moreover, to address the issue of insufficient datasets for network training in existing methods, we propose using image style transfer techniques to synthesize paired datasets of infrared and visible. Experimental results show that our method achieves results comparable to the most advanced methods in infrared and visible image matching. Furthermore, our method has a significant advantage in inference speed, which is beneficial for tasks that require real-time completion.
Springer
Showing the best result for this search. See all results