Learning Rain Location Prior for Nighttime Deraining

Open Access
Authors
Publication date 2023
Book title 2023 IEEE/CVF International Conference on Computer Vision
Book subtitle ICCV 2023 : Paris, France, 2-6 October 2023 : proceedings
ISBN
  • 9798350307191
ISBN (electronic)
  • 9798350307184
Event 2023 IEEE/CVF International Conference on Computer Vision (ICCV)
Pages (from-to) 13102-13111
Publisher Los Alamitos, California: IEEE Computer Society
Organisations
  • Faculty of Science (FNWI) - Informatics Institute (IVI)
Abstract
Rain can significantly degrade image quality and visibility, making deraining a critical area of research in computer vision. Despite recent progress in learning-based deraining methods, there is a lack of focus on nighttime deraining due to the unique challenges posed by non-uniform local illuminations from artificial light sources. Rain streaks in these scenes have diverse appearances that are tightly related to their relative positions to light sources, making it difficult for existing deraining methods to effectively handle them. In this paper, we highlight the importance of rain streak location information in nighttime deraining. Specifically, we propose a Rain Location Prior (RLP) that is learned implicitly from rainy images using a recurrent residual model. This learned prior contains location information of rain streaks and, when injected into deraining models, can significantly improve their performance. To further improve the effectiveness of the learned prior, we also propose a Rain Prior Injection Module (RPIM) to modulate the prior before injection, increasing the importance of features within rain streak areas. Experimental results demonstrate that our approach outperforms existing state-of-the-art methods by about 1dB and effectively improves the performance of deraining models. We also evaluate our method on real night rainy images to show the capability to handle real scenes with fully synthetic data for training. Our method represents a significant step forward in the area of nighttime deraining and highlights the importance of location information in this challenging problem. The code is publicly available at https://github. com/zkawfanx/RLP.
Document type Conference contribution
Note With supplemental material
Language English
Published at https://doi.org/10.1109/ICCV51070.2023.01209
Published at https://openaccess.thecvf.com/content/ICCV2023/html/Zhang_Learning_Rain_Location_Prior_for_Nighttime_Deraining_ICCV_2023_paper.html
Other links https://github.com/zkawfanx/RLP https://www.proceedings.com/72328.html
Downloads
Supplementary materials
Permalink to this page
Back