TINJAUAN LITERATUR SISTEMATIS KLASIFIKASI CUACA BERBASIS CITRA MENGGUNAKAN METODE DEEP LEARNING
DOI:
https://doi.org/10.33480/inti.v21i1.8615Keywords:
Deep Learning, Road Weather Detection, Systematic Literature Review, Weather Classification, Weather RecognitionAbstract
Image-based weather recognition has become an important research area due to its applications in intelligent transportation systems, autonomous vehicles, road condition monitoring, and computer vision. Recent advances in deep learning have significantly improved the automatic recognition of diverse weather conditions. However, the variety of image sources, datasets, deep learning architectures, and weather scenarios makes it challenging to obtain a comprehensive understanding of current research trend. Therefore, this study aims to identify the image sources and datasets used in weather recognition research, analyze dominant deep learning approaches, and investigate the weather conditions most frequently addressed in image-based weather recognition and road weather detection. A Systematic Literature Review (SLR) following the PRISMA 2020 guidelines was conducted using the Scopus database. From an initial set of 603 retrieved articles, 73 studies met the predefined inclusion criteria and were selected for further analysis. The results indicate that public datasets such as DAWN, RTTS, Foggy Cityscapes, nuScenes, WeatherDataset-4, and WeatherNet are among the most frequently used data sources. Convolutional Neural Networks (CNNs) remain the dominant approach, although the adoption of Transformer-based models, Vision Transformers, YOLO, Multimodal Fusion, and Multi-Task Learning has increased considerably in recent years. Furthermore, rain, fog, and snow are the most extensively investigated weather conditions due to their significant impact on visibility and perception system performance. The findings provide a comprehensive overview of recent developments in deep learning-based weather recognition and offer valuable insights and directions for future research.
Downloads
References
Abdelraouf, A., Abdel-Aty, M., & Wu, Y. (2022). Using Vision Transformers for Spatial-Context-Aware Rain and Road Surface Condition Detection on Freeways. IEEE Transactions on Intelligent Transportation Systems, 23(10), 18546–18556. https://doi.org/10.1109/TITS.2022.3150715
Acuña-Escobar, D., Intriago-Pazmiño, M., & Ibarra-Fiallo, J. (2026). MVP—A Multistep Visual Pretraining Pipeline for Efficient Weather Recognition. IEEE Access, 14, 738–750. https://doi.org/10.1109/ACCESS.2025.3648029
Aloufi, N., Alnori, A., & Basuhail, A. (2024). Enhancing Autonomous Vehicle Perception in Adverse Weather: A Multi Objectives Model for Integrated Weather Classification and Object Detection. Electronics, 13(15). https://doi.org/10.3390/electronics13153063
Alzanin, S. (2025). Explainable artificial intelligence with temporal convolutional networks for adverse weather condition detection in driverless vehicles. Scientific Reports, 15. https://doi.org/10.1038/s41598-025-05136-4
Biswas, S., Kumar, J., Mitra, A., Ganesh, A., & Singh, P. (2026). Multi-dimensional attention transformer for vehicle and pedestrian detection in adverse weather. Scientific Reports, 16(1), 1–19. https://doi.org/10.1038/s41598-026-40319-7
Broughton, G., Janota, J., Blaha, J., Rouček, T., Simon, M., Vintr, T., Yang, T., Yan, Z., & Krajník, T. (2022). Embedding Weather Simulation in Auto-Labelling Pipelines Improves Vehicle Detection in Adverse Conditions. Sensors, 22(22), 1–22. https://doi.org/10.3390/s22228855
Chen, L., Luo, F., Wang, F., & Lv, L. (2025). Research on Weather Recognition Based on a Field Programmable Gate Array and Lightweight Convolutional Neural Network. Electronics, 14(9). https://doi.org/10.3390/electronics14091740
Chen, S., Shu, T., Zhao, H., & Tang, Y. Y. (2023). MASK-CNN-Transformer for real-time multi-label weather recognition. Knowledge-Based Systems, 278, 110881. https://doi.org/10.1016/j.knosys.2023.110881
Chen, W., Yan, F., Wang, N., He, J., & Wu, Y. (2025). WCGNet: A Weather Codebook and Gating Fusion for Robust 3D Detection Under Adverse Conditions. Electronics (Switzerland), 14(22), 1–14. https://doi.org/10.3390/electronics14224379
Cote, M. P., Splitt, M. E., Lazarus, S. M., White, R. T., & Baker, C. G. (2025). Ground-Based Cloud Type Classification for Aviation Weather Hazard Detection Using Deep Learning. IEEE Access, 13, 203027–203040. https://doi.org/10.1109/ACCESS.2025.3634057
Dasu, B. T., Reddy, M. V., Kumar, K. V., Chithaluru, P., Ahmed, N., & Abd Elminaam, D. S. (2026). A self-attention driven multi-scale object detection framework for adverse weather in smart cities. Scientific Reports, 16(1), 1–22. https://doi.org/10.1038/s41598-025-31660-4
Dong, D., & Li, Z. (2021). Smartphone Sensing of Road Surface Condition and Defect Detection. Sensors, 21(16), 5433. https://doi.org/10.3390/s21165433
Esmaeil Abbasi, A., Mangini, A. M., & Fanti, M. P. (2024). Object and Pedestrian Detection on Road in Foggy Weather Conditions by Hyperparameterized YOLOv8 Model. Electronics (Switzerland), 13(18). https://doi.org/10.3390/electronics13183661
Fan, G.-F., Peng, L.-L., Hong, W.-C., & Liao, Y.-S. (2018). Applications of the Gray Degree-Based Factor Analysis on Cloud Image to Improve the Accuracy of Weather Recognition. Iranian Journal of Science and Technology, Transactions A: Science, 42(4), 2117–2129. https://doi.org/10.1007/s40995-017-0449-9
Gao, R., Omar, M. H., & Mahmuddin, M. (2025). YOLO-DER: A Dynamic Enhancement Routing Framework for Adverse Weather Vehicle Detection. Electronics (Switzerland), 14(24). https://doi.org/10.3390/electronics14244851
Gragnaniello, D., Greco, A., Sansone, C., & Vento, B. (2025). Real-time joint recognition of weather and ground surface conditions by a multi-task deep network. Engineering Applications of Artificial Intelligence, 139(PA), 109543. https://doi.org/10.1016/j.engappai.2024.109543
Gupta, H., Kotlyar, O., Andreasson, H., & Lilienthal, A. J. (2024). Video WeAther RecoGnition (VARG): An Intensity-Labeled Video Weather Recognition Dataset. Journal of Imaging, 10(11), 1–16. https://doi.org/10.3390/jimaging10110281
Huang, F., Zheng, J., Liu, X., Shen, Y., & Chen, J. (2024). Polarization of road target detection under complex weather conditions. Scientific Reports, 14(1), 30348. https://doi.org/10.1038/s41598-024-80830-3
Huang, J., Chen, X., Jin, Q., & Li, P. (2025). A Fusion Estimation Method for Tire-Road Friction Coefficient Based on Weather and Road Images. Lubricants, 13(10), 1–22. https://doi.org/10.3390/lubricants13100459
Ibrahim, M. R., Haworth, J., & Cheng, T. (2019). WeatherNet: Recognising Weather and Visual Conditions from Street-Level Images Using Deep Residual Learning. ISPRS International Journal of Geo-Information, 8(12). https://doi.org/10.3390/ijgi8120549
Jakubec, M., Lieskovska, E., Bucko, B., & Zabovska, K. (2024). Pothole detection in adverse weather: leveraging synthetic images and attention-based object detection methods. Multimedia Tools and Applications, 83(39), 86955–86982. https://doi.org/10.1007/s11042-024-19723-6
Jiao, T., Chen, Y., Feng, X., Guo, C., & Song, J. (2026). Semantic-Enhanced Bidirectional Multimodal Fusion for 3D Object Detection Under Adverse Weather. Applied Sciences (Switzerland), 16(6). https://doi.org/10.3390/app16062943
Jing, Z., Li, S., & Zhang, Q. (2024). YOLOv8-STE: Enhancing Object Detection Performance Under Adverse Weather Conditions with Deep Learning. Electronics (Switzerland), 13(24). https://doi.org/10.3390/electronics13245049
Johansen, A. S., Nasrollahi, K., Escalera, S., & Moeslund, T. B. (2023). Who Cares about the Weather? Inferring Weather Conditions for Weather-Aware Object Detection in Thermal Images. Applied Sciences (Switzerland), 13(18). https://doi.org/10.3390/app131810295
Ju, H., Nalcakan, Y., Park, I., Jin, Y., Yeo, S., & Kim, S. (2025). Multi-Modal Cross-Attention-Based Multi-Label Weather and Severity Level Classification. IEEE Access, 13(October), 215882–215896. https://doi.org/10.1109/ACCESS.2025.3645363
Kalkan, M., Bostancı, G. E., Güzel, M. S., Kalkan, B., Özsarı, Ş., Soysal, Ö., & Köse, G. (2022). Cloudy/clear weather classification using deep learning techniques with cloud images. Computers and Electrical Engineering, 102(June), 108271. https://doi.org/10.1016/j.compeleceng.2022.108271
Zhang, Q., Wang, L., Meng, H., Zhang, Z., & Yang, C. (2024). Ship Detection in Maritime Scenes under Adverse Weather Conditions. Remote Sensing, 16(9), 1567. https://doi.org/10.3390/rs16091567
Li, C.-H. G., Chen, K.-W., Lai, C.-C., & Hwang, Y.-T. (2021). Real-Time Rain Detection and Wiper Control Employing Embedded Deep Learning. IEEE Transactions on Vehicular Technology, 70(4), 3256–3266. https://doi.org/10.1109/TVT.2021.3066677
Li, J., Deng, Q. W., Gao, W. X., Yang, B., Jia, L., Zhou, J., & Pu, H. B. (2025). DSF-YOLO for robust multiscale traffic sign detection under adverse weather conditions. Scientific Reports, 15(1), 1–17. https://doi.org/10.1038/s41598-025-02877-0
Li, J., & Luo, X. (2023). A Study of Weather-Image Classification Combining VIT and a Dual Enhanced-Attention Module. Electronics, 12(5), 1213. https://doi.org/10.3390/electronics12051213
Li, P., Ni, J., & Tao, D. (2025). End-to-End Cascaded Image Restoration and Object Detection for Rain and Fog Conditions. IET Computer Vision, 19(1). https://doi.org/10.1049/cvi2.70021
Li, X., Li, W., Yan, X., Wang, W., & Bu, F. (2026). Object Detection Method Based on Polarimetric Features and PFOD-Net Under Adverse Weather Conditions. Applied Sciences, 16(4), 1698. https://doi.org/10.3390/app16041698
Lin, F., & Wang, T. (2017). Metric learning for weather image classification. https://doi.org/10.1007/s11042-017-4948-7
Liu, B., Jin, J., Zhang, Y., & Sun, C. (2025). WRRT-DETR: Weather-Robust RT-DETR for Drone-View Object Detection in Adverse Weather. Drones, 9(5). https://doi.org/10.3390/drones9050369
Lv, K., Yao, C., Huang, K., Ye, S., & Zhuang, J. (2026). FAD-DETR: A Frequency-Adaptive and Haze-Aware Detection Transformer for Autonomous Driving in Adverse Weather. Applied Sciences (Switzerland), 16(6), 1–20. https://doi.org/10.3390/app16062913
Moroto, Y., Maeda, K., Ogawa, T., & Haseyama, M. (2024). Snow- or ice-covered road detection in winter road surface conditions using deep neural networks. Computer-Aided Civil and Infrastructure Engineering, 39(19), 2935–2950. https://doi.org/10.1111/mice.13233
Noh, I., Doh, H.-W., Kim, S.-O., Kim, S.-H., Shin, S., & Lee, S.-J. (2021). Machine Learning-Based Hourly Frost-Prediction System Optimized for Orchards Using Automatic Weather Station and Digital Camera Image Data. Atmosphere, 12(7). https://doi.org/10.3390/atmos12070846
Page, M., Mckenzie, J., Bossuyt, P., Boutron, I., Hoffmann, T., Mulrow, C., Shamseer, L., Tetzlaff, J., Akl, E., Brennan, S., Chou, R., Glanville, J., Grimshaw, J., Hróbjartsson, A., Lalu, M., Li, T., Loder, E., Mayo-Wilson, E., Mcdonald, S., & Moher, D. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 372, n71. https://doi.org/10.1136/bmj.n71
Park, J.-I., Jo, S., Seo, H.-T., & Park, J. (2025). Real-Time Snowfall Recognition and Object Tracking System for Autonomous Driving in Adverse Snowy Weather. IEEE Access, 13, 166987–167000. https://doi.org/10.1109/ACCESS.2025.3613456
Sakhai, M., Mazurek, S., Caputa, J., Argasiński, J. K., & Wielgosz, M. (2024). Spiking Neural Networks for Real-Time Pedestrian Street-Crossing Detection Using Dynamic Vision Sensors in Simulated Adverse Weather Conditions. Electronics (Switzerland), 13(21). https://doi.org/10.3390/electronics13214280
Salis, M., Atto, A. M., Ferraris, S., & Meo, R. (2025). Time Distributed Deep Learning Models for Purely Exogenous Forecasting: Application to Water Table Depth Predictions Using Weather Image Time Series. Environmental Modelling and Software, 193(November 2024), 106568. https://doi.org/10.1016/j.envsoft.2025.106568
Samo, M., Mafeni Mase, J. M., & Figueredo, G. (2023). Deep Learning with Attention Mechanisms for Road Weather Detection. Sensors, 23(2), 798. https://doi.org/10.3390/s23020798
Senior-Williams, J., Hogervorst, F., Platen, E., Kuijt, A., Onderwater, J., & Tervo, R. (2024). The classification of tropical storm systems in infrared geostationary weather satellite images using transfer learning. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 17, 5234–5244. https://doi.org/10.1109/JSTARS.2024.3365852.
Sharma, A., Chaudhary, S., Malhotra, J., Khichar, S., & Wuttisittikulkij, L. (2022). Photonic Sensor for Multiple Targets Detection under Adverse Weather Conditions in Autonomous Vehicles. Journal of Sensor and Actuator Networks, 11(4). https://doi.org/10.3390/jsan11040060
Sharma, T., Debaque, B., Duclos, N., Chehri, A., Kinder, B., & Fortier, P. (2022). Deep Learning-Based Object Detection and Scene Perception under Bad Weather Conditions. Electronics (Switzerland), 11(4), 1–11. https://doi.org/10.3390/electronics11040563
Singh Gill, H., & Singh Khehra, B. (2020). Efficient image classification technique for weather degraded fruit images. IET Image Processing, 14(14), 3463–3470. https://doi.org/10.1049/iet-ipr.2018.5310
Song, Y., & Lu, Y. (2025). A Review of Unmanned Visual Target Detection in Adverse Weather. Electronics (Switzerland), 14(13), 1–38. https://doi.org/10.3390/electronics14132582
Tabassum, N., & El-Sharkawy, M. (2024). Vehicle Detection in Adverse Weather: A Multi-Head Attention Approach with Multimodal Fusion. Journal of Low Power Electronics and Applications, 14(2). https://doi.org/10.3390/jlpea14020023
Tan, L., Xuan, D., Xia, J., & Wang, C. (2020). Weather Recognition Based on 3C-CNN. KSII Transactions on Internet and Information Systems, 14(8), 3567–3582. https://doi.org/10.3837/tiis.2020.08.024
Tarmissi, K., Mengash, H., Negm, N., Said, Y., & Al-Sharafi, A. (2024). Explainable artificial intelligence with fusion-based transfer learning on adverse weather conditions detection using complex data for autonomous vehicles. AIMS Mathematics, 9, 35678–35701. https://doi.org/10.3934/math.20241693
Tog, M., Ergen, B., & Co, Z. (2020). Detection of weather images by using spiking neural networks of deep learning models. https://doi.org/10.1007/s00521-020-05388-3
Tran-Trung, K., Duong Thi Hong, H., & Truong Hoang, V. (2022). Weather Forecast Based on Color Cloud Image Recognition under the Combination of Local Image Descriptor and Histogram Selection. Electronics (Switzerland), 11(21), 0–14. https://doi.org/10.3390/electronics11213460
Tumas, P., Serackis, A., & Nowosielski, A. (2021). Augmentation of severe weather impact to far-infrared sensor images to improve pedestrian detection system. Electronics (Switzerland), 10(8), 1–16. https://doi.org/10.3390/electronics10080934
Wang, J., Xu, M., Xue, H., Huo, Z., & Luo, F. (2024). Joint image restoration for object detection in snowy weather. IET Computer Vision, 18(6), 759–771. https://doi.org/10.1049/cvi2.12274
Wang, Q., Zhou, Z., & Zhang, Z. (2026). PF-ConvNeXt: An Adverse Weather Recognition Network for Autonomous Driving Scenes. Electronics (Switzerland), 15(5). https://doi.org/10.3390/electronics15050920
Wang, S., Xie, X., Li, M., Wang, M., Yang, J., Li, Z., Zhou, X., & Zhou, Z. (2024). An Adaptive Multimodal Fusion 3D Object Detection Algorithm for Unmanned Systems in Adverse Weather. Electronics (Switzerland), 13(23), 1–22. https://doi.org/10.3390/electronics13234706
Wang, Z., Zhou, P., Zhang, S., Du, W., & Chen, X. (2025). Enhancing Parking Spot Detection in Extreme Weather Conditions: A Deep Learning Approach with Simulated Weather Augmentation. IEEE Access, 13(July), 147163–147172. https://doi.org/10.1109/ACCESS.2025.3600276
Xia, J., Xuan, D., Tan, L., & Xing, L. (2020). ResNet15: Weather Recognition on Traffic Road with Deep Convolutional Neural Network. Advances in Meteorology, 2020(1), 6972826. https://doi.org/10.1155/2020/6972826
Xiao, H., Zhang, F., Shen, Z., Wu, K., & Zhang, J. (2021). Classification of Weather Phenomenon From Images by Using Deep Convolutional Neural Network. Earth and Space Science, 8(5), 1–9. https://doi.org/10.1029/2020EA001604
Xiaoming, H., & Yafeng, Q. (2023). Weather recognition method based on convolutional neural network and feature fusion. Journal of Applied Optics, 44(2), 323–329. https://doi.org/10.5768/JAO202344.0202004
Xie, K., Huang, L., Zhang, W., Qin, Q., & Lyu, L. (2022). A CNN-based multi-task framework for weather recognition with multi-scale weather cues. Expert Systems with Applications, 198(March), 116689. https://doi.org/10.1016/j.eswa.2022.116689
Xie, K., Wei, Z., Huang, L., Qin, Q., & Zhang, W. (2021). Graph convolutional networks with attention for multi-label weather recognition. Neural Computing and Applications, 33(17), 11107–11123. https://doi.org/10.1007/s00521-020-05650-8
Yang, H., Liu, L., Zhang, J., & Guo, K. (2025). A cross-environmental algorithm for multi-scale road crack detection under extreme weather conditions. Computer-Aided Civil and Infrastructure Engineering, 40(21), 3359–3384. https://doi.org/10.1111/mice.70014
Yao, J., Fan, X., Li, B., & Qin, W. (2022). Adverse Weather Target Detection Algorithm Based on Adaptive Color Levels and Improved YOLOv5. Sensors, 22(21), 1–21. https://doi.org/10.3390/s22218577
Yildirim, M., Çinar, A., & Cengİl, E. (2022). Classification of the weather images with the proposed hybrid model using deep learning, SVM classifier, and mRMR feature selection methods. Geocarto International, 37(9), 2735–2745. https://doi.org/10.1080/10106049.2022.2034989
Yoon, J. H., Jung, J. W., & Yoo, S. B. (2024). Auxcoformer: Auxiliary and Contrastive Transformer for Robust Crack Detection in Adverse Weather Conditions. Mathematics, 12(5). https://doi.org/10.3390/math12050690
Yu, T., Kuang, Q., Hu, J., Zheng, J., & Li, X. (2021). Global-Similarity Local-Salience Network for Traffic Weather Recognition. IEEE Access, 9, 4607–4615. https://doi.org/10.1109/ACCESS.2020.3048116
Yuan, Y., Wei, Y., Guo, Y., Chen, J., & Jiang, T. (2025). CME-YOLO: A Cross-Modal Enhanced YOLO Algorithm for Adverse Weather Object Detection in Autonomous Driving. Big Data and Cognitive Computing, 9(4). https://doi.org/10.3390/bdcc9040092
Zhang, Z., Ma, H., Fu, H., & Zhang, C. (2016). Scene-free multi-class weather classification on single images. Neurocomputing, 207, 365–373. https://doi.org/10.1016/j.neucom.2016.05.015
Zhao, B., Hua, L., Li, X., Lu, X., & Wang, Z. (2019). Weather recognition via classification labels and weather-cue maps. Pattern Recognition, 95, 272–284. https://doi.org/10.1016/j.patcog.2019.06.017
Zhao, B., Li, X., Lu, X., & Wang, Z. (2018). A CNN–RNN architecture for multi-label weather recognition. Neurocomputing, 322, 47–57. https://doi.org/10.1016/j.neucom.2018.09.048
Zheng, C., Zhang, F., Hou, H., Bi, C., Zhang, M., & Zhang, B. (2016). Active Discriminative Dictionary Learning for Weather Recognition. Mathematical Problems in Engineering, 2016(1), 8272859. https://doi.org/10.1155/2016/8272859
Zheng, L., Lu, W., & Zhou, Q. (2023). Weather image-based short-term dense wind speed forecast with a ConvLSTM-LSTM deep learning model. Building and Environment, 239(May), 110446. https://doi.org/10.1016/j.buildenv.2023.110446
Zhu, Z., Li, X., Zhai, J., & Hu, H. (2024). PODB: A learning-based polarimetric object detection benchmark for road scenes in adverse weather conditions. Information Fusion, 108(March), 300072. https://doi.org/10.1016/j.inffus.2024.102385
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Gilang Andhika Buwana, Mohamad Nurkamal Fauzan
This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.
Penulis yang menerbitkan jurnal ini menyetujui ketentuan berikut:
1. Penulis memegang hak cipta dan memberikan hak jurnal mengenai publikasi pertama dengan karya yang dilisensikan secara bersamaan di bawah Creative Commons Attribution 4.0 International License. yang memungkinkan orang lain untuk berbagi karya dengan pengakuan atas karya penulis dan publikasi awal pada jurnal.
2. Penulis dapat memasukkan pengaturan kontrak tambahan yang terpisah untuk distribusi non-eksklusif dari versi jurnal yang diterbitkan (misalnya, mengirimkannya ke repositori institusional atau menerbitkannya dalam sebuah buku), dengan pengakuan atas publikasi awalnya pada Jurnal.
3. Penulis diizinkan dan didorong untuk memposting karya mereka secara online (misalnya, dalam penyimpanan institusional atau di situs web mereka) sebelum dan selama proses pengiriman, karena hal itu dapat menghasilkan pertukaran yang produktif, serta kutipan dari karya yang diterbitkan sebelumnya.
