A survey of deep learning in image processing: developments, applications and challenges

Artificial Intelligence Review

Abstract

The rapid advancement of deep learning models (DLMs) in computer vision is driven by their capacity to unify feature representation and task inference into end-to-end automated frameworks, thereby surpassing manual feature engineering. This survey categorizes DLMs into Convolutional Neural Networks (CNNs), Visual Transformers (ViTs), and hybrid models based on their core components (convolutional vs. attention-based), systematically reviews their technical evolution, and critically analyzes their strengths and limitations. CNNs, the pioneering paradigm, leverage the locality of convolution kernels for efficient hierarchical pattern extraction. However, their reliance on multi-layer stacking to aggregate global context and rigidity to geometric variations has motivated innovations such as deformable convolutions to expand receptive fields. ViTs, emerging later, prioritize the globality of attention mechanisms to model long-range dependencies directly, but face computational bottlenecks and noise sensitivity, which are addressed by sparse attention and hierarchical tokenization. Hybrid models now dominate as optimal compromises, combining the locality of CNNs and globality of ViTs to balance efficiency and expressiveness. Moreover, we emphasize universal techniques—neural architecture search (NAS), model compression, and self-supervised learning—as indispensable tools to enhance robustness and adaptability across architectures. Despite progress, challenges persist in interpretability, data efficiency, and real-world robustness. We advocate prioritizing lightweight hybrid designs, explainable attention-convolution combinations, and cross-modal systems integrating more data beyond vision. This survey not only systematically reviews the technical evolution of DLMs but also proposes a forward-looking roadmap for adaptive, scalable, and trustworthy vision systems, grounded in current technological trajectories.

Authors 3

1. Zhan Xiong Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   The Leiden Institute of Advanced Computer Science, Leiden University, Rapenburg 70, 2311 EZ, Leiden, The Netherlands

2. Xiaoqin Tang corresponding

   Southwest University

   Affiliation as printed

   College of Computer and Information Science, Southwest University, No.216 Tiansheng Rd, Chongqing, 400700, China

3. Fons Verbeek corresponding Aachen Leiden Institute of Advanced Computer Science

   Leiden University

   Affiliation as printed

   The Leiden Institute of Advanced Computer Science, Leiden University, Rapenburg 70, 2311 EZ, Leiden, The Netherlands