Enhancing Rare Object Detection on Roadways Through Conditional Diffusion Models for Data Augmentation

IEEE Transactions on Intelligent Transportation Systems, vol. 25, pp. 19018–19029

Abstract

The detection of rare objects within traffic environments is critically important for the safety and reliability of autonomous driving systems. However, the scarcity of sufficient data and the long-tail effect associated with rare objects pose significant challenges to their detection. To address this issue, this study introduces a Conditional Diffusion Model, the RareGenDiffuse Model, which generates images of rare objects by taking traffic background images and corresponding bounding box images as inputs. Based on diffusion models, the RareGenDiffuse Model enables control over the category and location of the generated rare objects by adjusting the bounding box images. Experimental results demonstrate that the proposed model offers the advantages of high clarity and controllability. Utilizing the generated rare object dataset significantly enhances the detection outcomes for rare objects. The methodology proposed in this study can effectively reduce the efforts required for data acquisition and labeling, presenting a valuable solution to the challenges of rare object detection in traffic scenarios.

Authors 7

1. Hancheng Zhang

   Southeast University

   Affiliation as printed

   Intelligent Transportation System Research Center and the Bridge Engineering Research Center, Southeast University, Nanjing, China

2. Yuanyuan Hu Aachen Institute of Highway Engineering

   RWTH Aachen University

   Affiliation as printed

   Institute of Highway Engineering. RWTH Aachen University, Aachen, Germany

3. Zhendong Qian

   Southeast University

   Affiliation as printed

   Intelligent Transportation System Research Center and the Bridge Engineering Research Center, Southeast University, Nanjing, China

4. Jirui Sha

   Beijing Jiaotong University

   Affiliation as printed

   School of Economics and Management, Beijing Jiaotong University, Beijing, China

5. Min Xie

   Southeast University

   Affiliation as printed

   Intelligent Transportation System Research Center and the Bridge Engineering Research Center, Southeast University, Nanjing, China

6. Yuyang Wan

   Aalborg University

   Affiliation as printed

   Department of Energy Technology, Aalborg University, Aalborg, Denmark

7. Pengfei Liu Aachen Institute of Highway Engineering

   RWTH Aachen University

   Affiliation as printed

   Institute of Highway Engineering. RWTH Aachen University, Aachen, Germany