A Single-Stage, Bottom-up Approach for Occluded VIS using Spatio-temporal Embeddings

IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), pp. 3851–3855

Abstract

The task of Video Instance Segmentation (VIS) involves segmenting, tracking and classifying all object instances present in a given video clip. Occluded VIS is a more challenging extension of this task which involves longer video sequences where objects undergo significant occlusions over time. Most existing approaches to VIS involve multiple networks which separately handle segmenting, tracking and classifying object instances, and potentially a set of heuristics to combine the individual network outputs. By contrast, we employ just one, single-stage network without any heuristics or post-processing for the end-to-end task. Our approach is called ’STEm-Seg’, which is a bottom-up method for Segmenting object instances in videos using Spatio-Temporal Embeddings. We achieve 3rd place in the Occluded VIS challenge with an mAP score of 21.6% on the test set.

Authors 5

1. Ali Athar Aachen

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University, Aachen, Germany

2. Sabarinath Mahadevan Aachen

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University, Aachen, Germany

3. Aljoša Ošep

   Technical University of Munich

   Affiliation as printed

   Technical University of Munich, Munich, Germany

4. Laura Leal-Taixé

   Technical University of Munich

   Affiliation as printed

   Technical University of Munich, Munich, Germany

5. Bastian Leibe Aachen

   RWTH Aachen University

   Affiliation as printed

   RWTH Aachen University, Aachen, Germany