On Detection, Data Association And Segmentation For Multi-Target Tracking
Keywords
Correlation; Detectors; Dual decomposition; Inference algorithms; Lagrangian relaxation; Multiple target tracking; Network flow; Object segmentation; Object segmentation; Optimization; Target tracking; Task analysis
Abstract
In this work, we propose a tracker that differs from most existing multi-target trackers in two major ways. Firstly, our tracker does not rely on a pre-trained object detector to get the initial object hypotheses. Secondly, our tracker's final output is the fine contours of the targets rather than traditional bounding boxes. Therefore, our tracker simultaneously solves three main problems: detection, data association and segmentation. This is especially important because the output of each of those three problems are highly correlated and the solution of one can greatly help improve the others. The proposed algorithm consists of two main components: structured learning and Lagrange dual decomposition. Our structured learning based tracker learns a model for each target and infers the best locations of all targets simultaneously in a video clip. The inference of our structured learning is achieved through a new Target Identity-aware Network Flow (TINF). The second component is Lagrange dual decomposition, which combines the structured learning tracker with a multi-label Conditional Random Field (CRF) based segmentation algorithm. This leads to more accurate segmentation results and also helps better resolve typical difficulties in multiple target tracking, such as occlusion handling, ID-switch and track drifting.
Publication Date
6-20-2018
Publication Title
IEEE Transactions on Pattern Analysis and Machine Intelligence
Document Type
Article
Personal Identifier
scopus
DOI Link
https://doi.org/10.1109/TPAMI.2018.2849374
Copyright Status
Unknown
Socpus ID
85048853799 (Scopus)
Source API URL
https://api.elsevier.com/content/abstract/scopus_id/85048853799
STARS Citation
Tian, Yicong; Dehghan, Afshin; and Shah, Mubarak, "On Detection, Data Association And Segmentation For Multi-Target Tracking" (2018). Scopus Export 2015-2019. 8999.
https://stars.library.ucf.edu/scopus2015/8999