Graph Regularization Network with Semantic Affinity for Weakly-Supervised Temporal Action Localization
  • Park, Jungin
  • Lee, Jiyoung
  • Jeon, Sangryul
  • Kim, Seungryong
  • Sohn, Kwanghoon
Citations

SCOPUS

6

초록

This paper presents a novel deep architecture for weakly-supervised temporal action localization that not only generates segment-level action responses but also propagates segment-level responses to the neighborhood in a form of graph Laplacian regularization. Specifically, our approach consists of two sub-modules; a class activation module to estimate the action score map over time through the action classifiers, and a graph regularization module to refine the estimated action score map by solving a quadratic programming problem with the predicted segment-level semantic affinities. Since these two modules are integrated with fully differentiable layers, the proposed networks can be jointly trained in an end-to-end manner. Experimental results on Thumos14 and ActivityNet1.2 demonstrate that the proposed method provides outstanding performances in weakly-supervised temporal action localization. © 2019 IEEE.

키워드

graph Laplacian regularizationsemantic affinityweakly-supervised temporal action localization
제목
Graph Regularization Network with Semantic Affinity for Weakly-Supervised Temporal Action Localization
저자
Park, JunginLee, JiyoungJeon, SangryulKim, SeungryongSohn, Kwanghoon
DOI
10.1109/ICIP.2019.8803589
발행일
2019-09
유형
Conference Paper
저널명
Proceedings - International Conference on Image Processing, ICIP
2019-September
페이지
3701 ~ 3705