상세 보기
- Park, J.;
- Lee, J.;
- Jeon, S.;
- Kim, S.;
- Kim, S.;
- 외 1명
SCOPUS
1초록
While recognizing human actions and surrounding scenes addresses different aspects of video understanding, they have strong correlations that can be used to complement the singular information of each other. In this paper, we propose an approach for joint action and scene recognition that is formulated in an end-to-end learning framework based on temporal attention techniques and the fusion of them. By applying temporal attention modules to the generic feature network, action and scene features are extracted efficiently, and then they are composed to a single feature vector through the proposed fusion module. Our experiments on the CoVieW18 dataset show that our model is able to detect temporal attention with only weak supervision, and remarkably improves multi-task action and scene classification accuracies. © 2018 Association for Computing Machinery.
키워드
- 제목
- Learning to detect, associate, and recognize human actions and surrounding scenes in untrimmed videos
- 저자
- Park, J.; Lee, J.; Jeon, S.; Kim, S.; Kim, S.; Sohn, K.
- 발행일
- 2018-10
- 유형
- Conference Paper
- 저널명
- CoVieW 2018 - Proceedings of the 1st Workshop and Challenge on Comprehensive Video Understanding in the Wild, co-located with MM 2018
- 페이지
- 21 ~ 26