Application of OpenPose and deep learning for intelligent surveillance reconnaissance system

Authors

  • Kyujung Choi Kwangwoon University
  • Suyeong Oh Department of Electronics and Communications Engineering
  • Chaebong Sohn Department of Electronics and Communications Engineering

DOI:

https://doi.org/10.37944/jams.v3i3.80

Keywords:

OpenPose, keypoints, deep neural networks, convolutional neural networks, long short-term memory

Abstract

In this study, defense surveillance reconnaissance systems were implemented through deep learning networks such as OpenPose and deep neural networks (DNN), convolutional neural networks (CNN), and long short-term memory (LSTM). This study proposes a target recognition method which differs from the existing surveillance reconnaissance systems. This method consists in distinguishing between ordinary people and targets by classifying motions in the images being filmed. Thus, the skeleton data of the target in the image are extracted using OpenPose. Then, keypoints included in the extracted skeleton data are entered into DNN, CNN, and LSTM to classify the motion. The classified motions are selected as motions learned in the military, such as overall security. When the system classifies motions and recognizes targets, it identifies them on the map and tracks them. The tracking algorithm calculates the movement direction of the target by calculating the change in the values of keypoints extracted through OpenPose by frames. Finally, it uses the depth information obtained from the camera to display targets on the map based on the camera location. All these computations are based on the use of the skeleton data rather than the entire image, thus reducing the overall computation.

Author Biography

Kyujung Choi, Kwangwoon University

Department of Electronics and Communications Engineering

This research was supported by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2020-2016-0-00288) supervised by the IITP (Institute for Information & communications Technology Planning & Evaluation).

OpenPose motion

Downloads

Published

2020-12-31 — Updated on 2020-12-31

Versions

How to Cite

Choi, K., Oh, S., & Sohn, C. (2020). Application of OpenPose and deep learning for intelligent surveillance reconnaissance system. Journal of Advances in Military Studies, 3(3), 113-132. https://doi.org/10.37944/jams.v3i3.80