Many people can take photos with smartphones and easily post photos via SNS (Social Network Services). This has caused a social problem that unintended appearance in photos may threaten the privacy of photographed persons. For this issue, numerous studies have already been introduced to prevent the unintended appearance in photos from the photographer’s side, but only a few methods tackled this from the photographed person's side. Therefore, we considered calling attention to a situation that a photo-taking behavior by a photographer can be automatically detected by using a wearable camera worn by a photographed person. In this paper, we propose an approach to detect photo-taking behaviors in video data taken from the wearable camera, analyzing specific human skeleton information. OpenPose is utilized to obtain the human’s skeleton information and the time-series data are analyzed. In addition, we compare two similar behaviors which are photo-taking behaviors and net-surfing behaviors. These video data are distinguished by DP matching and cross-validation. Finally, it is concluded that the detection accuracy of photo-taking behaviors is about 92.5%, which is satisfactory enough for this research purpose.