Automatic change detection system over unmanned aerial vehicle video sequences based on convolutional neural networks

García Rubio, Víctor and Rodrigo Ferrán, Juan Antonio and Menendez Garcia, Jose Manuel and Sánchez Almodóvar, Nuria and Lalueza Mayordomo, José María and Álvarez Garcia, Federico (2019). Automatic change detection system over unmanned aerial vehicle video sequences based on convolutional neural networks. "Sensors", v. 19 (n. 20); pp. 1-16. ISSN 1424-8220. https://doi.org/10.3390/s19204484.

Description

Title: Automatic change detection system over unmanned aerial vehicle video sequences based on convolutional neural networks
Author/s:
  • García Rubio, Víctor
  • Rodrigo Ferrán, Juan Antonio
  • Menendez Garcia, Jose Manuel
  • Sánchez Almodóvar, Nuria
  • Lalueza Mayordomo, José María
  • Álvarez Garcia, Federico
Item Type: Article
Título de Revista/Publicación: Sensors
Date: 16 October 2019
ISSN: 1424-8220
Volume: 19
Subjects:
Freetext Keywords: change detection; convolutional neural networks; moving camera; image alignment; UAV
Faculty: E.T.S.I. Telecomunicación (UPM)
Department: Señales, Sistemas y Radiocomunicaciones
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (1MB) | Preview

Abstract

In recent years, the use of unmanned aerial vehicles (UAVs) for surveillance tasks has increased considerably. This technology provides a versatile and innovative approach to the field. However, the automation of tasks such as object recognition or change detection usually requires image processing techniques. In this paper we present a system for change detection in video sequences acquired by moving cameras. It is based on the combination of image alignment techniques with a deep learning model based on convolutional neural networks (CNNs). This approach covers two important topics. Firstly, the capability of our system to be adaptable to variations in the UAV flight. In particular, the difference of height between flights, and a slight modification of the camera’s position or movement of the UAV because of natural conditions such as the effect of wind. These modifications can be produced by multiple factors, such as weather conditions, security requirements or human errors. Secondly, the precision of our model to detect changes in diverse environments, which has been compared with state-of-the-art methods in change detection. This has been measured using the Change Detection 2014 dataset, which provides a selection of labelled images from different scenarios for training change detection algorithms. We have used images from dynamic background, intermittent object motion and bad weather sections. These sections have been selected to test our algorithm’s robustness to changes in the background, as in real flight conditions. Our system provides a precise solution for these scenarios, as the mean F-measure score from the image analysis surpasses 97%, and a significant precision in the intermittent object motion category, where the score is above 99%.

Funding Projects

TypeCodeAcronymLeaderTitle
Horizon 2020762013NRG-5ENGINEERING - INGEGNERIA INFORMATICA SPAEnabling Smart Energy as a Service via 5G Mobile Network advances (NRG-5)

More information

Item ID: 64293
DC Identifier: http://oa.upm.es/64293/
OAI Identifier: oai:oa.upm.es:64293
DOI: 10.3390/s19204484
Official URL: https://www.mdpi.com/1424-8220/19/20/4484
Deposited by: Memoria Investigacion
Deposited on: 10 Oct 2020 10:52
Last Modified: 10 Oct 2020 10:52
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM