Simultaneous depth completion and 3D object detection via deep learning for scene reconstruction in autonomous driving scenarios

Bastico, Matteo (2021). Simultaneous depth completion and 3D object detection via deep learning for scene reconstruction in autonomous driving scenarios. Thesis (Master thesis), E.T.S.I. Telecomunicación (UPM).

Description

Title: Simultaneous depth completion and 3D object detection via deep learning for scene reconstruction in autonomous driving scenarios
Author/s:
  • Bastico, Matteo
Contributor/s:
  • Belmonte Hernández, Alberto
  • Álvarez García, Federico
Item Type: Thesis (Master thesis)
Masters title: Ingeniería de Telecomunicación
Date: 2021
Subjects:
Freetext Keywords: KITTI, 'Depth Completion', '3D Object Detection', 'Reflectance Estimation', Psuedo-LiDAR,'Deep Learining', Depth-Map, 'Reflectance Image', NLSPN, OpenPCDet, PyTorch.
Faculty: E.T.S.I. Telecomunicación (UPM)
Department: Señales, Sistemas y Radiocomunicaciones
Creative Commons Licenses: Recognition - No derivative works - Non commercial

Full text

[img]
Preview
PDF - Requires a PDF viewer, such as GSview, Xpdf or Adobe Acrobat Reader
Download (14MB) | Preview

Abstract

The use of learning-based techniques in the autonomous driving field has grown exponentially in the last years. In particular, great focus has been given to object detection and depth estimation algorithms. Recently, also depth completion has become a competitive research topic in self-driving scenarios. In this work, we propose a new exible two-stages framework based on both depth completion and 3D object detection which takes as input RGB-D data. The first stage, in which the depth completion process is carried out, generates a dense depth map of the analysed scene. This depth map is converted into a pseudo-LiDAR pointcloud which is fed into the second stage to perform the object detection. Between the two stages we introduce a new process which is in charge of estimating the reflectances of the points in the pseudo-LiDAR pointcloud. Three different reflectance estimation alorithms are proposed in this work and their performances are compared. Moreover, the entire framework is trained and evaluated using the prestigious KITTI dataset for autonomous driving applications. The results are finally compared with State-of-The-Art algorithms in the self-driving field. The entire project is implemented in Python programming language using the PyTorch library and some pre-coded networks to make easier the developing process.

More information

Item ID: 66224
DC Identifier: http://oa.upm.es/66224/
OAI Identifier: oai:oa.upm.es:66224
Deposited by: Biblioteca ETSI Telecomunicación
Deposited on: 02 Mar 2021 09:10
Last Modified: 02 Mar 2021 09:10
  • Logo InvestigaM (UPM)
  • Logo GEOUP4
  • Logo Open Access
  • Open Access
  • Logo Sherpa/Romeo
    Check whether the anglo-saxon journal in which you have published an article allows you to also publish it under open access.
  • Logo Dulcinea
    Check whether the spanish journal in which you have published an article allows you to also publish it under open access.
  • Logo de Recolecta
  • Logo del Observatorio I+D+i UPM
  • Logo de OpenCourseWare UPM