Within the scope of the ATLASCAR2 project, this dissertation is based on studying and developing an autonomous driving assistance simulator named CARLA that implements an interface based in ROS to replicate the ATLASCAR2 setup in the simulation. The idea of using an autonomous driving simulator was proposed as a way to simplify the data aquisition process for the ATLASCAR2 since this process keeps on getting more and more difficult due to factors such as the complexity in the setup and the calibration processes of the installed sensors on the ATLASCAR2, as well as other factors such as the hardware interface and the time that is required to perform a single data aquisition using the ATLASCAR2. This tool can produce realistic scenarios and can be used for testing out the algorithms that are going to be implemented in the ATLASCAR2 in controlled environments, offering a degree of ground truth for these algorithms that can be used to evaluate the performance in these environments before implementing them in the real platform. The replication of the ATLASCAR2 setup process as well as the algorithms involved in CARLA will be discussed in further detail during this dissertation which include sections talking about the replication process and the algorithms involved, showing the results of the ATLASCAR2 setup implementation in CARLA as well as some other results produced from experiments with CARLA simulated data which include the use of computer vision algorithms as well as other algorithms that are currently being used in the ATLASCAR2.
In the fields of ADAS and AD, there have been some technological studies that have kept on growing these past few decades in both the automobile industry and the academic environment. It is also important to note that in AD and ADAS the use of autonomous driving simulators is becoming more and more significant as they prove to be important tools for testing and evaluating the algorithms that are going to be implemented in the autonomous vehicle before implementing these algorithms in the real vehicle. These simulators can produce realistic scenarios that are often used for data acquisition in datasets that in conjunction with data labelling can be used as input for learning algorithms and work on their results. The purpose of this dissertation is focused on the adaptation of an autonomous driving simulator named CARLA in the context of the ATLASCAR2 project and test the results of the simulation. These results can later on be used for research of methods to register data using the cameras and the LIDAR sensors of the ATLASCAR2 installed in the simulated vehicle. This registered data is important for the vehicle to know its surroundings and later on create models of the objects present in CARLA and therefore computer vision algorithms used for object detection and visual perception must be tested with data registered from CARLA in order to create these models. For this reason, a tool for testing out these algorithms using frames gathered from the CARLA simulation will be developed. This dissertation will also be used to evaluate algorithms that are currently being implemented in the ATLASCAR2, evaluating the performance of these algorithms in the scenarios provided by the CARLA simulator. This tool can also be used to test the developed algorithms before implementing them in the ATLASCAR2 offering then the possibility to alternate between simulated scenarios that can be controlled and real world scenarios.
13/02/2019 - 15/02/2019
ROS Melodic Instalation and Tutorial Resolution
18/02/2019 - 01/03/2019
ROS Tutorial Resolution
ROS Workshop 2019 with Professor Miguel Oliveira
Preliminar Report
04/03/2019 - 10/03/2019
LAR Meeting #1 Presentation
Idea Discussion from Presentation
11/03/2019 - 16/03/2019
Introduction to CARLA
ROS-CARLA Integration with ros-bridge package
18/03/2019 - 22/03/2019
ROS-CARLA Integration Continuation
Solved some issues of the MTT package
Master's Thesis Blog Creation
25/03/2019 - 29/03/2019
Fixing ROS-CARLA Integration Problems
Adding new sensor to CARLA Module
Displaying CARLA results in RVIZ
01/04/2019 - 05/04/2019
Adding new sensor module to CARLA Module
Creating new sensor blueprint using Unreal UE4 Engine
Added Carla ROS Manual Control Package
Added Carla Waypoint Publisher Package
08/04/2019 - 12/04/2019
Added sensor configuration modules
Fixed point cloud simulation issues with LIDAR sensors.
Adding MTT Package to work with LIDAR point clouds.
15/04/2019 - 26/04/2019
Fixing problems with MTT package
Writting topics in dissertation
29/04/2019 - 03/05/2019
Fixing problems with MTT package
Writting topics in dissertation
Drawing bounding boxes using image_converter package
Creating JSON datasets
06/05/2019 - 10/05/2019
Completed ATLASCAR setup.
Solving point cloud distribution problems in the MTT package.
Added new JSON dataset format.
Writting topics in dissertation.
13/05/2019 - 24/05/2019
Created PCL Point Cloud Recording and Visualizing packages.
Filtered point cloud information using spherical coordinates.
Tests with completed ATLASCAR setup.
Created ROS Template Matching package for object tracking.
Writting topics in dissertation.
27/05/2019 - 31/05/2019
Tests with ROS Template Matching Package
Tests with Fusion of LIDAR and Camera data.
Writting topics in dissertation
03/06/2019 - 07/06/2019
Tests with LIDAR and Camera data fusion.
First delivery of the dissertation.
10/06/2019 - 14/06/2019
Creating new sensor configuration for other ATLASCAR algorithms.
Creating rosbag files for these algorithms.
17/06/2019 - 28/06/2019
Completed template matching algorithm.
Created rosbag files for road visual perception algorithm.
Writting topics in dissertation.
01/07/2019 - 12/07/2019
Tested rosbag files with road visual perception and performed evaluation of the algorithm in CARLA.
Added changes in CARLA bounding boxes algorithm, implemented pedestrian labels and ground truth provided by the blueprint IDs.
Writting final topics in dissertation.
15/07/2019 - 19/07/2019
Delivery of the dissertation.
Second LAR Meeting presentation.
Master Thesis presentation.