PhD Position on Deep Depth from Defocus (Deep DFD) for near range and in-situ 3D exploration
The closing date for this job submission has passed.
Acquiring 3D geometry of the scene is essential for many applications in the areas of navigation, robotics, scene understanding, etc. Among the existing approaches, those using passive devices are of increased interest since they allow the use of compact, standard and low cost imaging systems like DSLR cameras. There are many depth cues that can be used to extract the 3D geometry. In single shot images, the depth is laying in the blur, objects shadow, chromatic effects and shape distortions caused by lens aberrations, etc. When multiple images are used, depth information comes from perspective change like in binocular systems or structures motion in video sequences. The physics of these effects is well known and more or less accurate mathematical models exists and are used by analytical image processing methods that are generally prone to heavy calculation.
The entrance of the newcoming Deep Neural Networks (DNN) on the stage of signal processing has boosted the subject due to their capability to learn complex models that ingest multiple effects, not only single ones as analytical approaches are doing. The flexibility in learning and the fast processing once the training is accomplished make from DNNs a very promising tool in building the 3D geometry of scenes from easy to acquire images.
The successful candidate will be employed for 3 years by University Politehnica of Bucharest and will be part of CEOSpaceTech, a very dynamic research laboratory oriented towards space applications. She or he receives a financial package, which is twice the average salary in the country and additional mobility and family allowance, granted according to the rules for Early Stage Researchers (ESRs) in an EU Marie Sklodowska-Curie Actions Innovative Training Networks (ITN). A career development plan will be prepared for her/him in accordance with the supervisor. The plan will include a choice of more than 20 streamed or registered courses, stages in Spain, and various outreach activities. For more information please visit the Marie Sklodowska-Curie Actions Innovative Training Networks website.
• Study of physical foundation for depth cues in images and evaluation of their potential in existing methods for depth mapping.
• Elaboration of DNN based solutions for depth inference from single shot images by exploiting defocus and other depth cues.
• Definition of benchmarks for DNN training, validation and testing.
• evaluation of the depth maps accuracy obtained with the DNNs using indoor and outdoor image collection.
• A Master of Science in Computer Science Science is required. It could comprise to the full range of mathematical, physical, engineering and technology disciplines related to sensor data acquisition and programming
• Proficient English level
• Image analysis, neural networks, programming languages, basic knowledge on optics could be an advantage.
• CiTIUS, Santiago de Compostela, Spain, Prof. Dr. P. López Martínez, 3 months, study the possibilities to integrate the coded aperture into the sensor and to understand the impact of sensor technology on the camera performance.
• INSITU, Santiago de Compostela, Spain, Prof. Dr. P. Arias Sánchez, 5 months, refine the camera specification by studying the applications.