Für eine korrekte Darstellung dieser Seite benötigen Sie einen XHTML-standardkonformen Browser, der die Darstellung von CSS-Dateien zulässt.

TOF Range Enhancement

Background: 

An important field of reasearch in computer vision is the 3D analysis and reconstruction of objects and scenes. A rather new technologie in this context is the PMD, based on the time-of-flight principle, which measures full-range distance information in real-time. Unfortunately, PMD-based devices have still limited resolution and provide only IR intensity information.

This reasearch direction focuses on a fast algorithmic approach to combine high resolution RGB images with PMD distance data, acquired using a binocular camera setup. The resulting combined RGBZ-data not only enhances the visual result, but also represents a basis for advanced data processing in e.g. object recognition with sub-pixel accuracy. A simple but efficient method is used to detect geometric occlusion caused by the binocular setup, which otherwise will lead to false color assignments.

Dynamic environements could cause mismatching regarding fusion. As any optical camera, ToF cameras are also subject to motion blur on dynamic scenes also known as motion artifacts. Here a GPU optical flow based method is proposed in order to warp all sequential sub phase images in the same reference in order to correct motion artifacts. A earlier method consisted to compute 3 optical flows and was achieving good results with a low framerate (around 12FPS). By reducing the number of optical flow computed and with a better memory management, a rate greater than 25FPS can be achieved.

This research project is partially funded by grant KO-2960-5/1,2 from the German Research Foundation (DFG).

Publications: 


2015

Begutachtete Konferenzbeiträge

[bib] - L. Xiao, F. Heide, M. O'Toole, A. Kolb, M. B. Hullin, K. N. Kutulakos, W. Heidrich - Defocus Deblurring and Superresolution for Time-of-Flight Depth Cameras
In Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), IEEE, 2015, pages 2376-2384

2014

Artikel in Zeitschriften

[bib] - Felix Heide, Lei Xiao, Andreas Kolb, Matthias B. Hullin, Wolfgang Heidrich - Imaging in scattering media using correlation image sensors and sparse convolutional coding
In Optics Express, 22(21), 2014, pages 26338 - 26350

2013

Begutachtete Konferenzbeiträge

[bib] - D. Lefloch , T. Hoegg , A. Kolb - Real-Time Motion Artifacts Compensation of ToF Sensors Data on GPU
In SPIE Defense, Security - Three-Dimensional Imaging, Visualization, and Display, Proc. SPIE 8738, 2013, pages 87380U - 87380U-7

2008

Artikel in Zeitschriften

[bib] - M. Lindner, M. Lambers, A. Kolb - Data Fusion and Edge-Enhanced Distance Refinement for 2D RGB and 3D Range Images
In Int. J. on Intell. Systems and Techn. and App. (IJISTA), Issue on Dynamic 3D Imaging, 5(1), 2008, pages 344 - 354 - [pdf]

Begutachtete Konferenzbeiträge

[bib] - A. Kolb, E. Barth, R. Koch - ToF-Sensors: New Dimensions for Realism and Interactivity
In Conf. on Computer Vision and Pattern Recognition (CVPR), Workshop on ToF Camera based Computer Vision (TOF-CV), 2008, pages 1-6 - [pdf]

2007

Begutachtete Konferenzbeiträge

[bib] - M. Lindner, A. Kolb, K. Hartmann - Data-Fusion of PMD-Based Distance-Information and High-Resolution RGB-Images
In Proc. of the Int. IEEE Symp. on Signals, Circuits & Systems (ISSCS), 1, 2007, pages 121 - 124 - [pdf]