Advances in Photometric 3D-Reconstruction

Advances in Photometric 3D-Reconstruction
Author: Jean-Denis Durou
Publisher: Springer Nature
Total Pages: 239
Release: 2020-09-16
Genre: Computers
ISBN: 3030518663

Download Advances in Photometric 3D-Reconstruction Book in PDF, Epub and Kindle

This book presents the latest advances in photometric 3D reconstruction. It provides the reader with an overview of the state of the art in the field, and of the latest research into both the theoretical foundations of photometric 3D reconstruction and its practical application in several fields (including security, medicine, cultural heritage and archiving, and engineering). These techniques play a crucial role within such emerging technologies as 3D printing, since they permit the direct conversion of an image into a solid object. The book covers both theoretical analysis and real-world applications, highlighting the importance of deepening interdisciplinary skills, and as such will be of interest to both academic researchers and practitioners from the computer vision and mathematical 3D modeling communities, as well as engineers involved in 3D printing. No prior background is required beyond a general knowledge of classical computer vision models, numerical methods for optimization, and partial differential equations.

3D Reconstruction Using Generalized Perspective Photometric Stereo

3D Reconstruction Using Generalized Perspective Photometric Stereo
Author: Maryam Khanian
Publisher:
Total Pages:
Release: 2018
Genre:
ISBN:

Download 3D Reconstruction Using Generalized Perspective Photometric Stereo Book in PDF, Epub and Kindle

Die Rekonstruktion von 3D-Gestaltinformationen ist eine fundamentale Aufgabenstellung im Bereich Computer-Vision. Unter den verschiedenen Techniken ist das sogenannte Photometrische Stereo Verfahren (PS) hervorzuheben, da es im Vergleich zu anderen Ansätzen ein höheres Potenzial für eine hoch genaue 3D-Rekonstruktion besitzt. Diese Arbeit befasst sich mit Verallgemeinerungen klassischer PS-Ansätze, die dieses Potenzial weiter ausschöpfen sollen. Die Entwicklungen können beispielsweise verwendet werden, um in Zukunft die 3D-Information in verschiedensten Bereichen für einen Anwender zu erschließen, wie etwa in der Medizin, der Film- und Videospieleindustrie, beim autonomen Fahren oder für Anwendungen in der virtuellen Realität. Die erste der Neuentwicklungen betrifft die systematische Verwendung von hellen Lichtreflexionen in der Berechnung der 3D-Rekonstruktion sowie die perspektivische Projektion. Hierdurch werden Beschränkungen üblicher Methoden, wie auf die Rekonstruktion diffus reflektierender Materialien und auf relativ weit entfernte Objekte, aufgehoben. Die Anwendbarkeit des entwickelten Ansatzes wird mittels der Rekonstruktion aus endoskopischen Bildern mit vielen hellen Lichtreflexionen untermauert. In einem weiteren Schritt wird gezeigt, wie man in Echtzeit eine 3D-Rekonstruktion auch von sehr feinen Details mittels eines verallgemeinerten Reflexionsmodells erreichen kann. Hierdurch werden hochaufgelöste Rekonstruktionen auch von Details erreicht, die für das menschliche Auge in Bildern unsichtbar sind. Hieraus ergeben sich viele potenzielle Anwendungsmöglichkeiten, etwa im Bereich der automatischen Detektion von Mikrodruck, die im Sicherheitsbereich Verwendung finden, oder in der industriellen Produktion für die Detektion sehr feiner Strukturen wie etwa gedruckter Schaltkreise. Als weiterer Beitrag der Arbeit wird ein Verfahren für das sogenannte nicht-kalibrierte PS entwickelt, bei dem neuronale Netzwerke verwendet werden, um die in diesem Fall fehlende Information der Beleuchtungsrichtung auszugleichen. Schließlich wird zum ersten Mal in der Literatur beschrieben, wie man basierend auf Metaheuristiken und tiefen neuronalen Netzen eine qualitativ hochwertige 3D-Rekonstruktion allein durch Bilder aus dem Internet oder natürliche Bilder ohne weiteres zusätzliches Wissen erlangt.zeige weniger.

Real-time 3D Reconstruction and Rendering for Minimally Invasive Surgery with Multi Cameras Array

Real-time 3D Reconstruction and Rendering for Minimally Invasive Surgery with Multi Cameras Array
Author: Jianwei Ke
Publisher:
Total Pages: 0
Release: 2024
Genre:
ISBN:

Download Real-time 3D Reconstruction and Rendering for Minimally Invasive Surgery with Multi Cameras Array Book in PDF, Epub and Kindle

Advancements in digital camera technologies have led to significantly smaller camera sensors without compromising imaging quality. This trend opens avenues for replacing single-camera systems with multi-camera arrays, offering benefits such as an expanded field-of-view and 3D information. However, camera arrays require additional processing to interpret the collected image data. This report addresses two significant algorithmic challenges in developing a camera array. The first challenge involves virtual view generation, which is the task of estimating the image for a virtual camera using image data from multiview cameras. Ideally, if the geometry of the underlying scene is known, the virtual view can be generated by projecting the 3D geometry to the virtual camera. However, finding the 3D geometry of a scene from multiview cameras is an active research topic in Computer Vision. Considering the real-time processing requirement (

3D Reconstruction of Deformable Surface Based on Binocular Vision

3D Reconstruction of Deformable Surface Based on Binocular Vision
Author: Bo Yang
Publisher:
Total Pages:
Release: 2020-11-30
Genre:
ISBN: 9781954318007

Download 3D Reconstruction of Deformable Surface Based on Binocular Vision Book in PDF, Epub and Kindle

The 3D reconstruction of deformable surfaces is a classical problem in the field of computer vision, which has many important applications in virtual reality, surgical navigation, and training. For example, accurate 3D reconstruction for intracavitary soft-tissue scenes based on a stereo-endoscope can effectively promote surgeons and surgical robots' perception in a Minimally Invasive Surgery (MIS), and thus improve the precision and safety of surgical operations. However, the dynamic deformable soft-tissues bring great challenges for accurate reconstruction. This book provides an in-depth discussion about the binocular reconstruction techniques for dynamic deformable surfaces such as beating heart surfaces. The camera models and calibration methods used for stereo vision are introduced first. The classical stereo matching methods are then presented. The deformable-model-based reconstruction methods are discussed emphatically, from the common-used deformable models, such as the triangular affine transformation, the B-spline model, and the Thin Plate Spline (TPS), to some improved models proposed recently, such as the Quasi-Spherical Triangle (QST) model, the overlapping TPS model, and the Triangular Radial Cubic Spline (TRCS) model. This book includes Reconstruction techniques based on machine learning, statistical deformable modeling using principal component analysis, and Deep-learning methods for deformable surface reconstruction with selected experimental results.

Visual SLAM And Surface Reconstruction For Abdominal Minimally Invasive Surgery

Visual SLAM And Surface Reconstruction For Abdominal Minimally Invasive Surgery
Author: Bingxiong Lin
Publisher:
Total Pages:
Release: 2015
Genre: Computer science
ISBN:

Download Visual SLAM And Surface Reconstruction For Abdominal Minimally Invasive Surgery Book in PDF, Epub and Kindle

Depth information of tissue surfaces and laparoscope poses are crucial for accurate surgical guidance and navigation in Computer Assisted Surgeries (CAS). Intra-operative Three Dimensional (3D) reconstruction and laparoscope localization are therefore two fundamental tasks in CAS. This dissertation focuses on the abdominal Minimally Invasive Surgeries (MIS) and presents laparoscopic-video-based methods for these two tasks. Different kinds of methods have been presented to recover 3D surface structures of surgical scenes in MIS. Those methods are mainly based on laser, structured light, time-of-flight cameras, and video cameras. Among them, laparoscopic-video-based surface reconstruction techniques have many significant advantages. Specifically, they are non-invasive, provide intra-operative information, and do not introduce extra-hardware to the current surgical platform. On the other side, laparoscopic-video-based 3D reconstruction and laparoscope localization are challenging tasks due to the specialties of the abdominal imaging environment. The well-known difficulties include: low texture, homogeneous areas, tissue deformations, and so on. The goal of this dissertation is to design novel 3D reconstruction and laparoscope localization methods and overcome those challenges from the abdominal imaging environment. Two novel methods are proposed to achieve accurate 3D reconstruction for MIS. The first method is based on the detection of distinctive image features, which is difficult in MIS images due to the low-texture and homogeneous tissue surfaces. To overcome this problem, this dissertation first introduces new types of image features for MIS images based on blood vessels on tissue surfaces and designs novel methods to efficiently detect them. After vessel features have been detected, novel methods are presented to match them in stereo images and 3D vessels can be recovered for each frame.

Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2009

Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2009
Author: Guang-Zhong Yang
Publisher: Springer Science & Business Media
Total Pages: 1078
Release: 2009-09-07
Genre: Computers
ISBN: 3642042678

Download Medical Image Computing and Computer-Assisted Intervention -- MICCAI 2009 Book in PDF, Epub and Kindle

The two-volume set LNCS 5761 and LNCS 5762 constitute the refereed proceedings of the 12th International Conference on Medical Image Computing and Computer-Assisted Intervention, MICCAI 2009, held in London, UK, in September 2009. Based on rigorous peer reviews, the program committee carefully selected 259 revised papers from 804 submissions for presentation in two volumes. The first volume includes 125 papers divided in topical sections on cardiovascular image guided intervention and robotics; surgical navigation and tissue interaction; intra-operative imaging and endoscopic navigation; motion modelling and image formation; image registration; modelling and segmentation; image segmentation and classification; segmentation and atlas based techniques; neuroimage analysis; surgical navigation and robotics; image registration; and neuroimage analysis: structure and function.