- 标题
- 摘要
- 关键词
- 实验方案
- 产品
-
Moving-tolerant Augmented Reality Surgical Navigation System using Autostereoscopic 3D Image Overlay
摘要： Augmented reality (AR) surgical navigation systems based on image overlay have been used in minimally invasive surgery (MIS). However, conventional systems still suffer from a limited viewing zone, a shortage of intuitive three-dimensional (3D) image guidance and can’t be moved freely. To fuse the 3D overlay image with the patient in situ, it is essential to track the overlay device while it is moving. A direct line-of-sight should be maintained between the optical markers and the tracker camera. In this study, we propose a moving-tolerant AR surgical navigation system using autostereoscopic image overlay, which can avoid the use of the optical tracking system during the intraoperative period. The system captures binocular image sequences of environmental change in the operation room to locate the overlay device, rather than tracking the device directly. Therefore, it is no longer required to maintain a direct line-of-sight between the tracker and the tracked devices. The movable range of the system is also not limited by the scope of the tracker camera. Computer simulation experiments demonstrate the reliability of the proposed moving-tolerant AR surgical navigation system. We also fabricate a computer-generated integral photography (CGIP)-based 3D overlay AR system to validate the feasibility of the proposed moving-tolerant approach. Qualitative and quantitative experiments demonstrate that the proposed system can always fuse the 3D image with the patient, thus increasing the feasibility and reliability of traditional 3D overlay image AR surgical navigation systems.
关键词： integral photography,moving-tolerant,augmented reality,Minimally invasive surgery
更新于2025-09-09 09:28:46
-
Gesture-based registration correction using a mobile augmented reality image-guided neurosurgery system
摘要： In image-guided neurosurgery, a registration between the patient and their pre-operative images and the tracking of surgical tools enables GPS-like guidance to the surgeon. However, factors such as brainshift, image distortion, and registration error cause the patient-to-image alignment accuracy to degrade throughout the surgical procedure no longer providing accurate guidance. The authors present a gesture-based method for manual registration correction to extend the usage of augmented reality (AR) neuronavigation systems. The authors’ method, which makes use of the touchscreen capabilities of a tablet on which the AR navigation view is presented, enables surgeons to compensate for the effects of brainshift, misregistration, or tracking errors. They tested their system in a laboratory user study with ten subjects and found that they were able to achieve a median registration RMS error of 3.51 mm on landmarks around the craniotomy of interest. This is comparable to the level of accuracy attainable with previously proposed methods and currently available commercial systems while being simpler and quicker to use. The method could enable surgeons to quickly and easily compensate for most of the observed shift. Further advantages of their method include its ease of use, its small impact on the surgical workflow and its small-time requirement.
关键词： registration correction,brainshift,image-guided neurosurgery,neuronavigation,augmented reality
更新于2025-09-09 09:28:46
-
34.3: A Dual Depth Head Up Display System for Vehicle
摘要： Vehicle mounted augmented reality head up display (AR-HUD) helps in focusing a driver’s attention on traffic surroundings. We have developed a dual depth windshield type HUD prototype containing an AR image and a common one. The throw distance of the AR image is 7.5m, with a FOV of 10°×5°, while, the throw distance of the common one is 2.5m, with a FOV of 5°×1°. Two 5 inch LCD panel are used as the picture generate unit. Off-axis reflective optical system including a freeform mirror is applied to realize dual depth display in a common light path. A special apodization back light module is designed to meet the demands of the high luminance illumination. The test result shows the main parameters of the prototype meet the design requirement.
关键词： Dual-depth,Head up display,Augmented reality
更新于2025-09-04 15:30:14
-
46.1: Design of Full-color Multi-plane Augmented Reality Display with PSLC Scattering Shutters
摘要： A full-color optical-see-through head mounted display (HMD) with polymer-stabilized liquid crystal (PSLC) scattering shutters for augmented display was proposed. Three LEDs (RGB) and a DMD were used to achieve the quasi-collimated projection image. Our system solves the accommodation-vergence conflict with accurate depth cues.
关键词： augmented reality,head mounted display,Full-color display,Multi-plane,3D display
更新于2025-09-04 15:30:14
-
[IEEE 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) - Tuebingen/Reutlingen, Germany (2018.3.18-2018.3.22)] 2018 IEEE Conference on Virtual Reality and 3D User Interfaces (VR) - A Calibration Method for Large-Scale Projection Based Floor Display System
摘要： We propose a calibration method for deploying a large-scale projection-based floor display system. In our system, multiple projectors are installed on the ceiling of a large indoor space like a gymnasium to achieve a large projection area on the floor. The projection results suffer from both perspective distortion and lens distortion. In this paper, we use projector-camera systems, in which a camera is mounted on each projector, with the “straight lines have to be straight” methodology, to calibrate our projection system. Different from conventional approaches, our method does not use any calibration board and makes no requirement on the overlapping among the projections and the cameras’ fields of view.
关键词： calibration,augmented reality,projector-camera system,lens distortion,Large-scale projection
更新于2025-09-04 15:30:14
-
Augmented Reality Microsurgical Planning with a Smartphone (ARM-PS): A dissection route map in your pocket
摘要： SUMMARY INTRODUCTION: Perioperative microsurgical planning increases the likelihood of successful results. Augmented reality is the addition of artificial information allowing the user to perform tasks more efficiently. The aim of our study is to report the use of augmented reality for microsurgical planning with a smartphone (ARM-PS) as a dissection route map. PATIENTS AND METHODS: Augmented reality was used for superficial circumflex iliac artery perforator flap planning. Three-dimensional reconstruction images of the inguinal and lower abdomen vascular anatomy were performed from computed tomography angiography. Three-dimensional images were imported to a smartphone and an augmented reality app was used to superimpose them with the camera. The drawings performed with ARM-PS were correlated with handheld doppler and intraoperative findings. RESULTS: Correlation of ARM-PS drawings with handheld doppler was 100% for superficial inferior epigastric artery, superficial and deep branch of superficial circumflex iliac artery perforator in sixty inguinal areas studied. Intraoperative findings matched perfectly in all thirty cases with ARM-PS drawings for the mentioned vessels and lymph nodes location. Flap harvest time decreased in 20% compared with our traditional timing. CONCLUSIONS: ARM-PS is an easy, non-invasive and accurate method that provides a dissection route map, standardizing flaps harvesting and has a perfect correlation with intraoperative findings. It reduces operating time and may improve operative results, decreasing donor site morbidity.
关键词： new technologies,SCIP flap,smartphone,perforator flap,microsurgical planning,Augmented reality,preoperative planning
更新于2025-09-04 15:30:14
-
[IEEE 2018 IEEE 18th International Conference on Bioinformatics and Bioengineering (BIBE) - Taichung, Taiwan (2018.10.29-2018.10.31)] 2018 IEEE 18th International Conference on Bioinformatics and Bioengineering (BIBE) - Sigma-Delta ADC for Image Sensor in Virtual and Augmented Reality Camera to Medical Training
摘要： This article presents a continuous time lowpass sigma-delta ADC for wide field of view (FOV) image sensor with a chain of integrators and with capacitive feedforward summation (CICFF) plus circuit which for implementation in low power applications. The summation of feedforward signals is achieved by capacitors plus, without the essential thing of any extra active components which can be used in virtual reality (VR) and augmented reality (AR) camera. The quantizer uses a comparator which can achieve high linearity easily. The chip was implemented in 1.8 V supply voltage which works as a part of CMOS active-pixel image sensor with global shutter and high dynamic range (HDR) operation. The proposed idea can support medical training.
关键词： Sigma-Delta ADC,Medical Training,Image Sensor,Augmented Reality
更新于2025-09-04 15:30:14
-
[IEEE 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE) - Nara, Japan (2018.10.9-2018.10.12)] 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE) - New Approach for Embedding Secret Information into Fiber Materials
摘要： We propose an artificial fiber (AF) pattern as a technique for embedding electrical information into paper. In order to adapt to more generic targets, we chose to embed information in fabric materials that are closely related to everyday life (such as clothes and bags). In this study, we examine a specific pattern (a traditional Japanese katagami pattern) for a kimono rather than a fiber pattern, and evaluate the adaptability to different photographic environments.
关键词： data hiding,augmented reality,katagami,fabric materials,Artificial fiber pattern
更新于2025-09-04 15:30:14
-
[IEEE 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE) - Nara, Japan (2018.10.9-2018.10.12)] 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE) - A Projection-based AR system to display brain angiography via Stereo Vision
摘要： In this paper, a projector-based augmented reality (AR) system to display segmented brain angiography is proposed. Firstly, this scheme employed an adaptive algorithm to find the optimal threshold from the histogram of a CT image. Then, with the help of computer vision technology, the geometrical relationship between the facial data and the CT’s angiography information is derived, and the registration process is executed. When the image registration is finished, the correct location of the vascular image is obtained. Since the surface of the head is irregular, directly project the uncorrected CT angiography images on the surface will be deformed. To alleviate this problem, we employed a projector to project a set of lines on the head, and then a camera is used to capture these lines to derive the correction information required for surface deformation. Finally, the vascular image after deformation correction is projected on the head to provide the doctors as a reference.
关键词： projector-based,augmented reality
更新于2025-09-04 15:30:14
-
27.2: <i>Invited Paper:</i> True 3D displays for AR applications
摘要： Augmented reality (AR) technology, which integrates virtual computer-generated information into the real world scene, is believed to be the next-generation human-machine interface. However, most AR products adopt stereoscopic 3D display technique, which causes the accommodation-vergence conflict. To solve this problem, we have proposed two approaches. The first is a multi-planar volumetric display using fast switching polymer-stabilized liquid crystal (PSLC) films. By rapidly switching the films between scattering and transparent states while synchronizing with a high-speed projector, the 2D slices of a 3D volume could be displayed in time sequence. We delved into the research on developing high-performance PSLC films in both normal mode and reverse mode; moreover, we also realized the demonstration of four-depth AR images with correct accommodation cues. For the second approach, we realized a holographic AR display using digital blazed gratings and a 4f system to eliminate zero-order and higher-order noise. With a 4k liquid crystal on silicon device, we achieved a field of view (FOV) of 32 deg. Moreover, we designed a compact waveguide- based holographic 3D display. In the design, there are two holographic optical elements (HOEs), each of which functions as a diffractive grating and a Fresnel lens. Because of the grating effect, holographic 3D image light is coupled into and decoupled out of the waveguide by modifying incident angles. Because of the lens effect, the collimated zero order light is focused at a point, and got filtered out. The optical power of the second HOE also helps enlarge FOV.
关键词： 3D display,holographic display,Augmented reality,volumetric display,liquid crystal
更新于2025-09-04 15:30:14