'New augmented reality system to guide plastic surgery'

Scientists have developed an augmented reality system that could be a useful guide to planning, performing and evaluating the results of facial reconstruction and other procedures.
The system enables researchers to create three dimensional (3D) simulations of the desired results of facial reconstructive procedures and project them over the patient's face during surgery.
Researchers at Osaka Medical College in Japan reported the development and initial experience with the augmented reality (AR) system for evaluation of improvements of the body surface, a key consideration in plastic surgery.
Initial experience in eight cases suggests that augmented reality could be a useful guide to planning, performing and evaluating the results of facial reconstruction and other procedures, they said.

Augmented reality is a technology that combines computer-generated images on a screen with a real object or scene.
"We sought to develop a sophisticated yet simple and modifiable AR technique for use during plastic and reconstructive surgery," said Koichi Ueda and Daisuke Mitsuno from Osaka Medical College.

Researchers used a high-definition digital camera to capture 3D image of the facial surface and computed tomography scans to obtain digital information on the underlying facial bones for each patient.
These digital data were then manipulated to create 3D simulations of the ideal final results.
For example, in a patient with a fractured cheekbone, the reconstruction was simulated by obtaining and reversing an image of the opposite, uninjured bone.

Using a pair of commercially available smart glasses, the surgeon was able to superimpose the 3D digital simulation image of the desired appearance over the patient's face during surgery.
The group used free, open source software products to solve various technical problems, including manipulating and displaying the 3D simulations and lining them up with the surgical field.
In the study published in the journal Plastic and Reconstructive Surgery - Global Open, the team described their preliminary experience with AR system in eight patients undergoing reconstructive facial surgery.
The AR system helped in planning and confirming reconstruction of the underlying facial bones, for example, in a patient with a congenital bone development disorder and another patient with a complex facial fracture.

In all cases, the 3D simulation of the body surface provided a visual reference of the final facial appearance, researchers said.
"Our findings are not only useful for body surface evaluation but also for effective evaluation of AR technology in the field of plastic surgery," said Ueda.