All kinds of medical images can help doctors get a picture of a patient's internal anatomy. However, these images are displayed in 2D, which means doctors have to convert the images in their heads into 3D to prepare for surgery, for example. A new system offers a solution. The system can convert 2D medical images into a 3D view and project this view onto a patient's body. This gives doctors a better picture of a patient's internal anatomy.
The new system is called ProjectDR and projects a 3D representation based on medical images such as CT scans and MRI data directly onto a patient's body. Doctors decide exactly what they want to view. Thus, it is possible to project full medical images, but also certain segments of these images such as the lungs or blood vessels.
Internal anatomy in the context of the body
ProjectDR is a project by researchers at the Canadian University of Alberta. "We wanted to create a system that could show doctors a patient's internal anatomy in the context of the body," explains Ian Watts, a graduate student in Computer Science at the University of Alberts. Watts developed ProjectDR with graduate student Michael Fiest. Using ProjectDR, doctors can not only get a better picture of a patient's organs, among other things, but also better place them in the context of a patient's body.
What is remarkable about the system is that the 3D images are automatically adapted to a patient's movements. This means that to display the images correctly, the patient does not have to sit completely still in a certain position, which increases patient comfort. In addition, doctors can view medical images from any angle and can be sure that the images are displayed correctly regardless of the patient's exact position.
Motion interpretation
A motion interpretation system is used to adapt the images to the patient's movements. This system accurately maps the patient's movements using infrared cameras and markings on the patient's body. Software written by Watts specifically for ProjectDR automatically adjusts the 3D images to the findings of the motion interpretation system, so that the images are always correctly displayed on the body.
ProjectDR's developers have a variety of applications in mind for their technology. For instance, surgeons can use the system to prepare for surgery, but ProjectDR can also be used to train doctors and surgeons in training. "There are many applications for this technology, including teaching, physiotherapy, laparoscopic surgery and planning operations," Watts explains.
Testing
The system is still under development; in the short term, its feasibility will be tested in a clinical environment. "We will soon roll out ProjectDR in an operating theatre in a surgical simulation laboratory to test the pros and cons in real-world surgical applications," said Pierre Boulanger, professor of computer science at the University of Alberta. Greg Kawchuk, co-supervisor of the project and affiliated with the Faculty of Rehabilitation Medicine, added: "We are also conducting pilot studies to test the usability of the system for learning chiropractic and physiotherapy procedures."
Once these tests are completed, the research team expects to roll out the system in practice in the near future.
EchoPixel
One company that has been converting 2D medical images into 3D images for some time is EchoPixel. This company has developed True 3D, a visualisation system specifically aimed at the medical sector. True 3D allows doctors to view medical images in 3D using 3D glasses. A key difference with ProjectDR is that True 3D does not project medical images onto the human body, but displays them on a screen.
The EchoPixel consists of a monitor, 3D glasses, an array of cameras and a stylus. The images are displayed on the screen and viewed by the doctor with 3D glasses. About four cameras monitor the orientation of the doctor's head so that the software can automatically adjust the images accordingly. Using the stylus, users can pick up a part of the medical image such as an organ and rotate it in any direction. This allows doctors to detect diseases more easily and accurately, and better prepare for operations.
Author: Wouter Hoeffnagel
Source: University of Alberta
Source: EchoPixel
