Tom Cruise Minority Report Raytheon Army Version
In my last post on Fogscreen I shared my vision for a future of alternative display technologies opening up new options for surgical imaging. Let me elaborate on what I have called the “hand gesture control” concept. In traditional surgery there is a direct interaction between surgeon and patient. Laparoscopy (”keyhole surgery”- my specialty) is the revolutionary breakthrough where for the first time there is a technological interface between surgeon and patient. I believe this is a radical enabling step since this interface can now be modified endlessly by technology. Today we remain shackled by the surgeon using his hand to manipulate the tools. The DaVinci robot was one of the first steps whereby the direct line of touch between surgeon and patient has been interrupted by a computer controlled interface.
We should further explore the possibilities of the hand gesture system. Fogscreen employes this in their interactive version where you write with your finger like a cursor in space and the lines appear where you gesture. Clearly, a computer and camera system track movements and convert them into cursor paths. First shown in Minority Report, Tom Cruise gestures in space and pulls, pushes, and manipulats computer images projected in space. Wll folks, prototypes of this already exist. Raytheon has developed one for the army (they get all the good stuff first)– but the concept directly applies to surgery. Project an image in space- gesture with hand - direct laser or robotic tool- it opens up endless possibilities for free form and novel operative procedures and I predict it will be a major concept for future surgery.
Related Articles
15 users responded in this post
[…] I have a series of Nextfest updates coming. These are the first of my photo/video reports. An outstanding show at the Javits Center in NYC fromWired with advances in technology and cutting edge developments. The first impresion is the fogscreen display overhead as you pass into the exhibit hall. Fogscreen generates a water vapor mist with ultrasound (like an ultrasound humidifier) and then projects videon onto the mist-like screen. Ok Doc cool but isn’t this just a party trick why sould we care? The more intriguing aspect (besides the techno club rave entrance) is that this is one of the first commercialized alternative video display technologies. I have been speaking for years that I envision future endoscopy and medical imaging to employ several alternative display technologies. Today we are using just CRTs, LCDs, and the occasiaonal HMD (head mounted display). THinking outside the box a bit — if we can transform the imaging display then we can create new funtionality. I envision augmented reality displays joining live visio with projected images. Just as fogscreen images on moving water vapor we could someday image on living tissues. Interactivity has been added by the fogscreen people for entertainment– you draw with your finger in space and the computer “sees” and interprets where you are. The same could be done for surgery by pointing and drawing in space. Remember Tom Cruise’s hand movements directing the image recalls in Minority Report… Its coming… « FDA Approves Adhesion Prevention Solution for Surgery | NextFest 2: Hand Gesture Controlled Surgery and Tom Cruise » […]
this is so freakin COOL!!!!!
It’s like Kurtzweil’s book The Singularity is Near…when technology enhances human abilities, the possibility for evolution becomes endless and RAPID…no need to wait for natural evolution when the mind can create adaptations as fast as anyone can think of them.
Wow. As a layperson, this concept of laparoscopy as a technological revolution blows my mind.
Michele
[…] I previously wrote on the fogscreen display system. Just as interesting as the display system is a demo of the hand gesture control concept. Here hands point in space and the display responds with electric ink. There must be a video tracking system trnslating the movements into mouse controls. I can forsee systems where conrol systems like this would folow a sugeons hands. Just like Tom Cruise in Minority Report (before he jumped on couches). « New Robots with Whiskers- Next Cut Of Their Hands | […]
[…] […]
[…] I previously wrote on the fogscreen display system. Just as interesting as the display system is a demo of the hand gesture control concept. Here hands point in space and the display responds with electric ink. There must be a video tracking system trnslating the movements into mouse controls. I can forsee systems where conrol systems like this would folow a sugeons hands. Just like Tom Cruise in Minority Report (before he jumped on couches). « Interactive Hand Gesture Control Video | […]
[…] In addition to the fogscreen display overhead as you entered Nextfest there was another water vapor-based projection system. Heliodisplay from IOtechnology also projects moving images onto a stream of vapor. They also have an interactive gesture controled version. Generates the same ideas to me for a gesture control surgical system. Here my video of me messing with the images. You can see the mirror projector in the back. « New Robots with Whiskers- Cut Off Their Hands | Hand Gesture Control Video » […]
[…] Steven F. Palter introduces his vision of hand “gesture controlled” surgery. […]
[…] Grand Rounds 3.3 are up hosted by Jon Mikel at Unbounded Medicine. I really like this site which is on our DITM blogroll. He is a student in MExico studying to be a surgeon and somehow finds time to blog on medicine and society. I am honored that my post on what I call “gesture controlled surgery”, Nextfest, and Tom Cruise in Minority Report is included. Thanks and welcome all grand rounds visitors! « World’s Thinnest LCD for Cell-Phones Also Good for Surgeon | […]
[…] In the big picture this is another variation of alternative control systems. I often speak of “gesture controled surgery” where gestures are converted by video to task controls for surgery. This another way to potentially control surgical taks without traditional hands or instruments. « World’s Largest Seamless Display- Coming to the OR Someday | […]
I really liked Minority Report and the futuristic ideas it had. Are there any plans to make a sequel?
[…] I am very excited about recent reports of tiny scopes to look inside the breast or into the spine or into the brain. I belive microendoscopes will continue to evolve. This report is impoin that this is a new type of endoscope that uses a different mechanism for providing the image. The system allows radically smaller scopes and potentially provides a 3D image. THis opens up the potential for remote imaging and for computer modification of the images- the two topics I belive define the future of endoscopic surgery. […]
Is anyone here a follower/believer of Scientology? Do you think Tom Cruise is a good spokesman? He had the leader of Scientology go with him
and his bride on their honeymoon and now some critics are saying his wedding was a sales pitch for Scientology.
[…] Computer/Radio Control is over a portable radio with miniature flat screen. Allows soldiers to exchange information and videos in real time. Menus are controlled with a remote input device attached to the soldier and activated with a finger touch. Medical Applications: information exchange for alternate visualization and new surgical gesture controls. […]
[…] Read about the concept of gesture control in medicine here and and see videos here. I am sure this idea will make it to the operating room of the future. « New Swallowable Pillcam Aims to Sniff not Just Look | […]
[…] What is unique about the screen is that it is a collaborative touch table interface. That is, multiple users can interact and manipulate objects. While they claim Microsoft has kept this under wraps for 5 years it is not a new concept at all. Heck, even Minority Report ( my surgical version here) used this concept in its image manipulation scenes. […]
Leave A Reply
Please Note: Comment moderation maybe active so there is no need to resubmit your comments