Bookmark and Share

Search:
Advanced Search
Posted: 6/22/2011 - 0 comment(s) [ Comment ] - 0 trackback(s) [ Trackback ]
Category: In the News

Serious Games In The Operating Room

 
Serious Games bringing the Kinect technology into the operating room
 

Da Vinci Surgical Robot--Soon to Be Kinectified
 
Via: The Daily of the University of Washington - UW students adapt gaming hardware for robotic surgery
January 18, 2011
A group of graduate engineering students have adapted Microsoft’s new Kinect technology for surgical robotics. The method involves using the Kinect — an array of cameras and sensors that allow videogame users to control their Xbox 360s with their bodies — to give surgeons force feedback when using tools to perform robotic surgery.
 
“For robotics-assisted surgeries, the surgeon has no sense of touch right now,” said Howard Chizeck, UW professor of electrical engineering. “What we’re doing is using that sense of touch to give information to the surgeon, like ‘You don’t want to go here."
 
Currently, surgeons commonly use robotic tools for minimally invasive surgeries. Tubes with remotely controlled surgical instruments on the ends are inserted into the patient in order to minimize scarring. Surgeons control the instruments with input devices that resemble complex joysticks, and use tiny cameras in the tubes to see inside the patient.
 
The problem is, however, that surgeons have no realistic way to feel what they are doing. If they move a surgical instrument into something solid, the instrument will stop but the joystick will keep moving.
 
Electrical engineering graduate student Fredrik Ryden solved this problem by writing code that allowed the Kinect to map and react to environments in three dimensions, and send spatial information about that environment back to the user.
 
This places electronic restrictions on where the tool can be moved; if the actual instrument hits a bone, the joystick that controls it stops moving. If the instrument moves along a bone, the joystick follows the same path. It is even possible to define off-limits areas to protect vital organs.
 
Howard’s group came up with the idea of using a “depth camera,” a sensor that detects movement in three dimensions by measuring reflecting infrared radiation to automatically define those regions. At a meeting on a Friday afternoon in December, a team member suggested using the newly released Kinect.
 
Before the idea to use a Kinect, a similar system would have cost around $50,000, Chizeck said.
 
The project is part of a larger research effort at the electrical engineering department’s BioRobotics Lab to improve surgical robotic methods. The team hopes to integrate its feedback system into a collaboration of different systems.
 
The team hopes to make surgical robotics reliable and practical enough for long-distance use, allowing doctors in major cities to easily perform surgeries on patients in small, isolated towns.
 
Ryden said that a paper will soon be published about the research. In the meantime, the sensors will need to be scaled down to a size deemed appropriate for surgical use, and the resolution of the video will need to be increased before it is usable.
 
Reach reporter Ryan Dunn at news at dailyuw.com.
 
##
 
Serious Games Bringing The Kinect Technology Into The Operating Room
 
Via: Winnipeg Free Press - Video Games in the OR? Doctors Say New Technology Makes Surgery More Efficient
 
At the same time, doctors at a Toronto hospital are banking on video game technology to save time and prevent contamination in the operating room.
 
A team at Sunnybrook Hospital has started using the Xbox Kinect to virtually manipulate key medical images during surgery. The doctors use hand gestures to zoom in and out of the images or freeze a particular shot without leaving the operating table.
 
Surgeons typically have to leave the sterile field around the patient to pull up images such as MRI or CT scans on a nearby computer. They then have to go through a meticulous cleanup before returning to the area to make sure they don't bring in any bacteria that could harm the patient. It can take up to 20 minutes to clean up each time a doctor consults an image, said Dr. Calvin Law, who helped integrate the technology into the operating room.
 
Those interruptions sometimes cause more than an hour's delay over the course of a surgery, said Law, a surgical oncologist with the hospital's gastrointestinal cancer team. By eliminating those delays, the hospital could save enough time to operate on more patients. What's more, it would help surgeons stay focused and decrease the risk of contamination by keeping everyone within the sterile field, he said.
 
With better control over the images, surgeons can be more precise, Law said. For a cancer surgeon, that could mean saving more healthy tissue when removing a tumor, he said.
 
The idea to bring the Kinect into the operating room came from three engineers — Jamie Tremaine, Greg Brigley and Matt Strickland.
 
The console is a depth camera, meaning it sees in 3-D. It then creates a digital skeleton of the person captured on camera and tracks how the skeleton moves. Those motions are translated into commands.
 
The engineers worked closely with surgeons at Sunnybrook to find command gestures that could be used in the operating room without compromising surgery procedures, Law said.
 
The system underwent extensive testing and has been used in surgery six times, Law said. There are plans to roll it out in other parts of the hospital. They're also looking into ways to use the technology for physiotherapy.
Posted: 6/22/2011 - 0 comment(s) [ Comment ] - 0 trackback(s) [ Trackback ]
Category: In the News

Enlarge Image

MICROSOFT You can go to Disneyland... sort of, with Xbox 360's Kinnect.

LOS ANGELES -- Gamers, start saving your shekels.

If this week's preview of upcoming video games is any indication, there's plenty to get excited about in the months and years to come.

Roughly 45,000 members of the interactive entertainment industry made the annual pilgrimage to Los Angeles this week to attend E3 -- a.k.a. the Electronic Entertainment Expo -- to catch a glimpse at tomorrow's titles today.

And so, after three exhausting days of traipsing through the world's biggest video game trade show, the following are some of the key highlights:

Hot hardware

Nintendo unveiled its next-generation video game console, Wii U, slated for a late 2012 launch.

Gamers will use a 6.2-inch wireless touch screen to control the action -- be it swiping or tapping fingers, using the buttons and analog sticks or taking advantage of the built-in gyroscope to tilt the controller around. Think of it as an iPad meets a Nintendo Wii (but with high-definition graphics, too).

For example, in a football game you can draw a play on the tablet, so that your opponent beside you doesn't see what you're planning. Or in an adventure game, you'll move your character around the virtual world on the television screen but have important info displayed on the Wii U screen, such as character stats, a mini-map, mission objectives, and so on. Or the tablet can show a different perspective of the same game.

If someone in the family wants to watch TV, you can keep playing your Wii U game on the tablet. The console will also play older Nintendo Wii games.

The tablet -- which also includes a camera, microphone and speaker -- is lightweight and comfortable, and the half-dozen games and other demos were a blast.

No price or launch date has been announced yet.

-- -- --

Sony also unveiled new hardware at the show. The PlayStation Vita will soon replace the Sony PlayStation Portable (PSP), bringing console-like graphics to a hand-held system for the first time. Be sure to check out Uncharted: Golden Abyss on YouTube.

You can play games in one of four ways: via the 5-inch OLED touch screen, the back touch panel, various buttons and dual analog sticks, and a built-in gyroscope. The PSVita also boasts dual cameras, Internet connectivity, customizable apps, and the ability to chat with friends while playing online.

The impressive new hand-held will go on sale in time for Christmas for $249.99 for the Wi-Fi version and $299.99 for the Wi-Fi + 3G version.

Shoot now, ask questions later

Action games were all the rage at this year's E3, including a number of first- and third-person shooters. Amassing much of the buzz at the show were sequels with a "3" in their name: Activision's Call of Duty: Modern Warfare 3, Electronic Arts' Battlefield 3, Ubisoft's Far Cry 3, EA/BioWare's Mass Effect 3, Sony's Uncharted 3: Drake's Deception and Microsoft Game Studios' Gears of War 3.

One of the most impressive shooters was 2K Games' BioShock Infinite, which is also the third game in the popular franchise. The wildly strange and imaginative action sequel takes place on a floating air city in an alternate 1912, as you attempt to rescue a mysterious young woman with uncontrollable powers. The stunningly detailed world, memorable characters and intense action sequences all adds to the immersive experience. The single-player adventure is slated for a 2012 launch on PlayStation 3, Xbox 360 and PC.

While not shooters, per se, other impressive action games at E3 include Bethesda's The Elder Scrolls: Skyrim, Crystal Dynamics' reinvented Tomb Raider, Nintendo's The Legend of Zelda: Skyward Sword, Warner Bros.' Batman: Arkham City and EA/BioWare's Star Wars: The Old Republic.

For the kiddies

Activision's Call of Duty: Modern Warfare 3 might get all the press, but the California-based publisher likely has another monster hit on their hands -- for younger gamers.

Out this holiday season for all major consoles and the PC, Skylanders: Spyro's Adventure is part toy, part video game. Players get three small action figures that, when placed on the "Portal of Power" -- a small disc that plugs into the video game machine's USB port -- unlocks that character inside the action role-playing game. There are roughly 30 action figures to collect in total, each with their own unique skills and abilities, and you can "level up" the in-game character over time. When you take your Skylanders figurine to someone else's Portal of Power -- even if it's on another console -- your character and all of its powers are teleported into the game.

Microsoft also wowed attendees with the next batch of games that utilize the popular Kinect for Xbox 360 peripheral. Young kids will no doubt fall for the charm of Kinect Disneyland Adventures, where you can walk around the amusement park, take virtual photos with the Disney characters and engage in more than a dozen motion-sensing games (with a friend beside you, if you like).

Also coming this fall for Kinect is Warner Bros.' Sesame Street: Once Upon A Monster, that uses the Kinect camera to allow kids to play around with Sesame Street characters.

Winnipeg Free Press

By: Marc Saltzman

Posted: 6/22/2011 - 0 comment(s) [ Comment ] - 0 trackback(s) [ Trackback ]
Category: In the News

By: Derrik J. Lang, The Associated Press

The new Nintendo Wii U gaming console is displayed on a video screen during a news conference at the E3 Gaming Convention in Los Angeles, Tuesday, June 7, 2011. (AP Photo/Chris Pizzello)

LOS ANGELES, Calif. - Nintendo has introduced the world to the Wii's touchy new big brother: the Wii U.

The Japanese gaming giant on Tuesday unveiled the Wii video game console's successor, which will broadcast high-definition video and feature a touchscreen controller that can detect motion and interact with what appears on a television display.

"Up until now, home console games had to occupy the TV screen in order to be played," said Nintendo president Satoru Iwata. "The new controller for Wii U, with its 6.2-inch screen built in, means you won't need to give up your gameplay when someone else comes in the room and wants to watch a TV program."

The white touchscreen controller, reminiscent of Apple Inc.'s iPad and other tablet computers, can broadcast standard-definition video but also features a directional pad, microphone, dual analog sticks, speakers, two pairs of shoulder buttons and a front-facing camera, which can be used to make video calls.

The console itself will use proprietary high-definition optical discs, 1080p HDMI output and internal memory that can be upgraded with USB and SD technology. No other technical specifications were provided.

The prototype controller was demonstrated during the Electronic Entertainment Expo, the gaming industry's annual convention, in several ways: displaying a player's inventory in a "Legend of Zelda" game, offering an alternative way to play a chasing game, being used as a shield from incoming attacks in a first-person shooter game and showing the image of a teed-up golf ball on the ground before it was struck to a putting green depicted on a TV.

The controller was also shown being used to browse the Internet both on a TV and the controller. Reggie Fils-Aime, Nintendo of America president, noted that the touchscreen controller is not meant to be a portable gaming device and that the system is dubbed the Wii U because its "unique, unifying and maybe even utopian."

Nintendo said the Wii U will be released between April and December next year and will be backward-compatible with Wii games and controllers.

"Smash Brothers," ''Darksiders II," ''Batman: Arkham City," ''Tekken," ''Assassin's Creed" and "Metro: Last Light" were among the titles announced that would be released for the system.

The price for Wii U was not revealed.

The unveiling of the Wii U comes after two years of slumping sales for Nintendo's Wii, which remains the overall top-selling home video game console against Microsoft Corp.'s Xbox 360 and Sony Corp.'s PlayStation 3. Those consoles already feature high-definition graphics and added motion-sensing capabilities similar to the Wii last year with their respective Kinect and Move camera systems.

Posted: 6/22/2011 - 0 comment(s) [ Comment ] - 0 trackback(s) [ Trackback ]

Musician and inventor Onyx Ashanti demonstrates "beatjazz" -- his music created with two handheld controllers, an iPhone and a mouthpiece, and played with the entire body. At TED's Full Spectrum Auditions, after locking in his beats and loops, he plays a 3-minute song that shares his vision for the future of music.

Musician and inventor Onyx Ashanti demonstrates "beatjazz" -- his music created with two handheld controllers, an iPhone and a mouthpiece, and played with the entire body. At TED's Full Spectrum Auditions, after locking in his beats and loops, he plays a 3-minute song that shares his vision for the future of music.

Original Article