How your video games could start playing you

New sensors monitoring immersion will adapt during play

Topics: videogames, Science, kinect, xbox, Microsoft, ,

New sensor technology will let machines monitor players, and adjust games based on their emotions.

When Microsoft Iintorduced the Kinect sensor in 2010, the company said the motion-capture system would transform gaming. That was only partially true; gamers could do novel things like swing an imaginary golf club or dance, but the Kinect wasn’t sensitive enough to register intricate maneuvers. The system, however, has become most popular among hackers, who used it to build smart shopping carts and gesture-controlled quadrocopters. In November, the company will launch an upgraded Kinect with the Xbox One console. With that release, Microsoft could finally disrupt gaming at the level it had originally intended, changing not only how we interact with games but also how games interact with us.

Successful videogames have one thing in common: immersion. When drawn in, players lose track of time, their pulse rises, they become unaware of their surroundings, and, according to a recent study at the University College London, they have difficulty returning to reality. In short, their point of view shifts from the real world to the virtual world. But while it’s easy to identify an immersive game (or scene within a game) after the fact, developers have never had feedback of a player’s engagement in real time.

The intensity of a game could ratchet up as a player leaned forward or his heart began to race.With the new Kinect, reams of information will flow from the gamer. And that data will be granular enough to detect extremely subtle signals. A high-speed 1080p camera can detect minute movements, including eye blinks, wrist twists, and muscle flexes. Using a combination of the camera’s color feed and the active infrared, the Kinect can also pick up fluctuations in a gamer’s facial blood flow to estimate heart rate.

You Might Also Like

Developers could mine that data to change the way games unfold. Along with a player’s skills-response time, shooting accuracy-his reactions could factor into gameplay. For example, the intensity of a game could ratchet up as a player leaned forward or his heart began to race. Games could even respond to facial expressions. Granted, precise emotions are hard to nail down (intense fear and intense joy both raise the heart rate). For that reason, applications may be basic at first-adjusting difficulty based on a player’s posture, for instance.

That probably won’t be the case for long, as sensors become more powerful, affordable, and easily integrated into devices. Already, Israeli company Umoove has created compact head- and eye-tracking systems that could adjust a player’s viewpoint based on head movements. And Irish start-up Galvanic has developed a prototype skin-conductivity sensor that can better correlate a player’s stress level and in-game performance. Consoles with such heightened senses will allow for games that are progressively more immersive-and blur the once stark line between the real world and the virtual one.

This article originally appeared in the September 2013 issue of Popular Science.









More Related Stories

Featured Slide Shows

  • Share on Twitter
  • Share on Facebook
  • 1 of 10
  • Close
  • Fullscreen
  • Thumbnails
    Michael Ohl/Museum fur Naturkunde

    Soul-sucking 'dementor' wasps and 8 other crazy new species

    Soul-Sucking Dementor Wasp

    Latin name: Ampulex dementor

    Truong Ngyuen

    Soul-sucking 'dementor' wasps and 8 other crazy new species

    10,000th reptile species

    Latin name: Cyrtodactylus vilaphongi

    Jodi Rowley/Australian Museum

    Soul-sucking 'dementor' wasps and 8 other crazy new species

    Colour-changing thorny frogs

    Latin name: Gracixalus lumarius

    Judith L. Eger

    Soul-sucking 'dementor' wasps and 8 other crazy new species

    Long-fanged bat

    Latin name: Hypsugo dolichodon

    Neang Thy Moe/FFI

    Soul-sucking 'dementor' wasps and 8 other crazy new species

    Stealthy wolf snake

    Latin name: Lycodon zoosvictoriae

    Michael Janes

    Soul-sucking 'dementor' wasps and 8 other crazy new species

    Feathered coral

    Latin name: Ovabunda andamanensis

    Jerome Constant

    Soul-sucking 'dementor' wasps and 8 other crazy new species

    World's second-longest insect

    Phryganistria heusii yentuensis

    Nantasak Pinkaew

    Soul-sucking 'dementor' wasps and 8 other crazy new species

    Slide 8

    Latin name: Sirindhornia spp

    Tim Johnson

    Soul-sucking 'dementor' wasps and 8 other crazy new species

    Slide 9

    Tylototriton shanorum

  • Recent Slide Shows

Comments

Loading Comments...