MS Kinect 2.0 - Game/Application Ideas

[007ELmO]

Hi,

I'm thinking of coding a game using the Kinect 2.0 sensor (the one that comes with XBOX One). Microsoft provides an SDK on the computer to allow you to program against it.

In the past, I programmed an automatic BMI calculator for the Cleveland Clinic using the first Kinect:
https://www.youtube.com/watch?v=g8GlZ8LcZ8o

There are several new enhancements to the Kinect 2 sensor that we can utilize for extra tricks, that I'd like to investigate.

• 5-6 people detected at once (25 joints per person)
• Directional Microphone Array allows us to listen in just a portion of the room. In V1 I could talk from 30ft away and the speech SDK could pick up my programmed grammar.
• More accurate Depth/RGB cameras (finger joint tracking now included)
• Detecting facial expressions are supposedly now supported, although V1 had it, I think it might be out of the box in V2
• Extremely accurate depth camera supposedly can get your relative heart beat by seeing micro fluctuations in your skin and clothing!
• IR Sensor can see you in the dark.

Of course there are other simple things you can do with the Kinect that other hardware has probably done better, like control your mouse with your hands (ala Minority Report). I presented on how you can easily play solitaire or write in thin air (paintbrush) using the Kinect running in the background. To grab a card in solitaire, you'd just close your fist, and to drop it, you'd release it. It's sort of neat the simple power that opens up once you realize you can control the mouse with your hands, lol. I tried and failed quickly to take control of Quake Live with the Kinect, that would be a neat demonstration I think.

Anyway, if you'd like to talk about a public idea that might be fun to code, please reply.

If you'd like talk about a private idea that could possibly make money, we can speak in PM.

Thanks!
ELmO

 

[Rakehellion]

Sex camera. To take 3D videos while you're having sex with advanced nipple detection features.

 

[purbeast0]

considering a BMI calculator is 100% not possible from just a video or picture of someone ... i'm not sure what to tell you.

 

[QueBert]

considering a BMI calculator is 100% not possible from just a video or picture of someone ... i'm not sure what to tell you.

BMI calculators are mostly worthless anyways, it claims I'm overweight, but I wear 32" jeans and medium shirts. Based off that chart I would look like a dying cancer patient if I was between my proper weight zone. And I would have to shop in the damn toddlers section.

 

[007ELmO]

The BMI calculator interfaced with a computerized weight scale to get their weight, so it was pretty simple to find the user's height and calculate BMI. It's already been implemented and is being tested out in grocery stores in Cleveland (lol).

Secondly the Kinect 2's depth sensor is more accurate, so now I can get waist measurements (if the user spins in a circle, lol)/etc. which help for characteristic health calculations.

But that's not that fun to me, I'm trying to think of different application/games to program.

 

[SunnyD]

"Fapplication"

 

[007ELmO]

This forum rocks lol

 

[purbeast0]

BMI calculators are mostly worthless anyways, it claims I'm overweight, but I wear 32" jeans and medium shirts. Based off that chart I would look like a dying cancer patient if I was between my proper weight zone. And I would have to shop in the damn toddlers section.

i know they are. but they require your weight, which the kinect cannot capture from a video or image, which was my point. but i see he said it was with another scale. i'd guess that the code to capture height from a kinect is probably very simple since it's probably just an api call.

i'm just under being obese and have a 34" waste (although i wear 36" because i hate pants being tight around my thighs).

 

[takeru]

get it working for surgeon simulator co-op mode (left and right arms on the screen lol)

 

[swanysto]

I don't know if it is possible from a physics standpoint, but could you make a frisbee golf game? If they can read the twist in your wrist for bowling, I would think you would be able to read arcs and stuff with a frisbee throw.

My friends and I spent the most time on the simplest games like darts and stuff for the Wii. Dodgeball might be fun as well.

 

[ImpulsE69]

I don't know if it is possible from a physics standpoint, but could you make a frisbee golf game?

I'm going to need you to step out of the car.....

 

[ImpulsE69]

Elmo: do you remember back in the day at some amusement parks they had these video set ups that would film you doing certain actions, and then they would put you in a cartoon (like scooby doo, etc) and play it back so you are actually in the scenes interacting with the characters. You could make a childs game/program that did something like that?

Or you could make a spy program for the NSA.