IR Head Tracking for games, simulators

Thebobo

Lifer
Jun 19, 2006
18,574
7,672
136
Recently purchased Xplane and I'm really digging it. I wanted get a head tracker but not the $150.00 commercial one so I am building a IR head tracker. Lost of folks of done it there are tons of videos online.

So what I spent to far.
PS3 camera from newegg $3 dollars
Camera driver PC driver $3
3 IR LEDs $3
Already had the resistors. but a couple dollars if you needs to purchase.
Head tracking software is free.
The LED head clip I'm making out of a balsaply . I'll just velcro or wire tie it to my head set.

Interesting I ordered the IR LED but got these huge ones. I tested them out and the camera sees them fine. So just 10 dollars and some time. When I finish my LED headphone clip I'll post and and some video of the action. Just do a search online for IR head tracker and there are tons of links on how to assemble.

Anyone else here make one and use it? what games or simulations are you using?

 
Last edited:
Mar 11, 2004
23,444
5,847
146
I don't really get this with a display that doesn't also move along with your vision. I guess maybe with a projector that fills your field of view or something?

Don't get me wrong, neat little project, I just feel like this is one of those "immersive" things that actually hurts immersion some as either you'll have it nowhere close to 1:1 tracking, or you're gonna be turning away from the onscreen action in such a way that it'd break immersion. But that could just be me.
 
Last edited:

Thebobo

Lifer
Jun 19, 2006
18,574
7,672
136
I don't really get this with a display that doesn't also move along with your vision. I guess maybe with a projector that fills your field of view or something?

Rather than me explain it best just to watch this short video. The one he has is the commercial version which cost $150. You can put one together for under $20, works exactly the same, as I stated above the software needed is opentrack software and its open source.

 
Mar 11, 2004
23,444
5,847
146
Rather than me explain it best just to watch this short video. The one he has is the commercial version which cost $150. You can put one together for under $20, works exactly the same, as I stated above the software needed is opentrack software and its open source.


Yes, I know how they work and that video highlights many of the things I was saying. Without a display that covers your FOV, you're going to end up doing weird strained looks where you're turning away from the display as part of it, so its something that I think seems more immersive but has glaring flaws that makes it less immersive for me because the scaling isn't quite right and you have to be aware of your own space (which isn't the same as the space you're in in the game (well unless you put in a ton of effort to make it that way). Kinda like the Wii's controllers, they sound good in theory, but in practice it just didn't work as well and became tedious pantomime that reduces the immersion for various reasons.

Now, with a full cockpit setup, or VR and other things, that makes a bit more sense. For a single typical computer monitor, you're going to be looking away and doing a lot of awkward movements with your head to enable the changes you see on the screen (and you're going to make some of that pointless as your awkward head movement makes the screen less visible). For me, that actually hurts immersion more than it helps it. I'd rather focus the view on where I'd have my view focused if I were actually there (and flying a plane like that, or driving, its on the sky or road, not on the immediate cockpit for most of the time I'm there; they spend a lot of time trying to make controlling things intuitive so that you're not sitting there fiddling at all the different controls, or for flying bigger complex jets you'd have a lot of tr

I know some people like that, and like I said, its a neat project, but it just doesn't work for me, it basically makes me constantly aware of the hardware outside of the game, but for a single monitor it just reinforces that I'm playing a game and watching things through this little 2D window, keeping me from losing myself in the immersion of the experience. My mind actually immerses more when I'm not thinking about all the hardware and are using a simple intuitive controller so that I focus on what I want to actually focus on.

Again, I'm not saying its worthless, and I know people that do a lot of stuff like this paired with doing more (multiple displays or VR headsets, flight controls, even building their own little simulator thing that actually resembles real cockpits - well as much as you can while not spending a ridiculous amount of money) to heighten the immersion, and that the DIY aspect is appealing (to me that's the most appealing aspect).

Oh, and another point, in real life I can keep my eyes focused while changing my head quite a bit, but using that it's gonna be changing my view quite a lot. I know they're moving towards eye tracking for VR as well to make it so you can do that (although I think some of that is actually basically just shifting all the tilting so that the info is provided by your eyes and not your full head movement).

Its kinda the old, give a kid a cardboard box and they'll have more fun and immerse in their imagination than a toy that seems really immersive or "realistic" but has flaws. It often burst the immersion bubble and then you become aware of and focused on the aspects of it compared to your mind fully in its own space. So we keep adding things here and there that will help the overall immersion once we get things right, but it can also hurt the immersion because we're dealing with the not fully formed (or "there yet") implementation of it. I'm not trying to criticize that, just recognize why it can often feel less immersive than playing some simple yet incredibly bizarre game (like Mario Bros, I can become more absorbed into something like that than I can many of the sims because of how I'm able to focus on what is there with the former versus what isn't there in the latter).

I actually thought the way that the one guy reversed the IR tracking on the Wii was more interesting (the one where he had the IR trackers on some glasses, and he had some targets that when facing straight on appeared to be flat on the same plane, but then he'd step/walk in different directions and you'd see that some were closer and others farther away). Stuff like that is fun, but the stationary cockpit type stuff really just takes me out of the game for some reason. I know that's not true for everyone though. Its kinda weird in that I remember liking the cockpit view when playing some racing games (the first Xbox 360 Project Gotham Racing game comes to mind as one I enjoyed), but often times it doesn't (like the ones where you see the top of the dash and steering wheel, maybe the speedo, even though that's probably more realistic, it often was less immersive to me because there was some weird awkward disconnect happening). But I always preferred the behind the car view over the "bumper barely off the road car POV" view (but know that some people apparently feel the complete opposite and wonder why anyone would play a racing game from not the most first-person view that you can).
 

Thebobo

Lifer
Jun 19, 2006
18,574
7,672
136
I look at it as another input device, can't have enough with simulators. Just curious have you tried a calibrated IR head tracking set up? I did and fell in love with it and I almost spent $150 which seemed a ripoff off and I saw all these other folks doing it for < 30 dollars.

Btw your movements are scaled, you don't have to turn your head 90% to end to look 90% you can set it up to whatever you want to. That why it's so valuable with only one monitor.

Anyway its up and running, still working on calibrating and here is a pic of my chepo-IRclip1000X. That and a 3 dollar ps3 cam and free opettrack software. btw you can play around with open track just with one IR or two led to do other things on your computer not just play games.

https://sourceforge.net/projects/opentrack.mirror/

0gIjltN.jpg

Yea it looks like crap but its functional - maybe V2
 
Last edited:

purbeast0

No Lifer
Sep 13, 2001
53,455
6,301
126
Rather than me explain it best just to watch this short video. The one he has is the commercial version which cost $150. You can put one together for under $20, works exactly the same, as I stated above the software needed is opentrack software and its open source.

Still looks absolutely stupid because you aren't even looking where you move your body. You're still looking at your fixed position monitor.

"Oh let me turn my head to the left but look out corner peripheral of my right side to see what is on the monitor to see what is on the left side of my car."

Just get a VR setup if you want this and have it actually working in a manner that makes any sense.
 

Thebobo

Lifer
Jun 19, 2006
18,574
7,672
136
Still looks absolutely stupid because you aren't even looking where you move your body. You're still looking at your fixed position monitor.

"Oh let me turn my head to the left but look out corner peripheral of my right side to see what is on the monitor to see what is on the left side of my car."

Just get a VR setup if you want this and have it actually working in a manner that makes any sense.

Have you ever tried head tracking as an input device with a flight simulator? And damn for a geek site a bunch technology Eeyore's here. /Sad :p

btw here is a list of the simulators, games that use head tracking.
https://www.naturalpoint.com/trackir/games/
 

purbeast0

No Lifer
Sep 13, 2001
53,455
6,301
126
Have you ever tried head tracking as an input device with a flight simulator? And damn for a geek site a bunch technology Eeyore's here. /Sad :p

btw here is a list of the simulators, games that use head tracking.
https://www.naturalpoint.com/trackir/games/
No but I have PSVR and that looks completely retarded and basically a bootleg attempt at trying to replicate VR.

I get the idea behind it but it's just completely backwards.

Look right to see what's on your left. That simply doesn't make any sense to me and wouldn't add any immersion after 2 seconds of the gimmick wore off.
 

ImpulsE69

Lifer
Jan 8, 2010
14,946
1,077
126
This method is used quite a bit in virtual pinball cabinets. I've never done it myself but many people think it is pretty cool. Seemed like a lot of work for something that only somewhat worked.
 

destrekor

Lifer
Nov 18, 2005
28,799
359
126
Still looks absolutely stupid because you aren't even looking where you move your body. You're still looking at your fixed position monitor.

"Oh let me turn my head to the left but look out corner peripheral of my right side to see what is on the monitor to see what is on the left side of my car."

Just get a VR setup if you want this and have it actually working in a manner that makes any sense.

Yeah that's terrible with a single monitor. However, I have used that kind of setup (camera tracking entirely, no reflectors - wasn't 100% reliable) with a triple-monitor surround setup and playing iRacing. And it was glorious. You didn't need the FOV to be too wide to see out the sides, you just turn your head a little bit (you customize how much) and you see far more out of your left monitor without having to lose straight ahead from most of your vision.

Also it's an older technology, it pre-dates modern VR. But true VR systems make driving/racing simulators a touch more difficult because you lose vision of where your hands are in relation to the wheel and all the buttons you may need to manage. I say that without having seen what the Vive does with the front cameras in relation to seeing your hands and the wheel.

I've still been waiting for the 2nd/3rd generation evolutions of the current products before I sink money into the platform. That and while the dual 290x's in Crossfire can handle it for some games, Crossfire/SLI is dying as developers now need to specifically support it in modern DirectX 12/ FL 11_3, whereas before developer support requirements were minimal and it was all in the drivers to really handle the GPU load splitting. It's very buggy now even playing games where DX11 is still an option, especially the Battlefield series. BF1 my crossfire setup fails to beat the performance of a single GPU, especially when looking at consistent minimum performance. It is superior gameplay with a single GPU, which is thankful because I haven't wanted to play BF1 or even BF4 before it much with triple-monitor surround play. I played it some in BF3 but generally preferred to just go for superior graphics on a single monitor while maintaining a good framerate.
 

KillerCharlie

Diamond Member
Aug 21, 2005
3,691
68
91
Does your homemade version have 6DOF, or only 3?

I love how people here are bashing it without having tried it.

I've been using aTrackIR for a while now with latest IL-2 flight sim. Now that I have it, I couldn't imagine playing without it. It's vital for flight sims.

You don't actually move your head that much, it's very subtle. For moderate angles you don't even notice you're using it - it feels natural. Head tracking adds a tremendous amount of immersion.

I'd love to try VR, but it'll be a while before it would well at a reasonable price.
 
  • Like
Reactions: Thebobo

destrekor

Lifer
Nov 18, 2005
28,799
359
126
Does your homemade version have 6DOF, or only 3?

I love how people here are bashing it without having tried it.

I've been using aTrackIR for a while now with latest IL-2 flight sim. Now that I have it, I couldn't imagine playing without it. It's vital for flight sims.

You don't actually move your head that much, it's very subtle. For moderate angles you don't even notice you're using it - it feels natural. Head tracking adds a tremendous amount of immersion.

I'd love to try VR, but it'll be a while before it would well at a reasonable price.

I mean you can get reasonable prices today. Especially now that new hardware is coming out soon, there have been great deals on current Oculus and HTC Vive sets. They aren't at all terrible products by any stretch of the definition, but depending on personal sensitivities I have heard they may not be comfortable. It seems like it is comfortable for most people who are at least interested, which may be a partially self-selecting crowd, perhaps having experienced some other form of "VR" or 3D environment. I certainly know at least a few people personally who aren't remotely interested in VR goggles in the first place, because of prior experiences being uncomfortable.Some of those folk may just need the 2nd or 3rd generation hardware, with higher refresh rates and simply superior performance in every capacity.
 

purbeast0

No Lifer
Sep 13, 2001
53,455
6,301
126
Yeah that's terrible with a single monitor. However, I have used that kind of setup (camera tracking entirely, no reflectors - wasn't 100% reliable) with a triple-monitor surround setup and playing iRacing. And it was glorious. You didn't need the FOV to be too wide to see out the sides, you just turn your head a little bit (you customize how much) and you see far more out of your left monitor without having to lose straight ahead from most of your vision.

Also it's an older technology, it pre-dates modern VR. But true VR systems make driving/racing simulators a touch more difficult because you lose vision of where your hands are in relation to the wheel and all the buttons you may need to manage. I say that without having seen what the Vive does with the front cameras in relation to seeing your hands and the wheel.

I've still been waiting for the 2nd/3rd generation evolutions of the current products before I sink money into the platform. That and while the dual 290x's in Crossfire can handle it for some games, Crossfire/SLI is dying as developers now need to specifically support it in modern DirectX 12/ FL 11_3, whereas before developer support requirements were minimal and it was all in the drivers to really handle the GPU load splitting. It's very buggy now even playing games where DX11 is still an option, especially the Battlefield series. BF1 my crossfire setup fails to beat the performance of a single GPU, especially when looking at consistent minimum performance. It is superior gameplay with a single GPU, which is thankful because I haven't wanted to play BF1 or even BF4 before it much with triple-monitor surround play. I played it some in BF3 but generally preferred to just go for superior graphics on a single monitor while maintaining a good framerate.
Ah for 3+ monitor setups I could definitely see it being useful.
 

Thebobo

Lifer
Jun 19, 2006
18,574
7,672
136
Does your homemade version have 6DOF, or only 3?

I love how people here are bashing it without having tried it.

I've been using aTrackIR for a while now with latest IL-2 flight sim. Now that I have it, I couldn't imagine playing without it. It's vital for flight sims.

You don't actually move your head that much, it's very subtle. For moderate angles you don't even notice you're using it - it feels natural. Head tracking adds a tremendous amount of immersion.

I'd love to try VR, but it'll be a while before it would well at a reasonable price.

6DOF, I'm still setting mine up on opentracker. yea the naysayers really aren't grasping the suttitley of how it works, or its benefits. While looking into it I see how popular it is in flying and driving simulators and some newer games such as on Elite Dangerous. Looks like a cool game going to try it out.

BTW what's really cool if you just want to play around with head tracking the opentracker software you can use your Smartphones Gyro as a input to control your game if you want to try head tracking since its free. Strap it to you hat and go! https://www.youtube.com/watch?v=fYyorc6A7vo :)

772e84dd4fc9d1bfb1f30cddda9f19bf.jpg
 
  • Like
Reactions: [DHT]Osiris

Thebobo

Lifer
Jun 19, 2006
18,574
7,672
136
Yeah that's terrible with a single monitor. However, I have used that kind of setup (camera tracking entirely, no reflectors - wasn't 100% reliable) with a triple-monitor surround setup and playing iRacing. And it was glorious. You didn't need the FOV to be too wide to see out the sides, you just turn your head a little bit (you customize how much) and you see far more out of your left monitor without having to lose straight ahead from most of your vision.
.

Disagree 100% it perfect for single monitor usage. Multiple monitors you don't need one, your view is already there what's the point lol? It's not so much for emersion it's an INPUT DEVICE.

I still think the ones complaining here haven't used one or have a have grasp of how it helps folks especially in aircraft simulators.
 
Last edited:

clamum

Lifer
Feb 13, 2003
26,252
403
126
I have TrackIR (v5) and it works really well. There's no way in shit I'd build one myself because I don't think $150 for Track IR with the track clip pro is expensive but to each their own I suppose. I think it's a must-have for any sim game and it works good in something like ARMA too. I don't really use it anymore (don't play those games much) but I would highly recommend it if you play flight sims, racing games, Elite: Dangerous or space sims, etc.
 

Scarpozzi

Lifer
Jun 13, 2000
26,391
1,780
126
Ah for 3+ monitor setups I could definitely see it being useful.
The calibration makes the difference though. If you're only moving your head 30% for a 90% simulated turn, it could be beneficial. I flew some real life airplanes and when flying VFR, you do need to turn your head. This seems like it could help. I will state that when you really need it isn't on takeoffs or landing final approaches....just when doing the legs to line up on the runway.

Seems like a fun project and definitely a cool use of cheap parts. For a 3 monitor setup, it'd be pretty nice..... I've not played with Flight Sims in years because we had kids and I lost my office.....I started using a laptop instead of a desktop and eventually just my phone and only get out the laptop a handful of times a year. I'm about finished with the bonus room I'm building (upstairs). I should have hvac in 2-3 weeks and I'll likely have a desk in the corner...hopefully I can build out a new gaming PC for kicks and see if anything's changed in the last 12 years.
 
  • Like
Reactions: Thebobo

Thebobo

Lifer
Jun 19, 2006
18,574
7,672
136
I have TrackIR (v5) and it works really well. There's no way in shit I'd build one myself because I don't think $150 for Track IR with the track clip pro is expensive but to each their own I suppose. I think it's a must-have for any sim game and it works good in something like ARMA too. I don't really use it anymore (don't play those games much) but I would highly recommend it if you play flight sims, racing games, Elite: Dangerous or space sims, etc.

Thanks for the inspiring words. I tried it at a friends house and was like I have to have one now. Am currently flying Xplane 11 looking into FS Stream.
 
  • Like
Reactions: clamum

[DHT]Osiris

Lifer
Dec 15, 2015
16,698
15,656
146
6DOF, I'm still setting mine up on opentracker. yea the naysayers really aren't grasping the suttitley of how it works, or its benefits. While looking into it I see how popular it is in flying and driving simulators and some newer games such as on Elite Dangerous. Looks like a cool game going to try it out.

BTW what's really cool if you just want to play around with head tracking the opentracker software you can use your Smartphones Gyro as a input to control your game if you want to try head tracking since its free. Strap it to you hat and go! https://www.youtube.com/watch?v=fYyorc6A7vo :)

772e84dd4fc9d1bfb1f30cddda9f19bf.jpg
Okay, that's some level 35 hacking right there. Digging it.
 
  • Like
Reactions: Thebobo

BurnItDwn

Lifer
Oct 10, 1999
26,278
1,784
126
It seems like maybe an HTC Vive would work better for your needs. Though if it causes motion sickness for you or whatever, then I can understand trying to compromise with a halfway type system.
 

destrekor

Lifer
Nov 18, 2005
28,799
359
126
Disagree 100% it perfect for single monitor usage. Multiple monitors you don't need one, your view is already there what's the point lol? It's not so much for emersion it's an INPUT DEVICE.

I still think the ones complaining here haven't used one or have a have grasp of how it helps folks especially in aircraft simulators.

Yeah I sort of misspoke with it being bad with 1 monitor. It can definitely help so long as you dial in the settings right.

But for 3 monitor, it can be just as helpful! You might *think* everything would be in view with 3 monitors, but that isn't always the case. You can get away with "looser" settings with the head turning due to the extra screen real estate, for instance. But depending on screen size, distance to screen from head, the relative angle between the monitors, etc, all factor in when trying to set a faithful field of view. In iRacing they offer a ton of tools to dial in settings all geared toward an accurate FOV. I mean I was breaking out the measuring tape and carefully lining monitors up and finding out the angles in degrees. When the FOV that felt right was in place, I couldn't really see out of the side windows. Now if you can get a total wraparound monitor setup, covering a full 180 degrees, then you definitely wouldn't need head tracking.
 
  • Like
Reactions: Thebobo

Scarpozzi

Lifer
Jun 13, 2000
26,391
1,780
126
Yesterday after my reply, I hit teh intrawebs to see what advancements they've made in Flight Sims since I got Flight Sim X way back in the day...looks like it's still relevant.

I suppose no one is willing to invest the kind of money Microsoft did in the engine and the bitmaps are pretty good for generated scenery. MS also created a GIS program back then called Streets and I think they were using that data to map the roads in Flight Sim X.... When I used to run it, I'd turn the scenery way up high and my system didn't have much of an issue keeping up with the demands. I'm building a new room over my garage that'll be like 900sq feet of space. I'll have plenty of space to throw a rig in there with 2-3 monitors in the corner. It might be fun to do a build with SSD and a shiny new Intel proc in the winter months.
 

Thebobo

Lifer
Jun 19, 2006
18,574
7,672
136
Yesterday after my reply, I hit teh intrawebs to see what advancements they've made in Flight Sims since I got Flight Sim X way back in the day...looks like it's still relevant.

I suppose no one is willing to invest the kind of money Microsoft did in the engine and the bitmaps are pretty good for generated scenery. MS also created a GIS program back then called Streets and I think they were using that data to map the roads in Flight Sim X.... When I used to run it, I'd turn the scenery way up high and my system didn't have much of an issue keeping up with the demands. I'm building a new room over my garage that'll be like 900sq feet of space. I'll have plenty of space to throw a rig in there with 2-3 monitors in the corner. It might be fun to do a build with SSD and a shiny new Intel proc in the winter months.

Yea I did as well and ended up with X Plane-11 it has the best scenery and flight dynamics and there are lots of plugins to make it even more realistic. MFSstream version base is only $25 I'll probably try that as well.

The one thing I wanted to do was myself and a buddy fly our sailplanes together but you have to join an ATC setup to online in X plane.

And you can try the Xplane11 demo, lets you play for 15 mins every time you reset. Enough to see if you like it.
 

Scarpozzi

Lifer
Jun 13, 2000
26,391
1,780
126
Yea I did as well and ended up with X Plane-11 it has the best scenery and flight dynamics and there are lots of plugins to make it even more realistic. MFSstream version base is only $25 I'll probably try that as well.

The one thing I wanted to do was myself and a buddy fly our sailplanes together but you have to join an ATC setup to online in X plane.

And you can try the Xplane11 demo, lets you play for 15 mins every time you reset. Enough to see if you like it.
I played one of the Xplane versions a long while ago. I had downloaded it somehow, but wasn't impressed with the mechanics at the time. I was comparing it to maybe Flight Sim 2000 or 2002....I feel old.

I may check the 11 demo out if it's being actively developed. My controller is an old Logitec joystick with force feedback. It was fun flying with it, but the force feedback was interesting when on autopilot.....you couldn't take your hand off the stick because it would start thrashing back and forth if you weren't there to counteract the motors. I may have to start from scratch and figure out what controllers I should go with if I do the build in the next 6-8 months.
 
  • Like
Reactions: Thebobo

pauldun170

Diamond Member
Sep 26, 2011
9,260
5,300
136
I have TrackIR (v5) and it works really well. There's no way in shit I'd build one myself because I don't think $150 for Track IR with the track clip pro is expensive but to each their own I suppose. I think it's a must-have for any sim game and it works good in something like ARMA too. I don't really use it anymore (don't play those games much) but I would highly recommend it if you play flight sims, racing games, Elite: Dangerous or space sims, etc.

Same here.
Track IR user since original then moved on to 2 and 5. Won't fly or drive without it.
Unfortunately i haven't the time to game much nowadays so it sits mostly idle
 
  • Like
Reactions: Thebobo