Duration: 0:32

189 views

8

A custom software on my pc running Windows (yes, it's an Mac Mini running Windows through Bootcamp) interacts through usb with an Adafruit Huzzah32 ESP32 microcontroller that then sends gamepad commands to a gaming console, in this demo an Android TV but it could be a Playstation, Xbox or Nintendo Switch instead. With the appropriate Bluetooth adapter you could access retro consoles like Gamecube, Sega Genesis or PS1 as well! I'll be posting a link to my software and Arduino code any day soon, keep your eyes open.

WEB CAM + OTHER VIEWING SOLUTIONS
I'm using a cheap Web cam (quite low quality as you may notice) and can see what's happening on the big TV through Win Camera app that's running in the background window (the custom software is a little black box , it needs to be on top/the active window). I use two physical switches acting as left/right keys and you can do an action like jump or toggle throttle through eye blinks, thanks to the wide customisation possibilities in Project Iris software. So I don't need to look at the pc screen that much necessarily. With a better webcam or even an hdmi capture card on your pc you can of course look mostly in your pc screen or skip the big TV altogether. Project Iris can also draw interaction areas outside of your pc screen so you can literally do actions by staring into thin air or even have a plastic glass screen and draw corresponding squares with a pencil. Or if you can remove the monitor and leave the eye tracker in front of you, then you have a "headless" solution. Or just plug the gaming console into the same monitor as your pc and just switch the hdmi channel then you have the game screen visible and the pc still running in the background with your eye tracking, voice controls, keyboard or whatever you're using on your computer.