I redesigned Be My Eyes for XR | XR Design Challenge
9#redesign #immersivetech #accessibility #metaquest3 #applevisionpro #arvr #orion
Inspiration
Geordie LaForge's vision tech, Daredevil's audio vision, RoboCop's AR vision, or Neo being able to see after losing his sight. Growing up, these technologies fascinated me, but after meeting Mo, a low-vision colleague, who used an iPad pro to see the world, I believed the technology to help people like him needs to accelerate.
With XR tech such as the Meta Quest, Apple Vision Pro, and upcoming Meta Orion, I believe that that future can come soon.
For the immersive insiders XR Design challenge, I decided to take this opportunity to bring this concept to light and redesign what Be My Eyes could look like powered by XR tech.
For context: Be My Eyes is an award winning accessibility app where low-vision users can get help from volunteers using video calls to be their eyes. Later, Be My Eyes won boost grants from Expo 2020 Dubai's Expo Live, an Apple Design award, and has collaborated with Open AI, and Meta Raybans.
What it does
In this video I showcase:
A simplified onboarding that uses simple hand gestures rather than eye tracking, to interact with the app.
A digital twin environment that recreates the world around the user, for better flexibility in showing information to those with different types of visual assistance needs.
An alternate High Contrast version to recognize shapes in an environment
A spatial audio ping that allows to locate objects in a space with sound
A visual AI that identifies objects direct in front of a user
Being able to call on a volunteer, who can help
References of best practices I have taken inspiration from
How we built it
The concept was built using Figma, and #Bezi. It was prototyped on to work on desktop, and the apple vision pro.
What's next for Be My Eyes XR
If I had the chance to take it further, I would seriously consider adding more features for different types of visual assistance needs. For example, my friend who needs visual assistance, has tunnel vision, Being able to compress the view and give a wider view within a specified visual area can greatly help with his mobility.
_____________________________
Try it out: https://bezi.com/play/1fee3616-f8ff-465f-9a58-f97143c602d5
Works on:
Desktop browser
Meta Quest browser
Apple Vision Pro Safari