Mixed Reality Training Experience
Overview
The 3D digital world is a relatively new area that currently has no set standards when it comes to designing user interfaces. Extended reality encompasses multiple facets of the 3D space including augmented reality (AR), virtual reality (VR), and mixed reality (XR). Through weeks of extensive research on user interfaces (UI), and technological capabilities of the Hololense 2, my team and I partnered with Th3rd Coast Digital Solutions (now MindSpring), an industry leader in augmented reality solutions and immersive technologies, to design an XR training experience for an energy company.
Our work explored how to push past the boundaries set by 2D interfaces, and explore ways to create immersive 3D experiences.
Timeline
Sep 2021 - May 2022
My Role
Research UX/UI Design for XR
Mixed Reality Training Experience
Overview
The 3D digital world is a relatively new area that currently has no set standards when it comes to designing user interfaces. Extended reality encompasses multiple facets of the 3D space including augmented reality (AR), virtual reality (VR), and mixed reality (XR). Through weeks of extensive research on user interfaces (UI), and technological capabilities of the Hololense 2, my team and I partnered with Th3rd Coast Digital Solutions (now MindSpring), an industry leader in augmented reality solutions and immersive technologies, to design an XR training experience for an energy company.
Our work explored how to push past the boundaries set by 2D interfaces, and explore ways to create immersive 3D experiences.
Timeline
Sep 2021 - May 2022
My Role
Research UX/UI Design for XR
Research
I conducted extensive research regarding interfaces, experience design, motion tracking in the Hololense 2, and custom gestures. Part of my research was focused on creating custom gestures to activate certain parts of the UI. Keeping with the focus of creating surprise and delight, gesture design was a challenge because we had to assess and determine the practicality of each gesture. First, we had to see if the gesture was possible to create in the HoloLens 2. Second, we had to keep in mind some design considerations:
No two people have the same intuitions
The more physical the response of an object, the wider the range of interactions
Create a base set of gestures with specific affordances
Use real world affordances
Eliminate ambiguity
This research helped to guide the design process for the training experience which would guide users through the building and different zones. Taking my research and the branding standards and requirements of the project, I assisted in forming the UI, flow, and testing the experiences.
UX/UI Design for XR
My designs focused on how intuitive, accessible, and practical the interface was, while pushing the traditional 2D outside with the use of custom gestures. Usability was also a key focus. How intuitive is the UI? Is it accessible to all types of people with disabilities? What other functions aside from visuals could we provide to make the experience more seamless? Ultimately, we made decisions that advocated for the user. Hitting all three of these points is easier said than done. There were many times we had to go back to the drawing board and reform strategies. With every iteration came new challenges that pushed us forward.
I learned, through this focused approach, that the ultimate goal is to push outside the boundaries in ways that create delight in the most practical ways possible, while also telling a story. When developing new solutions for this project, we came up with subtle details that would surprise the user.
These small surprises created delight when we presented them, and as a result an emotional attachment was made in the experience. This goes back to our core fundamental of designing UI/UX. This approach made for a more successful client presentation and overall experience.
By prioritizing user needs and incorporating feedback at each stage of the design process, we have created a product that resonates with our target audience and fulfills their requirements effectively. Moving forward, it is essential to continue gathering user feedback and iterating on our designs to maintain usability. By remaining agile and responsive to evolving user needs and market trends, we can ensure the long-term success and sustainability of our solutions. By placing the user at the center of the design process, we can create experiences that delight, engage, and empower users, ultimately driving success for both our users and Nurture as a platform.
