Client: JOVRNALISM
Tools and framework: Apple ARKit, Unity, C#, Depth-kit, Volumetric capture, 360 Video, UI/UX
Role: AR UX designer, Director (Volumetric capture & 360 video), Engineer (AR)
Team size: 15
--------
Exploring the potential of the immersive medium, the class of jovrnalism tell the story of Leimert Park - a historic and influential black neighbourhood of Los Angeles.
The class during the first visit to KAOS network listened to various stories of neighbourhoods ranging from jazz musician to revolutionaries of watt riots. Johnnie Raines who is an active stakeholder in the community shared his story around his house.
The class during the first visit to KAOS network listened to various stories of neighbourhoods ranging from jazz musician to revolutionaries of watt riots. Johnnie Raines who is an active stakeholder in the community shared his story around his house.
JOVRNALISM class at KAOS network interacting with Leimert Park community
The storyline was designed collaboratively with engineers, storytellers, and journalists. The whole project developed as a part of JOVRNALISM class - a hackathon-style course where students from different backgrounds collaborate to decide how to apply emerging technology to a story/theme, often in partnership with a media company.
Prof. Robert Hernandez supervising videogrammetry process
Johnnie being captured volumetrically using Depth-kit
Formulating the basics of the frame in the spatial domain
Raja interviewing Johnnie
Ideas exploring interactions to start the experience
AR app - portal design using Unity game engine
Idea sketches
Loading page to initiate AR
The interaction required to begin the experience
Start of experience. Closed-door
The door opens up inviting the user to enter the portal
Guidelines leading to the exit portal
Using cutting-edge and innovative techniques, the class created an augmented reality experience of the story. For this, I led the creative engineering design aspect of the project which included responsibilities like videogrammetry for volumetric human capture, AR application development and UX design for AR. The development process used Microsoft's Kinect sensor connected with Depth-kit software for videogrammetry and unity game engine along with apple ARKit for AR experience development.
Initial test of videogrammetry in AR
Initial design of object placement and door interaction in AR