In 2019, I transitioned to a more technical role creating AR/VR prototypes in Unity for Facebook’s Portal video messaging product.
One of the products I helped take to completion was the Mic Drop lip sync AR music experience. Users can choose AR look effects and songs and then record themselves singing on a virtual stage.
My work included programmatically linking the AR feed from Microsoft’s Connect and Facebook’s Portal prototypes to Unity, C# programming the UI and user flow navigation, animating assets, making assets performant for mobile, programming HLSL shaders, and working across multiple cross functional teams to create a midi triggering visual effects light display for the virtual stage.
A review of the app here: