Designing Motion for Real-Time Vision Systems
Designing the interaction model and motion language that helped users understand, navigate, and trust Google's AI-powered visual search experience.
Company: Google
Role: UX Motion Designer
Launch: 2017
Expertise: Interaction Design • Motion Systems • Rapid Prototyping
Context
Google Lens introduced a new generation of AI-powered visual search, transforming the camera into the primary interface for interacting with Google Search.
I developed the interaction model and motion language for the North Star prototype, introducing two new affordances: a lines-and-points mesh and Google-color framing that visualized how the system perceived the world.
Challenge
Users needed to trust an AI system interpreting the world through a live camera feed. The challenge was to communicate what the system was seeing, how its confidence evolved, and when it was ready to recommend an action without disrupting the camera experience.
Interaction Model
I organized the experience around three continuous states—Looking, Understanding, and Delivering—using the visual system and motion to communicate recognition, growing confidence, and readiness to act.
Looking
As the camera opens, the lines-and-points mesh reveals where the system is focusing. I designed the visualization to make Lens's attention visible instead of relying on a traditional loading indicator.
Understanding
As confidence increases, recognized objects become highlighted and the framing transitions from white to Google's four colors, creating a branded confirmation that the system has identified the content.
Delivering
Once Lens recognizes the content, the interface transitions into contextual actions. In the prototype, a concert poster resolves into information about Adele with options such as Find Tickets and Add to Calendar, connecting recognition to a useful next step without breaking continuity.
North Star Prototype
The complete prototype demonstrated the journey from opening the camera to recognizing content and presenting contextual actions. Whether identifying a concert poster, translating text, or recognizing an object, motion connects recognition to action while preserving continuity throughout the experience.
Impact
The prototype became the North Star for the launch experience, aligning product, design, and engineering around a shared interaction model. The accompanying motion guidelines helped teams apply the framework consistently across Google Lens.