This presentation was recorded at GOTO Copenhagen 2025. #GOTOcon #GOTOcph
https://gotocph.com

Ken Pfeuffer - The Mastermind Behind Apple's Gaze-and-Pinch Technology @kenpfeuffer3002 

RESOURCES
https://bsky.app/profile/kenpfeuffer.bsky.social
https://twitter.com/KenPfeuffer
https://www.linkedin.com/in/ken-pfeuffer-404377129
https://medium.com/@ken.pfeuffer
https://kenpfeuffer.com

Links
https://dl.acm.org/doi/epdf/10.1145/3131277.3132180
https://developer.apple.com/design/human-interface-guidelines/gestures#visionOS
https://youtu.be/RVMf_SP7iTc
https://cs.au.dk/news-events/ken-pfeuffers-research-comes-to-life-in-apples-vision-pro-headset

ABSTRACT
The user interface—what connects you, me, and the digital world—has evolved remarkably from 2D GUIs with keyboards and mice to multi-touch, wearables, and now spatial computing (AR/VR/XR), reaching billions of people worldwide. Major shifts in interface paradigms are rare and often occur only once in decades, yet we may be on the cusp of one that could fundamentally transform everything we do with our hands on computers.

In this talk, I will trace this evolution and introduce Eye-Hand Symbiosis—my decade-long vision and research project exploring the fusion of eyes and hands for interaction. It is showing first signs of becoming reality, and I will share where this path might lead in the years ahead. [...]

TIMECODES
00:00 Intro
03:21 AR/VR today
08:50 Agenda
09:10 How did we get here?
20:22 Where does eye input come from?
38:01 What's ahead?
42:49 Outro

Download slides and read the full abstract here:
https://gotocph.com/2025/sessions/3666

RECOMMENDED BOOKS
Drew Reeves • X/UI Graphic Design For Beginners Made Simple • https://amzn.to/49t6Tmf
Jenifer Tidwell, Charles Brewer & Aynne Valencia • Designing Interfaces • https://amzn.to/3L5HHKB
LaViola Jr., Kruijff, Bowman, McMahan & Poupyrev • 3D User Interfaces • https://amzn.to/4aQVn6E

https://bsky.app/profile/gotocon.com
https://twitter.com/GOTOcon
https://www.linkedin.com/company/goto-
https://www.instagram.com/goto_con
https://www.facebook.com/GOTOConferences
#UserInterface #UserExperience #GazePinch #UX #UI #DevEx #AR #VR #XR #AppleVisionPro #VisionOS #GazeComputerControl #EyeHandSymbiosis #Programming #SoftwareEngineering #KenPfeuffer #GOTO

CHANNEL MEMBERSHIP BONUS
Join this channel to get early access to videos & other perks:
https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join

Looking for a unique learning experience?
Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech
Sign up for updates and specials at https://gotopia.tech/newsletter

SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily.
https://www.youtube.com/user/GotoConferences/?sub_confirmation=1

GOTO's resource offers insights, tutorials, and resources for software developers, architects, and technology leaders. Readers can learn about emerging technologies, industry trends, and best practices for software development. With articles, talks, and workshops, GOTO provides  guidance and expertise for staying ahead in the ever-evolving world of technology.

The Evolution of User Interfaces • Ken Pfeuffer • GOTO 2025