Key Takeaways
- A UCF research team won the Auggie Award for Best Interaction Product for their “Be There Without Being There: Humanoid Robot Immersive Telepresence” system.
- The project pairs a humanoid robot with an immersive digital twin, letting a user’s body movements control the robot in real time as if they were physically present.
- Led by Professor Carolina Cruz‑Neira and Assistant Professor Mohsen Rakhshan, the work was carried out entirely by undergraduate and graduate students.
- Applications span disaster response, remote healthcare, and virtual tourism, extending human capabilities safely and effectively.
- Future upgrades will add AI‑driven autonomy and haptic feedback to let users feel temperature, texture, and manipulate objects remotely.
- The award highlights UCF’s role as a technology leader and showcases what students can achieve when tackling real‑world challenges.
Overview and Recognition
The University of Central Florida (UCF) team’s project, Be There Without Being There: Humanoid Robot Immersive Telepresence, earned the Auggie Award for Best Interaction Product at the 2024 Augmented World Expo in Long Beach, California. The Auggie Awards, which attracted over 330 entries across 18 categories, are among the most prestigious honors in the augmented and virtual reality industry. This accolade not only validates the technical novelty of the work but also places UCF on the global stage for immersive telepresence research. Receiving the award underscores the interdisciplinary strength of the university’s simulation and training programs and highlights the potential of blending robotics with extended reality (XR) to solve practical problems.
Team Composition and Leadership
The award‑winning group consists of computer science student researchers Judah Rowe (’23 ’25MS), junior Liam Abramov, seniors Seniah McField and Megan Bailey, Assistant Professor Mohsen Rakhshan, and is led by UCF Institute for Simulation and Training Interim Director and Agere Chair Professor of Computer Science Carolina Cruz‑Neira. Notably, Professor Cruz‑Neira also received the 2026 Auggie Award for Innovator of the Year, recognizing her sustained contributions to the field. While Cruz‑Neira and Rakhshan provided guidance and mentorship, the students were responsible for the system’s design, implementation, and troubleshooting, demonstrating a high level of autonomy and technical skill.
Technical Description of the System
At its core, the technology creates a real‑time digital twin of the robot’s surroundings while mapping the user’s body movements directly onto the humanoid platform. When a participant walks, gestures, or turns their head, those motions are captured by motion‑tracking sensors and replicated by the robot with minimal latency, producing a sensation of being physically present in the remote location. Professor Cruz‑Neira likened the experience to the avatar concept portrayed in the film Avatar, emphasizing that the system allows a human to be “physically functional in a remote location as if they were really there.” This tight coupling of human intuition and robotic execution distinguishes the project from earlier telepresence attempts that relied solely on joystick or voice commands.
Student‑Driven Innovation
Professor Cruz‑Neira stressed that the project was completed entirely by UCF students, who solved all the engineering challenges and brought the prototype to award‑winning sophistication. The students integrated hardware components—such as the humanoid robot, inertial measurement units, and VR headsets—with software pipelines for sensor fusion, motion retargeting, and low‑latency networking. Their collaborative effort exemplified experiential learning, allowing them to apply classroom knowledge to a complex, real‑world problem and to iterate rapidly based on testing feedback. The success of the student‑led effort highlights the value of providing undergraduates with opportunities to lead cutting‑edge research.
Practical Applications Across Industries
The telepresence system offers tangible benefits wherever physical presence is risky, costly, or impossible. In disaster response, a robot could enter buildings weakened by hurricanes or earthquakes to assess structural integrity and locate survivors without endangering human rescuers. Healthcare providers could conduct remote examinations of patients with limited mobility or those residing far from specialized clinics, improving access to care. Additionally, individuals unable to travel could experience virtual strolls along landmarks such as Paris’s Champs‑Élysées through the robot’s eyes and ears, opening new possibilities for tourism, education, and cultural exchange. These use cases illustrate how the technology extends human capabilities while enhancing safety and effectiveness.
Future Enhancements: AI Autonomy and Haptic Feedback
The research team is actively refining the system to deepen the user experience. Planned upgrades include incorporating artificial intelligence to grant the robot greater autonomous navigation and obstacle‑avoidance capabilities, reducing the cognitive load on the operator. Furthermore, the group aims to integrate haptic feedback mechanisms that would allow users to sense temperature, texture, and resistance when the robot interacts with objects, effectively giving them a remote sense of touch. Such advancements would move the platform from simple motion mimicry toward a more immersive, embodied telepresence where users can both perceive and manipulate distant environments naturally.
Significance for UCF and the Broader Technology Landscape
Professor Cruz‑Neira views the project as a testament to UCF’s evolving identity as a technology university, demonstrating that the institution is not only discussing the future but actively helping to build it. The award confirms that UCF students can rise to complex, interdisciplinary challenges and produce work that garners international recognition. By merging robotics, digital twins, and immersive interfaces, the team contributes a tangible example of how emerging technologies can augment human abilities, paving the way for safer, more efficient operations in fields ranging from emergency management to remote medicine. The ongoing work promises to keep UCF at the forefront of telepresence innovation, inspiring future generations of researchers and engineers.