XRC Toolkit
The XRC Toolkit is a collection of tools and 3D interaction techniques, developed by the XR Collaboratory, to accelerate AR/VR prototyping. These modular, reusable packages are used across all our prototyping activities, including research explorations, collaborations, and student projects.
SELECTED PACKAGES
-
![]()
XRC Sphere Select
This package is an implementation of the Sphere Select interaction technique.
-
![]()
XRC Go-Go
This package is an implementation of the Go-Go interaction technique.
-
![]()
XRC Grab Move
This package is an implementation of the Grab Move locomotion technique.
-
![]()
XRC Alignment Tool
This package provides a tool for aligning object to user-defined planes and coordinate systems.
-
![]()
XRC Mesh Tool
This package provides a tool for manipulating the vertices of a 3D mesh.
-
![]()
XRC Color Tool
This package provides a tool for modifying the color properties of a selected object.
-
![]()
XRC Scale Tool
This package provides a tool for manipulating the scale of a selected object.
-
![]()
XRC Line Tool
This package provides a tool for creating a simple line in 3D space.
-
![]()
XRC Create Tool
This package provides a tool for creating, deleting, and duplicating 3D objects.
Explorations
We study different themes and 3D interaction challenges through project activities called Explorations. These projects are frequently used to test XRC Toolkit components in specific application contexts.
SELECTED EXPLORATIONS
-
Campus Designer
The Campus Designer project enables members of the XR Collaboratory to deploy their interaction techniques in the context of a 3D design tool, as well as for iteration and evaluation of XRC Toolkit packages.
-
Marble Run
The Marble Run project allows XR Collaboratory members to quickly iterate on system control techniques for controlling motors and robot prototypes. Student contributors: Vikram Pandian, Grant Hinkle
-
Campus Walker
Campus Walker explores how we might navigate and interact with virtual environments using real-time volumetric avatars
Collaborations
We collaborate with Cornell faculty on AR/VR-related projects in fields such as computer vision, computer graphics, and human-computer interaction, as well as application domains such as healthcare and architecture.
SELECTED COLLABORATIONS
-
![]()
Y-AR: A Mixed Reality CAD Tool for 3D Wire Bending
Shuo Feng, Bo Liu, Yifan Shan, Ofer Berman, Harald Haraldsson, Thijs Roumen
arXiv preprint arXiv:2410.23540. 2024.
Website -
![]()
ReRun: Enabling Multi-Perspective Analysis of Driving Interaction in VR
David Goedicke, Harald Haraldsson, Navit Klein, Lunshi Zhou, Avi Parush, Wendy Ju
In Companion of the 2023 ACM/IEEE International Conference on Human-Robot Interaction (HRI '23). Association for Computing Machinery, New York, NY, USA, 889–890.
-
![]()
Designing Extended Reality Guidance for Physical Caregiving Tasks
-
![]()
Continuous Travel In Virtual Reality Using a 3D Portal
Andrew Atkins, Serge Belongie, and Harald Haraldsson
In Adjunct Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology (UIST '21 Adjunct). Association for Computing Machinery, New York, NY, USA, 51–54.
-
![]()
-
![]()
-
![]()
-
![]()
Decoupled Localization and Sensing with HMD-based AR for Interactive Scene Acquisition
Søren K. Skovsen, Harald Haraldsson, Abe Davis, Henrik Karstoft, Serge Belongie
2020 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct)
-
![]()
Generating Spatial Attention Cues via Illusory Motion
Janus Nortoft Jensen, Morten Hannemose, Jakob Wilm, Anders Bjorholm Dahl, Jeppe Refall Frisvad, Serge Belongie
CVPR Workshop on Computer Vision for Augmented and Virtual Reality, Long Beach, CA, 2019
Student Projects
We provide mentorship for several student projects each semester at Cornell Tech.
See also course projects.
Graph Sketch: AI-Integrated Spatial Mind-Mapping Tool for XR
Student: Connor Pugh
Independent Study at the XR Collaboratory
Spring 2025
ZoomAR: Magnification Tool for Precise Manipulation in Augmented Reality
Student: Zhening Zhu
Independent Study at the XR Collaboratory
Spring 2025
Asymmetric Remote Collaboration using Tangible Interaction in Augmented Reality
Student: Connor Pugh
Independent Study at the XR Collaboratory
Fall 2024
Gaze + Cheek: Hands-free System Control in VR
Student: Zhening Zhu
Independent Study at the XR Collaboratory
Fall 2024
Multi-Object Image Plane Lasso Selection
Student: Connor Pugh
Independent Study at the XR Collaboratory
Spring 2024
Expand Miniature: Selection based on Progressive Refinement in Dense VR Environments
Student: Sissel Sun
Independent Study at the XR Collaboratory
Spring 2024
Automatic Extraction of Procedural Tasks from Egocentric Videos
Student: Ruslana Yurtyn
Independent Study at the XR Collaboratory
Spring 2024
Project Ideate: A Spatial LLM-Powered Environment for Design Ideation & Synthesis
Student: Rishik Sarkar
Independent Study at the XR Collaboratory
Spring 2025
Draw Extrude: XR Technique for Adding New Forms to 3D Meshes
Student: Tamara Bo Rabin
Independent Study at the XR Collaboratory
Spring 2025
Cross-Device Augmented Reality Interactions for Mobile Phones and Head-Mounted Displays
Student: Qingxuan Yan
Independent Study at the XR Collaboratory
Fall 2024
Enhancing Gaze + Pinch Depth Control using Microgestures in Extended Reality
Student: Connor Pugh
Independent Study at the XR Collaboratory
Fall 2024
Interaction Tasks
Student: David Lou
Independent Research at the XR Collaboratory
Spring 2024
In-situ Playback of Immersive Recordings
Student: Amitesh Sinha
Independent Study at the XR Collaboratory
Spring 2024
Touch Motors
Student: Michael Hanlon (based on prior work by Grant Hinkle and Vikram Pandian)
Independent Study at the XR Collaboratory
Spring 2024
ADDITIONAL STUDENT PROJECTS
-
![]()
Marking Menu
Student: Connor Pugh
-
![]()
Input Action Visualizer
Student: David Lou
-
![]()
Voice2Action
Students: Grace Nho, Steven Xu, Yang Su
-
![]()
Simulating Augmented Reality through Virtual Reality
Students: Angelica Kosasih, Cheng-Wei Hu
