Experiences

The LEAP Group application and simulation team designs and develops mixed reality, multi-sensory, and interactive digital experiences to expand access, engagement, and depth in learning. These experiences are focused on education for manufacturing and micro/nanotechnology and are categorized into three key areas: (i) apps, (ii) simulations, and (iii) haptics.

XR Applications

Machining in the Dorm Room

MITDR is an open-ended Virtual Reality (VR) system designed to train users in drilling using a 3-axis milling machine. The VR simulation includes onboarding for the experience, a safety module, machine setup and drilling tutorial, and the option for open-ended practice. Learners engage with instructional guides through an assessment of drilled hole geometries against an engineering drawing, with warnings to correct engagement and errors for feedback on performance. This work was publish in ACM CHI 2024

Product Teardown

These apps enable learners to manipulate, and virtually disassemble various parts and products (representing high-volume manufacturing processes), while receiving scaffolded guidance to inspect manufacturing features. This work has been published and won two best paper awards at ASEE 2021.

Scanning Electron Microscope (SEM)

This AR app introduces the purpose, function, and working principles of the Scanning Electron Microscope.

Machine Shop Skills

This set of AR apps enable blended learning of machining hands-on skills. These instructional modules can be experienced before a student steps into the machine shop to prepare, or during the course to augment in-person instruction.

Simulations

AFM Image Artifact Simulation

This simulation enables visualization of imaging artifacts of the Atomic Force Microscope (AFM). Students can manipulate parameters such as tip shape, surface profile, and tip cleanliness, and compare the actual surface to the imaged profile.

Kits

AFM Haptics and Visualization

This visualization and haptic feedback controller kit enables students to see and “feel” the forces acting on the Atomic For Microscope (AFM) tip to enable multi-modal learning of mechanical principles on the nanometer scale. This work was most recently published in Nisal Ovitigala’s thesis.