The Immersive Medical Training System Using Spatial Computing Technology revolutionizes medical education by leveraging AR/VR to create interactive, realistic training environments. Developed by students at the HKIIT at IVE(ST) addresses limitations in traditional medical training, such as lack of engagement and high costs. The system offers modules for CPR, acupuncture, and Glasgow Coma Scale assessments, enabling medical students and professionals to practice complex procedures in a safe, scalable virtual setting. Key features include real-time performance analytics, role-based access for students, educators, and administrators, and a user-friendly interface with multilingual support. A remote consultation system (collaborating feature with North District Hospital) enhances collaboration, allowing real-time virtual discussions among trainees, instructors, and hospital clinicians, supported by vital sign streaming and diagnostic image integration. Built using ARKit and RealityKit for Apple Vision Pro, the system ensures high-fidelity simulations and seamless hardware integration. Despite challenges like hardware shortages and incomplete CPR force-sensor integration, the project delivers robust software functionalities and plans future enhancements, including expanded modules and AI-driven guidance, to improve medical training outcomes and accessibility.
• AR/VR using ARKit and Reality Kit for Apple Vision Pro-Provides cardiopulmonary resuscitation (CPR), acupuncture, and Glasgow Coma Scale assessment modules
• Tele-consultation system (in partnership with Northside Hospital) provides strong software capabilities and plans for future improvements, including expanded modules and AI-driven guidance
- ITCC Innovation Awards 2024/25 (Innovation Track) - Silver Award, VTC Innovation and Technology Co-creation Centre, 2025
