vinod sharma .in Solution Architect, Author & Educator
Courses, books, roadmaps, and tutorials to help developers build real-world skills.
© 2026 Vinod Sharma. All rights reserved.
Spatial Computing (AR/VR/MR) A comprehensive roadmap for building immersive spatial computing experiences. This path covers 3D mathematics, computer graphics, game engines, VR and AR development, mixed reality, spatial UI/UX, 3D assets, spatial audio, multiplayer networking, AI integration, and enterprise applications like digital twins and training simulations.
12 milestones in this roadmap
Step 1 intermediate 4-6 weeks
3D Mathematics (Vectors, Matrices, Quaternions) Master linear algebra for 3D transformations including vectors, matrices, and quaternions used in every spatial computing pipeline.
1 Vector operations (dot product, cross product, normalisation) 2 Transformation matrices (model, view, projection) 3 Quaternion algebra and SLERP interpolation 4 Homogeneous coordinates and perspective division 5 Coordinate system conversions (world, camera, clip, NDC)
MATLAB NumPy / SciPy GeoGebra 3D Wolfram Mathematica
Step 1 intermediate 4-6 weeks
3D Mathematics (Vectors, Matrices, Quaternions) Master linear algebra for 3D transformations including vectors, matrices, and quaternions used in every spatial computing pipeline.
1 Vector operations (dot product, cross product, normalisation) 2 Transformation matrices (model, view, projection) 3 Quaternion algebra and SLERP interpolation 4 Homogeneous coordinates and perspective division 5 Coordinate system conversions (world, camera, clip, NDC)
Step 2 intermediate 6-8 weeks
Computer Graphics Fundamentals Learn the real-time rendering pipeline from vertex processing through rasterisation to fragment shading, with emphasis on PBR and performance.
1 Programmable GPU pipeline stages (vertex, geometry, fragment) 2 Physically-based rendering (Cook-Torrance BRDF, metallic workflow) 3 Shader programming in GLSL and HLSL 4 Shadow mapping, screen-space ambient occlusion, bloom
Step 3 beginner 8-10 weeks
Game Engine Basics (Unity & Unreal) Build interactive 3D applications using Unity and Unreal Engine, covering editor workflows, scripting, physics, and asset pipelines.
1 Unity scene hierarchy, prefabs, and C# MonoBehaviour lifecycle 2 Unreal Engine Blueprints and C++ gameplay framework 3 Physics engines (PhysX, Chaos) and collision detection 4 Animation state machines and blend trees 5
Step 4 intermediate 6-8 weeks
VR Development (Headset SDKs & Interaction) Develop VR experiences using OpenXR and headset SDKs with proper interaction patterns, locomotion, and comfort optimisation.
1 OpenXR runtime and interaction profiles 2 Controller-based and hand-tracking input systems 3 Locomotion methods (teleportation, continuous, arm-swing) 4 Foveated rendering and fixed foveated rendering 5
Step 5 intermediate 6-8 weeks
AR Development (ARKit/ARCore/WebXR) Create AR applications using platform SDKs with plane detection, image tracking, world anchors, and environmental understanding.
1 SLAM and visual-inertial odometry for AR tracking 2 Plane detection, mesh reconstruction, and scene geometry 3 Image and object tracking anchors 4 Light estimation and environment probes 5
Step 6 advanced 6-8 weeks
Mixed Reality & Passthrough Build mixed reality experiences where virtual content interacts with the physical world through passthrough, spatial mapping, and scene understanding.
1 Video and optical see-through passthrough architectures 2 Spatial mesh generation and scene reconstruction 3 Semantic scene understanding and labelling 4 Virtual-physical object interaction and physics 5
Step 7 intermediate 4-6 weeks
Spatial UI/UX Design Design user interfaces for 3D space including gaze-based interaction, spatial menus, and ergonomic placement following platform design guidelines.
1 Ergonomic UI placement zones and comfort distances 2 Gaze, pinch, and gesture interaction affordances 3 Spatial typography and legibility at varying depths 4 Information hierarchy in volumetric layouts 5
Step 8 intermediate 8-10 weeks
3D Asset Creation & Optimisation Create and optimise 3D models, textures, and animations for real-time rendering on mobile XR hardware with strict polygon and draw call budgets.
1 Polygonal modelling and retopology for real-time use 2 PBR texturing workflows (albedo, normal, roughness, metallic) 3 LOD generation and mesh decimation strategies 4 Texture atlasing and draw call batching
Step 9 intermediate 4-6 weeks
Spatial Audio & Haptics Implement spatial audio using HRTF and ambisonics, and design haptic feedback patterns that enhance immersion and presence.
1 Head-related transfer functions (HRTF) and binaural rendering 2 Ambisonic encoding and decoding (first and higher order) 3 Audio occlusion, diffraction, and reverb in 3D scenes 4 Distance attenuation models and Doppler effects 5
Step 10 advanced 6-8 weeks
Multiplayer & Networked Experiences Build shared spatial experiences with real-time networking, state synchronisation, voice chat, and avatar systems for co-presence.
1 Client-server vs peer-to-peer networking architectures 2 State synchronisation and authority models (server/client) 3 Latency compensation, prediction, and interpolation 4 Voice chat integration and spatial voice attenuation
Step 11 advanced 6-8 weeks
AI Integration in Spatial Computing Integrate AI capabilities into spatial experiences including LLM-driven NPCs, computer vision scene understanding, and generative 3D content.
1 LLM-powered conversational agents in virtual worlds 2 Real-time object recognition and scene understanding 3 Gesture and pose recognition with ML models 4 Neural radiance fields (NeRF) and Gaussian splatting 5
Step 12 advanced 6-8 weeks
Enterprise Applications (Digital Twins & Training) Apply spatial computing to enterprise use cases including digital twins, training simulations, remote collaboration, and architectural visualisation.
1 Digital twin architecture with real-time IoT data feeds 2 Industrial training simulation design and assessment 3 Remote spatial collaboration and virtual whiteboards 4 Architectural and construction BIM-to-XR pipelines Ready to start this journey? Browse our courses and books to begin your learning path.
MATLAB NumPy / SciPy GeoGebra 3D Wolfram Mathematica
5
Forward vs deferred rendering trade-offs
6 Anti-aliasing techniques (MSAA, TAA, FXAA)
OpenGL / Vulkan HLSL / GLSL RenderDoc NVIDIA Nsight Graphics
Step 2 intermediate 6-8 weeks
Computer Graphics Fundamentals Learn the real-time rendering pipeline from vertex processing through rasterisation to fragment shading, with emphasis on PBR and performance.
1 Programmable GPU pipeline stages (vertex, geometry, fragment) 2 Physically-based rendering (Cook-Torrance BRDF, metallic workflow) 3 Shader programming in GLSL and HLSL 4 Shadow mapping, screen-space ambient occlusion, bloom 5 Forward vs deferred rendering trade-offs 6 Anti-aliasing techniques (MSAA, TAA, FXAA)
OpenGL / Vulkan HLSL / GLSL RenderDoc NVIDIA Nsight Graphics
Asset import pipelines and build optimisation
6 Profiling tools and frame budget management
Unity 2022+ Unreal Engine 5 Blender (asset pipeline) Visual Studio / Rider
Step 3 beginner 8-10 weeks
Game Engine Basics (Unity & Unreal) Build interactive 3D applications using Unity and Unreal Engine, covering editor workflows, scripting, physics, and asset pipelines.
1 Unity scene hierarchy, prefabs, and C# MonoBehaviour lifecycle 2 Unreal Engine Blueprints and C++ gameplay framework 3 Physics engines (PhysX, Chaos) and collision detection 4 Animation state machines and blend trees 5 Asset import pipelines and build optimisation 6 Profiling tools and frame budget management
Unity 2022+ Unreal Engine 5 Blender (asset pipeline) Visual Studio / Rider
Reprojection techniques (ASW, Motion Smoothing)
6 VR comfort metrics and simulator sickness mitigation
Meta Quest SDK (OpenXR) SteamVR / OpenXR Unity XR Interaction Toolkit Oculus Developer Hub
Step 4 intermediate 6-8 weeks
VR Development (Headset SDKs & Interaction) Develop VR experiences using OpenXR and headset SDKs with proper interaction patterns, locomotion, and comfort optimisation.
1 OpenXR runtime and interaction profiles 2 Controller-based and hand-tracking input systems 3 Locomotion methods (teleportation, continuous, arm-swing) 4 Foveated rendering and fixed foveated rendering 5 Reprojection techniques (ASW, Motion Smoothing) 6 VR comfort metrics and simulator sickness mitigation
Meta Quest SDK (OpenXR) SteamVR / OpenXR Unity XR Interaction Toolkit Oculus Developer Hub
Occlusion rendering (people occlusion, depth API)
6 Persistent and cloud-based spatial anchors
Apple ARKit / RealityKit Google ARCore WebXR Device API Niantic Lightship ARDK
Step 5 intermediate 6-8 weeks
AR Development (ARKit/ARCore/WebXR) Create AR applications using platform SDKs with plane detection, image tracking, world anchors, and environmental understanding.
1 SLAM and visual-inertial odometry for AR tracking 2 Plane detection, mesh reconstruction, and scene geometry 3 Image and object tracking anchors 4 Light estimation and environment probes 5 Occlusion rendering (people occlusion, depth API) 6 Persistent and cloud-based spatial anchors
Apple ARKit / RealityKit Google ARCore WebXR Device API Niantic Lightship ARDK
Shared spatial anchors for multi-user MR
6 Depth compositing and hand occlusion in passthrough
Apple visionOS / RealityKit Meta Quest 3 MR SDK Microsoft MRTK (HoloLens) Unity PolySpatial
Step 6 advanced 6-8 weeks
Mixed Reality & Passthrough Build mixed reality experiences where virtual content interacts with the physical world through passthrough, spatial mapping, and scene understanding.
1 Video and optical see-through passthrough architectures 2 Spatial mesh generation and scene reconstruction 3 Semantic scene understanding and labelling 4 Virtual-physical object interaction and physics 5 Shared spatial anchors for multi-user MR 6 Depth compositing and hand occlusion in passthrough
Apple visionOS / RealityKit Meta Quest 3 MR SDK Microsoft MRTK (HoloLens) Unity PolySpatial
Accessibility in spatial interfaces (low vision, motor)
6 Apple Human Interface Guidelines for visionOS
Figma + ShapesXR Apple Reality Composer Pro Meta Interaction SDK Bezi (3D prototyping)
Step 7 intermediate 4-6 weeks
Spatial UI/UX Design Design user interfaces for 3D space including gaze-based interaction, spatial menus, and ergonomic placement following platform design guidelines.
1 Ergonomic UI placement zones and comfort distances 2 Gaze, pinch, and gesture interaction affordances 3 Spatial typography and legibility at varying depths 4 Information hierarchy in volumetric layouts 5 Accessibility in spatial interfaces (low vision, motor) 6 Apple Human Interface Guidelines for visionOS
Figma + ShapesXR Apple Reality Composer Pro Meta Interaction SDK Bezi (3D prototyping)
5
Skeletal rigging and animation for real-time playback
6 USD and glTF interchange formats
Blender Substance 3D Painter / Designer Maya / 3ds Max glTF Tools / USD Composer
Step 8 intermediate 8-10 weeks
3D Asset Creation & Optimisation Create and optimise 3D models, textures, and animations for real-time rendering on mobile XR hardware with strict polygon and draw call budgets.
1 Polygonal modelling and retopology for real-time use 2 PBR texturing workflows (albedo, normal, roughness, metallic) 3 LOD generation and mesh decimation strategies 4 Texture atlasing and draw call batching 5 Skeletal rigging and animation for real-time playback 6 USD and glTF interchange formats
Blender Substance 3D Painter / Designer Maya / 3ds Max glTF Tools / USD Composer
Haptic waveform design and controller vibration patterns
6 Psychoacoustic principles for convincing spatial audio
Wwise Spatial Audio FMOD Studio Meta Haptics SDK Resonance Audio (Google)
Step 9 intermediate 4-6 weeks
Spatial Audio & Haptics Implement spatial audio using HRTF and ambisonics, and design haptic feedback patterns that enhance immersion and presence.
1 Head-related transfer functions (HRTF) and binaural rendering 2 Ambisonic encoding and decoding (first and higher order) 3 Audio occlusion, diffraction, and reverb in 3D scenes 4 Distance attenuation models and Doppler effects 5 Haptic waveform design and controller vibration patterns 6 Psychoacoustic principles for convincing spatial audio
Wwise Spatial Audio FMOD Studio Meta Haptics SDK Resonance Audio (Google)
5
Avatar systems and inverse kinematics for upper body
6 Networked spatial anchors and shared world alignment
Photon Fusion / PUN 2 Normcore Unity Netcode for GameObjects Agora (voice chat)
Step 10 advanced 6-8 weeks
Multiplayer & Networked Experiences Build shared spatial experiences with real-time networking, state synchronisation, voice chat, and avatar systems for co-presence.
1 Client-server vs peer-to-peer networking architectures 2 State synchronisation and authority models (server/client) 3 Latency compensation, prediction, and interpolation 4 Voice chat integration and spatial voice attenuation 5 Avatar systems and inverse kinematics for upper body 6 Networked spatial anchors and shared world alignment
Photon Fusion / PUN 2 Normcore Unity Netcode for GameObjects Agora (voice chat)
Procedural content generation for 3D environments
6 Text-to-3D and image-to-3D generation pipelines
OpenAI API / Claude API MediaPipe (hand/pose tracking) PyTorch3D NVIDIA Instant NeRF
Step 11 advanced 6-8 weeks
AI Integration in Spatial Computing Integrate AI capabilities into spatial experiences including LLM-driven NPCs, computer vision scene understanding, and generative 3D content.
1 LLM-powered conversational agents in virtual worlds 2 Real-time object recognition and scene understanding 3 Gesture and pose recognition with ML models 4 Neural radiance fields (NeRF) and Gaussian splatting 5 Procedural content generation for 3D environments 6 Text-to-3D and image-to-3D generation pipelines
OpenAI API / Claude API MediaPipe (hand/pose tracking) PyTorch3D NVIDIA Instant NeRF
5
Enterprise MDM and device fleet deployment
6 ROI measurement frameworks for enterprise XR
NVIDIA Omniverse Unity Industry (Digital Twin) Microsoft Dynamics 365 Guides PTC Vuforia Expert Capture
Step 12 advanced 6-8 weeks
Enterprise Applications (Digital Twins & Training) Apply spatial computing to enterprise use cases including digital twins, training simulations, remote collaboration, and architectural visualisation.
1 Digital twin architecture with real-time IoT data feeds 2 Industrial training simulation design and assessment 3 Remote spatial collaboration and virtual whiteboards 4 Architectural and construction BIM-to-XR pipelines 5 Enterprise MDM and device fleet deployment 6 ROI measurement frameworks for enterprise XR
NVIDIA Omniverse Unity Industry (Digital Twin) Microsoft Dynamics 365 Guides PTC Vuforia Expert Capture