0% found this document useful (0 votes)
48 views45 pages

Stream 1 XR Tooling Recommendations

The document provides recommendations on XR tooling by outlining 4 main steps for software developers: understanding the technology and choosing AR, VR, or MR; selecting devices; identifying development software like Unity and Unreal Engine; and selecting technology toolkits like AR Foundation, SteamVR Plugin, and MRTK. Popular development platforms, engines, and plugins are described along with trends in hardware adoption and an example demo using Virnect tools.

Uploaded by

Rashid
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
48 views45 pages

Stream 1 XR Tooling Recommendations

The document provides recommendations on XR tooling by outlining 4 main steps for software developers: understanding the technology and choosing AR, VR, or MR; selecting devices; identifying development software like Unity and Unreal Engine; and selecting technology toolkits like AR Foundation, SteamVR Plugin, and MRTK. Popular development platforms, engines, and plugins are described along with trends in hardware adoption and an example demo using Virnect tools.

Uploaded by

Rashid
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 45

XR Tooling

Recommendations
IMRAN MAHALIL
XR ENGINEER
ASIA PACIFIC UNIVERSITY

YOGATHIPAN SHANMUGAM
CHIEF TECHNOLOGY OFFICER
SPARK CAPITAL DEVELOPMENT BERHAD
4 main steps to follow as a
software developer

• Step 1: Understand the


technology
• Step 2: Choosing your device
• Step 3: Identify which
Development software to use
• Step 4: Selecting your
technology tool kit
Step 1: Understanding
the technology
Which technology to use?
Determine which Technology to
use and for what purpose?

AR: Low specification/cheap


mobile devices.
VR: Full 360 degree viewing and
interaction.
MR: More expensive technology.
Ref: Application of mixed reality for improving architectural design comprehension effectiveness, Po-Han Chen
VR/AR/MR Trends

Real and widely accessible


• AR is now intrinsic in iOS/ Android phones
• High-fi VR (Using Head gear; Oculus, HTC, Pico & etc.)
• Low-fi VR (Using smart phone based goggles; G Cardboard) made VR accessibility
widely available.
Step 2: Choosing your
device

• Price
• Technology (features)
• Best fitted to your customer /
work industry
Adoption
The adoption of XR tech
related hardware usage
especially on VR / AR
hardware increasing
exponentially worldwide.
XR Hardware
Well known Augmented-Reality (AR)
devices

Smartphone Tablets

AR headsets
Well known Virtual-Reality (VR) devices

VR headset stand alone


Sony PlayStation VR2 game console

Handphone based VR
HTC VIVE Pro 2 Desktop headset
Well known Mix-Reality (MR) devices

September 30, 2022


Magic Leap One (August 8, 2018) Apple vision pro (Early 2024)

Microsoft
Hololens3
February 2025
- BuildWagon
The Verge said it was originally
scheduled for release in 2024.

Meta Quest Pro (October 25, 2022) Microsoft Hololens2 (November 7, 2019)
Step 3: Identify which
Development software to use

• Software has different output


such as graphics
• Programming language
• Device compatibility
XR Engines / Game Engines

Unity Engine
Unreal Engine
XR DEVELOPMENT
VIRTUAL RALITY Using Unity Engine

Download unity hub: https://unity.com/download


Install Unity application
Install Unity application
Install Unity application
Creating Project
Using Unity Engine and MRTK
• Unity Mixed Reality Tutorials MRTK (Project Setup) - YouTube
WIDELY USED XR DEVELOPMENT PLATFORM
Toolkit Compatibility Features Licensing Pros Cons

Unity with AR VR, AR (Various Versatile, visual Robust support, Learning curve,
Free/Paid
Foundation Platforms) scripting, asset store resources optimization required

VR, AR (Various High-fidelity graphics, Stunning graphics, System requirements,


Unreal Engine Royalty-based
Platforms) visual scripting immersive VR learning curve

JavaScript-based, Accessibility, growing Limited performance,


WebXR Web-based VR & AR Open-source
browser compatibility support browser issues

Object recognition, Robust for marker- Licensing costs,


Vuforia Unity integration for AR Free/Paid
image targets based AR requires Unity

Plane detection, face Optimized for Apple, iOS exclusive, Mac


ARKit (Apple) iOS AR apps Free, App Store fees
tracking regular updates required
Environmental
Supported on Android, Android exclusive,
ARCore (Google) Android AR apps understanding, motion Free
updates varying compatibility
tracking

Spatial computing, Groundbreaking tech, Expensive hardware,


Magic Leap Magic Leap devices Developer program
gesture recognition unique interaction niche market

Limited vs
Web-based AR, VR, No coding required, Cloud integration, easy
Amazon Sumerian Pay-as-you-go Unity/Unreal, usage
3D AWS integration prototypes
costs
Step 4: Selecting your
technology tool kit

• After you identified your device


and development software, you
need to search for your XR tool
kits
Widely used UNITY Plugin
Plugin Description

AR Foundation Build AR experiences for Android and iOS, supports various AR SDKs.

SteamVR Plugin Support for HTC Vive, Oculus Rift, and other SteamVR devices.

Oculus Integration Dedicated package for Oculus VR devices development.

Vuforia Engine Image recognition and tracking capabilities for AR development.

VRTK (Virtual Reality Toolkit) Extensive scripts and prefabs for VR applications.

MRTK (Mixed Reality Toolkit) Toolkit for HoloLens and Windows Mixed Reality devices.
Widely used UNREAL Plugin
Plugin Description

VR Expansion Plugin A free solution to common VR development problems.

Oculus VR Plugin Development support for Oculus devices.

SteamVR Plugin Support for SteamVR within Unreal Engine.

ARCore Plugin AR development for Android devices.

Leap Motion Plugin Hand and finger tracking within Unreal.


Widely used WEBXR Plugin

Plugin Description

A-Frame A web framework for building virtual reality experiences.

Three.js XR Plugin Enables WebXR support within the Three.js library.


Software and hardware integration
Thank you
Sample demo of Virnect XR tool:
APU - Virnect demo (Imran Mahalil) - YouTube

You might also like