Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.
https://github.com/microsoft/MixedRealityToolkit-Unity

This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity
https://github.com/microsoft/MixedRealityToolkit-Unity
hololens holotoolkit holotoolkit-unity mixed-reality mixedrealitytoolkit mixedrealitytoolkit-unity mrtk openvr unity
Last synced: 30 days ago
JSON representation
This repository is for the legacy Mixed Reality Toolkit (MRTK) v2. For the latest version of the MRTK please visit https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity
Host: GitHub
URL: https://github.com/microsoft/MixedRealityToolkit-Unity
Owner: microsoft
License: mit
Created: 2016-01-28T18:54:58.000Z (over 8 years ago)
Default Branch: main
Last Pushed: 2024-03-26T19:25:38.000Z (3 months ago)
Last Synced: 2024-05-09T18:10:56.168Z (about 1 month ago)
Topics: hololens, holotoolkit, holotoolkit-unity, mixed-reality, mixedrealitytoolkit, mixedrealitytoolkit-unity, mrtk, openvr, unity
Language: C#
Homepage: https://aka.ms/mrtkdocs
Size: 1.79 GB
Stars: 5,959
Watchers: 420
Forks: 2,123
Open Issues: 0
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE.md
- Code of conduct: CODE_OF_CONDUCT.md
- Codeowners: CODEOWNERS
- Security: SECURITY.md
- Authors: Authors.md
Lists

awesome-stars - MixedRealityToolkit-Unity - platform MR app development in Unity. | microsoft | 5328 | (C#)
Awesome-SLAM - MixedRealityToolkit-Unity
awesome-dotnet-machine-learning - MRTK-Unity - Unity?style=social"/> : Mixed Reality Toolkit (MRTK) provides a set of components and features to accelerate cross-platform MR app development in Unity. (Uncategorized / Uncategorized)
README

        > [!IMPORTANT]  

> With the creation of the new Mixed Reality Toolkit organization, there now exists two MRTK repositories,

> one repository for version 3+ and a legacy one for version 2.

> 



> MRTK v3+

> 



> New versions of the Mixed Reality Toolkit will be released by the Mixed Reality Toolkit

> organization using a repository at https://github.com/MixedRealityToolkit/MixedRealityToolkit-Unity.

> Visit this repository for the latest version of the MRTK project, and when

> creating new issues or discussion topics for MRTK version 3 or later.

> 



> MRTK v2 (Legacy)

> 



> The old MRTK2 repository, https://github.com/microsoft/MixedRealityToolkit-Unity,

> is remaining under Microsoft's management and will stay on version 2. Microsoft is committed to the next version of MRTK, and recommends applications

> move to MRTK version 3 or later. However, Microsoft will continue to support and address critical MRTK2 issues, until MRTK2 is deprecated. Please open

> MRTK2 issues and discussion topics using the old repository.





![Mixed Reality Toolkit](https://user-images.githubusercontent.com/13754172/122838732-89ea3400-d2ab-11eb-8c79-32dd84944989.png)

[![MRTK_AWE_AuggieAwards_2021a](https://user-images.githubusercontent.com/13754172/142922601-f7c38745-aa50-4b50-8ad3-41992e543f5e.png)](https://www.awexr.com/usa-2021/auggie-winners)

# What is the Mixed Reality Toolkit

MRTK-Unity is a Microsoft-driven project that provides a set of components and features, used to accelerate cross-platform MR app development in Unity. Here are some of its functions:

* Provides the **cross-platform input system and building blocks for spatial interactions and UI**.

* Enables **rapid prototyping** via in-editor simulation that allows you to see changes immediately.

* Operates as an **extensible framework** that provides developers the ability to swap out core components.

* **Supports a wide range of devices**:

| XR SDK Plugin (Unity XR Plugin Management Providers) | Supported Devices |

|---|---|

| Unity OpenXR Plugin (Unity 2020 or 2021 LTS) 
 (Mixed Reality OpenXR Plugin required for certain features on certain devices) | Microsoft HoloLens 2 
 Windows Mixed Reality headsets 
 Meta Quest 
 Device running on SteamVR via OpenXR |

| Windows XR Plugin | Microsoft HoloLens 
 Microsoft HoloLens 2 
 Windows Mixed Reality headsets |

| Oculus XR Plugin (Unity 2019 or newer LTS) | Meta Quest (via Oculus Integration Package) |

| ARCore XR Plug-in | Android (via AR Foundation) |

| ARKit XR Plug-in | iOS (via AR Foundation) |

**Additional devices supported:**

* Ultraleap Leap Motion controller for hand tracking (via Ultraleap's OpenXR API layer (recommended) or via [Ultraleap's Plugin for Unity](https://learn.microsoft.com/windows/mixed-reality/mrtk-unity/mrtk2/supported-devices/leap-motion-mrtk))

| NOTE: We have introduced the public preview of MRTK3, the next chapter of MRTK. For documentation, please go to the [MRTK3 documentation](https://aka.ms/mrtk3). For code, please go to the [mrtk3 branch](https://github.com/Microsoft/MixedRealityToolkit-Unity/tree/mrtk3). |

| --- |

# Getting started with MRTK

If you're new to MRTK or Mixed Reality development in Unity, **we recommend you start at the beginning of our** [Unity development journey](https://docs.microsoft.com/windows/mixed-reality/unity-development-overview?tabs=mrtk%2Chl2) in the Microsoft Docs. The Unity development journey is specifically tailored to walk new developers through the installation, core concepts, and usage of MRTK.

| IMPORTANT: The Unity development journey currently uses **MRTK version 2.8.2**, **Mixed Reality OpenXR plugin version 1.6.0** and **Unity 2020.3.42+**. |

| --- |

If you're an experienced Mixed Reality or MRTK developer, check the links in the next section for the newest packages and release notes.

# Documentation

**Starting from MRTK 2.6, we are publishing both conceptual docs and API references on docs.microsoft.com. For conceptual docs, please visit our new landing page. For API references, please visit the MRTK-Unity section of the dot net API explorer. Existing content will remain here but will not be updated further.**

| [![Release notes](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_ReleaseNotes.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/release-notes/mrtk-27-release-notes)
[Release Notes](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/release-notes/mrtk-27-release-notes)| [![MRTK Overview](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_ArchitectureOverview.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/architecture/overview)
[MRTK Overview](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/architecture/overview)| [![Feature Guides](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_FeatureGuides.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/button)
[Feature Guides](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/button)| [![API Reference](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_APIReference.png)](https://docs.microsoft.com/dotnet/api/Microsoft.MixedReality.Toolkit?view=mixed-reality-toolkit-unity-2020-dotnet-2.6.0)
[API Reference](https://docs.microsoft.com/dotnet/api/Microsoft.MixedReality.Toolkit?view=mixed-reality-toolkit-unity-2020-dotnet-2.6.0)|

|:---|:---|:---|:---|

# Build status

| Branch | CI Status | Docs Status |

|---|---|---|

| `main` |[![CI Status](https://dev.azure.com/aipmr/MixedRealityToolkit-Unity-CI/_apis/build/status/public/mrtk_CI?branchName=main)](https://dev.azure.com/aipmr/MixedRealityToolkit-Unity-CI/_build/latest?definitionId=15)|[![Docs Validation (MRTK2)](https://github.com/microsoft/MixedRealityToolkit-Unity/actions/workflows/docs_mrtk2.yaml/badge.svg?branch=main)](https://github.com/microsoft/MixedRealityToolkit-Unity/actions/workflows/docs_mrtk2.yaml)

# Required software

 | [![Windows SDK](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK170802_Short_17.png)](https://developer.microsoft.com/windows/downloads/windows-10-sdk) [Windows SDK](https://developer.microsoft.com/windows/downloads/windows-10-sdk)| [![Unity](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK170802_Short_18.png)](https://unity3d.com/get-unity/download/archive) [Unity 2018/2019/2020 LTS](https://unity3d.com/get-unity/download/archive)| [![Visual Studio 2019](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK170802_Short_19.png)](http://dev.windows.com/downloads) [Visual Studio 2019](http://dev.windows.com/downloads)| [![Emulators (optional)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK170802_Short_20.png)](https://docs.microsoft.com/windows/mixed-reality/using-the-hololens-emulator) [Emulators (optional)](https://docs.microsoft.com/windows/mixed-reality/using-the-hololens-emulator)|

| :--- | :--- | :--- | :--- |

Please refer to the [Install the tools](https://docs.microsoft.com/en-us/windows/mixed-reality/develop/install-the-tools) page for more detailed information.

# Feature areas

| [![Input System](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_InputSystem.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/overview)
[Input System](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/overview)
  | [![Hand Tracking
 (HoloLens 2)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_HandTracking.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/hand-tracking)
[Hand Tracking
 (HoloLens 2)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/hand-tracking)
  | [![Eye Tracking
 (HoloLens 2)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_EyeTracking.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/eye-tracking/eye-tracking-main)
[Eye Tracking
 (HoloLens 2)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/eye-tracking/eye-tracking-main)
  | [![Profiles](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_Profiles.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/configuration/mixed-reality-configuration-guide)
[Profiles](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/configuration/mixed-reality-configuration-guide)
  | [![Hand Tracking
 (Ultraleap)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_HandTracking.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/supported-devices/leap-motion-mrtk)
[Hand Tracking
(Ultraleap)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/supported-devices/leap-motion-mrtk)
  |

| :--- | :--- | :--- | :--- | :--- |

| [![UI Controls](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_UIControls.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/#ux-building-blocks)
[UI Controls](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/#ux-building-blocks)
  | [![Solvers](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_Solver.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/solvers/solver)
[Solvers](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/solvers/solver)
  | [![Multi-Scene
 Manager](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_SceneSystem.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/scene-system/scene-system-getting-started)
[Multi-Scene
 Manager](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/scene-system/scene-system-getting-started) | [![Spatial
 Awareness](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_SpatialUnderstanding.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/spatial-awareness/spatial-awareness-getting-started)
[Spatial
 Awareness](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/spatial-awareness/spatial-awareness-getting-started) | [![Diagnostic
 Tool](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_Diagnostics.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/diagnostics/diagnostics-system-getting-started)
[Diagnostic
 Tool](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/diagnostics/diagnostics-system-getting-started) |

| [![MRTK Standard Shader](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_StandardShader.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/rendering/mrtk-standard-shader)
[MRTK Standard
Shader](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/rendering/mrtk-standard-shader) | [![Speech & Dictation](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_VoiceCommand.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/speech)
[Speech](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/speech)
 & [Dictation](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/dictation) | [![Boundary
System](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_Boundary.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/boundary/boundary-system-getting-started)
[Boundary
System](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/boundary/boundary-system-getting-started)| [![In-Editor
Simulation](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_InputSystem.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input-simulation/input-simulation-service)
[In-Editor
Simulation](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input-simulation/input-simulation-service) | [![Experimental
Features](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_Experimental.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/contributing/experimental-features)
[Experimental
Features](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/contributing/experimental-features)|

# UX building blocks

|  [![Button](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Button/MRTK_Button_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/button) [Button](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/button) | [![Bounds Control](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/bounds-control/MRTK_BoundsControl_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/bounds-control) [Bounds Control](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/bounds-control) | [![Object Manipulator](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/manipulation-handler/MRTK_Manipulation_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/object-manipulator) [Object Manipulator](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/object-manipulator) |

|:--- | :--- | :--- |

| A button control which supports various input methods, including HoloLens 2's articulated hand | Standard UI for manipulating objects in 3D space | Script for manipulating objects with one or two hands |

|  [![Slate](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Slate/MRTK_Slate_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/slate) [Slate](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/slate) | [![System Keyboard](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/system-keyboard/MRTK_SystemKeyboard_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/system-keyboard) [System Keyboard](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/system-keyboard) | [![Interactable](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Interactable/InteractableExamples.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/interactable) [Interactable](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/interactable) |

| 2D style plane which supports scrolling with articulated hand input | Example script of using the system keyboard in Unity  | A script for making objects interactable with visual states and theme support |

|  [![Solver](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Solver/MRTK_Solver_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/solvers/solver) [Solver](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/solvers/solver) | [![Object Collection](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/object-collection/MRTK_ObjectCollection_Main.jpg)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/object-collection) [Object Collection](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/object-collection) | [![Tooltip](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Tooltip/MRTK_Tooltip_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/tooltip) [Tooltip](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/tooltip) |

| Various object positioning behaviors such as tag-along, body-lock, constant view size and surface magnetism | Script for laying out an array of objects in a three-dimensional shape | Annotation UI with a flexible anchor/pivot system, which can be used for labeling motion controllers and objects |

|  [![Slider](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Slider/MRTK_UX_Slider_Main.jpg)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/sliders) [Slider](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/sliders) | [![MRTK Standard Shader](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK-Standard-Shader/MRTK_StandardShader.jpg)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/rendering/mrtk-standard-shader) [MRTK Standard Shader](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/rendering/mrtk-standard-shader) | [![Hand Menu](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Solver/MRTK_UX_HandMenu.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/hand-menu) [Hand Menu](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/hand-menu) |

| Slider UI for adjusting values supporting direct hand tracking interaction | MRTK's Standard shader supports various Fluent design elements with performance | Hand-locked UI for quick access, using the Hand Constraint Solver |

|  [![App Bar](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/app-bar/MRTK_AppBar_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/app-bar) [App Bar](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/app-bar) | [![Pointers](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Pointers/MRTK_Pointer_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/pointers) [Pointers](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/pointers) | [![Fingertip Visualization](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Fingertip/MRTK_FingertipVisualization_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/fingertip-visualization) [Fingertip Visualization](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/fingertip-visualization) |

| UI for Bounds Control's manual activation | Learn about various types of pointers | Visual affordance on the fingertip which improves the confidence for the direct interaction |

|  [![Near Menu](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/near-menu/MRTK_UX_NearMenu.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/near-menu) [Near Menu](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/near-menu) | [![Spatial Awareness](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/spatial-awareness/MRTK_SpatialAwareness_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/spatial-awareness/spatial-awareness-getting-started) [Spatial Awareness](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/spatial-awareness/spatial-awareness-getting-started) | [![Voice Command](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Input/MRTK_Input_Speech.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/speech) [Voice Command](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/speech) / [Dictation](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/dictation) |

| Floating menu UI for the near interactions | Make your holographic objects interact with the physical environments | Scripts and examples for integrating speech input |

|  [![Progress Indicator](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/progress-indicator/MRTK_ProgressIndicator_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/progress-indicator) [Progress Indicator](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/progress-indicator) | [![Dialog](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Dialog/MRTK_UX_Dialog_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/dialog) [Dialog [Experimental]](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/dialog) | [![Hand Coach](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/hand-coach/MRTK_UX_HandCoach_Main.jpg)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/hand-coach) [Hand Coach](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/hand-coach) |

| Visual indicator for communicating data process or operation | UI for asking for user's confirmation or acknowledgement  | Component that helps guide the user when the gesture has not been taught |

|  [![Hand Physics Service](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/hand-physics/MRTK_UX_HandPhysics_Main.jpg)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/experimental/hand-physics-service) [Hand Physics Service [Experimental]](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/experimental/hand-physics-service) | [![Scrolling Collection](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/scrolling-collection/ScrollingCollection_Main.jpg)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/scrolling-object-collection) [Scrolling Collection](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/ux-building-blocks/scrolling-object-collection) | [![Dock](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/Dock/MRTK_UX_Dock_Main.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/experimental/dock) [Dock [Experimental]](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/experimental/dock) |

| The hand physics service enables rigid body collision events and interactions with articulated hands | An Object Collection that natively scrolls 3D objects | The Dock allows objects to be moved in and out of predetermined positions |

|  [![Eye Tracking: Target Selection](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/eye-tracking/mrtk_et_targetselect.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/eye-tracking/eye-tracking-target-selection) [Eye Tracking: Target Selection](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/eye-tracking/eye-tracking-target-selection) | [![Eye Tracking: Navigation](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/eye-tracking/mrtk_et_navigation.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/eye-tracking/eye-tracking-navigation) [Eye Tracking: Navigation](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input/eye-tracking/eye-tracking-navigation) | [![Eye Tracking: Heat Map](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/eye-tracking/mrtk_et_heatmaps.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/example-scenes/eye-tracking-examples-overview#visualization-of-visual-attention) [Eye Tracking: Heat Map](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/example-scenes/eye-tracking-examples-overview#visualization-of-visual-attention) |

| Combine eyes, voice and hand input to quickly and effortlessly select holograms across your scene | Learn how to auto-scroll text or fluently zoom into focused content based on what you are looking at | Examples for logging, loading and visualizing what users have been looking at in your app |

# Tools

|  [![Optimize Window](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_OptimizeWindow.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/tools/optimize-window) [Optimize Window](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/tools/optimize-window) | [![Dependency Window](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_DependencyWindow.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/tools/dependency-window) [Dependency Window](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/tools/dependency-window) | ![Build Window](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_BuildWindow.png) Build Window | [![Input recording](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Icon_InputRecording.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input-simulation/input-animation-recording) [Input recording](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/input-simulation/input-animation-recording) |

|:--- | :--- | :--- | :--- |

| Automate configuration of Mixed Reality projects for performance optimizations | Analyze dependencies between assets and identify unused assets |  Configure and execute an end-to-end build process for Mixed Reality applications | Record and playback head movement and hand tracking data in editor |

# Example scenes

Explore MRTK's various types of interactions and UI controls through the example scenes. You can find example scenes under [**Assets/MRTK/Examples/Demos**](/Assets/MixedRealityToolkit.Examples/Demos) folder.

[![Example Scene](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_Examples.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/example-scenes/hand-interaction-examples)

# MRTK examples hub

With the MRTK Examples Hub, you can try various example scenes in MRTK. On HoloLens 2, you can download and install [MRTK Examples Hub through the Microsoft Store app](https://www.microsoft.com/p/mrtk-examples-hub/9mv8c39l2sj4).

See [Examples Hub README page](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/example-scenes/example-hub) to learn about the details on creating a multi-scene hub with MRTK's scene system and scene transition service.

[![Example Scene](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_ExamplesHub.png)](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/example-scenes/hand-interaction-examples)

# Sample apps made with MRTK

| [![Periodic Table of the Elements](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRDL_PeriodicTable.jpg)](https://medium.com/@dongyoonpark/bringing-the-periodic-table-of-the-elements-app-to-hololens-2-with-mrtk-v2-a6e3d8362158)| [![Galaxy Explorer](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRTK_GalaxyExplorer.jpg)](https://docs.microsoft.com/windows/mixed-reality/galaxy-explorer-update)| [![Galaxy Explorer](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRDL_Surfaces.jpg)](https://docs.microsoft.com/windows/mixed-reality/galaxy-explorer-update)|

|:--- | :--- | :--- |

| [Periodic Table of the Elements](https://github.com/Microsoft/MRDL_Unity_PeriodicTable) is an open-source sample app which demonstrates how to use MRTK's input system and building blocks to create an app experience for HoloLens and Immersive headsets. Read the porting story: [Bringing the Periodic Table of the Elements app to HoloLens 2 with MRTK v2](https://medium.com/@dongyoonpark/bringing-the-periodic-table-of-the-elements-app-to-hololens-2-with-mrtk-v2-a6e3d8362158) |[Galaxy Explorer](https://github.com/Microsoft/GalaxyExplorer) is an open-source sample app that was originally developed in March 2016 as part of the HoloLens 'Share Your Idea' campaign. Galaxy Explorer has been updated with new features for HoloLens 2, using MRTK v2. Read the story: [The Making of Galaxy Explorer for HoloLens 2](https://docs.microsoft.com/windows/mixed-reality/galaxy-explorer-update) |[Surfaces](https://github.com/microsoft/MRDL_Unity_Surfaces) is an open-source sample app for HoloLens 2 which explores how we can create a tactile sensation with visual, audio, and fully articulated hand-tracking. Check out Microsoft MR Dev Days session [Learnings from the Surfaces app](https://channel9.msdn.com/Shows/Docs-Mixed-Reality/Learnings-from-the-MR-Surfaces-App) for the detailed design and development story. |

# Session videos from Mixed Reality Dev Days 2020

| [![MRDevDays](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRDevDays_Session1.png)](https://docs.microsoft.com/shows/Mixed-Reality/Intro-to-MRTK-Unity)| [![MRDevDays](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRDevDays_Session2.png)](https://docs.microsoft.com/shows/Mixed-Reality/MRTKs-UX-Building-Blocks)| [![MRDevDays](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/MRDevDays_Session3.png)](https://docs.microsoft.com/shows/Mixed-Reality/MRTK-Performance-and-Shaders)|

|:--- | :--- | :--- |

| Tutorial on how to create a simple MRTK app from start to finish. Learn about interaction concepts and MRTK’s multi-platform capabilities. | Deep dive on the MRTK’s UX building blocks that help you build beautiful mixed reality experiences. | An introduction to performance tools, both in MRTK and external, as well as an overview of the MRTK Standard Shader. |

See [Mixed Reality Dev Days](https://docs.microsoft.com/windows/mixed-reality/mr-dev-days-sessions) to explore more session videos.

# Engage with the community

* Join the conversation around MRTK on [Slack](https://holodevelopers.slack.com/). You can join the Slack community via the [automatic invitation sender](https://holodevelopersslack.azurewebsites.net/).

* Ask questions about using MRTK on [Stack Overflow](https://stackoverflow.com/questions/tagged/mrtk) using the **MRTK** tag.

* Search for [known issues](https://github.com/Microsoft/MixedRealityToolkit-Unity/issues) or file a [new issue](https://github.com/Microsoft/MixedRealityToolkit-Unity/issues) if you find something broken in MRTK code.

* For questions about contributing to MRTK, go to the [mixed-reality-toolkit](https://holodevelopers.slack.com/messages/C2H4HT858) channel on slack.

This project has adopted the [Microsoft Open Source Code of Conduct](https://opensource.microsoft.com/codeofconduct/).

For more information, see the [Code of Conduct FAQ](https://opensource.microsoft.com/codeofconduct/faq/) or contact [[email protected]](mailto:[email protected]) with any additional questions or comments.

# Useful resources on the Mixed Reality Dev Center

| [![Discover](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/mrdevcenter/icon-discover.png)](https://docs.microsoft.com/windows/mixed-reality/) [Discover](https://docs.microsoft.com/windows/mixed-reality/)| [![Design](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/mrdevcenter/icon-design.png)](https://docs.microsoft.com/windows/mixed-reality/design) [Design](https://docs.microsoft.com/windows/mixed-reality/design)| [![Develop](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/mrdevcenter/icon-develop.png)](https://docs.microsoft.com/windows/mixed-reality/development) [Develop](https://docs.microsoft.com/windows/mixed-reality/development)| [![Distribute](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/mrdevcenter/icon-distribute.png)](https://docs.microsoft.com/windows/mixed-reality/implementing-3d-app-launchers) [Distribute](https://docs.microsoft.com/windows/mixed-reality/implementing-3d-app-launchers)|

| :--------------------- | :----------------- | :------------------ | :------------------------ |

| Learn to build mixed reality experiences for HoloLens and immersive headsets (VR).          | Get design guides. Build user interface. Learn interactions and input.     | Get development guides. Learn the technology. Understand the science.       | Get your app ready for others and consider creating a 3D launcher. |

# Useful resources on Azure

| [![Spatial Anchors](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/mrdevcenter/icon-azurespatialanchors.png)](https://docs.microsoft.com/azure/spatial-anchors/)
 [Spatial Anchors](https://docs.microsoft.com/azure/spatial-anchors/)| [![Speech Services](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/mrdevcenter/icon-azurespeechservices.png)](https://docs.microsoft.com/azure/cognitive-services/speech-service/)
 [Speech Services](https://docs.microsoft.com/azure/cognitive-services/speech-service/)| [![Vision Services](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/features/images/mrdevcenter/icon-azurevisionservices.png)](https://docs.microsoft.com/azure/cognitive-services/computer-vision/)
 [Vision Services](https://docs.microsoft.com/azure/cognitive-services/computer-vision/)|

| :------------------------| :--------------------- | :---------------------- |

| Spatial Anchors is a cross-platform service that allows you to create Mixed Reality experiences using objects that persist their location across devices over time.| Discover and integrate Azure powered speech capabilities like speech to text, speaker recognition or speech translation into your application.| Identify and analyze your image or video content using Vision Services like computer vision, face detection, emotion recognition or video indexer. |

# Learn more about the MRTK project

You can find our planning material on [our wiki](https://github.com/Microsoft/MixedRealityToolkit-Unity/wiki) under the Project Management Section. You can always see the items the team is actively working on in the Iteration Plan issue.

# How to contribute

Learn how you can contribute to MRTK at [Contributing](https://docs.microsoft.com/windows/mixed-reality/mrtk-unity/contributing/contributing).

**For details on the different branches used in the Mixed Reality Toolkit repositories, check this [Branch Guide here](https://github.com/Microsoft/MixedRealityToolkit-Unity/wiki/Branch-Guide).**