awesome-mixed-reality

KO | EN

gitlite — search

#typescript #ai-agents #ai #dsh-plugin #deepseek-harness #open-source #claude-code #codex #cli #developer-tools #react #windows

awesome-mixed-reality

★ 83 Open GitHub ↗

🌟 A curated list of awesome resources for Mixed Reality development.

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Awesome Mixed Reality [![Awesome](https://awesome.re/badge.svg)](https://awesome.re)

> 🌟 A curated list of awesome resources for Mixed Reality development.

## Contents

- [Awesome Mixed Reality ](#awesome-mixed-reality-)
  - [Contents](#contents)
  - [YouTube Tutorials](#youtube-tutorials)
  - [Websites](#websites)
  - [Tools](#tools)
  - [Debugging](#debugging)
  - [Packages \& Services](#packages--services)
  - [SDKs](#sdks)
  - [Assets](#assets)
  - [GitHub Projects](#github-projects)
  - [Interesting Hardware](#interesting-hardware)
  - [Books](#books)
  - [Supporting Apple Vision Pro](#supporting-apple-vision-pro)
    - [Apple Vision Development on Xcode](#apple-vision-development-on-xcode)
  - [Quest 3 Mixed Reality](#quest-3-mixed-reality)
    - [Using Meta XR SDK](#using-meta-xr-sdk)
  - [Use XR Interaction Toolkit](#use-xr-interaction-toolkit)
  - [Industry Experts and Companies](#industry-experts-and-companies)
  - [Other Awesome XR Lists](#other-awesome-xr-lists)
  - [Contribute](#contribute)
  - [Author](#author)

## YouTube Tutorials

- [Unity tutorials](https://www.youtube.com/watch?v=XtQMytORBmM) - Comprehensive Unity tutorials for mixed reality development.
- [Unity Fireship](https://www.youtube.com/watch?v=iqlH4okiQqg) - Advanced Unity topics, covering various aspects of Unity development.
- [C# Fireship](https://www.youtube.com/watch?v=ravLFzIguCM) - In-depth guide to C# programming, essential for Unity developers.
- [.NET framework explained](https://www.youtube.com/watch?v=bEfBfBQq7EE) - Overview of the .NET framework, useful for understanding Unity's backend.
- [Valem - How to Make a XR Game in Unity](https://www.youtube.com/watch?v=CcJ4yMTzXUM) - Valem's MR tutorial with the latest Meta XR All-In-One SDK.
- [Valem - VR Dev for Beginners](https://www.youtube.com/watch?v=i3DbJwy0R6E) - Beginner-friendly tutorials on VR development using Unity.
- [Valem's Let's make a VR game](https://www.youtube.com/watch?v=QCvqimfrMZw&list=PLpEoiloH-4eM-fykn_3_QcJ-A_MIJF5B9&index=1) - Step-by-step guide to creating VR games from scratch.
- [Dilmer Valecillos's YT Channel](https://www.youtube.com/@dilmerv)
- [Justin P Barnett's YT Channel](https://www.youtube.com/@JustinPBarnett)
- [Samyam's YT Channel](https://www.youtube.com/@samyam)
- [Brackey's YT Channel (Gamedev GOAT)](https://www.youtube.com/@Brackeys)
- [Black Whale Studio YT Channel](https://www.youtube.com/@blackwhalestudio)
- [Procedural Animation](https://www.youtube.com/watch?v=qlfh_rv6khY)
- [GeoHot on AI Girlfriend](https://www.youtube.com/watch?v=RA7fivgW8TM) - Exploration of AI integration in mixed reality applications.

## Websites

- [Awesome Unity GitHub](https://github.com/RyanNielson/awesome-unity) - A curated list of Unity resources, tools, and tutorials.
- [Quest Docs](https://developer.oculus.com/resources/) - Official Oculus Quest documentation and resources for developers.

## Tools

- **Meta XR Simulator** - [Simulate and test XR applications](https://developer.oculus.com/documentation/tools/tools-overview/).
- **Meta Quest Developer Hub** - [Comprehensive development tools for Oculus Quest](https://developer.oculus.com/downloads/package/oculus-developer-hub/).
- **Wonderland Engine (WebXR)** - [Wonderland Engine for creating WebXR applications](https://wonderlandengine.com/).
- **Cognitive3D (Analytics)** - [Analytics platform tailored for XR applications](https://cognitive3d.com/).
- **Meta Haptics Studio** - [Development tools for creating haptic feedback experiences](https://developer.oculus.com/documentation/unity/unity-haptics/).
- [wit.ai](https://wit.ai/) (NLP) - Natural language processing tools for VR/AR applications.
- [webxr.tools](https://webxr.tools) - A collection of tools for WebXR development.
- **Mattercraft** - [Mixed reality development tools](https://mattercraft.io/).
- **Spark AR Studio** - [Tool for creating augmented reality experiences](https://sparkar.facebook.com/ar-studio/).
- [Meta tools](https://developer.oculus.com/downloads/unity/) - A suite of tools provided by Meta for XR development.
- [Lens Studio - Developing AR apps on Snap platform](https://ar.snap.com/lens-studio)
- [Unity XR Device Simulator](https://docs.unity3d.com/Packages/com.unity.xr.interaction.toolkit@2.0/manual/xr-device-simulator.html)

## Debugging

- **Immersive Debugger** - [Immersive Debugger inside the headset by Meta SDK](https://developer.oculus.com/documentation/unity/immersivedebugger-overview/)
- **RenderDoc for Oculus** - [Frame capture and analysis tool for Oculus applications](https://developer.oculus.com/documentation/native/pc/dg-renderdoc-tutorial/).
- **Unity Profiler** - [Built-in performance profiling tool for Unity applications](https://docs.unity3d.com/Manual/Profiler.html).
- **OVR Metrics Tool** - [Oculus VR metrics analysis tool](https://developer.oculus.com/documentation/tools/tools-ovrmetricstool/).
- **ovrgpuprofiler** - [GPU profiling tool for Oculus applications](https://developer.oculus.com/blog/gpu-profiling-with-oculus-tools/).
- **VrApi Logcat** - [Logging tool for VR applications, useful for debugging](https://developer.oculus.com/documentation/native/android/logcat/).
- **XRGizmos** - [Gizmos for XR development in Unity](https://github.com/darktable/XRGizmos).
- **Graphy** - [Performance monitoring tool for Unity applications](https://assetstore.unity.com/packages/tools/gui/graphy-ultimate-stats-monitor-debugger-105778).

## Packages & Services

- [OpenAI](https://github.com/srcnalt/OpenAI-Unity) - Integration of OpenAI services with Unity.
- [Ezy Slice](https://github.com/DavidArayan/ezy-slice) - Mesh slicing framework for Unity.
- **Unity third person character controller** - [Pre-built character controller for Unity](https://assetstore.unity.com/packages/essentials/characters/standard-assets-32351).
- **Unity Gaming Services (Netcode)** - [Networking services provided by Unity for game development](https://unity.com/products/multiplay).
- **ParrelSync (multiplayer)** - [Tool for synchronizing multiplayer sessions in Unity](https://github.com/VeriorPies/ParrelSync).
- **Unity Relay** - [Networking relay service for Unity games](https://unity.com/products/multiplay).
- **Unity Lobby** - [Lobby service for multiplayer games](https://unity.com/products/lobby).
- **Shadow Receiver URP** - [Universal Render Pipeline shadow receiver for Unity](https://assetstore.unity.com/packages/vfx/shaders/shadow-receiver-urp-188251).

## SDKs

- **Meta XR all-in-one SDK** - [Comprehensive SDK for developing Meta XR applications](https://developer.oculus.com/downloads/package/oculus-integration/).
- **Meta Building Blocks** - [Pre-built components for XR development](https://developer.oculus.com/documentation/unity/unity-prefabs-building-blocks/).
- **Meta Spatial SDK** - [Native Android Framework for Meta XR](https://developers.meta.com/horizon/develop/spatial-sdk)
- **MR Utility Kit** - [Utility kit for mixed reality development](https://github.com/microsoft/MixedRealityToolkit-Unity).
- **SteamVR** - [SDK for developing VR applications for Steam](https://store.steampowered.com/app/250820/SteamVR/).
- **Unity XR Interaction Toolkit** - [Toolkit for creating XR interactions in Unity](https://docs.unity3d.com/Packages/com.unity.xr.interaction.toolkit@2.0/manual/index.html).
- **MRTK** - [Mixed Reality Toolkit by Microsoft](https://github.com/microsoft/MixedRealityToolkit-Unity).
- **VRTK** - [VR Toolkit for Unity, providing a range of tools and components](https://vrtoolkit.readme.io/).
- **HurricaneVR** - [VR interaction framework](https://assetstore.unity.com/packages/tools/physics/hurricane-vr-complete-physics-interaction-framework-182937).
- **AutoHandVR** - [Tool for hand interactions in VR](https://assetstore.unity.com/packages/tools/interaction-systems/autohand-physics-based-vr-interaction-186761).
- **VR Interaction Framework** - [Comprehensive framework for VR interactions](https://assetstore.unity.com/packages/templates/packs/vr-interaction-framework-178370).
- **VR Physics Player Controller** - [Physics-based player controller for VR applications](https://assetstore.unity.com/packages/tools/physics/vr-physics-player-controller-150258).
- **Portals for VR** - [Portal system for VR applications](https://assetstore.unity.com/packages/tools/portals/portals-169995).
- **Final IK** - [Inverse kinematics system for VR](https://assetstore.unity.com/packages/tools/animation/final-ik-14290).
- **VR Hand Models** - [Hand models for VR applications](https://assetstore.unity.com/packages/3d/characters/humanoids/vr-hands-121680).
- **Amplify Impostor** - [Impostor rendering system for Unity](https://assetstore.unity.com/packages/tools/terrain/amplify-impostors-119877).
- **Easy Save** - [Data saving tool for Unity](https://assetstore.unity.com/packages/tools/input-management/easy-save-the-complete-save-load-asset-768).
- **Aura 2** - [Volumetric lighting system for Unity](https://assetstore.unity.com/packages/tools/particles-effects/aura-2-volumetric-lighting-fog-202020).
- **RayFire** - [Destruction and fragmentation tool for Unity](https://assetstore.unity.com/packages/tools/modeling/rayfire-for-unity-148690).
- **Poly Universal** - [Universal assets for VR/AR development](https://assetstore.unity.com/packages/3d/environments/poly-universal-sci-fi-kit-176439).
- **Synty Studios** - [Provider of stylized assets for Unity](https://syntystore.com/).
- **Niantic Lightship** - [AR development platform by Niantic](https://lightship.dev/).
- **LOVR** - [Lua Virtual Reality Framework](https://github.com/bjornbytes/lovr)
- **Reality Accelerator Toolkit** - [Collection of tools and samples for building high-quality MR experiences](https://github.com/meta-quest/reality-accelerator-toolkit).
- **AR Foundation** - [Unity framework for AR development](https://docs.unity3d.com/Packages/com.unity.xr.arfoundation@4.2/manual/index.html).
- **XR Hands** - [Hand tracking tools for XR applications](https://docs.unity3d.com/Packages/com.unity.xr.hands@0.2/manual/index.html).
- **Meta XR interaction SDK OVR Samples** - [Sample projects for Meta XR](https://developer.oculus.com/resources/sample-apps-unity/).
- **Meta XR Haptics SDK** - [SDK for developing haptic feedback in XR](https://developer.oculus.com/documentation/unity/unity-haptics/).
- **Meta Avatars SDK** - [SDK for creating avatars in XR applications](https://developer.oculus.com/documentation/unity/unity-avatars-sdk/).
- **Meta Voice SDK** - [SDK for integrating voice interactions in XR](https://developer.oculus.com/documentation/unity/unity-voice-sdk/).

## Assets

- [Unity Asset Store](https://assetstore.unity.com/) - Marketplace for Unity assets.
- [Sketchfab](https://sketchfab.com/) - Repository of 3D models.
- [TurboSquid](https://www.turbosquid.com/) - Marketplace for 3D models.
- [Free3D](https://free3d.com/) - Free 3D models for various applications.
- [CGTrader](https://www.cgtrader.com/) - 3D model marketplace.
- **Pro builder** - [3D modeling tool for Unity](https://unity.com/features/probuilder).
- **Mixamo** - [Tool for 3D character animations](https://www.mixamo.com/).
- [Poliigon](https://www.poliigon.com/search/free) - 3D Assets and Textures
- [Kenney.nl](https://kenney.nl/) - Free game assets.
- [Ready Player Me](https://readyplayer.me/) - Avatar creation tool.
- **Character Creator** - [Tool for creating detailed 3D characters](https://www.reallusion.com/character-creator/default.html).
- **Oculus Lipsync** - [Lip sync tool for Oculus](https://developer.oculus.com/downloads/package/oculus-lipsync-unity/).
- **Meta 3DGen** - [Tool for generating 3D models](https://developer.oculus.com/downloads/package/oculus-3dgen/).
- [Luma AI](https://lumalabs.ai/) - AI-based tool for creating 3D models.
- **AR Foundation Remote** - [Remote testing tool for AR Foundation](https://assetstore.unity.com/packages/tools/utilities/ar-foundation-editor-remote-202080).
- **DoTween Pro** - [Tweening engine for Unity](https://assetstore.unity.com/packages/tools/animation/dotween-hotween-v2-27676).
- **Hologram Shaders Pro** - [Hologram shaders for Unity](https://assetstore.unity.com/packages/vfx/shaders/hologram-shaders-pro-155998).
- [InWorld.ai](https://inworld.ai/) - AI-based character behavior tool.
- **Live Script Reload** - [Live scripting tool for Unity](https://assetstore.unity.com/packages/tools/utilities/live-script-reload-201808).
- **Odin Inspector & Serializer** - [Advanced inspector and serialization tool for Unity](https://assetstore.unity.com/packages/tools/utilities/odin-inspector-and-serializer-89041).
- **Vour** - [VR asset creation tool](https://vour.co/).
- **SRDebugger** - [Debugging tool for Unity applications](https://assetstore.unity.com/packages/tools/gui/srdebugger-console-in-game-debug-tools-on-device-visibility-38153).
- **Stable Fast 3D** - [Rapid 3D Asset Generation From Single Images](https://platform.stability.ai/docs/api-reference#tag/Control/paths/~1v2beta~1stable-image~1control~1style/post)
- **Mesh Effects** - [Mesh effects tool for Unity](https://assetstore.unity.com/packages/vfx/particles/spells/mesh-effects-67803).
- **Pro Sound Collection** - [Sound effects collection for Unity](https://assetstore.unity.com/packages/audio/sound-fx/pro-sound-collection-50235).

## GitHub Projects

- [Oculus Samples](https://github.com/oculus-samples) - Sample projects provided by Oculus.
- [Unity Showcase](https://developer.oculus.com/documentation/unity/unity-showcases/) - Showcase of Unity projects.
- [AR Foundation Samples](https://github.com/Unity-Technologies/arfoundation-samples) - Sample projects for AR Foundation.
- [Mixed Reality Example for Meta-OpenXR](https://github.com/Unity-Technologies/mr-example-meta-openxr) - Example project for Meta-OpenXR.
- [First Hand](https://github.com/oculus-samples/Unity-FirstHand) - Hand interaction sample projects.
- [The World Beyond](https://github.com/oculus-samples/Unity-TheWorldBeyond) - Sample project for world-building in VR.
- [Phanto](https://github.com/oculus-samples/Unity-Phanto) - VR interaction sample project.
- [XR Interaction Toolkit Example](https://github.com/Unity-Technologies/XR-Interaction-Toolkit-Examples) - Example projects for XR Interaction Toolkit.
- [VR Beginner The Escape Room](https://assetstore.unity.com/packages/templates/tutorials/vr-beginner-the-escape-room-163264) - VR beginner tutorial project.
- [Scape Scraper](https://www.youtube.com/watch?v=QCvqimfrMZw&list=PLpEoiloH-4eM-fykn_3_QcJ-A_MIJF5B9&index=1&t=0s) - VR game development series.
- [Open Brush](https://github.com/icosa-foundation/open-brush) - Open-source VR painting application.
- [Tilt Brush](https://github.com/googlevr/tilt-brush) - The OG Painting App in VR created by Google in 2016 (not being maintained anymore though, but continued in spirit by Open Brush)
- [VR Alchemy Lab](https://github.com/Unity-Technologies/VRAlchemyLab) - VR interaction sample projects.
- [Move Fast](https://github.com/Unity-Technologies/mr-example-meta-openxr) - Mixed reality interaction sample project.
- [Whisperer](https://github.com/oculus-samples/voicesdk-samples-whisperer) - Voice SDK sample projects.
- [Ultimate Glove Ball](https://github.com/oculus-samples/Unity-UltimateGloveBall) - VR glove interaction sample project.
- [White Christmas](https://github.com/GlamrHQ/WhiteChristmas) - Object Detection in Meta Quest Headset

## Interesting Hardware

- **WEART Haptic Gloves** - [Advanced haptic feedback gloves](https://www.weart.it/).
- **Magic Leap 2** - [Mixed reality headset](https://www.magicleap.com/magic-leap-2).
- **Tilt Five AR Glasses** - [Augmented reality glasses](https://www.tiltfive.com/).
- **Logitech MX Ink pen** - [MR Stylus](https://www.logitech.com/en-us/products/vr/mx-ink.html).
- **Zapbox** - [iPhone as a MR headset device](https://www.zappar.com/zapbox/)
- **XREAL One** - [AR Glasses Equipped With a Self-Developed Spatial Computing Chip](https://us.shop.xreal.com/products/xreal-one)
- **Snapchat Spectacles** - [AR glasses powered by Snap OS](https://www.spectacles.com/)

## Books

- [Virtual Reality - Steven Lavalle](https://lavalle.pl/vr/) - Comprehensive guide to virtual reality, providing foundational knowledge and advanced techniques.
- [Interactive Computer Graphics - Edward Angel](https://tinnakorn.cs.rmu.ac.th/Courses/ComputerGraphic/Pearson.Interactive.Computer.Graphics.A.Top-Down.Approach.with.WebGL.7th.Edition.pdf) - Textbook on computer graphics with a focus on WebGL.

## Supporting Apple Vision Pro

- **Unity is building PolySpatial** to use Unity assets in Apple's headset.
- **URP and Standard Render Pipeline** are supported, including shader graphs for custom shaders.
- **Gaze interactor for eye tracking** is available.
- **Unity editor preview** is supported.
- **Signup for PolySpatial beta** to get early access.
- **Ensure Unity version 6 and above** for compatibility.

### Apple Vision Development on Xcode

- **Use the latest version of Xcode** with visionOS, and install Reality Composer Pro.
- **Familiarize with concepts from SwiftUI and RealityKit**.
- **Use the built-in simulator** to test applications.

## Quest 3 Mixed Reality

### Using Meta XR SDK

- **Ensure the headset is in developer mode**.
- **Create a passthrough component**:
  - Set underlay placement.
  - Remove the skybox in OVR rig.
  - Enable passthrough support, Quest 3 in OVR manager.
- **Scene model**:
  - Create a scene manager component on a game object.
  - Add a plane and volume prefab to it.
  - Enable scene support in OVRCameraRig.
- **Enable depth**:
  - Create a new mixed reality depth material.
  - Recommended: use Meta's depth API.
- **Shadows**:
  - Create a texture and set it to the shadow material.
  - Use a Raycast with the same layer mask as the scene's global mesh.
  - Recommended: Use the shadow receiver custom shader and add that to the scene's plane, and enable shadow in all the mesh renderers.

## Use XR Interaction Toolkit

- **Ensure to use Unity version 6 and above**.
- **Install the dependencies**:
  - XR Plugin Management
  - XR Interaction Toolkit
  - OpenXR Plugin
  - AR Foundation
  - meta-openxr
- **Configurations**:
  - Enable Meta quest feature group.
  - Disable auto graphics API, and set color space to linear, target architecture to ARM64, Vulkan above OpenGLES3.
  - Disable terrain holes and HDR, post-processing.
- **Edit the project hierarchy**:
  - Add AR Session.
  - Add AR Plane Manager in XR Rig.
  - Add AR Camera Manager and AR Camera Background in Main Camera, remove the skybox.
- **Customize the plane** by adding a plane prefab to the AR Plane Manager.
- **Anchor**:
  - Add AR Anchor Manager to XR Rig.
  - Add AR Anchor to the prefab.

## Industry Experts and Companies

Thanks to Robert Scoble for his valuable contribution. Here are the lists of VR/AR experts and companies curated by him:

- **VR/AR Experts**:
  - [List 1 (550 people)](https://x.com/i/lists/733162578625449985)
  - [List 2](https://x.com/i/lists/1786062895668974066)

- **Companies in XR**:
  - [Companies List](https://x.com/i/lists/733277650085511168)

## Other Awesome XR Lists

- [Awesome visionOS](https://github.com/tomkrikorian/awesome-visionOS)
- [Awesome Meta Spatial SDK](https://github.com/tomkrikorian/awesome-meta-spatial-sdk)

## Contribute

Contributions welcome! Read the [contribution guidelines](CONTRIBUTING.md) first.

## Author

[Saurabh Chalke](https://x.com/saurabhchalke)

Feel free to reach out to me on [Twitter/X](https://x.com/saurabhchalke) for any sort of help related to MR :)

-----

awesome-mixed-reality

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README