Programming for Mixed Reality with Windows 10, Unity, Vuforia and UrhoSharp : 9781509306879

Programming for Mixed Reality with Windows 10, Unity, Vuforia and UrhoSharp

Published by
Pearson Higher Ed USA
Available on demand
Title type
Title type
This is the first start-to-finish guide to programming AI-powered mixed reality apps and games using today’s breakthrough technologies -- including Microsoft Cognitive Services, Unity, Vuforia, Xamarin UrhoSharp, and the Universal Windows Platform. Pioneering mixed reality developer Dawid Borycki guides you through every aspect and phase of mixed reality development, from simple 2D apps to cutting-edge apps that run on Microsoft HoloLens and today’s newest immersive headsets. One step at a time, you’ll learn how to:
  • Set up a mixed reality development environment with all the tools you’ll need, including HoloLens and Mixed Reality simulators
  • Write Universal Windows 2D apps for all Windows 10 devices, and adjust their views and capabilities to specific hardware
  • Acquire, display and process audio and video
  • Send images from world-facing headset cameras to Microsoft’s computer vision machine learning modules
  • Generate descriptions of what the user sees, and present them via text or speech
  • Use mobile sensor readings to control content displayed through mixed reality headsets
  • Master core concepts and techniques for building 3D mixed reality apps with Unity
  • Format 3D objects with materials to create holograms
  • Add interactions to holograms based on user input Integrate HoloLens-specific capabilities, including air gestures, spatial sound, and mapping
  • Connect mixed reality experiences with real objects in the environment via the Vuforia Unity extension
  • Write cross-platform 3D mixed reality apps with Xamarin UrhoSharp
Table of contents
  • Part I: Mixed Reality Fundamentals
  • 1. Introduction to Mixed Reality in Windows 10
  • 2. Exploring the Development Tools
  • 3. Configuring the Development Environment, Emulators and Hardware
  • Part II. Developing 2D UWP Apps
  • 4. Understanding UWP Basics
  • 5. Working with Media Controls, Speech Synthesis and Recognition
  • 6. Using Microsoft Cognitive Services to Develop AI-Enabled apps
  • 7. Connecting with Other Devices
  • Part III. Developing 3D Apps
  • 8. Understanding 3D Graphics Fundamentals
  • 9. Using the Unity Editor to Create and Modify 3D Scenes
  • 10. Adding Physical Effects and Interactivity to 3D Scenes
  • 11. Adding Animations to 3D Objects in Unity
  • 12. Understanding HoloLens-Specific Functionalities
  • 13. Creating an AI-Powered 3D App
  • 14. Installing and Using the Vufora Extension for Unity
  • 15. Using UrhoSharp to Build 3D Mixed Reality Apps
Author biography

Dawid Borycki, is a biomedical researcher and software engineer with extensive experience in Microsoft technologies. He has executed many challenging software development projects for advanced device prototyping, including signal and image processing, control algorithms, embedded device interfacing, desktop (.NET C#), web (ASP.NET MVC), and mobile (Universal Windows Platform, Xamarin, Xamarin.Forms) programming. He is author of Programming for the Internet of Things: Using Windows 10 IoT Core and Azure IoT Suite