What Headsets have the ability to do Mixed reality or Augmented Reality with KeyVR?

KeyVR has the option for passthrough or mixed reality. Not all headsets are able to use this feature.

Issue

Customer is not able to use mixed reality with certain headsets.

Environment Details

  • KeyVR
    • Any version

Answer

Augmented Reality via a VR headset is essentially passthrough.  Right now, the Varjo XR headsets are the only ones that natively work with passthrough in KeyVR.

Quest 3 and other headsets don't currently allow mixed reality. That is because they only do AR when NOT connected to a PC. So if you use the Quest 3 in standalone mode, without PC connected, it can do AR. But as soon as you connect it to a PC, it becomes a pure VR headset without the support for passthrough. Meta says this is to protect the user's privacy (we could theoretically record the camera feed etc.). We can't control this as it's the headset manufacturers that do. 

However, the Quest 3 can enable passthrough in KeyVR using a 3rd party app called Virtual Desktop Streamer.  This app allows color keying to achieve passthrough.  Since this involves a 3rd party application, KeyShot cannot officially offer support with it.