Using the Mixed Reality Capture tool
The Mixed Reality Capture Tool allows you to place real-world objects in VR. Using a webcam, green screen and broadcasting software you can capture footage of yourself and superimpose it in the virtual world.
Getting Started with the Mixed Reality Capture Tool
To set up the Mixed Reality Capture Tool:
- From your PC, download the Mixed Reality Capture Tool.
- Launch the app and click Get Started.
- Review the terms and conditions and click Agree.
- Click Rift S to begin setup.
- If you have an Meta Quest, follow the setup instructions in this article.
- If this is your first time using mixed reality capture, install the Mixed Reality Capture app on your Rift S.
- Launch the Mixed Reality Capture app in your Rift S and click Search for Device.
- Once the device is found click Calibrate Your Camera.
- Select your webcam from the Current Camera menu and then click Begin Calibration.
- Follow the onscreen instructions to calibrate your controller and then click Save to Headset.
- Locate the game launcher on your computers hard drive. Example location: C:\Program Files\Oculus\Software. Create a shortcut of the launcher.
- Right click the shortcut and click Properties.
- In the field next to Target add "-mixedreality" to the end of the text in the box.
- Launching the game from the shortcut should now open a split screen of your computer.
Setting Up Open Broadcaster Software
To use the Mixed Reality Capture Tool with Open Broadcaster Software, or OBS:
- Follow the link from the capture tool to install the required OBS version.
- Click Generate OBS Scene Collection and launch OBS.
- From the top of OBS, click Scene Collection Menu > click Import. Pick the OBS Scene Collection file you saved. Once it's imported, go back to the Scene Collection Menu and select your file from the dropdown.
- In the foreground and background layer, right click and click Filters > click Crop/Pad. Make sure you're selecting the background from the left side of the screen and the foreground from the right side of the screen.
- If they look incorrectly sized, click on both layers and then click Transform > click Stretch to Screen.
- Close out of this screen, right click on the foreground layer, click Filters > click Chroma Key. Make sure the dropdown Key Color Type matches the main background color .
Note: If you're noticing that there is latency between your movements and the ones being captured, you may need to adjust the Render Delay in OBS. To adjust this, right click on your video capture device and click Filters. Click Render Delay and make adjustments until the latency from your movements decreases.
Copy article
