UE5 Guide: Blackmagic DeckLink Video IO, Genlock, Timecode, Vive Tracking, & Live Compositing

Introduction

This tutorial guides you through setting up video input, genlock, timecode, motion tracking, and live compositing in Unreal Engine 5 (UE5) using the Blackmagic DeckLink system. This setup is essential for real-time virtual production and enhances your workflow in film and video projects.

Step 1: Launch Unreal Engine and Set Up Project

• Open Unreal Engine from the Epic Games Launcher.
• Select Film, Video, and Live Events and choose Blank project. This setup loads essential plugins.
• Avoid using starter content and ray tracing for this initial setup.
• To access relevant windows, navigate to Window > Virtual Production for options like Live Link, Genlock, and Timecode Provider.

Step 2: Activate Required Plugins

• Go to Edit > Plugins and ensure the following plugins are activated:
  • Composure
  • SteamVR
  • Blackmagic Media Player
  • Live Link
  • Live Link XR
  • OpenXR Media Framework
  • Utilities Media I/O Framework
  • Camera Calibration
• Note that you may need to restart Unreal Engine after enabling some of these plugins.

Step 3: Set Up Blackmagic Video Input

• Connect your Blackmagic URSA Mini 12K camera to the Blackmagic DeckLink 8K Pro via SDI.
• Open Blackmagic Desktop Video Setup to configure the inputs and outputs.
  • Confirm video input settings are at 2160p, 30 frames per second.
  • Set up an output to an SDI to HDMI converter connected to a monitor at 1080p, 30 frames.
• Open Media Express to check the live feed from your camera.

Step 4: Create Media Bundle in Unreal Engine

• Press Ctrl + Spacebar to open the Content Browser.
• Right-click and select Media > Media Bundle and name it black_magic_design_video_input.
• Double-click the media bundle to configure settings:
  • Choose Blackmagic Media Source and set it to match your camera settings:
    • Resolution: 4K Ultra HD
    • Frame Rate: 30 FPS
    • Timecode Format: VITC
  • Set video format to 10-bit YUV and sRGB.

Step 5: Add Video Source to Scene

• Drag the video input from your Content Drawer into the scene.
• Confirm the live video feed is visible in the viewport.

Step 6: Configure Timecode and Genlock

• Create a new Blueprint Class:
  • Right-click in the Content Drawer, choose Blueprint Class, and search for Blackmagic Timecode Provider.
  • Name it blackmagic_design_custom_time_code and set it up to match your camera settings.
• Repeat the process for Genlock:
  • Create another Blueprint Class named blackmagic_custom_time_step.
• Now, go to Project Settings:
  • Set the Timecode Provider to the custom timecode Blueprint created.
  • Set the Time Step to the custom time step Blueprint created.

Step 7: Create Virtual Camera

• Add a Cinematic > Cinema Camera Actor to your scene.
• Match the camera settings:
  • Focal Length: 20
  • Aperture: 2.8
  • Sensor Size: 27.03mm x 14.25mm.
• Create a new Composure setup:
  • Go to Composure and create an Empty Comp Shot.
• In the Comp Shot, add a Media Plate with the live video feed as the input.

Step 8: Set Up Motion Tracking

• Ensure SteamVR is installed and your HTC Vive Pro 2 setup is active.
• Open Live Link and add the VR sources (e.g., HMD, controllers).
• For camera tracking:
  • Select the cinema camera actor, go to Details, and add Live Link Controller.
• Create a parent anchor (e.g., a sphere) to control camera movement in 3D space without visible interference.

Step 9: Output Compositing to Blackmagic

• Create a new Blackmagic Media Output:
  • Name it bmd_video_output and configure it for DeckLink 8K Pro, setting the output to 1080p, 30 FPS with external timecode.
• In your Composure settings, add the media output to capture and display the composited video.

Conclusion

You have now set up a complete system in Unreal Engine 5 for video input, genlock, timecode, motion tracking, and live compositing using Blackmagic technology. This setup is essential for real-time virtual production environments. Next steps could involve further refining your compositing settings, exploring more advanced camera calibration, or integrating additional tracking devices for enhanced control.