Live Streaming in an 8K World with RED and Media.Monks

Step-by-Step Tutorial: Live Streaming in an 8K World with RED and Media.Monks

Introduction:

In this tutorial, you will learn about the collaboration between RED Digital Cinema and MediaMonks to bring a Post Malone concert to VR headsets in stunning clarity with minimal latency. This innovative approach involves a cloud-centric distribution model and live streaming in an 8K world. Let's dive into the workflow and technology behind this groundbreaking project.

1. Understanding the Workflow:

   • MediaMonks sought a solution for live AR and XR, which relies on various components of the RED ecosystem.
   • The process begins with an 8K sensor, to which a special dual fisheye lens is added for capturing left and right eye views in 4K.
   • Live footage is offloaded to a GPU for processing, enabling real-time de-warping for AR/VR viewing.

2. Difference from Traditional Workflows:

   • Previously, workflows involved offline processing of recorded footage from separate left and right cameras.
   • With the connected workflow interfacing directly with the GPU, live streaming replaces post-event processing.

3. Network Bandwidth and Latency Management:

   • Utilize technology that allows the transfer of raw footage from the camera to the GPU for processing using a simple 10 gigabit ethernet connection.
   • The processed footage is then compressed for distribution via the Cloud, ensuring minimal latency.

4. De-Warping Process for VR Viewing:

   • Real-time de-warping adjusts the footage for both left and right eye views in the headset, creating an immersive experience for viewers.

5. Experiencing the VR Headset:

   • You can experience the immersive headset view that showcases different perspectives without the need for multiple camera shots.

6. Post-Production and Editing:

   • MediaMonks steps in to edit, package, and deliver the final project in 8K quality, leveraging multiple RED Raptor XLs for VR production.
   • Utilize AWS Snowcone for secure and redundant backups, enabling global collaboration and efficient post-production workflows.

7. Efficient Cloud-Based Collaboration:

   • By leveraging cloud-based workflows, the team successfully meets deadlines and delivers VR content at 8K and 60 frames per second.
   • The project was completed entirely on the Cloud, showcasing the cost-saving efficiencies and quick-turnaround capabilities of cloud-based post-production.

8. Continuous Innovation in Media & Entertainment:

   • The collaboration between RED and MediaMonks highlights the evolving landscape of media production, driven by continuous innovations and cloud-based technologies.

By following these steps, you can gain insights into the live streaming process in an 8K world and understand the collaborative efforts that enable high-quality VR experiences through efficient cloud-based workflows.