Low Latency NVIDIA Jetson Streaming to VR Headset

Discover the future of Real-Time 360° Video Streaming

Discover how the combination of NVIDIA Jetson platforms, VR headsets like Meta Quest, and RidgeRun products provide low-latency 360° video streaming solutions. With a wide range of applications, the 360° view and low latency will offer you an experience that feels as if you are truly there.

How it Works

To understand how it works, please review the following steps:

1. Connect the hardware according to the following schematic diagram.

2. To generate the 360-degree stream, simply run a Gstreamer pipeline on the NVIDIA Jetson platform using RidgeRun products. This will create a panoramic image, which will be transmitted to the VR headset at a high speed.

3. On your VR open the RidgeRun360LiveStream app. Type your IP host into the initial menu, and click Play.

4. Put on the VR headset and immerse yourself in the 360-degree streaming experience, with an impressive latency of just 267 ms between real life and the streaming you're viewing.

NVIDIA Jetson Platform Configuration

The NVIDIA Jetson platform utilizes RidgeRun products to generate a 360-degree image, which is then transmitted to VR headsets via network connection. Below is a list of RidgeRun products with their information and respective functions for this purpose:

GstCUDA streamlines the integration of CUDA algorithms into GStreamer pipelines by providing a framework with base classes. This lets developers focus on algorithm logic without dealing with the complexities of CUDA and GStreamer, accelerating the development process and reducing time to market. For more information please refer to GstCUDA.

GstProjector is a GStreamer element that converts the output of the fish eye to an equirectangular image. It works alongside the Stitcher to create a 360-degree image. For more information please refer to RidgeRun Image Projector.

Cudastitcher is a GStreamer element that merges multiple overlapping images into a panoramic image. It transforms the input images to make the borders between them seamless. For more information please refer to Image Stitching.

GstRtspSink is a GStreamer element that enables high-performance streaming to multiple computers using the RTSP/RTP protocols. It is essential for streaming video to the Meta Quest with very low latency. For more information please refer to GstRtspSink.

Streaming to VR Headset

Refer to GStreamer RidgeRun Support for Meta Quest to more information about how to set up your heaset VR.

Potential Applications and Use Cases

Real-Time 360° Video Streaming offers diverse applications across industries and entertainment. The product's low latency and panoramic view make it ideal for simulating presence in a specific location, even when physically distant.

Hazardous Locations:

Implementing the system in life-threatening environments, where physical presence poses risks such as high radiation levels, disaster zones, or hazardous industrial settings, enhances safety protocols by enabling remote monitoring and assessment without endangering personnel.

Difficult-to-Access Areas:

Capture 360-degree video to explore and monitor tight or inaccessible spaces for humans, such as small caves or even large and complex machinery, where direct human observation is impractical or uncomfortable.

Events:

Capture and broadcast live events, such as concerts, festivals, conferences, and even sports, offering viewers an immersive experience from multiple angles, just as if they were there.

Wildlife Observation:

Observing and studying wild animals up close in their natural habitat without disturbing their environment or risking human life. You'll feel like you're right there with them in real-time.

Benefits

Low latency NVIDIA Jetson streaming to VR headset offers various benefits to the user, including:

Real-Time Feedback:

Low latency ensures quick response times, significantly enhancing user interaction and control. This is crucial for applications in robotics, remote operations, and interactive experiences, where every millisecond between real life and the image seen in the headset is crucial.

Operational Efficiency:

With the low latency of this product, the system minimizes downtime and boosts productivity in industrial and security applications. Instant access to critical visual data enables faster decision-making and problem-solving, enhancing overall operational effectiveness.

For direct inquiries, please refer to the contact information available on our Contact page. Alternatively, you may complete and submit the form provided at the same link. We will respond to your request at our earliest opportunity.

Links to RidgeRun Resources and RidgeRun Artificial Intelligence Solutions can be found in the footer below.

❯