View source for Low Latency NVIDIA Jetson Streaming to VR Headset

<seo title="Low Latency NVIDIA Jetson Streaming to VR Headset | Low Latency | RidgeRun Developer" titlemode="replace" keywords="Low Latency, GStreamer, Meta Quest, Streaming, RTSP, 360, RidgeRun, VR, headset, virtual reality, panoramic, 360 video"  description="This wiki page from RidgeRun is about Low Latency NVIDIA Jetson Streaming to VR Headset"></seo>

{{NVIDIA Pref Partner logo and RR Contact}}

== Discover the future of Real-Time 360° Video Streaming ==

Discover how the combination of NVIDIA Jetson platforms, VR headsets like Meta Quest, and RidgeRun products provide low-latency 360° video streaming solutions. With a wide range of applications, the 360° view and low latency will offer you an experience that feels as if you are truly there.

<br>
<center>
<embedvideo service="youtube">https://youtu.be/a9YNdtn0hoI</embedvideo>
</center>

== How it Works ==
To understand how it works, please review the following steps:

1. Connect the hardware according to the following schematic diagram.
<br>
<br>
[[File:RidgeRun diagram.png|480px|thumb|center|Low Latency Streaming Diagram]]
<br>
2. To generate the 360-degree stream, simply run a Gstreamer pipeline on the NVIDIA Jetson platform using RidgeRun products. This will create a panoramic image, which will be transmitted to the VR headset at a high speed.
<br>
<br>
[[File:360 streaming.png|580px|thumb|center|360 Low Latency Streaming]]
<br>
3. On your VR open the RidgeRun360LiveStream app. Type your IP host into the initial menu, and click Play. 
<br>
<br>
[[File:App menu.png|480px|thumb|center|RidgeRun360LiveStream main menu]]
<br>
4. Put on the VR headset and immerse yourself in the 360-degree streaming experience, with an impressive latency of just 267 ms between real life and the streaming you're viewing.

=== NVIDIA Jetson Platform Configuration ===
The NVIDIA Jetson platform utilizes RidgeRun products to generate a 360-degree image, which is then transmitted to VR headsets via network connection. Below is a list of RidgeRun products with their information and respective functions for this purpose:

* '''GstCUDA''' streamlines the integration of CUDA algorithms into GStreamer pipelines by providing a framework with base classes. This lets developers focus on algorithm logic without dealing with the complexities of CUDA and GStreamer, accelerating the development process and reducing time to market. For more information please refer to [[GstCUDA | GstCUDA]].

* '''GstProjector''' is a GStreamer element that converts the output of the fish eye to an equirectangular image. It works alongside the Stitcher to create a 360-degree image. For more information please refer to [[RidgeRun_Image_Projector | RidgeRun Image Projector]].

* '''Cudastitcher''' is a GStreamer element that merges multiple overlapping images into a panoramic image. It transforms the input images to make the borders between them seamless. For more information please refer to [[Image_Stitching_for_NVIDIA_Jetson | Image Stitching]].

* '''GstRtspSink''' is a GStreamer element that enables high-performance streaming to multiple computers using the RTSP/RTP protocols. It is essential for streaming video to the Meta Quest with very low latency. For more information please refer to [[GstRtspSink | GstRtspSink]].

=== Streaming to VR Headset ===
Refer to [[GStreamer_Support_for_Meta_Quest#GStreamer_on_Meta_Quest_Overview|GStreamer RidgeRun Support for Meta Quest]] to more information about how to set up your heaset VR.

== Potential Applications and Use Cases ==

Real-Time 360° Video Streaming offers diverse applications across industries and entertainment. The product's low latency and panoramic view make it ideal for simulating presence in a specific location, even when physically distant.

'''Hazardous Locations:'''

Implementing the system in life-threatening environments, where physical presence poses risks such as high radiation levels, disaster zones, or hazardous industrial settings, enhances safety protocols by enabling remote monitoring and assessment without endangering personnel.
<br>
<br>
[[File:Building.png|320px|thumb|center]]
<br>
'''Difficult-to-Access Areas:'''

Capture 360-degree video to explore and monitor tight or inaccessible spaces for humans, such as small caves or even large and complex machinery, where direct human observation is impractical or uncomfortable.
<br>
<br>
[[File:Cave.png|320px|thumb|center]]
<br>
'''Events:'''

Capture and broadcast live events, such as concerts, festivals, conferences, and even sports, offering viewers an immersive experience from multiple angles, just as if they were there.
<br>
<br>
[[File:Stadium.png|320px|thumb|center]]
<br>
'''Wildlife Observation:'''

Observing and studying wild animals up close in their natural habitat without disturbing their environment or risking human life. You'll feel like you're right there with them in real-time.
<br>
<br>
[[File:Shark.png|320px|thumb|center]]
<br>
== Benefits ==

Low latency NVIDIA Jetson streaming to VR headset offers various benefits to the user, including:

'''Real-Time Feedback:'''

Low latency ensures quick response times, significantly enhancing user interaction and control. This is crucial for applications in robotics, remote operations, and interactive experiences, where every millisecond between real life and the image seen in the headset is crucial.

'''Operational Efficiency:'''

With the low latency of this product, the system minimizes downtime and boosts productivity in industrial and security applications. Instant access to critical visual data enables faster decision-making and problem-solving, enhancing overall operational effectiveness.

{{ContactUs}}

[[Category:GStreamer]] [[Category:Jetson]]