NVIDIA Jetson Orin - Capture and Display GStreamer Pipelines

NVIDIA®Jetson AGX Orin™
Introduction
SoM Overview Carrier Boards NVIDIA developer kit Auvidea X230D Connect Tech Forge Software Development Support
JetPack 5.0.2
Getting Started Installing JetPack Flashing the board with GUI installer JetPack Components Compiling Source Code Flashing the Board from Cmdline Performance Tuning Evaluating Performance Set Values Manually Tuning Power Maximizing Performance Software Encoders For Jetson Orin Nano
Development in the Board
Getting into the Board Using Serial Console Using SSH Using Ubuntu Login Installing Packages
Emulation
Flashing commands for emulation
Supported Cameras
IMX477+J20 Driver
GStreamer Pipelines
Capture and Display H264 H265
RidgeRun Products
GstPTZR GstCUDA GstColorTransfer GstWebRTC GstRtspSink GstInterpipe GstInference GstVPI GStreamer Daemon GstShark
RidgeRun Reference Designs
Panoramic Stitching and WebRTC Streaming
Reference Documentation
Contact Us

This section presents GStreamer pipelines to capture from MIPI CSI-2 and USB cameras and render the video to the display connected to the Orin. Key performance indicators are measured using three power profiles (operation modes). Check our GStreamer Pipelines section to find more information about how we extracted the performance metrics presented in this section.

MIPI CSI-2 Camera

For the pipelines in this section, we used the IMX477 camera.

1920x1080@30 using nv3dsink

The pipeline below captures and renders the video to the display connected to the Orin AGX using the nv3dsink element. Table 1 shows the performance metrics for this pipeline.

gst-launch-1.0 nvarguscamerasrc ! 'video/x-raw(memory:NVMM),width=1920,height=1080,framerate=30/1,format=NV12' ! nv3dsink

Table 1: Performance of pipeline at 1920x1080@30 using nv3dsink

Operation Mode	CPU (%)	GPU 1 (%)	GPU 2 (%)	FPS	latency (ms)
0 (max performance)
1 (min power)
2 (30W)

1920x1080@30 using xvimagesink

The pipeline below captures and renders the video to the display connected to the Orin AGX, using the xvimagesink element. Table 2 shows the performance metrics for this pipeline.

gst-launch-1.0 nvarguscamerasrc ! 'video/x-raw(memory:NVMM),width=1920,height=1080,framerate=30/1,format=NV12' ! nvvidconv ! xvimagesink

Table 2: Performance of pipeline at 1920x1080@30 using xvimagesink

Operation Mode	CPU (%)	GPU 1 (%)	GPU 2 (%)	FPS	latency (ms)
0 (max performance)
1 (min power)
2 (30W)

USB Camera

For the pipelines in this section, we used the LI-10635 USB camera.

1280x720@30 using xvimagesink

The pipeline below captures and renders the video to the display connected to the Orin AGX, using the xvimagesink element. Table 3 shows the performance metrics for this pipeline.

 gst-launch-1.0 -v v4l2src device=/dev/video0 ! video/x-raw,framerate=30/1,width=1280,height=720 ! nvvidconv ! xvimagesink

Table 3: Performance of pipeline at 1280x720@30 using xvimagesink

Operation Mode	CPU (%)	GPU 1 (%)	GPU 2 (%)	FPS	latency (ms)
0 (max performance)	32.27	22.2	23.87	30.01	0.13
1 (min power)	23.97	6.27	63.4	30.01	0.13
2 (30W)	27.6	5.87	64.87	30.01	0.16

1280x720@30 using nv3dsink

The pipeline below captures and renders the video to the display connected to the Orin AGX, using the nv3dsink element. Table 4 shows the performance metrics for this pipeline.

 gst-launch-1.0 -v v4l2src device=/dev/video0 ! video/x-raw,framerate=30/1,width=1280,height=720 ! nvvidconv ! 'video/x-raw(memory:NVMM), format=NV12' ! nv3dsink

Table 4: Performance of pipeline at 1280x720@30 using nv3dsink

Operation Mode	CPU (%)	GPU 1 (%)	GPU 2 (%)	FPS	latency (ms)
0 (max performance)	24.5	31.33	28.27	30.01	1.92
1 (min power)	32.87	17.93	52.17	30.01	2.47
2 (30W)	28.5	14.9	52.63	30.01	2.34