NVIDIA Jetson Xavier - Video Capture and Display using GStreamer

NVIDIA®Jetson Xavier™
Introduction
SoM Overview Carrier Boards NVIDIA Xavier Developer Kit Connect Tech Rogue Connect Tech Mimic Software Support NVIDIA JetPack
JetPack 5.X
Getting Started Installing JetPack Flashing the board with GUI installer JetPack Components Compiling Source Code Flashing the Board from Cmdline Performance Tuning Evaluating Performance Set Values Manually Tuning Power Maximizing Performance
Development in the Board
Getting into the Board Using Serial Console Using SSH Using Ubuntu Login Installing Packages
Video Capture and Display
Description Supported Cameras Imx219 Driver Software Support Using GStreamer Using Libargus
Processors
HD Audio and Video Subystem Video Encoder Video Decoder JPEG Encoder and Decoder Video Image Compositor Audio Processing Engine Deep Learning Accelerator Volta GPU Description Using CUDA Using OpenGL
Interfaces
I2C SD/eMMC Controller USB Controller
GStreamer Pipelines
Capture and Display H264 H265 VP9 MPEG4 Simultaneous Streams Compositor
Deep Learning
TensorRT Using TensorRT integrated with Tensorflow Parsing a Tensorflow model for TensorRT Parsing Caffe model for TensorRT Building TensorRT API examples Deep Learning Accelerator Software Support Deep Learning Tutorials Jetson Inference Jetson Reinforcement
RidgeRun Products
GstPTZR GstCUDA GstColorTransfer GstWebRTC GstRtspSink GstInterpipe GstInference GStreamer Daemon GstShark
Reference Documentation
Contact Us

GStreamer is a framework for creating streaming media applications. The fundamental design comes from the video pipeline at the Oregon Graduate Institute, as well as some ideas from DirectShow.

GStreamer Capture

GStreamer provides different commands for capturing images where two are nvarguscamerasrc and v4l2src.

nvarguscamerasrc

nvarguscamera src is used when the camera generates images of the Bayer format because it uses the ISP to change the images to a visible format.

ISP.png

Figure 1. ISP Bayer to YUV

nvarguscamerasrc road

Figure 2. nvarguscamerasrc road

v4l2src

v4l2src captures the images in the format provided by the camera, and is used when the camera uses visible formats.

v4l2src road

Figure 3. v4l2src road

GStreamer Display

GStreamer provides different commands for displaying images where two are nvoverlaysink and xvimagesink.

nvoverlaysink

nvoverlaysink is used when you need to use NVMM memory but also could use normal memory, this command writes directly into the screen buffer.

xvimagesink

xvimagesink is used when you need to use normal memory, this command opens a screen with the output

Pipeline Examples

For a complete summary of the samples go to https://developer.ridgerun.com/wiki/index.php?title=Xavier/GStreamer_Pipelines