Xavier/JetPack 5.0.2/Getting Started/Components: Difference between revisions

From RidgeRun Developer Wiki
No edit summary
 
(36 intermediate revisions by 8 users not shown)
Line 1: Line 1:
{{DISPLAYTITLE:NVIDIA Jetson Xavier - JetPack 4.0 Components |noerror}}
<noinclude>
{{Xavier/Head|previous=JetPack 5.0.2‎/Getting Started/Wizard Flashing|next=JetPack 5.0.2‎/Compiling_Code|metakeywords=jetpack,component}}
</noinclude>
 
{{DISPLAYTITLE:NVIDIA Jetson Xavier - JetPack 5.0.2 Software Components|noerror}}
 
This section provides an overview of some of the main software components provided in Jetpack 5.0.2 for Xavier.
 
 
==Jetpack Components==
Table 1 provides the versions of the key packages included in JetPack 5.1.3, Jetpack 5.0.2, and the version previously available in Jetpack 4.6.1:
<br>


== What is in JetPack 4.0 ? ==


{| class="wikitable" style="margin-right: 22em;"
{| class="wikitable" style="margin: auto;"
|+ Table 1: Version of Jetpack components
|-
|-
! Package  
! Package  
! Version
! Jetpack 5.1.3 Version
! Description
! Jetpack 5.0.2 Version
! Jetpack 4.6.1 Version
|-
| '''Linux for Tegra'''
| 35.5.0
| 35.1
| 32.7.1
|-
| '''CUDA'''
| 11.4.19
| 11.4.14
| 10.2
|-
|-
| Linux for Tegra (L4T)
| '''cuDNN'''
| 31.0.1
| 8.6.0
| Operative System, includes toolchain, u-boot, kernel and filesystem (Reference filesystem is now derived from Ubuntu 18.04),
| 8.4.1
NVIDIA Tegra User Space Drivers and sample applications.
| 8.2.1
|-
|-
| TensorRT  
| '''TensorRT'''
| 5.0 RC
| 8.5.2
| A platform for high-performance deep learning inference. It includes a deep learning inference optimizer and runtime that delivers low latency and high-throughput for deep learning inference applications.  
| 8.4.1
| 8.2.1
|-  
| '''OpenCV'''
| 4.5.4
| 4.5.4
| 4.1.1
|-
|-
| cuDNN
| ''' Vision Programming Interface (VPI) '''
| 7.3
| 2.4
| The NVIDIA CUDA® Deep Neural Network library (cuDNN) is a GPU-accelerated library of primitives for deep neural networks. cuDNN provides highly tuned implementations for standard routines such as forward and backward convolution, pooling, normalization, and activation layers.
| 2.1
| 1.2
|-
|-
| CUDA
| 10
| CUDA 10 is a software development platform for building GPU-accelerated applications.
|}
|}
<br>
=== Linux for Tegra===
Linux for Tegra (L4T) is the component that provides the OS components (kernel, file system, drivers, firmware) and the bootloader. Jetpack 5.1.3 comes with L4T version 35.5.0, featuring:
* '''Linux Kernel version 5.10''': the previous Jetpack version (4.6) came with Linux Kernel version 4.9.
* '''Ubuntu 20.04-based root file system''': the previous Jetpack version (4.6) came with Ubuntu 18.04-based root file system.
* '''UEFI-based bootloader''': CBoot was used prior to L4T 34.1.
<!--* '''Jetson Orin NX performance emulation on Jetson AGX Orin''':-->
* '''Support for NVSCI''': Provides utilities for streaming data packets between different applications and for inter-process communication (IPC).
* '''Toolchain''': aarch64  gcc-9.3-glibc-2.31 for 64-bit Kernel and user space.
* '''Jetson Power GUI''': a new tool for monitoring the power and thermal status of the Jetson platform.
<br>
==== Multimedia API ====
Included as part of L4T, the Multimedia API allows developers to develop camera-based multimedia applications. It has two main components:
<br>
* V4L2 Sensor driver API: the V4L2 API that enables the capture devices, codecs, and scaling functionality.
* Libargus: the proprietary NVIDIA library that allows using the Jetson Image Signal Processor (ISP).
<br>
JetPack 5.0.2 Multimedia API features new NVUtils Multimedia buffer management and buffer transformation API. Previous nvbuf_utils is deprecated in this release.
<br>
=== CUDA ===
Jetpack 5.0.2 includes CUDA 11.4.14 support. CUDA is a parallel computing API for NVIDIA GPUs. NVIDIA's CUDA Toolkit provides the development environment for creating GPU-accelerated applications in C/C++. Starting with CUDA 11, the various components in the toolkit are versioned independently. Table 2 provides the CUDA 11.4.14 components version information:
<br>
{| class="wikitable" style="margin: auto;"
|+ Table 2: CUDA 11.4 components version
|-
! Component Name
! Version Information
! Supported Architectures
|-
| CUDA Runtime (cudart)
| 11.4.148
| x86_64, POWER, Arm64
|-
|cuobjdump
|11.4.120
|x86_64, POWER, Arm64
|-
|CUPTI
|11.4.120
|x86_64, POWER, Arm64
|-
|CUDA cuxxfilt (demangler)
|11.4.120
|x86_64, POWER, Arm64
|-
|CUDA Demo Suite
|11.4.100
|x86_64
|-
|CUDA GDB
|11.4.120
|x86_64, POWER, Arm64
|-
|CUDA Memcheck
|11.4.120
|x86_64, POWER
|-
|CUDA NVCC
|11.4.152
|x86_64, POWER, Arm64
|-
|CUDA nvdisasm
|11.4.152
|x86_64, POWER, Arm64
|-
|CUDA NVML Headers
|11.4.120
|x86_64, POWER, Arm64
|-
|CUDA nvprof
|11.4.120
|x86_64, POWER, Arm64
|-
|CUDA nvprune
|11.4.120
|x86_64, POWER, Arm64
|-
|CUDA NVRTC
|11.4.152
|x86_64, POWER, Arm64
|-
|CUDA NVTX
|11.4.120
|x86_64, POWER, Arm64
|-
|CUDA NVVP
|11.4.193
|x86_64, POWER
|-
|CUDA Samples
|11.4.120
|x86_64, POWER, Arm64
|-
|CUDA Compute Sanitizer API
|11.4.120
|x86_64, POWER, Arm64
|-
|CUDA Thrust
|11.4.122
|x86_64, POWER, Arm64
|-
|CUDA cuBLAS
|11.6.5.2
|x86_64, POWER, Arm64
|-
|CUDA cuFFT
|10.5.2.100
|x86_64, POWER, Arm64
|-
|CUDA cuFile
|1.0.2.10
|x86_64
|-
|CUDA cuRAND
|10.2.5.120
|x86_64, POWER, Arm64
|-
|CUDA cuSOLVER
|11.2.0.120
|x86_64, POWER, Arm64
|-
|CUDA cuSPARSE
|11.6.0.120
|x86_64, POWER, Arm64
|-
|CUDA NPP
|11.4.0.110
|x86_64, POWER, Arm64
|-
|CUDA nvJPEG
|11.5.2.120
|x86_64, POWER, Arm64
|-
|Nsight Compute
|2021.2.2.1
|x86_64, POWER, Arm64 (CLI only)
|-
|NVTX
|1.21018621
|x86_64, POWER, Arm64
|-
|Nsight Systems
|2021.3.2.4
|x86_64, POWER, Arm64 (CLI only)
|-
|Nsight Visual Studio Edition (VSE)
|2021.2.1.21205
|x86_64 (Windows)
|-
|nvidia_fs1
|2.7.53
|x86_64
|-
|Visual Studio Integration
|11.4.120
|x86_64 (Windows)
|-
|NVIDIA Linux Driver
|470.82.01
|x86_64, POWER, Arm64
|-
|NVIDIA Windows Driver
|472.50
|x86_64 (Windows)
|-
|}
<!--The last update of CUDA 11.4 is Update 4, in which the Linux x86_64 Driver Version is >=470.82.01.-->
<br>
===CUDA Deep Neural Network (cuDNN)===
cuDNN is an NVIDIA library used by deep learning frameworks to accelerate common components, such as pooling, normalization, and backward convolution. Jetpack 5.0.2 comes with cuDNN 8.4.1, including bug fixes and new enhancements.
<br>
=== TensorRT ===
TensorRT is a framework created and published by NVIDIA for deep learning inference runtime. Jetpack 5.0.2 includes TensorRT 8.4.1 This version of TensorRT have a support for CUDA 11.x.
TensorRT 8.4.1 has been tested with the following dependencies versions:
* cuDNN 8.4.1
* TensorFlow 1.15.5
* PyTorch 1.9.0
* ONNX 1.9.0
<br>
=== OpenCV ===
OpenCV is an Open Source library for computer vision tasks. Jetpack 5.0.2 supports OpenCV version 4.5.4.
<br>


=== Vision Programming Interface (VPI) ===
VPI is a library provided by NVIDIA to easily take advantage of the power of the Programmable Vision Accelerator and the GPU. It brings Computer Vision and Image Processing algorithms implemented to run the PVA, OFA (Optical Flow Accelerator), GPU, and CPU. Jetpack 5.0 comes with VPI 2.1 version.
<br>


<noinclude>
<noinclude>
{{Xavier/Foot|<Replace with "previous" page>|<Replace with "next" page>}}
{{Xavier/Foot|JetPack 5.0.2‎/Getting Started/Wizard Flashing|JetPack 5.0.2‎/Compiling_Code}}
</noinclude><noinclude>
{{Xavier/Head}}
</noinclude>
</noinclude>

Latest revision as of 15:39, 5 September 2024




Previous: JetPack 5.0.2‎/Getting Started/Wizard Flashing Index Next: JetPack 5.0.2‎/Compiling_Code






This section provides an overview of some of the main software components provided in Jetpack 5.0.2 for Xavier.


Jetpack Components

Table 1 provides the versions of the key packages included in JetPack 5.1.3, Jetpack 5.0.2, and the version previously available in Jetpack 4.6.1:


Table 1: Version of Jetpack components
Package Jetpack 5.1.3 Version Jetpack 5.0.2 Version Jetpack 4.6.1 Version
Linux for Tegra 35.5.0 35.1 32.7.1
CUDA 11.4.19 11.4.14 10.2
cuDNN 8.6.0 8.4.1 8.2.1
TensorRT 8.5.2 8.4.1 8.2.1
OpenCV 4.5.4 4.5.4 4.1.1
Vision Programming Interface (VPI) 2.4 2.1 1.2



Linux for Tegra

Linux for Tegra (L4T) is the component that provides the OS components (kernel, file system, drivers, firmware) and the bootloader. Jetpack 5.1.3 comes with L4T version 35.5.0, featuring:

  • Linux Kernel version 5.10: the previous Jetpack version (4.6) came with Linux Kernel version 4.9.
  • Ubuntu 20.04-based root file system: the previous Jetpack version (4.6) came with Ubuntu 18.04-based root file system.
  • UEFI-based bootloader: CBoot was used prior to L4T 34.1.
  • Support for NVSCI: Provides utilities for streaming data packets between different applications and for inter-process communication (IPC).
  • Toolchain: aarch64 gcc-9.3-glibc-2.31 for 64-bit Kernel and user space.
  • Jetson Power GUI: a new tool for monitoring the power and thermal status of the Jetson platform.


Multimedia API

Included as part of L4T, the Multimedia API allows developers to develop camera-based multimedia applications. It has two main components:

  • V4L2 Sensor driver API: the V4L2 API that enables the capture devices, codecs, and scaling functionality.
  • Libargus: the proprietary NVIDIA library that allows using the Jetson Image Signal Processor (ISP).


JetPack 5.0.2 Multimedia API features new NVUtils Multimedia buffer management and buffer transformation API. Previous nvbuf_utils is deprecated in this release.

CUDA

Jetpack 5.0.2 includes CUDA 11.4.14 support. CUDA is a parallel computing API for NVIDIA GPUs. NVIDIA's CUDA Toolkit provides the development environment for creating GPU-accelerated applications in C/C++. Starting with CUDA 11, the various components in the toolkit are versioned independently. Table 2 provides the CUDA 11.4.14 components version information:


Table 2: CUDA 11.4 components version
Component Name Version Information Supported Architectures
CUDA Runtime (cudart) 11.4.148 x86_64, POWER, Arm64
cuobjdump 11.4.120 x86_64, POWER, Arm64
CUPTI 11.4.120 x86_64, POWER, Arm64
CUDA cuxxfilt (demangler) 11.4.120 x86_64, POWER, Arm64
CUDA Demo Suite 11.4.100 x86_64
CUDA GDB 11.4.120 x86_64, POWER, Arm64
CUDA Memcheck 11.4.120 x86_64, POWER
CUDA NVCC 11.4.152 x86_64, POWER, Arm64
CUDA nvdisasm 11.4.152 x86_64, POWER, Arm64
CUDA NVML Headers 11.4.120 x86_64, POWER, Arm64
CUDA nvprof 11.4.120 x86_64, POWER, Arm64
CUDA nvprune 11.4.120 x86_64, POWER, Arm64
CUDA NVRTC 11.4.152 x86_64, POWER, Arm64
CUDA NVTX 11.4.120 x86_64, POWER, Arm64
CUDA NVVP 11.4.193 x86_64, POWER
CUDA Samples 11.4.120 x86_64, POWER, Arm64
CUDA Compute Sanitizer API 11.4.120 x86_64, POWER, Arm64
CUDA Thrust 11.4.122 x86_64, POWER, Arm64
CUDA cuBLAS 11.6.5.2 x86_64, POWER, Arm64
CUDA cuFFT 10.5.2.100 x86_64, POWER, Arm64
CUDA cuFile 1.0.2.10 x86_64
CUDA cuRAND 10.2.5.120 x86_64, POWER, Arm64
CUDA cuSOLVER 11.2.0.120 x86_64, POWER, Arm64
CUDA cuSPARSE 11.6.0.120 x86_64, POWER, Arm64
CUDA NPP 11.4.0.110 x86_64, POWER, Arm64
CUDA nvJPEG 11.5.2.120 x86_64, POWER, Arm64
Nsight Compute 2021.2.2.1 x86_64, POWER, Arm64 (CLI only)
NVTX 1.21018621 x86_64, POWER, Arm64
Nsight Systems 2021.3.2.4 x86_64, POWER, Arm64 (CLI only)
Nsight Visual Studio Edition (VSE) 2021.2.1.21205 x86_64 (Windows)
nvidia_fs1 2.7.53 x86_64
Visual Studio Integration 11.4.120 x86_64 (Windows)
NVIDIA Linux Driver 470.82.01 x86_64, POWER, Arm64
NVIDIA Windows Driver 472.50 x86_64 (Windows)


CUDA Deep Neural Network (cuDNN)

cuDNN is an NVIDIA library used by deep learning frameworks to accelerate common components, such as pooling, normalization, and backward convolution. Jetpack 5.0.2 comes with cuDNN 8.4.1, including bug fixes and new enhancements.


TensorRT

TensorRT is a framework created and published by NVIDIA for deep learning inference runtime. Jetpack 5.0.2 includes TensorRT 8.4.1 This version of TensorRT have a support for CUDA 11.x.

TensorRT 8.4.1 has been tested with the following dependencies versions:

  • cuDNN 8.4.1
  • TensorFlow 1.15.5
  • PyTorch 1.9.0
  • ONNX 1.9.0


OpenCV

OpenCV is an Open Source library for computer vision tasks. Jetpack 5.0.2 supports OpenCV version 4.5.4.

Vision Programming Interface (VPI)

VPI is a library provided by NVIDIA to easily take advantage of the power of the Programmable Vision Accelerator and the GPU. It brings Computer Vision and Image Processing algorithms implemented to run the PVA, OFA (Optical Flow Accelerator), GPU, and CPU. Jetpack 5.0 comes with VPI 2.1 version.



Previous: JetPack 5.0.2‎/Getting Started/Wizard Flashing Index Next: JetPack 5.0.2‎/Compiling_Code