NVIDIA Jetson Orin - JetPack Components
This section provides an overview of some of the main software components provided in JetPack 6.1 for the Orin AGX.
Jetpack Components
Table 1 provides the versions of the key packages included in JetPack 6.1, and the version previously available in JetPack 5.0:
| Package | Jetpack 6.1 Version | Jetpack 5.0 Version |
|---|---|---|
| Linux for Tegra | 36.4 | 34.1 |
| CUDA | 12.6 | 11.4 |
| cuDNN | 9.3 | 8.3.2 |
| TensorRT | 10.3 | 8.4.0 Early Access |
| OpenCV | 4.5.x | 4.5.4 |
| Vision Programing Interface (VPI) | 3.2 | 2.0 |
Linux for Tegra
Linux for Tegra (L4T) is the component that provides the OS components (kernel, file system, drivers, firmware) and the bootloader. Jetpack 6.1 comes with L4T version 36.4, featuring:
- Linux Kernel version 5.15: the previous Jetpack version (5.0) came with Linux Kernel version 5.10.
- Ubuntu 22.04-based root file system: the previous Jetpack version (5.0) came with Ubuntu 20.04-based root file system.
- UEFI-based bootloader: continues from L4T 34.1.
- Support for upstream kernels: allows running kernels newer than 5.14.
- MAXN Super performance mode: available on Jetson Orin Nano Developer Kit, increasing performance up to 1.6x.
- Enhanced Argus Camera Library: reducing CPU utilization by up to 40%.
- Firmware TPM (fTPM) support: provides improved security.
- New GStreamer IPC plugins: nvunixfdsink / nvunixfdsrc for multimedia inter-process communication.
- Predictable Ethernet interface naming: improves networking consistency.
Multimedia API
Included as part of L4T, the Multimedia API allows developers to develop camera-based multimedia applications. It has two main components:
- V4L2 Sensor driver API: the V4L2 API that enables the capture devices, codecs, and scaling functionality.
- Libargus: the proprietary NVIDIA library that allows using the Jetson Image Signal Processor (ISP).
JetPack 6.1 Multimedia API includes performance improvements and new GStreamer-based IPC plugins for buffer sharing.
CUDA
Jetpack 6.1 includes CUDA 12.6 support. CUDA is a parallel computing API for NVIDIA GPUs. NVIDIA's CUDA Toolkit provides the development environment for creating GPU-accelerated applications in C/C++. Table 2 provides the CUDA 12.6 components version information:
| Component Name | Version Information | Supported Architectures |
|---|---|---|
| CUDA Runtime (cudart) | 12.6 | x86_64, POWER, Arm64 |
| cuobjdump | 12.6 | x86_64, POWER, Arm64 |
| CUPTI | 12.6 | x86_64, POWER, Arm64 |
| CUDA cuxxfilt (demangler) | 12.6 | x86_64, POWER, Arm64 |
| CUDA Demo Suite | 12.6 | x86_64 |
| CUDA GDB | 12.6 | x86_64, POWER, Arm64 |
| CUDA Memcheck | 12.6 | x86_64, POWER |
| CUDA NVCC | 12.6 | x86_64, POWER, Arm64 |
| CUDA nvdisasm | 12.6 | x86_64, POWER, Arm64 |
| CUDA NVML Headers | 12.6 | x86_64, POWER, Arm64 |
| CUDA nvprof | 12.6 | x86_64, POWER, Arm64 |
| CUDA nvprune | 12.6 | x86_64, POWER, Arm64 |
| CUDA NVRTC | 12.6 | x86_64, POWER, Arm64 |
| CUDA NVTX | 12.6 | x86_64, POWER, Arm64 |
| CUDA NVVP | 12.6 | x86_64, POWER |
| CUDA Samples | 12.6 | x86_64, POWER, Arm64 |
| CUDA Compute Sanitizer API | 12.6 | x86_64, POWER, Arm64 |
| CUDA Thrust | 12.6 | x86_64, POWER, Arm64 |
| CUDA cuBLAS | 12.6 | x86_64, POWER, Arm64 |
| CUDA cuFFT | 12.6 | x86_64, POWER, Arm64 |
| CUDA cuFile | 12.6 | x86_64 |
| CUDA cuRAND | 12.6 | x86_64, POWER, Arm64 |
| CUDA cuSOLVER | 12.6 | x86_64, POWER, Arm64 |
| CUDA cuSPARSE | 12.6 | x86_64, POWER, Arm64 |
| CUDA NPP | 12.6 | x86_64, POWER, Arm64 |
| CUDA nvJPEG | 12.6 | x86_64, POWER, Arm64 |
| Nsight Compute | 2023.2 | x86_64, POWER, Arm64 (CLI only) |
| NVTX | 12.6 | x86_64, POWER, Arm64 |
| Nsight Systems | 2024.5 | x86_64, POWER, Arm64 (CLI only) |
| Nsight Visual Studio Edition (VSE) | 2024.x | x86_64 (Windows) |
| Visual Studio Integration | 12.6 | x86_64 (Windows) |
| NVIDIA Linux Driver | 550.xx | x86_64, POWER, Arm64 |
| NVIDIA Windows Driver | 550.xx | x86_64 (Windows) |
CUDA Deep Neural Network (cuDNN)
cuDNN is an NVIDIA library used by deep learning frameworks to accelerate common components, such as pooling, normalization, and backward convolution. Jetpack 6.1 comes with cuDNN 9.3, including bugfixes and new enhancements.
TensorRT
TensorRT is a framework created and published by NVIDIA for deep learning inference runtime. Jetpack 6.1 includes TensorRT 10.3 with support for CUDA 12.x.
TensorRT 10.3 has been tested with the following dependency versions:
- cuDNN 9.3
- TensorFlow 2.x
- PyTorch 2.x
OpenCV
OpenCV is an Open Source library for computer vision tasks. Jetpack 6.1 supports OpenCV version 4.5.x.
Vision Programming Interface (VPI)
VPI is a library provided by NVIDIA to easily take advantage of the power of the Programmable Vision Accelerator and the GPU. It brings Computer Vision and Image Processing algorithms implemented to run the PVA, OFA (Optical Flow Accelerator), GPU, and CPU. Jetpack 6.1 comes with VPI 3.2 version. To learn more about how you can use VPI along with GStreamer, visit our GstVPI section.