RidgeRun Linux Camera Drivers - Jetson Capture Subsystem

From RidgeRun Developer Wiki





Jetson Capture SubSystem

The capture subsystem is a component in devices that rely on cameras for various applications, such as robotics, autonomous vehicles, and smart cameras. In Jetson boards, the capture subsystem plays a role in managing the flow of data from camera modules to the system for processing and analysis, and to memory.

The capture subsystem ensures that the data captured by the cameras is correctly received, formatted, and processed to meet the needs of the application. The subsystem comprises several key components that work together to handle the complexities of camera data, including the Camera Serial Interface (CSI), Video Input Unit (VI), and the Image Signal Processor (ISP). Each of these components is designed to optimize the performance, making it possible to achieve high-quality image capture and processing in real-time. The following picture shows these components of the capture susbsystem for Jetson boards.

Diagram describing the components of the NVIDIA Jetson Capture subsystem
  • CSI

The Camera Serial Interface (CSI) unit implements MIPI compliant CSI receivers that may receive data from an external camera module with a CSI transmitter. The CSI unit provides for direct connection to several camera modules (depending on the SoC) all of which may be active simultaneously.

  • Video Input Unit (VI)

The Video Input unit receives data from the CSI unit and prepares it for presentation to system memory or the dedicated ISP execution resources. The Video Input unit provides formatting for RGB, YCbCr, and raw Bayer data in support of a number of camera user models.

  • Image Signal Processor (ISP)

Execution resource providing image processing in support of various camera use cases and raw Bayer processing. It allows customer-specific algorithms, such as blur reduction, chromatic aberration correction, and high ISO noise processing.


Info
Visit our NVIDIA Jetpack Reference guide wiki for more information about Jetson boards and NVIDIA Jetpack.