RidgeRun Linux Camera Drivers/Examples/RB5: Difference between revisions

From RidgeRun Developer Wiki
No edit summary
Line 33: Line 33:


== GStreamer Examples ==
== GStreamer Examples ==
{{Review|Maybe just a short paragraph mentioning that for this pipelines to work an RB board with a MIPI camera connected is needed.}}


=== IMX577 ===
=== IMX577 ===

Revision as of 19:55, 12 August 2024





RB5 Capture SubSystem

The Qualcomm Robotics RB5 Development Kit is a platform designed for robotics development, featuring the Qualcomm QRB5165 processor. Customized for a wide range of robotics applications, this kit supports extensive prototyping with its 96Boards open hardware specification and mezzanine-board expansions. With 15 TOPS of compute power, advanced AI capabilities, and support for multiple cameras, it's used for creating autonomous robots and drones.

The next figure shows the basic hardware modules of the RB5 capture subsystem and their interconnections.


  • Camera Sensor

Communicates with the mainboard via MIPI CSI-2 protocol interfaces using C-PHY or D-PHY layers.

  • Image Front-End (IFE)

The ISP contains 2 Full IFEs for processing 25MP input resolution sensors and 5 IFE_lite for 2MP input resolution sensors. This modules provide Bayer processing for video/preview.

  • Bayer Processing Segment (BPS)

Processes the image data from the IFE, handle Bayer processing and downscaling, also support multiple format for flexible hybrid of hardware and software.

  • Image Processing Engine (IPE)

Further processes the image data, for example, image correction and adjustment, noise reduction, temporal filtering.


You can find more information on the hardware and software components of the capture subsystem in the following wiki.

OpenCV Examples

GStreamer Examples

IMX577

The IMX577 is a 12.3 megapixel CMOS stacked image sensor with a 7.857 mm diagonal and a square pixel array. Utilizing Sony's Stacked CMOS Image Sensor technology, it enables high-speed image capturing through column-parallel A/D converter circuits, offering high sensitivity and low noise. The following GStreamer pipelines shows how to capture from video using this camera sensor:

1920x1080@30

gst-launch-1.0 qtiqmmfsrc camera=0 ! "video/x-raw(memory:GBM),format=NV12,width=1920,height=1080,framerate=30/1" ! waylandsink sync=true

1280x720@60

gst-launch-1.0 qtiqmmfsrc camera=0 ! "video/x-raw(memory:GBM),format=NV12,width=1280,height=720,framerate=60/1" ! waylandsink sync=true
Note
Check the RB5 dedicated wiki for more information and examples.

RidgeRun Product Use Cases