RidgeRun Linux Camera Drivers/Examples/RB5: Difference between revisions
Efernandez (talk | contribs) No edit summary |
Efernandez (talk | contribs) |
||
Line 33: | Line 33: | ||
== GStreamer Examples == | == GStreamer Examples == | ||
{{Review|Maybe just a short paragraph mentioning that for this pipelines to work an RB board with a MIPI camera connected is needed.}} | |||
=== IMX577 === | === IMX577 === |
Revision as of 19:55, 12 August 2024
RB5 Capture SubSystem
The Qualcomm Robotics RB5 Development Kit is a platform designed for robotics development, featuring the Qualcomm QRB5165 processor. Customized for a wide range of robotics applications, this kit supports extensive prototyping with its 96Boards open hardware specification and mezzanine-board expansions. With 15 TOPS of compute power, advanced AI capabilities, and support for multiple cameras, it's used for creating autonomous robots and drones.
The next figure shows the basic hardware modules of the RB5 capture subsystem and their interconnections.
- Camera Sensor
Communicates with the mainboard via MIPI CSI-2 protocol interfaces using C-PHY or D-PHY layers.
- Image Front-End (IFE)
The ISP contains 2 Full IFEs for processing 25MP input resolution sensors and 5 IFE_lite for 2MP input resolution sensors. This modules provide Bayer processing for video/preview.
- Bayer Processing Segment (BPS)
Processes the image data from the IFE, handle Bayer processing and downscaling, also support multiple format for flexible hybrid of hardware and software.
- Image Processing Engine (IPE)
Further processes the image data, for example, image correction and adjustment, noise reduction, temporal filtering.
You can find more information on the hardware and software components of the capture subsystem in the following wiki.
OpenCV Examples
GStreamer Examples
anonymous: Maybe just a short paragraph mentioning that for this pipelines to work an RB board with a MIPI camera connected is needed. (please remove this box when addressed) |
IMX577
The IMX577 is a 12.3 megapixel CMOS stacked image sensor with a 7.857 mm diagonal and a square pixel array. Utilizing Sony's Stacked CMOS Image Sensor technology, it enables high-speed image capturing through column-parallel A/D converter circuits, offering high sensitivity and low noise. The following GStreamer pipelines shows how to capture from video using this camera sensor:
1920x1080@30
gst-launch-1.0 qtiqmmfsrc camera=0 ! "video/x-raw(memory:GBM),format=NV12,width=1920,height=1080,framerate=30/1" ! waylandsink sync=true
1280x720@60
gst-launch-1.0 qtiqmmfsrc camera=0 ! "video/x-raw(memory:GBM),format=NV12,width=1280,height=720,framerate=60/1" ! waylandsink sync=true
RidgeRun Product Use Cases