Sony IMX296 Linux Driver

Problems running the pipelines shown on this page? Please see our GStreamer Debugging guide for help.

Driver List Information

Refer to the RidgeRun Linux Camera Drivers to meet all the list of Drivers available.

Sony IMX296 Features

The IMX296 is a CMOS imaging sensor with an optical size-type of 1/2.9 and with approximately 1.58M effective pixels that enable high resolution and high speed imaging without distortion. (Taken from Vision Components).

Learn more about the sensor at the Vision Components webpage!

Supported Platforms

NVIDIA Jetson TX2

Features Included in the Driver

TX2

Feature	Details	SDK Support
RAW10 Bayer RGGB Capture		L4T 32.3.1 / Jetpack 4.3
1440x1080@60fps	1 Lane	L4T 32.3.1 / Jetpack 4.3
Gain control		L4T 32.3.1 / Jetpack 4.3
Exposure control		L4T 32.3.1 / Jetpack 4.3
V4l2 Media Controller driver		L4T 32.3.1 / Jetpack 4.3
ISP usage through NvArgusCameraSrc		L4T 32.3.1 / Jetpack 4.3

Enabling the Driver

In order to use this driver, you have to patch and compile the kernel source using JetPack:

Follow the instructions in (Downloading sources) to get the kernel source code.

Once you have the source code, apply the following patch in order to add the changes required for the IMX296 camera at kernel and dtb level.

4.3_imx296-v0.2.0.patch

Follow the instructions in (Build Kernel) for building the kernel, and then flash the image.

Make sure to enable IMX296 driver support:

make menuconfig

-> Device Drivers                                                                                                                        
  -> Multimedia support                                                                                           
    -> NVIDIA overlay Encoders, decoders, sensors and other helper chips 
       -> <*> IMX296 camera sensor support

Using the Driver

GStreamer Examples

Capture and Display

gst-launch-1.0 nvarguscamerasrc ! "video/x-raw(memory:NVMM),width=1440,height=1080" ! nvoverlaysink

Video Encoding

RECORDING_FILE="recording.mp4"
gst-launch-1.0 nvarguscamerasrc ! "video/x-raw(memory:NVMM),width=1440,height=1080" ! nvv4l2h264enc ! h264parse ! qtmux ! filesink location=$RECORDING_FILE -e

The sensor will capture in the 1440x1080@60 mode and the pipeline will encode the video and save it into recording.mp4 file.

Global Gain Example

The driver allows global gain control.

v4l2-ctl -d /dev/video0 --set-ctrl gain=$GAIN_VALUE

Exposure Example

The driver allows also exposure time control.

v4l2-ctl -d /dev/video0 --set-ctrl exposure=$EXPOSURE_VALUE

Performance

Using the next pipeline we were able to measure the framerate and CPU load for single capture with perf element:

gst-launch-1.0 nvarguscamerasrc ! "video/x-raw(memory:NVMM),width=1440,height=1080" ! perf print-arm-load=true ! fakesink

GST-PERF INFO: timestamp 0:05:30.224956703; bps: 483840,000; fps: 60,000; cpu: 17; 
GST-PERF INFO: timestamp 0:05:31.224502705; bps: 483840,000; fps: 60,001; cpu: 16; 
GST-PERF INFO: timestamp 0:05:32.225708807; bps: 483840,000; fps: 60,000; cpu: 15; 
GST-PERF INFO: timestamp 0:05:33.226909308; bps: 483840,000; fps: 59,900; cpu: 17; 
GST-PERF INFO: timestamp 0:05:34.227202400; bps: 483840,000; fps: 60,002; cpu: 16;

For direct inquiries, please refer to the contact information available on our Contact page. Alternatively, you may complete and submit the form provided at the same link. We will respond to your request at our earliest opportunity.

Links to RidgeRun Resources and RidgeRun Artificial Intelligence Solutions can be found in the footer below.

❯