GStreamer Based Image Signal Processor/Examples/IMX8 Pipelines: Difference between revisions
mNo edit summary |
|||
| (4 intermediate revisions by 2 users not shown) | |||
| Line 1: | Line 1: | ||
<noinclude> | <noinclude> | ||
{{GStreamer Based Image Signal Processor/Head|previous=Examples|next=Examples/x86 Pipelines| | {{GStreamer Based Image Signal Processor/Head|previous=Examples|next=Examples/x86 Pipelines|metakeywords=IMX8, x86, IMX8 Pipelines,x86 Pipelines, NV12, Bypass feature, Auto white balance, Color space conversion, Debayer plugin, Bypass feature, NV12 bypass}} | ||
</noinclude> | </noinclude> | ||
| Line 6: | Line 6: | ||
The GStreamer Based Image Signal Processor element can be easily incorporated into any pipeline. Here we present some sample pipelines for different use cases. | The GStreamer Based Image Signal Processor element can be easily incorporated into any pipeline. Here we present some sample pipelines for different use cases. | ||
=Debayer plugin pipelines examples= | ==Debayer plugin pipelines examples== | ||
For this pipeline example the ispcldebayer element will transform the buffer from '''bayer''' format to '''RGBA''' format | For this pipeline example the ispcldebayer element will transform the buffer from '''bayer''' format to '''RGBA''' format | ||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | <syntaxhighlight lang=bash style="background-color: #f0fff0"> | ||
| Line 15: | Line 15: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
=Color space conversion plugin pipelines examples= | ==Color space conversion plugin pipelines examples== | ||
For this example the ispclcsc element will convert the color space from '''RGBA''' to '''NV12''' format. | For this example the ispclcsc element will convert the color space from '''RGBA''' to '''NV12''' format. | ||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | <syntaxhighlight lang=bash style="background-color: #f0fff0"> | ||
| Line 21: | Line 21: | ||
HEIGHT=1080 | HEIGHT=1080 | ||
gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | ||
queue ! ispclcsc ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | queue ! ispclcsc ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| Line 30: | Line 30: | ||
HEIGHT=1080 | HEIGHT=1080 | ||
gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | ||
queue ! ispclcsc ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | queue ! ispclcsc ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | ||
</syntaxhighlight> | </syntaxhighlight> | ||
==Bypass feature== | ===Bypass feature=== | ||
if caps are the same for the input and output the color space converter will act like a bypass: | if caps are the same for the input and output the color space converter will act like a bypass: | ||
===RGBA bypass=== | ====RGBA bypass==== | ||
For this example the ispclcsc element will bypass the buffers from '''RGBA''' to '''RGBA'''. | For this example the ispclcsc element will bypass the buffers from '''RGBA''' to '''RGBA'''. | ||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | <syntaxhighlight lang=bash style="background-color: #f0fff0"> | ||
| Line 42: | Line 42: | ||
HEIGHT=1080 | HEIGHT=1080 | ||
gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | ||
queue ! ispclcsc ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | queue ! ispclcsc ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | ||
</syntaxhighlight> | </syntaxhighlight> | ||
===NV12 bypass=== | ====NV12 bypass==== | ||
For this example the ispclcsc element will | For this example the ispclcsc element will bypass the buffers from '''NV12''' to '''NV12'''. | ||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | <syntaxhighlight lang=bash style="background-color: #f0fff0"> | ||
WIDTH=1920 | WIDTH=1920 | ||
HEIGHT=1080 | HEIGHT=1080 | ||
gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | ||
queue ! ispclcsc ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | queue ! ispclcsc ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | ||
</syntaxhighlight> | </syntaxhighlight> | ||
==Histogram equalization plugin pipelines examples== | |||
=Histogram equalization plugin pipelines examples= | |||
For this pipeline example the ispcleq element will apply an algorithm to improve the image contrast with histogram equalization technique. This element can do this image improvement using a bayer input but also NV12 input. | For this pipeline example the ispcleq element will apply an algorithm to improve the image contrast with histogram equalization technique. This element can do this image improvement using a bayer input but also NV12 input. | ||
==Bayer RGGB == | ===Bayer RGGB === | ||
In this case, an average of the histogram components is used on the algorithm. | In this case, an average of the histogram components is used on the algorithm. | ||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | <syntaxhighlight lang=bash style="background-color: #f0fff0"> | ||
| Line 77: | Line 76: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
==NV12== | ===NV12=== | ||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | <syntaxhighlight lang=bash style="background-color: #f0fff0"> | ||
| Line 86: | Line 85: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
=Auto white balance plugin pipelines examples= | ==Auto white balance plugin pipelines examples== | ||
For this pipeline example the ispclawb element will apply an algorithm to improve the image white balance. This element does the image processing in rggb bayer format. | For this pipeline example the ispclawb element will apply an algorithm to improve the image white balance. This element does the image processing in rggb bayer format. | ||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | <syntaxhighlight lang=bash style="background-color: #f0fff0"> | ||
Latest revision as of 21:09, 16 January 2024
| GStreamer Image Signal Processor |
|---|
 |
| Image Signal Processor Basics |
| Docs |
| Getting Started |
| Examples |
| Performance |
| Troubleshoot |
| Contact Us |
The GStreamer Based Image Signal Processor element can be easily incorporated into any pipeline. Here we present some sample pipelines for different use cases.
Debayer plugin pipelines examples
For this pipeline example the ispcldebayer element will transform the buffer from bayer format to RGBA format
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-bayer, format=(string)bggr, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispcldebayer ! fakesink -v
Color space conversion plugin pipelines examples
For this example the ispclcsc element will convert the color space from RGBA to NV12 format.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ queue ! ispclcsc ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v
For this example the ispclcsc element will convert the color space from NV12 to RGBA format.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ queue ! ispclcsc ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v
Bypass feature
if caps are the same for the input and output the color space converter will act like a bypass:
RGBA bypass
For this example the ispclcsc element will bypass the buffers from RGBA to RGBA.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ queue ! ispclcsc ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v
NV12 bypass
For this example the ispclcsc element will bypass the buffers from NV12 to NV12.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ queue ! ispclcsc ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v
Histogram equalization plugin pipelines examples
For this pipeline example the ispcleq element will apply an algorithm to improve the image contrast with histogram equalization technique. This element can do this image improvement using a bayer input but also NV12 input.
Bayer RGGB
In this case, an average of the histogram components is used on the algorithm.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-bayer, format=(string)bggr, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispcleq ! fakesink -v
In case you want to use each component histogram instead of using an average of the components you can set the average property to false.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-bayer, format=(string)bggr, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispcleq average=false ! fakesink -v
NV12
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw, format=NV12, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispcleq ! fakesink -v
Auto white balance plugin pipelines examples
For this pipeline example the ispclawb element will apply an algorithm to improve the image white balance. This element does the image processing in rggb bayer format.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-bayer, format=(string)bggr, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispclawb ! fakesink -v