GStreamer Based Image Signal Processor/Examples/IMX8 Pipelines: Difference between revisions
Acervantes (talk | contribs) No edit summary |
mNo edit summary |
||
| (16 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
<noinclude> | <noinclude> | ||
{{GStreamer Based Image Signal Processor/Head|previous=Examples | {{GStreamer Based Image Signal Processor/Head|previous=Examples|next=Examples/x86 Pipelines|metakeywords=IMX8, x86, IMX8 Pipelines,x86 Pipelines, NV12, Bypass feature, Auto white balance, Color space conversion, Debayer plugin, Bypass feature, NV12 bypass}} | ||
</noinclude> | </noinclude> | ||
__TOC__ | |||
The GStreamer Based Image Signal Processor element can be easily incorporated into any pipeline. Here we present some sample pipelines for different use cases. | The GStreamer Based Image Signal Processor element can be easily incorporated into any pipeline. Here we present some sample pipelines for different use cases. | ||
=Debayer plugin pipelines examples= | ==Debayer plugin pipelines examples== | ||
For this pipeline example the ispcldebayer element will transform the buffer from '''bayer''' format to '''RGBA''' format | |||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | <syntaxhighlight lang=bash style="background-color: #f0fff0"> | ||
WIDTH=1920 | WIDTH=1920 | ||
| Line 13: | Line 15: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
=Color space conversion plugin pipelines examples= | ==Color space conversion plugin pipelines examples== | ||
For this example the ispclcsc element will convert the color space from '''RGBA''' to '''NV12''' format. | |||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | |||
WIDTH=1920 | |||
HEIGHT=1080 | |||
gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | |||
queue ! ispclcsc ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | |||
</syntaxhighlight> | |||
For this example the ispclcsc element will convert the color space from '''NV12''' to '''RGBA''' format. | |||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | |||
WIDTH=1920 | |||
HEIGHT=1080 | |||
gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | |||
queue ! ispclcsc ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | |||
</syntaxhighlight> | |||
===Bypass feature=== | |||
if caps are the same for the input and output the color space converter will act like a bypass: | |||
====RGBA bypass==== | |||
For this example the ispclcsc element will bypass the buffers from '''RGBA''' to '''RGBA'''. | |||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | |||
WIDTH=1920 | |||
HEIGHT=1080 | |||
gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | |||
queue ! ispclcsc ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | |||
</syntaxhighlight> | |||
====NV12 bypass==== | |||
For this example the ispclcsc element will bypass the buffers from '''NV12''' to '''NV12'''. | |||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | |||
WIDTH=1920 | |||
HEIGHT=1080 | |||
gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ | |||
queue ! ispclcsc ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v | |||
</syntaxhighlight> | |||
==Histogram equalization plugin pipelines examples== | |||
For this pipeline example the ispcleq element will apply an algorithm to improve the image contrast with histogram equalization technique. This element can do this image improvement using a bayer input but also NV12 input. | |||
===Bayer RGGB === | |||
In this case, an average of the histogram components is used on the algorithm. | |||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | |||
WIDTH=1920 | |||
HEIGHT=1080 | |||
gst-launch-1.0 videotestsrc is-live=true ! "video/x-bayer, format=(string)bggr, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispcleq ! fakesink -v | |||
</syntaxhighlight> | |||
In case you want to use each component histogram instead of using an average of the components you can set the '''average''' property to '''false'''. | |||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | |||
WIDTH=1920 | |||
HEIGHT=1080 | |||
gst-launch-1.0 videotestsrc is-live=true ! "video/x-bayer, format=(string)bggr, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispcleq average=false ! fakesink -v | |||
</syntaxhighlight> | |||
===NV12=== | |||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | |||
WIDTH=1920 | |||
HEIGHT=1080 | |||
gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw, format=NV12, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispcleq ! fakesink -v | |||
</syntaxhighlight> | |||
==Auto white balance plugin pipelines examples== | |||
For this pipeline example the ispclawb element will apply an algorithm to improve the image white balance. This element does the image processing in rggb bayer format. | |||
<syntaxhighlight lang=bash style="background-color: #f0fff0"> | <syntaxhighlight lang=bash style="background-color: #f0fff0"> | ||
WIDTH=1920 | WIDTH=1920 | ||
HEIGHT=1080 | HEIGHT=1080 | ||
gst-launch-1.0 videotestsrc is-live=true ! "video/x- | gst-launch-1.0 videotestsrc is-live=true ! "video/x-bayer, format=(string)bggr, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispclawb ! fakesink -v | ||
</syntaxhighlight> | </syntaxhighlight> | ||
<noinclude> | <noinclude> | ||
{{GStreamer Based Image Signal Processor/Foot|Examples/ | {{GStreamer Based Image Signal Processor/Foot|Examples|Examples/x86 Pipelines}} | ||
</noinclude> | </noinclude> | ||
Latest revision as of 21:09, 16 January 2024
| GStreamer Image Signal Processor |
|---|
 |
| Image Signal Processor Basics |
| Docs |
| Getting Started |
| Examples |
| Performance |
| Troubleshoot |
| Contact Us |
The GStreamer Based Image Signal Processor element can be easily incorporated into any pipeline. Here we present some sample pipelines for different use cases.
Debayer plugin pipelines examples
For this pipeline example the ispcldebayer element will transform the buffer from bayer format to RGBA format
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-bayer, format=(string)bggr, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispcldebayer ! fakesink -v
Color space conversion plugin pipelines examples
For this example the ispclcsc element will convert the color space from RGBA to NV12 format.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ queue ! ispclcsc ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v
For this example the ispclcsc element will convert the color space from NV12 to RGBA format.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ queue ! ispclcsc ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v
Bypass feature
if caps are the same for the input and output the color space converter will act like a bypass:
RGBA bypass
For this example the ispclcsc element will bypass the buffers from RGBA to RGBA.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ queue ! ispclcsc ! "video/x-raw,format=(string)RGBA,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v
NV12 bypass
For this example the ispclcsc element will bypass the buffers from NV12 to NV12.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! \ queue ! ispclcsc ! "video/x-raw,format=(string)NV12,width=$WIDTH,height=$HEIGHT,framerate=(fraction)30/1" ! fakesink -v
Histogram equalization plugin pipelines examples
For this pipeline example the ispcleq element will apply an algorithm to improve the image contrast with histogram equalization technique. This element can do this image improvement using a bayer input but also NV12 input.
Bayer RGGB
In this case, an average of the histogram components is used on the algorithm.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-bayer, format=(string)bggr, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispcleq ! fakesink -v
In case you want to use each component histogram instead of using an average of the components you can set the average property to false.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-bayer, format=(string)bggr, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispcleq average=false ! fakesink -v
NV12
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-raw, format=NV12, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispcleq ! fakesink -v
Auto white balance plugin pipelines examples
For this pipeline example the ispclawb element will apply an algorithm to improve the image white balance. This element does the image processing in rggb bayer format.
WIDTH=1920 HEIGHT=1080 gst-launch-1.0 videotestsrc is-live=true ! "video/x-bayer, format=(string)bggr, width=$WIDTH, height=$HEIGHT,framerate=(fraction)30/1" ! queue ! ispclawb ! fakesink -v