OpenGL Accelerated HTML Overlay: Performance - NXP i.MX 8

From RidgeRun Developer Wiki



Previous: Performance/x86 Index Next: Contact_Us




NXP i.MX 8

HTML Overlay can refresh the web page at 5 Hz maximum and run at 720p.

GStreamer plugin performance

The plugin was tested with an example overlay and a camera, using an i.MX8M Plus with Yocto Kirkstone. The measurements were taken with the following pipeline, using gst-perf:

  • HTML Overlay System memory
W=1280
H=720

# Average Behaviour
gst-launch-1.0 v4l2src device=/dev/video1 ! "video/x-raw,framerate=30/1,height=${HEIGHT},width=${WIDTH}" ! queue ! imxvideoconvert_g2d ! queue ! htmloverlay url="http://0.0.0.0:8000/overlay.html" enable-js=true web-refresh-rate=5 overlay-x=100 ! queue ! perf print-cpu-load=1 ! fakesink

# Limit
gst-launch-1.0 videotestsrc num-buffers=1 pattern=ball ! "video/x-raw,format=RGBA,height=${HEIGHT},width=${WIDTH}" ! imagefreeze ! queue ! htmloverlay url="http://0.0.0.0:8000/overlay.html" enable-js=true web-refresh-rate=5 overlay-x=100 ! queue ! perf ! fakesink
  • HTML Overlay GstGL
W=1280
H=720

# Average Behaviour
gst-launch-1.0 v4l2src device=/dev/video1 ! "video/x-raw,framerate=30/1,height=${HEIGHT},width=${WIDTH}" ! queue ! imxvideoconvert_g2d ! queue ! glupload ! "video/x-raw(memory:GLMemory)" ! queue ! glhtmloverlay url="http://0.0.0.0:8000/overlay.html" enable-js=true web-refresh-rate=5 overlay-x=100 ! queue ! "video/x-raw(memory:GLMemory)"  ! gldownload ! queue ! perf ! fakesink

# Limit
gst-launch-1.0 videotestsrc num-buffers=1 pattern=ball ! "video/x-raw,format=RGBA,height=${HEIGHT},width=${WIDTH}" ! imagefreeze ! queue ! glupload ! "video/x-raw(memory:GLMemory)" ! queue ! glhtmloverlay url="http://0.0.0.0:8000/overlay.html" enable-js=true web-refresh-rate=5 overlay-x=100 ! queue ! "video/x-raw(memory:GLMemory)"  ! gldownload ! queue ! perf ! fakesink


i.MX8MP with HTML refresh at 5 Hz
Resolution 720p 1080p 4K
System Memory (htmloverlay)
Maximum Framerate
(fps)
28.4 - -
CPU Consumption (%) 45 - -
RAM Consumption (MiB) 204.9 - -
GstGL-based (glhtmloverlay)
Maximum Framerate
(fps)
116.92 - -
CPU Consumption (%) 26 - -
RAM Consumption (MiB) 183.6 - -

Used overlay

The user overlay (click View Source on the wiki to see the html):

REC
Montreal City, Canada



Previous: Performance/x86 Index Next: Contact_Us