Spherical Video PTZ/Performance/Jetson AGX Xavier: Difference between revisions

Revision as of 17:32, 3 April 2024

Index

Next: Contact_Us

Benchmark environment

The measurements are taken considering the following criteria:

Average behaviour: measurements considering typical image processing pipelines.

Instruments:

GPU: Jtop
CPU: RidgeRun Profiler
RAM: RidgeRun Profiler
Framerate: GstShark

Engine wrapper

As mentioned previously, the Spherical Video PTZ features an engine wrapper, designed for application development. This section aims to conduct performance measurements using the average value obtained after processing the input image through the Process method of the Spherical Video PTZ engine wrapper. Below is the table displaying the results:

Spherical Video PTZ performance
n	Images type	PTZ used	Input size (px)	Output size (px)	RAM (MiB)	GPU	CPU	Avg processing time
1	Image	No	2000x1000	500x500	(phys) 120.00	(Usage) 1.18 % (VRAM) 6.00 MiB	(all) 10.47 % (core) 83.77 %	6.845 ms
2	Image	No	4000x2000	500x500	(phys) 171.00	(Usage) 4.40 % (VRAM) 6.00 MiB	(all) 11.11 % (core) 88.90 %	14.472 ms
3	Image	No	4000x2000	1000x1000	(phys) 174.00	(Usage) 5.10 % (VRAM) 7.00 MiB	(all) 10.92 % (core) 87.38 %	14.738 ms
4	Image	Yes	2000x1000	500x500	(phys) 124.00	(Usage) 5.14 % (VRAM) 6.00 MiB	(all) 5.64 % (core) 45.15 %	12.027 ms
5	Image	Yes	4000x2000	500x500	(phys) 179.00	(Usage) 6.30 % (VRAM) 6.00 MiB	(all) 7.24 % (core) 57.91 %	22.648 ms
6	Image	Yes	4000x2000	1000x1000	(phys) 183.00	(Usage) 7.47 % (VRAM) 7.00 MiB	(all) 5.68 % (core) 45.47 %	30.252 ms
7	CudaImage	No	2000x1000	500x500	(phys) 121.00	(Usage) 0.02 % (VRAM) 7.00 MiB	(all) 1.73 % (core) 13.86 %	336.00 us
8	CudaImage	No	4000x2000	500x500	(phys) 170.00	(Usage) 0.05 % (VRAM) 10.00 MiB	(all) 1.54 % (core) 12.35 %	352.00 us
9	CudaImage	No	4000x2000	1000x1000	(phys) 177.00	(Usage) 0.10 % (VRAM) 11.00 MiB	(all) 1.55 % (core) 12.37 %	380.00 us
10	CudaImage	Yes	2000x1000	500x500	(phys) 119.00	(Usage) 0.40 % (VRAM) 7.00 MiB	(all) 3.64 % (core) 29.15 %	5.389 ms
11	CudaImage	Yes	4000x2000	500x500	(phys) 170.00	(Usage) 0.62 % (VRAM) 10.00 MiB	(all) 3.39 % (core) 27.09 %	6.812 ms
12	CudaImage	Yes	4000x2000	1000x1000	(phys) 172.00	(Usage) 5.70 % (VRAM) 11.00 MiB	(all) 2.09 % (core) 16.71 %	19.471 ms

Gstreamer element: rrpanoramaptz

Processing time:

Processing time without ptz transformations(2000x1000):

GST_DEBUG="GST_TRACER:7" GST_TRACERS="proctime" gst-launch-1.0 videotestsrc is-live=true num-buffers=200 ! queue max-size-buffers=0 max-size-time=0 max-size-bytes=0 ! rrpanoramaptz ! "video/x-raw,width=2000,height=1000" ! fakesink

The graph depicts individual processing times for each element. For a more accurate representation, the average processing times in milliseconds (ms) are as follows:

queue0: 0.598 ms
rrpanoramaptz0: 3.146 ms
capsfilter0: 0.116 ms

Framerate:

Framerate: 30 fps (2000x1000):

GST_DEBUG="GST_TRACER:7" GST_TRACERS="framerate" gst-launch-1.0 videotestsrc is-live=true num-buffers=200 ! queue max-size-buffers=0 max-size-time=0 max-size-bytes=0 ! rrpanoramaptz ! "video/x-raw,width=2000,height=1000" ! fakesink

Framerate: 30 fps (1000x500 - 2000x1000):

GST_DEBUG="GST_TRACER:7" GST_TRACERS="framerate" gst-launch-1.0 videotestsrc is-live=true num-buffers=300 ! queue max-size-buffers=0 max-size-time=0 max-size-bytes=0 ! "video/x-raw,width=1000,height=500,framerate=30/1" ! rrpanoramaptz ! "video/x-raw,width=2000,height=1000,framerate=30/1" ! fakesink

Framerate: 30 fps (2000x1000 - 1000x500):

GST_DEBUG="GST_TRACER:7" GST_TRACERS="framerate" gst-launch-1.0 videotestsrc is-live=true num-buffers=300 ! queue max-size-buffers=0 max-size-time=0 max-size-bytes=0 ! "video/x-raw,width=1000,height=500,framerate=30/1" ! rrpanoramaptz ! "video/x-raw,width=2000,height=1000,framerate=30/1" ! fakesink

Framerate: 60 fps (2000x1000):

GST_DEBUG="GST_TRACER:7" GST_TRACERS="framerate" gst-launch-1.0 videotestsrc is-live=true num-buffers=300 ! queue max-size-buffers=0 max-size-time=0 max-size-bytes=0 ! rrpanoramaptz ! "video/x-raw,width=2000,height=1000,framerate=60/1" ! fakesink

Index

Next: Contact_Us

@@ Line 20: / Line 20: @@
 {| class="wikitable sortable" style="text-align:center;"
-|+ Caption text
+|+ Spherical Video PTZ performance
 |-
 ! n !! Images type !! PTZ used !! Input size (px) !! Output size (px) !! RAM (MiB) !! GPU !! CPU !! Avg processing time
@@ Line 26: / Line 26: @@
 | 1 || Image || No || 2000x1000 || 500x500 || (phys) 120.00 || (Usage) 1.18 % (VRAM) 6.00 MiB || (all) 10.47 % (core) 83.77 % || 6.845 ms
 |-
-| 2 || Image || No || 4000x2000 || 500x500 || (phys) 171.00 || Example || Example || Example
+| 2 || Image || No || 4000x2000 || 500x500 || (phys) 171.00 || (Usage) 4.40 % (VRAM) 6.00 MiB || (all) 11.11 % (core) 88.90 % || 14.472 ms
-|-
-| 3 || Image || No || 4000x2000 || 1000x1000 || (phys) 174.00 || Example || Example || Example
-|-
-| 4 || Image || Yes || 2000x1000 || 500x500 || (phys) 124.00 || Example || Example || Example
-|-
-| 5 || Image || Yes || 4000x2000 || 500x500 || (phys) 179.00 || Example || Example || Example
 |-
-| 6 || Image || Yes || 4000x2000 || 1000x1000 || (phys) 183.00 || Example || Example || Example
+| 3 || Image || No || 4000x2000 || 1000x1000 || (phys) 174.00 || (Usage) 5.10 % (VRAM) 7.00 MiB || (all) 10.92 % (core) 87.38 % || 14.738 ms
-|-
-| 7 || CudaImage || No || 2000x1000 || 500x500 ||  (phys) 121.00 || Example || Example || Example
-|-
-| 8 || CudaImage || No || 4000x2000 || 500x500 || (phys) 170.00 || Example || Example || Example
-|-
-| 9 || CudaImage || No || 4000x2000 || 1000x1000 || (phys) 177.00 || Example || Example || Example
-|-
-| 10 || CudaImage || Yes || 2000x1000 || 500x500 || (phys) 119.00 || Example || Example || Example
-|-
-| 11 || CudaImage || Yes || 4000x2000 || 500x500 || (phys) 170.00 || Example || Example || Example
-|-
-| 12 || CudaImage || Yes || 4000x2000 || 1000x1000 || (phys) 172.00 || Example || Example || Example
-|}
-{| class="wikitable sortable" style="text-align:center;"
-|+ Spherical Video PTZ performance
 |-
-! n !! Used PTZ properties !! Input size (px) !! Output size (px) !! RAM (MiB) !! GPU !! CPU !! Avg processing time (us)
+| 4 || Image || Yes || 2000x1000 || 500x500 || (phys) 124.00 || (Usage) 5.14 % (VRAM) 6.00 MiB || (all) 5.64 % (core) 45.15 % || 12.027 ms
 |-
-| 1 || No || 2000x1000 || 500x500 || (phys)  ||  ||  ||
+| 5 || Image || Yes || 4000x2000 || 500x500 || (phys) 179.00 || (Usage) 6.30 % (VRAM) 6.00 MiB || (all) 7.24 % (core) 57.91 % || 22.648 ms
 |-
-| 2 || No || 2000x1000 ||  || (phys)  ||  ||  ||
+| 6 || Image || Yes || 4000x2000 || 1000x1000 || (phys) 183.00 || (Usage) 7.47 % (VRAM) 7.00 MiB || (all) 5.68 % (core) 45.47 % || 30.252 ms
 |-
-| 3 || No || 4000x2000 || 250x250 || (phys)  ||  ||  ||
+| 7 || CudaImage || No || 2000x1000 || 500x500 ||  (phys) 121.00 || (Usage) 0.02 % (VRAM) 7.00 MiB || (all) 1.73 % (core) 13.86 % || 336.00 us
 |-
-| 4 || No || 4000x2000 || 500x500 || (phys)  ||  ||  ||
+| 8 || CudaImage || No || 4000x2000 || 500x500 || (phys) 170.00 || (Usage) 0.05 % (VRAM) 10.00 MiB || (all) 1.54 % (core) 12.35 % || 352.00 us
 |-
-| 5 || Yes || 2000x1000 || 250x250 || (phys) ||  ||  ||
+| 9 || CudaImage || No || 4000x2000 || 1000x1000 || (phys) 177.00 || (Usage) 0.10 % (VRAM) 11.00 MiB || (all) 1.55 % (core) 12.37 % || 380.00 us
 |-
-| 6 || Yes || 2000x1000 || 500x500 || (phys) ||  ||  ||
+| 10 || CudaImage || Yes || 2000x1000 || 500x500 || (phys) 119.00 || (Usage) 0.40 % (VRAM) 7.00 MiB || (all) 3.64 % (core) 29.15 % || 5.389 ms
 |-
-| 7 || Yes || 4000x2000 || 250x250 || (phys) ||  ||  ||
+| 11 || CudaImage || Yes || 4000x2000 || 500x500 || (phys) 170.00 || (Usage) 0.62 % (VRAM) 10.00 MiB || (all) 3.39 % (core) 27.09 % || 6.812 ms
 |-
-| 8 || Yes || 4000x2000 || 500x500 || (phys) ||  ||  ||
+| 12 || CudaImage || Yes || 4000x2000 || 1000x1000 || (phys) 172.00 || (Usage) 5.70 % (VRAM) 11.00 MiB || (all) 2.09 % (core) 16.71 % || 19.471 ms
 |}