Jump to content

GStreamer Video Stabilizer for NVIDIA Jetson Boards/Performance/Xavier: Difference between revisions

no edit summary
(Created page with "<noinclude> {{GStreamer Video Stabilizer for NVIDIA Jetson Boards/Head|next=Contact Us}} </noinclude> The following section describes some relevant performance measurements d...")
 
No edit summary
Line 3: Line 3:
</noinclude>
</noinclude>


The following section describes some relevant performance measurements during video stabilization.
The following section describes some relevant performance measurements during video stabilization. It begins with a summary of the results detailed on the following sections, as well as the pipelines used to capture such results.
 


__TOC__
__TOC__


= Reading buffers from file =  
= Summary =
== Reading buffers from file ==  
{| class="wikitable"
{| class="wikitable"
|-
|-
! RAM !! CPU 0 !! CPU 1 !! CPU 2 !! CPU 3 !! GPU !! Framerate
! !! RAM !! CPU 0 !! CPU 1 !! CPU 2 !! CPU 3 !! GPU !! Framerate
|-
|-
| 1948/15828MB (lfb 3250x4MB) || 5.14 || 6.42 || 6.14 || 70 || 32  || 43.5
| 1920x1080@30FPS || 1948/15828MB (lfb 3250x4MB) || 5.14 || 6.42 || 6.14 || 70 || 32  || 43.5
|}
|}


= Capturing buffers using v4l2src =  
== Capturing buffers using v4l2src ==  
{| class="wikitable"
{| class="wikitable"
|-
|-
! Resolution !! RAM !! CPU 0 !! CPU 1 !! CPU 2 !! CPU 3 !! GPU !! Framerate
! Resolution !! RAM !! CPU 0 !! CPU 1 !! CPU 2 !! CPU 3 !! GPU !! Framerate
|-
|-
| 640x480 || 1915/15828MB (lfb 3253x4MB) || 4 || 11.5 || 5.6 || 0.7 || 6.6 || 30
| 640x480@30FPS || 1915/15828MB (lfb 3253x4MB) || 4 || 11.5 || 5.6 || 0.7 || 6.6 || 30
|-
|-
| 1280x720 || 1422/15828MB (lfb 3438x4MB)  || 3 || 8.7 || 4.6 || 1.6 || 8.11 || 10
| 1280x720@10FPS || 1422/15828MB (lfb 3438x4MB)  || 3 || 8.7 || 4.6 || 1.6 || 8.11 || 10
|-
|-
| 1920x1080 || 1578/15828MB (lfb 3398x4MB) || 6.3 || 2.6 || 32 || 0.1 || 2 || 5
| 1920x1080@5FPS || 1578/15828MB (lfb 3398x4MB) || 6.3 || 2.6 || 32 || 0.1 || 2 || 5
|}
|}
= Performance monitoring =
== Read buffers from file ==
<pre>
gst-launch-1.0  filesrc location=$PATH_TO_FILE ! qtdemux ! h264parse ! omxh264dec ! nvvidconv ! 'video/x-raw, width=(int)1920, height=(int)1080, format=(string)RGBA' ! nvstabilize ! perf print-arm-load=true ! fakesink -v sync=true
</pre>
<pre>
RAM 1948/15828MB (lfb 3250x4MB) CPU [5%@1190,23%@1190,4%@1190,62%@1190,off,off,off,off]  GR3D_FREQ 32%
RAM 1948/15828MB (lfb 3250x4MB) CPU [12%@1190,3%@1190,4%@1190,73%@1190,off,off,off,off]  GR3D_FREQ 12%
RAM 1948/15828MB (lfb 3250x4MB) CPU [7%@1190,3%@1190,6%@1190,80%@1190,off,off,off,off]  GR3D_FREQ 38%
RAM 1948/15828MB (lfb 3250x4MB) CPU [6%@1190,2%@1190,6%@1190,71%@1190,off,off,off,off]  GR3D_FREQ 38%
RAM 1948/15828MB (lfb 3250x4MB) CPU [6%@1190,1%@1190,5%@1190,74%@1190,off,off,off,off]  GR3D_FREQ 34%
RAM 1948/15828MB (lfb 3250x4MB) CPU [6%@1190,10%@1190,13%@1190,60%@1190,off,off,off,off] GR3D_FREQ 27%
RAM 1948/15828MB (lfb 3250x4MB) CPU [4%@1190,4%@1190,5%@1190,70%@1190,off,off,off,off]  GR3D_FREQ 43%
</pre>
<pre>
perf: perf0; timestamp: 0:27:39.169478723; bps: 1989273227.944; mean_bps: 1995077777.687; fps: 29.979; mean_fps: 30.067; cpu: 9;
INFO:
perf: perf0; timestamp: 0:27:40.203579516; bps: 1989178631.256; mean_bps: 1994750047.330; fps: 29.978; mean_fps: 30.062; cpu: 9;
INFO:
perf: perf0; timestamp: 0:27:41.205048688; bps: 1987735674.404; mean_bps: 1994380869.807; fps: 29.956; mean_fps: 30.056; cpu: 9;
INFO:
perf: perf0; timestamp: 0:27:42.234629332; bps: 1997911685.682; mean_bps: 1994557410.601; fps: 30.109; mean_fps: 30.059; cpu: 9;
INFO:
perf: perf0; timestamp: 0:27:43.271330293; bps: 1984189537.179; mean_bps: 1994063702.343; fps: 29.903; mean_fps: 30.051; cpu: 9;
INFO:
perf: perf0; timestamp: 0:27:44.287287235; bps: 1894077121.233; mean_bps: 1989518857.747; fps: 28.545; mean_fps: 29.983; cpu: 9;
</pre>
<pre>
gst-launch-1.0  filesrc location=$PATH_TO_FILE ! qtdemux ! h264parse ! omxh264dec ! nvvidconv ! 'video/x-raw, width=(int)1920, height=(int)1080, format=(string)RGBA' ! nvstabilize ! perf print-arm-load=true ! fakesink -v sync=false
</pre>
<pre>
RAM 1948/15828MB (lfb 3250x4MB) CPU [5%@1190,23%@1190,4%@1190,62%@1190,off,off,off,off]  GR3D_FREQ 32%
RAM 1948/15828MB (lfb 3250x4MB) CPU [12%@1190,3%@1190,4%@1190,73%@1190,off,off,off,off]  GR3D_FREQ 12%
RAM 1948/15828MB (lfb 3250x4MB) CPU [7%@1190,3%@1190,6%@1190,80%@1190,off,off,off,off]  GR3D_FREQ 38%
RAM 1948/15828MB (lfb 3250x4MB) CPU [6%@1190,2%@1190,6%@1190,71%@1190,off,off,off,off]  GR3D_FREQ 38%
RAM 1948/15828MB (lfb 3250x4MB) CPU [6%@1190,1%@1190,5%@1190,74%@1190,off,off,off,off]  GR3D_FREQ 34%
RAM 1948/15828MB (lfb 3250x4MB) CPU [6%@1190,10%@1190,13%@1190,60%@1190,off,off,off,off] GR3D_FREQ 27%
RAM 1948/15828MB (lfb 3250x4MB) CPU [4%@1190,4%@1190,5%@1190,70%@1190,off,off,off,off]  GR3D_FREQ 43%
</pre>
<pre>
perf: perf0; timestamp: 0:49:03.086145386; bps: 3355382918.498; mean_bps: 3355382918.498; fps: 50.567; mean_fps: 50.567; cpu: 6;
INFO:
perf: perf0; timestamp: 0:49:04.119962865; bps: 2374831582.819; mean_bps: 2865107250.659; fps: 35.790; mean_fps: 43.178; cpu: 6;
INFO:
perf: perf0; timestamp: 0:49:05.131582409; bps: 2230163319.186; mean_bps: 2653459273.501; fps: 33.609; mean_fps: 39.989; cpu: 6;
INFO:
perf: perf0; timestamp: 0:49:06.151425864; bps: 2212179515.336; mean_bps: 2543139333.960; fps: 33.338; mean_fps: 38.326; cpu: 6;
INFO:
perf: perf0; timestamp: 0:49:07.152486874; bps: 2319970488.112; mean_bps: 2498505564.790; fps: 34.963; mean_fps: 37.654; cpu: 6;
INFO:
perf: perf0; timestamp: 0:49:08.160844239; bps: 2105767730.471; mean_bps: 2433049259.070; fps: 31.735; mean_fps: 36.667; cpu: 6;
INFO:
perf: perf0; timestamp: 0:49:09.169190775; bps: 3882550948.735; mean_bps: 2640120929.022; fps: 58.512; mean_fps: 39.788; cpu: 6;
INFO:
perf: perf0; timestamp: 0:49:10.171828956; bps: 3639933197.397; mean_bps: 2765097462.569; fps: 54.855; mean_fps: 41.671; cpu: 6;
INFO:
perf: perf0; timestamp: 0:49:11.183369089; bps: 3870293102.844; mean_bps: 2887896978.155; fps: 58.327; mean_fps: 43.522; cpu: 6;
</pre>
== Read buffers from v4l2src ==
''' 640x360@30Fps camera source '''
Pipeline:
<pre>
gst-launch-1.0 v4l2src device=/dev/video0 ! 'video/x-raw,width=640,height=480' ! nvvidconv ! 'video/x-raw(memory:NVMM),width=640,height=480,format=BGRx'  ! nvvidconv ! nvstabilize queue-size=5 ! perf print-arm-load=true ! fakesink
</pre>
Tegrastats:
<pre>
RAM 1915/15828MB (lfb 3253x4MB) CPU [5%@1190,6%@1190,5%@1190,3%@1190,off,off,off,off]  GR3D_FREQ 0%
RAM 1915/15828MB (lfb 3253x4MB) CPU [5%@1190,11%@1190,0%@1190,0%@1190,off,off,off,off] GR3D_FREQ 9%
RAM 1915/15828MB (lfb 3253x4MB) CPU [4%@1190,11%@1190,2%@1190,0%@1190,off,off,off,off] GR3D_FREQ 7%
RAM 1915/15828MB (lfb 3253x4MB) CPU [4%@1190,16%@1190,1%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0%
RAM 1915/15828MB (lfb 3253x4MB) CPU [4%@1190,17%@1190,1%@1190,0%@1190,off,off,off,off] GR3D_FREQ 9%
RAM 1915/15828MB (lfb 3253x4MB) CPU [5%@1190,19%@1190,1%@1190,0%@1190,off,off,off,off] GR3D_FREQ 20%
RAM 1915/15828MB (lfb 3253x4MB) CPU [5%@1190,22%@1190,0%@1190,1%@1190,off,off,off,off] GR3D_FREQ 3%
RAM 1915/15828MB (lfb 3253x4MB) CPU [2%@1190,1%@1190,20%@1190,2%@1190,off,off,off,off] GR3D_FREQ 1%
RAM 1915/15828MB (lfb 3253x4MB) CPU [2%@1190,1%@1190,21%@1190,1%@1190,off,off,off,off] GR3D_FREQ 11%
</pre>
Framerate and average CPU consumption: (negotiated framerate: 30 fps)
<pre>
INFO:
perf: perf0; timestamp: 1:08:26.619340314; bps: 296077774.528; mean_bps: 267035771.375; fps: 30.119; mean_fps: 27.164; cpu: 5;
INFO:
perf: perf0; timestamp: 1:08:27.620205839; bps: 294656967.029; mean_bps: 270488420.832; fps: 29.974; mean_fps: 27.516; cpu: 5;
INFO:
perf: perf0; timestamp: 1:08:28.658325183; bps: 293552375.997; mean_bps: 273051082.517; fps: 29.862; mean_fps: 27.776; cpu: 5;
INFO:
perf: perf0; timestamp: 1:08:29.687389555; bps: 296135410.273; mean_bps: 275359515.293; fps: 30.124; mean_fps: 28.011; cpu: 5;
INFO:
perf: perf0; timestamp: 1:08:30.692569786; bps: 283612422.139; mean_bps: 276109779.551; fps: 28.851; mean_fps: 28.087; cpu: 5;
INFO:
perf: perf0; timestamp: 1:08:31.720799605; bps: 305936274.350; mean_bps: 278595320.785; fps: 31.121; mean_fps: 28.340; cpu: 5;
INFO:
perf: perf0; timestamp: 1:08:32.752303453; bps: 285904895.626; mean_bps: 279157595.772; fps: 29.084; mean_fps: 28.397; cpu: 5;
</pre>
''' 1280x720@10Fps camera source '''
Pipeline:
<pre>
gst-launch-1.0 v4l2src device=/dev/video0 ! 'video/x-raw,width=1280,height=720' ! nvvidconv ! 'video/x-raw(memory:NVMM),width=1280,height=720,format=BGRx'  ! nvvidconv ! nvstabilize queue-size=5 ! perf print-arm-load=true ! fakesink
</pre>
Tegrastats:
<pre>
RAM 1422/15828MB (lfb 3438x4MB) CPU [2%@1190,1%@1190,10%@1190,5%@1190,off,off,off,off] GR3D_FREQ 18%
RAM 1422/15828MB (lfb 3438x4MB) CPU [2%@1190,0%@1190,13%@1190,0%@1190,off,off,off,off] GR3D_FREQ 16%
RAM 1422/15828MB (lfb 3438x4MB) CPU [3%@1190,1%@1190,5%@1190,8%@1190,off,off,off,off]  GR3D_FREQ 0%
RAM 1422/15828MB (lfb 3438x4MB) CPU [5%@1190,9%@1190,0%@1190,2%@1190,off,off,off,off]  GR3D_FREQ 0%
RAM 1422/15828MB (lfb 3438x4MB) CPU [5%@1190,16%@1190,0%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0%
RAM 1422/15828MB (lfb 3438x4MB) CPU [3%@1190,17%@1190,0%@1190,0%@1190,off,off,off,off] GR3D_FREQ 13%
RAM 1422/15828MB (lfb 3438x4MB) CPU [2%@1190,16%@1190,0%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0%
RAM 1422/15828MB (lfb 3438x4MB) CPU [2%@1190,17%@1190,0%@1190,0%@1190,off,off,off,off] GR3D_FREQ 20%
RAM 1422/15828MB (lfb 3438x4MB) CPU [3%@1190,2%@1190,14%@1190,0%@1190,off,off,off,off] GR3D_FREQ 6%
</pre>
Framerate and average CPU consumption: (negotiated framerate: 15 fps)
<pre>
INFO:
perf: perf0; timestamp: 0:21:16.175312915; bps: 294770087.952; mean_bps: 295687663.966; fps: 9.995; mean_fps: 10.026; cpu: 4;
INFO:
perf: perf0; timestamp: 0:21:17.176574979; bps: 294540271.327; mean_bps: 295572924.702; fps: 9.987; mean_fps: 10.022; cpu: 4;
INFO:
perf: perf0; timestamp: 0:21:18.177108331; bps: 294754791.942; mean_bps: 295498548.997; fps: 9.995; mean_fps: 10.020; cpu: 4;
INFO:
perf: perf0; timestamp: 0:21:19.246683534; bps: 275728157.471; mean_bps: 293851016.370; fps: 9.350; mean_fps: 9.964; cpu: 4;
INFO:
perf: perf0; timestamp: 0:21:20.247672144; bps: 294620734.995; mean_bps: 293910225.495; fps: 9.990; mean_fps: 9.966; cpu: 4;
</pre>
''' 1920x1080@5Fps camera source'''
Pipeline:
<pre>
gst-launch-1.0 v4l2src device=/dev/video0 ! 'video/x-raw,width=1920,height=1080' ! nvvidconv ! 'video/x-raw(memory:NVMM),width=1920,height=1080,format=BGRx'  ! nvvidconv ! nvstabilize queue-size=5 ! perf print-arm-load=true ! fakesink
</pre>
Tegrastats:
<pre>
RAM 1578/15828MB (lfb 3398x4MB) CPU [2%@1190,0%@1190,37%@1190,0%@1190,off,off,off,off]  GR3D_FREQ 0%
RAM 1578/15828MB (lfb 3398x4MB) CPU [18%@1190,3%@1190,24%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0%
RAM 1578/15828MB (lfb 3398x4MB) CPU [3%@1190,7%@1190,30%@1190,0%@1190,off,off,off,off]  GR3D_FREQ 0%
RAM 1578/15828MB (lfb 3398x4MB) CPU [17%@1190,0%@1190,24%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0%
RAM 1578/15828MB (lfb 3398x4MB) CPU [3%@1190,1%@1190,41%@1190,1%@1190,off,off,off,off]  GR3D_FREQ 0%
RAM 1578/15828MB (lfb 3398x4MB) CPU [6%@1190,9%@1190,28%@1190,0%@1190,off,off,off,off]  GR3D_FREQ 0%
RAM 1578/15828MB (lfb 3398x4MB) CPU [4%@1190,0%@1190,36%@1190,0%@1190,off,off,off,off]  GR3D_FREQ 0%
RAM 1578/15828MB (lfb 3398x4MB) CPU [4%@1190,0%@1190,35%@1190,0%@1190,off,off,off,off]  GR3D_FREQ 0%
RAM 1578/15828MB (lfb 3398x4MB) CPU [3%@1190,0%@1190,36%@1190,0%@1190,off,off,off,off]  GR3D_FREQ 20%
RAM 1578/15828MB (lfb 3398x4MB) CPU [3%@1190,6%@1190,35%@1190,0%@1190,off,off,off,off]  GR3D_FREQ 0% 
</pre>
Framerate and average CPU consumption: (negotiated framerate: 5 fps)
<pre>
INFO:
perf: perf0; timestamp: 0:26:07.954658555; bps: 0.000; mean_bps: 0.000; fps: 0.000; mean_fps: 0.000; cpu: 4;
INFO:
perf: perf0; timestamp: 0:26:09.201932927; bps: 319200978.500; mean_bps: 319200978.500; fps: 4.810; mean_fps: 4.810; cpu: 4;
INFO:
perf: perf0; timestamp: 0:26:10.402853309; bps: 331521727.808; mean_bps: 325361353.154; fps: 4.996; mean_fps: 4.903; cpu: 4;
INFO:
perf: perf0; timestamp: 0:26:11.548650907; bps: 347470793.005; mean_bps: 332731166.437; fps: 5.237; mean_fps: 5.014; cpu: 4;
INFO:
perf: perf0; timestamp: 0:26:12.604827888; bps: 314129171.501; mean_bps: 328080667.703; fps: 4.734; mean_fps: 4.944; cpu: 4;
INFO:
perf: perf0; timestamp: 0:26:13.800567792; bps: 332958027.635; mean_bps: 329056139.690; fps: 5.018; mean_fps: 4.959; cpu: 4;
INFO:
perf: perf0; timestamp: 0:26:14.801171755; bps: 331575740.521; mean_bps: 329476073.161; fps: 4.997; mean_fps: 4.965; cpu: 4;
</pre>




352

edits

Cookies help us deliver our services. By using our services, you agree to our use of cookies.