GStreamer Video Stabilizer for NVIDIA Jetson Boards - Performance - Xavier
| GStreamer Video Stabilizer |
|---|
 |
| Video Stabilization Basics |
| User Guide |
| Getting Started |
| Examples |
| Performance |
| Contact Us |
The following section describes some relevant performance measurements during video stabilization. It begins with a summary of the results detailed on the following sections, as well as the pipelines used to capture such results.
Summary
Reading buffers from file
| RAM | CPU 0 | CPU 1 | CPU 2 | CPU 3 | GPU | Framerate | |
|---|---|---|---|---|---|---|---|
| 1920x1080@30FPS | 1948/15828MB (lfb 3250x4MB) | 5.14 | 6.42 | 6.14 | 70 | 32 | 43.5 |
Capturing buffers using v4l2src
| Resolution | RAM | CPU 0 | CPU 1 | CPU 2 | CPU 3 | GPU | Framerate |
|---|---|---|---|---|---|---|---|
| 640x480@30FPS | 1915/15828MB (lfb 3253x4MB) | 4 | 11.5 | 5.6 | 0.7 | 6.6 | 30 |
| 1280x720@10FPS | 1422/15828MB (lfb 3438x4MB) | 3 | 8.7 | 4.6 | 1.6 | 8.11 | 10 |
| 1920x1080@5FPS | 1578/15828MB (lfb 3398x4MB) | 6.3 | 2.6 | 32 | 0.1 | 2 | 5 |
Performance monitoring
Read buffers from file
gst-launch-1.0 filesrc location=$PATH_TO_FILE ! qtdemux ! h264parse ! omxh264dec ! nvvidconv ! 'video/x-raw, width=(int)1920, height=(int)1080, format=(string)RGBA' ! nvstabilize ! perf print-arm-load=true ! fakesink -v sync=true
RAM 1564/15828MB (lfb 3421x4MB) CPU [3%@1190,63%@1190,3%@1190,27%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1564/15828MB (lfb 3421x4MB) CPU [9%@1190,68%@1190,3%@1190,1%@1190,off,off,off,off] GR3D_FREQ 6% RAM 1564/15828MB (lfb 3420x4MB) CPU [5%@1190,38%@1190,4%@1190,0%@1190,off,off,off,off] GR3D_FREQ 28% RAM 1564/15828MB (lfb 3420x4MB) CPU [10%@1190,31%@1190,0%@1190,5%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1564/15828MB (lfb 3420x4MB) CPU [5%@1190,46%@1190,1%@1190,2%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1564/15828MB (lfb 3419x4MB) CPU [11%@1190,32%@1190,0%@1190,3%@1190,off,off,off,off] GR3D_FREQ 38% RAM 1564/15828MB (lfb 3419x4MB) CPU [9%@1190,39%@1190,1%@1190,1%@1190,off,off,off,off] GR3D_FREQ 10% RAM 1564/15828MB (lfb 3418x4MB) CPU [10%@1190,38%@1190,1%@1190,2%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1564/15828MB (lfb 3418x4MB) CPU [9%@1190,38%@1190,0%@1190,0%@1190,off,off,off,off] GR3D_FREQ 34% RAM 1564/15828MB (lfb 3418x4MB) CPU [8%@1190,37%@1190,1%@1190,1%@1190,off,off,off,off] GR3D_FREQ 19% RAM 1564/15828MB (lfb 3417x4MB) CPU [9%@1190,33%@1190,0%@1190,2%@1190,off,off,off,off] GR3D_FREQ 30%
perf: perf0; timestamp: 0:27:39.169478723; bps: 1989273227.944; mean_bps: 1995077777.687; fps: 29.979; mean_fps: 30.067; cpu: 9; INFO: perf: perf0; timestamp: 0:27:40.203579516; bps: 1989178631.256; mean_bps: 1994750047.330; fps: 29.978; mean_fps: 30.062; cpu: 9; INFO: perf: perf0; timestamp: 0:27:41.205048688; bps: 1987735674.404; mean_bps: 1994380869.807; fps: 29.956; mean_fps: 30.056; cpu: 9; INFO: perf: perf0; timestamp: 0:27:42.234629332; bps: 1997911685.682; mean_bps: 1994557410.601; fps: 30.109; mean_fps: 30.059; cpu: 9; INFO: perf: perf0; timestamp: 0:27:43.271330293; bps: 1984189537.179; mean_bps: 1994063702.343; fps: 29.903; mean_fps: 30.051; cpu: 9; INFO: perf: perf0; timestamp: 0:27:44.287287235; bps: 1894077121.233; mean_bps: 1989518857.747; fps: 28.545; mean_fps: 29.983; cpu: 9;
gst-launch-1.0 filesrc location=$PATH_TO_FILE ! qtdemux ! h264parse ! omxh264dec ! nvvidconv ! 'video/x-raw, width=(int)1920, height=(int)1080, format=(string)RGBA' ! nvstabilize ! perf print-arm-load=true ! fakesink -v sync=false
RAM 1577/15828MB (lfb 3405x4MB) CPU [6%@1190,65%@1190,11%@1190,12%@1190,off,off,off,off] GR3D_FREQ 21% RAM 1578/15828MB (lfb 3405x4MB) CPU [6%@1190,67%@1190,13%@1190,4%@1190,off,off,off,off] GR3D_FREQ 21% RAM 1578/15828MB (lfb 3405x4MB) CPU [7%@1190,70%@1190,9%@1190,5%@1190,off,off,off,off] GR3D_FREQ 11% RAM 1578/15828MB (lfb 3405x4MB) CPU [8%@1190,60%@1190,12%@1190,13%@1190,off,off,off,off] GR3D_FREQ 25% RAM 1578/15828MB (lfb 3405x4MB) CPU [10%@1190,64%@1190,1%@1190,10%@1190,off,off,off,off] GR3D_FREQ 40% RAM 1578/15828MB (lfb 3405x4MB) CPU [11%@1190,70%@1190,2%@1190,2%@1190,off,off,off,off] GR3D_FREQ 31% RAM 1578/15828MB (lfb 3405x4MB) CPU [11%@1190,69%@1190,1%@1190,4%@1190,off,off,off,off] GR3D_FREQ 38% RAM 1578/15828MB (lfb 3405x4MB) CPU [9%@1190,71%@1190,3%@1190,4%@1190,off,off,off,off] GR3D_FREQ 38%
perf: perf0; timestamp: 0:49:03.086145386; bps: 3355382918.498; mean_bps: 3355382918.498; fps: 50.567; mean_fps: 50.567; cpu: 6; INFO: perf: perf0; timestamp: 0:49:04.119962865; bps: 2374831582.819; mean_bps: 2865107250.659; fps: 35.790; mean_fps: 43.178; cpu: 6; INFO: perf: perf0; timestamp: 0:49:05.131582409; bps: 2230163319.186; mean_bps: 2653459273.501; fps: 33.609; mean_fps: 39.989; cpu: 6; INFO: perf: perf0; timestamp: 0:49:06.151425864; bps: 2212179515.336; mean_bps: 2543139333.960; fps: 33.338; mean_fps: 38.326; cpu: 6; INFO: perf: perf0; timestamp: 0:49:07.152486874; bps: 2319970488.112; mean_bps: 2498505564.790; fps: 34.963; mean_fps: 37.654; cpu: 6; INFO: perf: perf0; timestamp: 0:49:08.160844239; bps: 2105767730.471; mean_bps: 2433049259.070; fps: 31.735; mean_fps: 36.667; cpu: 6; INFO: perf: perf0; timestamp: 0:49:09.169190775; bps: 3882550948.735; mean_bps: 2640120929.022; fps: 58.512; mean_fps: 39.788; cpu: 6; INFO: perf: perf0; timestamp: 0:49:10.171828956; bps: 3639933197.397; mean_bps: 2765097462.569; fps: 54.855; mean_fps: 41.671; cpu: 6; INFO: perf: perf0; timestamp: 0:49:11.183369089; bps: 3870293102.844; mean_bps: 2887896978.155; fps: 58.327; mean_fps: 43.522; cpu: 6;
Read buffers from v4l2src
640x360@30Fps camera source
Pipeline:
gst-launch-1.0 v4l2src device=/dev/video0 ! 'video/x-raw,width=640,height=480' ! nvvidconv ! 'video/x-raw(memory:NVMM),width=640,height=480,format=BGRx' ! nvvidconv ! nvstabilize queue-size=5 ! perf print-arm-load=true ! fakesink
Tegrastats:
RAM 1915/15828MB (lfb 3253x4MB) CPU [5%@1190,6%@1190,5%@1190,3%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1915/15828MB (lfb 3253x4MB) CPU [5%@1190,11%@1190,0%@1190,0%@1190,off,off,off,off] GR3D_FREQ 9% RAM 1915/15828MB (lfb 3253x4MB) CPU [4%@1190,11%@1190,2%@1190,0%@1190,off,off,off,off] GR3D_FREQ 7% RAM 1915/15828MB (lfb 3253x4MB) CPU [4%@1190,16%@1190,1%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1915/15828MB (lfb 3253x4MB) CPU [4%@1190,17%@1190,1%@1190,0%@1190,off,off,off,off] GR3D_FREQ 9% RAM 1915/15828MB (lfb 3253x4MB) CPU [5%@1190,19%@1190,1%@1190,0%@1190,off,off,off,off] GR3D_FREQ 20% RAM 1915/15828MB (lfb 3253x4MB) CPU [5%@1190,22%@1190,0%@1190,1%@1190,off,off,off,off] GR3D_FREQ 3% RAM 1915/15828MB (lfb 3253x4MB) CPU [2%@1190,1%@1190,20%@1190,2%@1190,off,off,off,off] GR3D_FREQ 1% RAM 1915/15828MB (lfb 3253x4MB) CPU [2%@1190,1%@1190,21%@1190,1%@1190,off,off,off,off] GR3D_FREQ 11%
Framerate and average CPU consumption: (negotiated framerate: 30 fps)
INFO: perf: perf0; timestamp: 1:08:26.619340314; bps: 296077774.528; mean_bps: 267035771.375; fps: 30.119; mean_fps: 27.164; cpu: 5; INFO: perf: perf0; timestamp: 1:08:27.620205839; bps: 294656967.029; mean_bps: 270488420.832; fps: 29.974; mean_fps: 27.516; cpu: 5; INFO: perf: perf0; timestamp: 1:08:28.658325183; bps: 293552375.997; mean_bps: 273051082.517; fps: 29.862; mean_fps: 27.776; cpu: 5; INFO: perf: perf0; timestamp: 1:08:29.687389555; bps: 296135410.273; mean_bps: 275359515.293; fps: 30.124; mean_fps: 28.011; cpu: 5; INFO: perf: perf0; timestamp: 1:08:30.692569786; bps: 283612422.139; mean_bps: 276109779.551; fps: 28.851; mean_fps: 28.087; cpu: 5; INFO: perf: perf0; timestamp: 1:08:31.720799605; bps: 305936274.350; mean_bps: 278595320.785; fps: 31.121; mean_fps: 28.340; cpu: 5; INFO: perf: perf0; timestamp: 1:08:32.752303453; bps: 285904895.626; mean_bps: 279157595.772; fps: 29.084; mean_fps: 28.397; cpu: 5;
1280x720@10Fps camera source Pipeline:
gst-launch-1.0 v4l2src device=/dev/video0 ! 'video/x-raw,width=1280,height=720' ! nvvidconv ! 'video/x-raw(memory:NVMM),width=1280,height=720,format=BGRx' ! nvvidconv ! nvstabilize queue-size=5 ! perf print-arm-load=true ! fakesink
Tegrastats:
RAM 1422/15828MB (lfb 3438x4MB) CPU [2%@1190,1%@1190,10%@1190,5%@1190,off,off,off,off] GR3D_FREQ 18% RAM 1422/15828MB (lfb 3438x4MB) CPU [2%@1190,0%@1190,13%@1190,0%@1190,off,off,off,off] GR3D_FREQ 16% RAM 1422/15828MB (lfb 3438x4MB) CPU [3%@1190,1%@1190,5%@1190,8%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1422/15828MB (lfb 3438x4MB) CPU [5%@1190,9%@1190,0%@1190,2%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1422/15828MB (lfb 3438x4MB) CPU [5%@1190,16%@1190,0%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1422/15828MB (lfb 3438x4MB) CPU [3%@1190,17%@1190,0%@1190,0%@1190,off,off,off,off] GR3D_FREQ 13% RAM 1422/15828MB (lfb 3438x4MB) CPU [2%@1190,16%@1190,0%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1422/15828MB (lfb 3438x4MB) CPU [2%@1190,17%@1190,0%@1190,0%@1190,off,off,off,off] GR3D_FREQ 20% RAM 1422/15828MB (lfb 3438x4MB) CPU [3%@1190,2%@1190,14%@1190,0%@1190,off,off,off,off] GR3D_FREQ 6%
Framerate and average CPU consumption: (negotiated framerate: 15 fps)
INFO: perf: perf0; timestamp: 0:21:16.175312915; bps: 294770087.952; mean_bps: 295687663.966; fps: 9.995; mean_fps: 10.026; cpu: 4; INFO: perf: perf0; timestamp: 0:21:17.176574979; bps: 294540271.327; mean_bps: 295572924.702; fps: 9.987; mean_fps: 10.022; cpu: 4; INFO: perf: perf0; timestamp: 0:21:18.177108331; bps: 294754791.942; mean_bps: 295498548.997; fps: 9.995; mean_fps: 10.020; cpu: 4; INFO: perf: perf0; timestamp: 0:21:19.246683534; bps: 275728157.471; mean_bps: 293851016.370; fps: 9.350; mean_fps: 9.964; cpu: 4; INFO: perf: perf0; timestamp: 0:21:20.247672144; bps: 294620734.995; mean_bps: 293910225.495; fps: 9.990; mean_fps: 9.966; cpu: 4;
1920x1080@5Fps camera source
Pipeline:
gst-launch-1.0 v4l2src device=/dev/video0 ! 'video/x-raw,width=1920,height=1080' ! nvvidconv ! 'video/x-raw(memory:NVMM),width=1920,height=1080,format=BGRx' ! nvvidconv ! nvstabilize queue-size=5 ! perf print-arm-load=true ! fakesink
Tegrastats:
RAM 1578/15828MB (lfb 3398x4MB) CPU [2%@1190,0%@1190,37%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1578/15828MB (lfb 3398x4MB) CPU [18%@1190,3%@1190,24%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1578/15828MB (lfb 3398x4MB) CPU [3%@1190,7%@1190,30%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1578/15828MB (lfb 3398x4MB) CPU [17%@1190,0%@1190,24%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1578/15828MB (lfb 3398x4MB) CPU [3%@1190,1%@1190,41%@1190,1%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1578/15828MB (lfb 3398x4MB) CPU [6%@1190,9%@1190,28%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1578/15828MB (lfb 3398x4MB) CPU [4%@1190,0%@1190,36%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1578/15828MB (lfb 3398x4MB) CPU [4%@1190,0%@1190,35%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0% RAM 1578/15828MB (lfb 3398x4MB) CPU [3%@1190,0%@1190,36%@1190,0%@1190,off,off,off,off] GR3D_FREQ 20% RAM 1578/15828MB (lfb 3398x4MB) CPU [3%@1190,6%@1190,35%@1190,0%@1190,off,off,off,off] GR3D_FREQ 0%
Framerate and average CPU consumption: (negotiated framerate: 5 fps)
INFO: perf: perf0; timestamp: 0:26:07.954658555; bps: 0.000; mean_bps: 0.000; fps: 0.000; mean_fps: 0.000; cpu: 4; INFO: perf: perf0; timestamp: 0:26:09.201932927; bps: 319200978.500; mean_bps: 319200978.500; fps: 4.810; mean_fps: 4.810; cpu: 4; INFO: perf: perf0; timestamp: 0:26:10.402853309; bps: 331521727.808; mean_bps: 325361353.154; fps: 4.996; mean_fps: 4.903; cpu: 4; INFO: perf: perf0; timestamp: 0:26:11.548650907; bps: 347470793.005; mean_bps: 332731166.437; fps: 5.237; mean_fps: 5.014; cpu: 4; INFO: perf: perf0; timestamp: 0:26:12.604827888; bps: 314129171.501; mean_bps: 328080667.703; fps: 4.734; mean_fps: 4.944; cpu: 4; INFO: perf: perf0; timestamp: 0:26:13.800567792; bps: 332958027.635; mean_bps: 329056139.690; fps: 5.018; mean_fps: 4.959; cpu: 4; INFO: perf: perf0; timestamp: 0:26:14.801171755; bps: 331575740.521; mean_bps: 329476073.161; fps: 4.997; mean_fps: 4.965; cpu: 4;