23,776
edits
GStreamer pipelines for Jetson TX2: Difference between revisions
m
no edit summary
mNo edit summary |
mNo edit summary |
||
| Line 18: | Line 18: | ||
Recall that this board is a quad-core A57 with some hardware units dedicated to encode/decode. Plugins accelerated by Hardware available: | Recall that this board is a quad-core A57 with some hardware units dedicated to encode/decode. Plugins accelerated by Hardware available: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-inspect-1.0 | grep omx | gst-inspect-1.0 | grep omx | ||
omx: nvoverlaysink: OpenMax Video Sink | omx: nvoverlaysink: OpenMax Video Sink | ||
| Line 37: | Line 37: | ||
NVIDIA plugins: | NVIDIA plugins: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-inspect-1.0 | grep nv | gst-inspect-1.0 | grep nv | ||
omx: nvoverlaysink: OpenMax Video Sink | omx: nvoverlaysink: OpenMax Video Sink | ||
| Line 58: | Line 58: | ||
Run it with sudo to get more information. | Run it with sudo to get more information. | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
ubuntu@tegra-ubuntu:~$ ./tegrastats | ubuntu@tegra-ubuntu:~$ ./tegrastats | ||
RAM 1787/7853MB (lfb 173x4MB) cpu [0%@1267,off,off,0%@1267,0%@1267,0%@1267] | RAM 1787/7853MB (lfb 173x4MB) cpu [0%@1267,off,off,0%@1267,0%@1267,0%@1267] | ||
| Line 108: | Line 108: | ||
In order to test some of the videos or incoming streams produced by the pipelines below you might need VLC installed in your Jetson module, there is a known issue with VLC version 2.2 and you need to download and install VLC 2.4 or newer, in order to do it please follow these steps: | In order to test some of the videos or incoming streams produced by the pipelines below you might need VLC installed in your Jetson module, there is a known issue with VLC version 2.2 and you need to download and install VLC 2.4 or newer, in order to do it please follow these steps: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
sudo apt-get build-dep vlc && sudo apt-get install libtool build-essential | sudo apt-get build-dep vlc && sudo apt-get install libtool build-essential | ||
wget http://download.videolan.org/pub/videolan/vlc/2.2.6/vlc-2.2.6.tar.xz | wget http://download.videolan.org/pub/videolan/vlc/2.2.6/vlc-2.2.6.tar.xz | ||
| Line 132: | Line 132: | ||
This plugin was created by NVIDIA and it has access to the ISP that helps converting from bayer to yuv suitable for the video encoders. However, it seems that its usage is limited to the ov5693 sensor until NVIDIA releases its source code or until it adds support to v4l2 to use the ISP. | This plugin was created by NVIDIA and it has access to the ISP that helps converting from bayer to yuv suitable for the video encoders. However, it seems that its usage is limited to the ov5693 sensor until NVIDIA releases its source code or until it adds support to v4l2 to use the ISP. | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | gst-launch-1.0 nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | ||
nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! fakesink silent=false -v | nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! fakesink silent=false -v | ||
| Line 141: | Line 141: | ||
ARM consumption: 45.7% of one core (4 cores available 400% - this means something like 11.25% of total) | ARM consumption: 45.7% of one core (4 cores available 400% - this means something like 11.25% of total) | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
RAM 1119/7853MB (lfb 1258x4MB) cpu [0%@1267,off,off,0%@1267,0%@1267,0%@1267] | RAM 1119/7853MB (lfb 1258x4MB) cpu [0%@1267,off,off,0%@1267,0%@1267,0%@1267] | ||
RAM 1119/7853MB (lfb 1258x4MB) cpu [28%@345,off,off,7%@345,3%@345,16%@345] | RAM 1119/7853MB (lfb 1258x4MB) cpu [28%@345,off,off,7%@345,3%@345,16%@345] | ||
| Line 162: | Line 162: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
1574 root 20 0 9.917g 116260 37488 S 45.7 1.4 1:24.81 nvcamera-daemon | 1574 root 20 0 9.917g 116260 37488 S 45.7 1.4 1:24.81 nvcamera-daemon | ||
11085 nvidia 20 0 331488 9492 6004 S 3.3 0.1 0:06.98 gst-launch-1.0 | 11085 nvidia 20 0 331488 9492 6004 S 3.3 0.1 0:06.98 gst-launch-1.0 | ||
| Line 171: | Line 171: | ||
nvcamerasrc exposes several properties to control the ISP | nvcamerasrc exposes several properties to control the ISP | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
wbmode : White balance affects the color temperature of the photo | wbmode : White balance affects the color temperature of the photo | ||
flags: readable, writable | flags: readable, writable | ||
| Line 348: | Line 348: | ||
Starting on L4T R23.2 there is a /dev/video0 node to capture, however, this node will give you frames in bayer which are NOT suitable to encode because it grabs frames directly from the [https://www.ovt.com/sensors/OV5693 ov5693 camera] without using the ISP. | Starting on L4T R23.2 there is a /dev/video0 node to capture, however, this node will give you frames in bayer which are NOT suitable to encode because it grabs frames directly from the [https://www.ovt.com/sensors/OV5693 ov5693 camera] without using the ISP. | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
https://devtalk.nvidia.com/default/topic/923984/ov5693-through-v4l2-interface-not-working-in-23-2/ | https://devtalk.nvidia.com/default/topic/923984/ov5693-through-v4l2-interface-not-working-in-23-2/ | ||
| Line 359: | Line 359: | ||
==== nvcamerasrc ==== | ==== nvcamerasrc ==== | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | gst-launch-1.0 nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | ||
nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! nvoverlaysink -e | nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! nvoverlaysink -e | ||
| Line 366: | Line 366: | ||
ARM consumption: 46.1% of one core (4 cores available 400% - this means something like 14% of total). However, only the capture is 11.25% so the display consumes '''2.75%'''. For other camera you can find in our wiki latency numbers for [https://developer.ridgerun.com/wiki/index.php?title=Jetson_glass_to_glass_latency#Introduction glass to glass measurements] | ARM consumption: 46.1% of one core (4 cores available 400% - this means something like 14% of total). However, only the capture is 11.25% so the display consumes '''2.75%'''. For other camera you can find in our wiki latency numbers for [https://developer.ridgerun.com/wiki/index.php?title=Jetson_glass_to_glass_latency#Introduction glass to glass measurements] | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
RAM 1184/7853MB (lfb 1246x4MB) cpu [2%@345,off,off,0%@345,0%@345,0%@345] | RAM 1184/7853MB (lfb 1246x4MB) cpu [2%@345,off,off,0%@345,0%@345,0%@345] | ||
| Line 388: | Line 388: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND | ||
1574 root 20 0 9.979g 208932 44656 S 46.2 2.6 5:18.85 nvcamera-daemon | 1574 root 20 0 9.979g 208932 44656 S 46.2 2.6 5:18.85 nvcamera-daemon | ||
| Line 400: | Line 400: | ||
ARM load: 157% but only videotestsrc consumes 100%. According to the NVIDIA forum when using videotestsrc the system is also doing memory copies to feed the encoder with NVMM memory buffers so that loads more the ARM. | ARM load: 157% but only videotestsrc consumes 100%. According to the NVIDIA forum when using videotestsrc the system is also doing memory copies to feed the encoder with NVMM memory buffers so that loads more the ARM. | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 videotestsrc num-buffers=150 ! 'video/x-raw, format=(string)I420,width=(int)640, height=(int)480' ! omxh264enc ! 'video/x-h264, stream-format=(string)byte-stream' ! filesink location=test.h264 -e | gst-launch-1.0 videotestsrc num-buffers=150 ! 'video/x-raw, format=(string)I420,width=(int)640, height=(int)480' ! omxh264enc ! 'video/x-h264, stream-format=(string)byte-stream' ! filesink location=test.h264 -e | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| Line 408: | Line 408: | ||
==== nvcamerasrc ==== | ==== nvcamerasrc ==== | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | ||
nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! omxh264enc bitrate=8000000 \ | nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! omxh264enc bitrate=8000000 \ | ||
| Line 418: | Line 418: | ||
ARM consumption 45.4% of one core (4 cores available 400% - this means something like 16.75% of total). However, only the capture is 11.25% so the h264 consumes '''5.5%''' | ARM consumption 45.4% of one core (4 cores available 400% - this means something like 16.75% of total). However, only the capture is 11.25% so the h264 consumes '''5.5%''' | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
RAM 1279/7853MB (lfb 1237x4MB) cpu [0%@1267,off,off,0%@1267,0%@1267,0%@1267] | RAM 1279/7853MB (lfb 1237x4MB) cpu [0%@1267,off,off,0%@1267,0%@1267,0%@1267] | ||
RAM 1280/7853MB (lfb 1237x4MB) cpu [8%@345,off,off,19%@345,10%@345,12%@345] | RAM 1280/7853MB (lfb 1237x4MB) cpu [8%@345,off,off,19%@345,10%@345,12%@345] | ||
| Line 439: | Line 439: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
1574 root 20 0 9.979g 214836 44684 S 45.4 2.7 7:10.27 nvcamera-daemon | 1574 root 20 0 9.979g 214836 44684 S 45.4 2.7 7:10.27 nvcamera-daemon | ||
11614 nvidia 20 0 700192 12800 9236 S 8.6 0.2 0:00.88 gst-launch-1.0 | 11614 nvidia 20 0 700192 12800 9236 S 8.6 0.2 0:00.88 gst-launch-1.0 | ||
| Line 446: | Line 446: | ||
The encoder exposes the following parameters | The encoder exposes the following parameters | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
control-rate : Bitrate control method | control-rate : Bitrate control method | ||
flags: readable, writable, changeable only in NULL or READY state | flags: readable, writable, changeable only in NULL or READY state | ||
| Line 532: | Line 532: | ||
=== Dual H264 encoding === | === Dual H264 encoding === | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | ||
nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! tee name=streams \ | nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! tee name=streams \ | ||
| Line 542: | Line 542: | ||
ARM consumption ~44.1% of one core (4 cores available 400% - this means something like 16.5% of total). However, only the capture is 11.25% so the dual h264 consumes '''5.25%''' | ARM consumption ~44.1% of one core (4 cores available 400% - this means something like 16.5% of total). However, only the capture is 11.25% so the dual h264 consumes '''5.25%''' | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
RAM 1320/7853MB (lfb 1221x4MB) cpu [0%@1420,off,off,0%@1420,0%@1420,0%@1420] | RAM 1320/7853MB (lfb 1221x4MB) cpu [0%@1420,off,off,0%@1420,0%@1420,0%@1420] | ||
RAM 1320/7853MB (lfb 1221x4MB) cpu [19%@345,off,off,16%@345,10%@345,9%@345] | RAM 1320/7853MB (lfb 1221x4MB) cpu [19%@345,off,off,16%@345,10%@345,9%@345] | ||
| Line 568: | Line 568: | ||
server: | server: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
CLIENT_IP=<IP_ADDRESS> | CLIENT_IP=<IP_ADDRESS> | ||
gst-launch-1.0 nvcamerasrc fpsRange="30 30" intent=3 ! nvvidconv flip-method=6 \ | gst-launch-1.0 nvcamerasrc fpsRange="30 30" intent=3 ! nvvidconv flip-method=6 \ | ||
| Line 577: | Line 577: | ||
PC client: | PC client: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 udpsrc port=5000 ! application/x-rtp,encoding-name=H264,payload=96 ! rtph264depay ! h264parse ! queue ! avdec_h264 ! xvimagesink sync=false async=false -e | gst-launch-1.0 udpsrc port=5000 ! application/x-rtp,encoding-name=H264,payload=96 ! rtph264depay ! h264parse ! queue ! avdec_h264 ! xvimagesink sync=false async=false -e | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| Line 585: | Line 585: | ||
*Server: | *Server: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
CLIENT_IP=<IP_ADDRESS> | CLIENT_IP=<IP_ADDRESS> | ||
gst-launch-1.0 nvcamerasrc fpsRange="30 30" intent=3 ! nvvidconv flip-method=6 \ | gst-launch-1.0 nvcamerasrc fpsRange="30 30" intent=3 ! nvvidconv flip-method=6 \ | ||
| Line 594: | Line 594: | ||
*Client: | *Client: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
vlc -vv --demux h264 --h264-fps 60 udp://@:5000 | vlc -vv --demux h264 --h264-fps 60 udp://@:5000 | ||
</syntaxhighlight> | </syntaxhighlight> | ||
==== h264 parse missing==== | ==== h264 parse missing==== | ||
In case gstreamer complains when running the pipeline for missing the h264parse plugin, run the following command to install it: | In case gstreamer complains when running the pipeline for missing the h264parse plugin, run the following command to install it: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
sudo apt-get install gstreamer1.0-plugins-bad | sudo apt-get install gstreamer1.0-plugins-bad | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| Line 616: | Line 616: | ||
ARM load: 156% but only videotestsrc consumes 100%. According to the NVIDIA forum when using videotestsrc the system is also doing memory copies to feed the encoder with NVMM memory buffers so that loads more the ARM. | ARM load: 156% but only videotestsrc consumes 100%. According to the NVIDIA forum when using videotestsrc the system is also doing memory copies to feed the encoder with NVMM memory buffers so that loads more the ARM. | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 videotestsrc num-buffers=150 ! 'video/x-raw, format=(string)I420,width=(int)640, height=(int)480' ! omxvp8enc ! qtmux ! filesink location=test.mp4 -e | gst-launch-1.0 videotestsrc num-buffers=150 ! 'video/x-raw, format=(string)I420,width=(int)640, height=(int)480' ! omxvp8enc ! qtmux ! filesink location=test.mp4 -e | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| Line 624: | Line 624: | ||
==== nvcamerasrc ==== | ==== nvcamerasrc ==== | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | ||
| Line 635: | Line 635: | ||
ARM consumption ~50% of one core (4 cores available 400% - this means something like 15.5% of total). However, only the capture is 11.25% so the VP8 consumes '''4.25%''' | ARM consumption ~50% of one core (4 cores available 400% - this means something like 15.5% of total). However, only the capture is 11.25% so the VP8 consumes '''4.25%''' | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
RAM 1442/7853MB (lfb 1134x4MB) cpu [0%@1267,off,off,0%@1267,0%@1267,0%@1267] | RAM 1442/7853MB (lfb 1134x4MB) cpu [0%@1267,off,off,0%@1267,0%@1267,0%@1267] | ||
RAM 1442/7853MB (lfb 1134x4MB) cpu [16%@345,off,off,12%@345,15%@345,14%@345] | RAM 1442/7853MB (lfb 1134x4MB) cpu [16%@345,off,off,12%@345,15%@345,14%@345] | ||
| Line 652: | Line 652: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
1574 root 20 0 9.979g 264008 44716 S 45.7 3.3 14:43.58 nvcamera-daemon | 1574 root 20 0 9.979g 264008 44716 S 45.7 3.3 14:43.58 nvcamera-daemon | ||
13065 nvidia 20 0 719944 14140 9996 S 9.2 0.2 0:09.34 gst-launch-1.0 | 13065 nvidia 20 0 719944 14140 9996 S 9.2 0.2 0:09.34 gst-launch-1.0 | ||
| Line 659: | Line 659: | ||
The encoder exposes the following parameters | The encoder exposes the following parameters | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
bitrate : Target bitrate | bitrate : Target bitrate | ||
flags: readable, writable, changeable in NULL, READY, PAUSED or PLAYING state | flags: readable, writable, changeable in NULL, READY, PAUSED or PLAYING state | ||
| Line 725: | Line 725: | ||
In order to support h265 you need VLC 2.2 in your computer to play the videos | In order to support h265 you need VLC 2.2 in your computer to play the videos | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
sudo add-apt-repository ppa:mc3man/trusty-media | sudo add-apt-repository ppa:mc3man/trusty-media | ||
sudo apt-get update | sudo apt-get update | ||
| Line 735: | Line 735: | ||
ARM load: 156% but only videotestsrc consumes 100%. According to the NVIDIA forum when using videotestsrc the system is also doing memory copies to feed the encoder with NVMM memory buffers so that loads more the ARM. | ARM load: 156% but only videotestsrc consumes 100%. According to the NVIDIA forum when using videotestsrc the system is also doing memory copies to feed the encoder with NVMM memory buffers so that loads more the ARM. | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 videotestsrc num-buffers=150 ! 'video/x-raw, format=(string)I420,width=(int)640, height=(int)480' ! omxh265enc ! filesink location=test.h265 -e | gst-launch-1.0 videotestsrc num-buffers=150 ! 'video/x-raw, format=(string)I420,width=(int)640, height=(int)480' ! omxh265enc ! filesink location=test.h265 -e | ||
</ | </syntaxhighlight> | ||
VLC can play the file correctly at 30fps and reports as codec: MPEG-H Part2/HEVC (H.265)(hevc). The fan on top of the SoC didn't turn on. | VLC can play the file correctly at 30fps and reports as codec: MPEG-H Part2/HEVC (H.265)(hevc). The fan on top of the SoC didn't turn on. | ||
| Line 743: | Line 743: | ||
==== nvcamerasrc ==== | ==== nvcamerasrc ==== | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | ||
nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! omxh265enc ! filesink location=test.h265 -e | nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! omxh265enc ! filesink location=test.h265 -e | ||
| Line 752: | Line 752: | ||
ARM consumption ~55% of one core (4 cores available 400% - this means something like 13% of total). However, only the capture is 11.25% so the h264 consumes '''1.75%''' | ARM consumption ~55% of one core (4 cores available 400% - this means something like 13% of total). However, only the capture is 11.25% so the h264 consumes '''1.75%''' | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
RAM 1487/7853MB (lfb 993x4MB) cpu [0%@1267,off,off,0%@1267,0%@1267,0%@1267] | RAM 1487/7853MB (lfb 993x4MB) cpu [0%@1267,off,off,0%@1267,0%@1267,0%@1267] | ||
RAM 1487/7853MB (lfb 993x4MB) cpu [12%@345,off,off,12%@345,10%@345,14%@345] | RAM 1487/7853MB (lfb 993x4MB) cpu [12%@345,off,off,12%@345,10%@345,14%@345] | ||
| Line 774: | Line 774: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
1574 root 20 0 9.979g 266012 44612 S 47.7 3.3 17:54.85 nvcamera-daemon | 1574 root 20 0 9.979g 266012 44612 S 47.7 3.3 17:54.85 nvcamera-daemon | ||
13273 nvidia 20 0 694396 12920 9156 S 8.6 0.2 0:01.32 gst-launch-1.0 | 13273 nvidia 20 0 694396 12920 9156 S 8.6 0.2 0:01.32 gst-launch-1.0 | ||
| Line 781: | Line 781: | ||
The encoder exposes the following parameters | The encoder exposes the following parameters | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
control-rate : Bitrate control method | control-rate : Bitrate control method | ||
flags: readable, writable, changeable only in NULL or READY state | flags: readable, writable, changeable only in NULL or READY state | ||
| Line 854: | Line 854: | ||
=== Dual H265 encoding === | === Dual H265 encoding === | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | ||
nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! tee name=streams \ | nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! tee name=streams \ | ||
| Line 861: | Line 861: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | gst-launch-1.0 -e nvcamerasrc fpsRange="30.0 30.0" ! 'video/x-raw(memory:NVMM), width=(int)1920, height=(int)1080, format=(string)I420, framerate=(fraction)30/1' ! \ | ||
nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! tee name=streams \ | nvvidconv flip-method=2 ! 'video/x-raw(memory:NVMM), format=(string)I420' ! tee name=streams \ | ||
| Line 870: | Line 870: | ||
ARM consumption ~48.7% of one core (4 cores available 400% - this means something like 13.5% of total). However, only the capture is 11.25% so the dual h265 consumes '''2.25%''' | ARM consumption ~48.7% of one core (4 cores available 400% - this means something like 13.5% of total). However, only the capture is 11.25% so the dual h265 consumes '''2.25%''' | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
RAM 1503/7853MB (lfb 965x4MB) cpu [0%@1420,off,off,0%@1420,0%@1420,0%@1420] | RAM 1503/7853MB (lfb 965x4MB) cpu [0%@1420,off,off,0%@1420,0%@1420,0%@1420] | ||
RAM 1503/7853MB (lfb 965x4MB) cpu [19%@345,off,off,10%@345,13%@345,16%@345] | RAM 1503/7853MB (lfb 965x4MB) cpu [19%@345,off,off,10%@345,13%@345,16%@345] | ||
| Line 893: | Line 893: | ||
Currently it is not possible to receive the stream using the PC because there is not a h265 decoder available on gstreamer. In order to evaluate the performance let's receive the stream on the Jetson module as well. | Currently it is not possible to receive the stream using the PC because there is not a h265 decoder available on gstreamer. In order to evaluate the performance let's receive the stream on the Jetson module as well. | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
export PKG_CONFIG_PATH=/home/$USER/gst_$VERSION/out/lib/pkgconfig | export PKG_CONFIG_PATH=/home/$USER/gst_$VERSION/out/lib/pkgconfig | ||
VERSION=1.8.0 | VERSION=1.8.0 | ||
| Line 900: | Line 900: | ||
server: | server: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
CLIENT_IP=<IP_ADDRESS> | CLIENT_IP=<IP_ADDRESS> | ||
gst-launch-1.0 nvcamerasrc fpsRange="30 30" intent=3 ! nvvidconv flip-method=6 \ | gst-launch-1.0 nvcamerasrc fpsRange="30 30" intent=3 ! nvvidconv flip-method=6 \ | ||
| Line 909: | Line 909: | ||
client: | client: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
gst-launch-1.0 udpsrc port=5000 ! application/x-rtp,encoding-name=H265,payload=96 ! rtph265depay \ | gst-launch-1.0 udpsrc port=5000 ! application/x-rtp,encoding-name=H265,payload=96 ! rtph265depay \ | ||
! h265parse ! queue ! omxh265dec ! nvoverlaysink sync=false async=false -e | ! h265parse ! queue ! omxh265dec ! nvoverlaysink sync=false async=false -e | ||
| Line 925: | Line 925: | ||
This is an application based on gstreamer and omx to capture, encode and save video to the filesystem. It has a lot of options. The source code is not released by NVIDIA yet but they are planning to release in future versions of Linux 4 Tegra (L4T), you can read about it at [https://devtalk.nvidia.com/default/topic/898129/jetson-tx1/enabling-camera-on-jetson-tx1-board/ Nvidia Embedded Computing Forum] | This is an application based on gstreamer and omx to capture, encode and save video to the filesystem. It has a lot of options. The source code is not released by NVIDIA yet but they are planning to release in future versions of Linux 4 Tegra (L4T), you can read about it at [https://devtalk.nvidia.com/default/topic/898129/jetson-tx1/enabling-camera-on-jetson-tx1-board/ Nvidia Embedded Computing Forum] | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
nvidia@tegra-ubuntu:~$ nvgstcapture-1.0 --help | nvidia@tegra-ubuntu:~$ nvgstcapture-1.0 --help | ||
Encoder null, cannot set bitrate! | Encoder null, cannot set bitrate! | ||
| Line 1,274: | Line 1,274: | ||
Sometimes when the board has been just flashed you need to run reboot in order to run nvgstcapture-1.0 successfully. To take snapshots: | Sometimes when the board has been just flashed you need to run reboot in order to run nvgstcapture-1.0 successfully. To take snapshots: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
nvgstcapture-1.0 | nvgstcapture-1.0 | ||
#then press j to take an snapshot | #then press j to take an snapshot | ||
| Line 1,281: | Line 1,281: | ||
Resolutions available to create snapshot: | Resolutions available to create snapshot: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
(2) : 640x480 | (2) : 640x480 | ||
(3) : 1280x720 | (3) : 1280x720 | ||
| Line 1,296: | Line 1,296: | ||
</syntaxhighlight> | </syntaxhighlight> | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
nvgstcapture-1.0 -m 1 --image-res=10 #set 1 to snapshot mode | nvgstcapture-1.0 -m 1 --image-res=10 #set 1 to snapshot mode | ||
</syntaxhighlight> | </syntaxhighlight> | ||
| Line 1,304: | Line 1,304: | ||
=== Capture and record video === | === Capture and record video === | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
nvgstcapture-1.0 -m 2 # set the mode in video | nvgstcapture-1.0 -m 2 # set the mode in video | ||
1 # start video recording | 1 # start video recording | ||
| Line 1,312: | Line 1,312: | ||
In case of video it should support: | In case of video it should support: | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
(2) : 640x480 | (2) : 640x480 | ||
(3) : 1280x720 | (3) : 1280x720 | ||
| Line 1,325: | Line 1,325: | ||
However, it is not possible to set other value than 2,3,4,5 up to 9. | However, it is not possible to set other value than 2,3,4,5 up to 9. | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
nvgstcapture-1.0 -m 2 --video-res=5 | nvgstcapture-1.0 -m 2 --video-res=5 | ||
</syntaxhighlight> | </syntaxhighlight> | ||
'''top''' | '''top''' | ||
<syntaxhighlight lang= | <syntaxhighlight lang="bash"> | ||
top - 22:15:09 up 2:30, 4 users, load average: 0.47, 0.45, 0.30 | top - 22:15:09 up 2:30, 4 users, load average: 0.47, 0.45, 0.30 | ||