GstInference/Benchmarks: Difference between revisions
No edit summary |
|||
Line 147: | Line 147: | ||
== TensorFlow Lite Benchmarks == | == TensorFlow Lite Benchmarks == | ||
<html> | |||
<script type="text/javascript" src="https://www.gstatic.com/charts/loader.js"></script> | |||
<br><br> | |||
<div id="chart_div" style="width: 800px; height: 500px;"></div> | |||
<script> | |||
google.charts.load('current', {'packages':['corechart', 'bar']}); | |||
google.charts.setOnLoadCallback(drawStuff); | |||
function drawStuff() { | |||
var button = document.getElementById('change-chart'); | |||
var chartDiv = document.getElementById('chart_div'); | |||
var data = google.visualization.arrayToDataTable([ | |||
['Model', 'FPS', 'CPU'], | |||
['InceptionV1', 21, 50], | |||
['InceptionV2', 16, 45], | |||
['InceptionV3', 6, 32], | |||
['InceptionV4', 3, 15], | |||
['TinyyoloV2', 9, 49], | |||
['TinyyoloV2', 10, 58] | |||
]); | |||
var materialOptions = { | |||
width: 900, | |||
chart: { | |||
title: 'Model performance', | |||
subtitle: 'distance on the left, brightness on the right' | |||
}, | |||
series: { | |||
0: { axis: 'distance' }, // Bind series 0 to an axis named 'distance'. | |||
1: { axis: 'brightness' } // Bind series 1 to an axis named 'brightness'. | |||
}, | |||
axes: { | |||
y: { | |||
distance: {label: 'parsecs'}, // Left y-axis. | |||
brightness: {side: 'right', label: 'apparent magnitude'} // Right y-axis. | |||
} | |||
} | |||
}; | |||
function drawMaterialChart() { | |||
var materialChart = new google.charts.Bar(chartDiv); | |||
materialChart.draw(data, google.charts.Bar.convertOptions(materialOptions)); | |||
} | |||
function drawClassicChart() { | |||
var classicChart = new google.visualization.ColumnChart(chartDiv); | |||
classicChart.draw(data, classicOptions); | |||
} | |||
drawMaterialChart(); | |||
}; | |||
</script> | |||
</html> | |||
<noinclude> | <noinclude> | ||
{{GstInference/Foot|Example Applications/DispTec|Model Zoo}} | {{GstInference/Foot|Example Applications/DispTec|Model Zoo}} | ||
</noinclude> | </noinclude> |
Revision as of 20:27, 16 March 2020
Make sure you also check GstInference's companion project: R2Inference |
GstInference |
---|
Introduction |
Getting started |
Supported architectures |
InceptionV1 InceptionV3 YoloV2 AlexNet |
Supported backends |
Caffe |
Metadata and Signals |
Overlay Elements |
Utils Elements |
Legacy pipelines |
Example pipelines |
Example applications |
Benchmarks |
Model Zoo |
Project Status |
Contact Us |
|
GstInference Benchmarks
The following benchmarks were run with a source video (1920x1080@60). With the following base GStreamer pipeline, and environment variables:
$ VIDEO_FILE='video.mp4' $ MODEL_LOCATION='graph_inceptionv1_tensorflow.pb' $ INPUT_LAYER='input' $ OUTPUT_LAYER='InceptionV1/Logits/Predictions/Reshape_1'
The environment variables were changed accordingly with the used model (Inception V1,V2,V3 or V4)
GST_DEBUG=inception1:1 gst-launch-1.0 filesrc location=$VIDEO_FILE ! decodebin ! videoconvert ! videoscale ! queue ! net.sink_model inceptionv1 name=net model-location=$MODEL_LOCATION backend=tensorflow backend::input-layer=$INPUT_LAYER backend::output-layer=$OUTPUT_LAYER net.src_model ! perf ! fakesink -v
The Desktop PC had the following specifications:
- Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz
- 8 GB RAM
- Cedar [Radeon HD 5000/6000/7350/8350 Series]
- Linux 4.15.0-54-generic x86_64 (Ubuntu 16.04)
The Jetson Xavier power modes used were 2 and 6 (more information: Supported Modes and Power Efficiency )
- View current power mode:
$ sudo /usr/sbin/nvpmodel -q
- Change current power mode:
sudo /usr/sbin/nvpmodel -m x
Where x is the power mode ID (e.g. 0, 1, 2, 3, 4, 5, 6).
Summary
Desktop PC | CPU Library | |
---|---|---|
Model | Framerate | CPU Usage |
Inception V1 | 11.89 | 48 |
Inception V2 | 10.33 | 65 |
Inception V3 | 5.41 | 90 |
Inception V4 | 3.81 | 94 |
Jetson Xavier (15W) | CPU Library | GPU Library | ||
---|---|---|---|---|
Model | Framerate | CPU Usage | Framerate | CPU Usage |
Inception V1 | 8.24 | 86 | 52.3 | 43 |
Inception V2 | 6.58 | 88 | 39.6 | 42 |
Inception V3 | 2.54 | 92 | 17.8 | 25 |
Inception V4 | 1.22 | 94 | 9.4 | 20 |
Jetson Xavier (30W) | CPU Library | GPU Library | ||
---|---|---|---|---|
Model | Framerate | CPU Usage | Framerate | CPU Usage |
Inception V1 | 6.41 | 93 | 66.27 | 72 |
Inception V2 | 5.11 | 95 | 50.59 | 62 |
Inception V3 | 1.96 | 98 | 22.95 | 44 |
Inception V4 | 0.98 | 99 | 12.14 | 32 |
Framerate
CPU Usage
TensorFlow Lite Benchmarks