GstInference and ONNXRT ACL backend

GstInference
Introduction
Getting started
Getting the code Building the plugin Quick Starting Guide
Supported architectures
InceptionV1 InceptionV2 InceptionV3 InceptionV4 TinyYoloV2 TinyYoloV3 YoloV2 ResNetV1 MobileNetV2 MobileNetV2 + SSD AlexNet
Supported backends
TensorFlow Tensorflow-Lite Coral from Google Caffe TensorRT ONNXRT ONNXRT ACL ONNXRT OpenVINO
Metadata and Signals
GstClassificationMeta GstEmbeddingMeta GstDetectionMeta GstInferenceMeta Signals
Overlay Elements
Inference Overlay
Utils Elements
InferenceFilter InferenceCrop InferenceDebug InferenceBin
Legacy pipelines
PC NANO TX2 Xavier IMX8
Example pipelines
Example applications
Classification Detection Hand Pose Recognition
Benchmarks
Model Zoo
Project Status
Releases Roadmap
Contact Us

The ONNXRT ACL backend is an extension of the ONNXRT backend. It is based on the ACL Execution Provider available in ONNX Runtime. ACL stands for Arm Compute Library, which is an extensive library for optimized functions for the Arm Cortex-A family of CPU processors and the Arm Mali family of GPUs. The library allows accelerating common computer vision and machine learning operations through technologies like Arm Neon and OpenCL.

Installation

GstInference depends on the C++ API of ONNX Runtime. For installation steps, follow the steps in R2Inference/Building the library section.

Enabling the backend

To use the ONNXRT ACL backend on GstInference be sure to run the R2Inference configure with the flags -Denable-onnxrt=true and -Denable-onnxrt-acl=true . Then, use the property backend=onnxrt_acl on the GstInference plugins. Please refer to this wiki page for more information.

Properties

This backend is an extension of the base ONNXRT backend, therefore the available properties are inherited from the base class. Check the ONNXRT ACL API Reference page for further information.