Tritonserver support for NVIDIA Jetson Platforms: Difference between revisions

Tritonserver support for NVIDIA Jetson Platforms (view source)

1,058 bytes added , 26 November 2021

m

212

edits

@@ Line 76: / Line 76: @@
 === Steps to use Triton client ===
+. Install all dependencies
+<syntaxhighlight lang=bash>
+apt-get install -y --no-install-recommends \
+        curl \
+        pkg-config \
+        python3 \
+        python3-pip \
+        python3-dev
+pip3 install --upgrade wheel setuptools cython && \
+pip3 install --upgrade grpcio-tools numpy==1.19.4 future attrdict
+</syntaxhighlight>
+. Install the python package
+The python package is located inside the downloaded and uncompressed release.
+You can install it by using:
+<syntaxhighlight lang=bash>
+python3 -m pip install --upgrade  clients/python/tritonclient-2.16.0-py3-none-any.whl[all]
+</syntaxhighlight>
+. Using one of the examples
+There are some python examples located in here: https://github.com/triton-inference-server/client/tree/main/src/python/examples
+These examples are included inside the downloaded release too.
+You can run for example:
+<syntaxhighlight lang=bash>
+python3 ./examples/image_client.py -m densenet_onnx -c 3 -s VGG /home/nvidia/client/src/python/cistus1.jpg --url localhost:8000 --protocol HTTP
+</syntaxhighlight>
 == Yocto support ==