Introduction to Neural Processing Unit in NXP i.MX8M Plus

From RidgeRun Developer Wiki





Previous: _Neural Processing Unit Index Next: Neural Processing Unit/Profiling the NPU




The NPU or Neural Processing Unit is a hardware module present in the i.MX8M Plus. This accelerator is dedicated to executing AI algorithms and inferences with pre-trained models. In order to measure the performance of the NPU in a certain application, we are going to use a Smart Parking application as our 'use case'.

Profiling the NPU

Installing gputop

Setting the board on debug mode

Use Case experiments: Smart Parking

Introduction to the use case

License Plate Detection

License Plate Recognition

Bash scripts for CPU usage_and time_estimation

Serial experiments

Parallel experiments

Results

Previous: _Neural Processing Unit Index Next: Neural Processing Unit/Profiling the NPU