NVIDIA GPU Acceleration

Scout Agent performance can also be drastically accelerated by NVIDIA GPU hardware. Rekor maintains binaries for CUDA 11.0 using CuDNN 8 on 64-bit Ubuntu Linux 20.04. On Ubuntu 18.04 the software runs on CUDA 10.0 using CuDNN 7. The Scout software ha

Ubuntu 18.04

First, set up the NVIDIA repositories:

 
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/cuda-repo-ubuntu1804_10.0.130-1_amd64.deb -O /tmp/cuda-repo-ubuntu1804_10.0.130-1_amd64.deb
sudo apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/7fa2af80.pub
sudo dpkg -i /tmp/cuda-repo-ubuntu1804_10.0.130-1_amd64.deb

If you have not already installed NVIDIA drivers, you must do this first:

 
sudo apt-get update
sudo apt-get install -y nvidia-driver-410
sudo reboot

Now you may install the Scout GPU acceleration package. Select install_nvidia from the menu:

 
bash <(curl https://deb.openalpr.com/install)

Ubuntu 20.04

First, install the NVIDIA GPU drivers via the official NVIDIA repository:

 
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/cuda-ubuntu2004.pin
sudo mv cuda-ubuntu2004.pin /etc/apt/preferences.d/cuda-repository-pin-600
sudo apt-key adv --fetch-keys https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/7fa2af80.pub
sudo add-apt-repository "deb https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2004/x86_64/ /"
sudo apt-get update
sudo apt-get -y install cuda-11-0

After installation, you will likely need to reboot. Make sure that the drivers are installed using the following command:

 
nvidia-smi

Next, install the Scout NVIDIA acceleration package. Select install_nvidia from the menu:

 
bash <(curl https://deb.openalpr.com/install)

The following properties will be set automatically in /etc/openalpr/openalpr.conf:

 
hardware_acceleration = 1
gpu_id = 0
gpu_batch_size = 5

The batch size controls how many images are simultaneously processed by the GPU. The default value is usually the best balance of performance and GPU memory usage.

Rekor also maintains special builds for Jetson TX-1/TX-2 hardware on Jetpack v3.1. To install, follow the standard Linux install instructions. The defaults are configured such that the GPU will automatically be installed, enabled, and configured with a default batch size of 5.

Windows 10

Prerequisites:

  1. Windows 10 64-bit

  2. NVIDIA GPU driver >= 417.22

Install:

  1. Install the latest version of the Scout Agent or SDK

  2. Install https://deb.openalpr.com/windows-nvidia/vc_redist_msvc2015.x64.exe

  3. Download and extract the following file to the agent bin directory (default C:\OpenALPR\Agent\bin) or SDK directory: https://deb.openalpr.com/windows-nvidia/openalpr_nvidiawindowslibs_4.1.2.zip

If running the agent, edit the Scout Agent config file c:\openalpr\agent\etc\openalpr\alprd.conf and add the following line:

 
hardware_acceleration = 1

Restart the Scout Agent service.

 

Last updated August 25, 2022