Skip to main content

QAI AppBuilder

Quick AI Application Builder (QAI AppBuilder) helps developers easily deploy AI models and design AI applications on Qualcomm® SoC platforms with Qualcomm® Hexagon™ Processor (NPU) using the Qualcomm® AI Runtime SDK.

It encapsulates model deployment APIs into a set of simplified interfaces for loading models onto the NPU and performing inference. QAI AppBuilder significantly reduces the complexity of model deployment for developers and provides multiple demos as references for designing custom AI applications.

Supports Python API / C++ API

QAI-APPBUILDER Architecture

Installation Method​

Clone the Repository​

Device
git clone https://github.com/quic/ai-engine-direct-helper.git --recursive

Download QAIRT SDK​

tip

Please download and extract the QAIRT SDK according to the Download QAIRT SDK Package instructions

Configure QAIRT Environment Variables​

Device
cd qairt/2.37.1.250807
source bin/envsetup.sh
export ADSP_LIBRARY_PATH=$QNN_SDK_ROOT/lib/hexagon-v68/unsigned
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:$QNN_SDK_ROOT/lib/aarch64-ubuntu-gcc9.4:$QNN_SDK_ROOT/lib/aarch64-oe-linux-gcc11.2

Build qai_appbuilder​

Create Virtual Environment​

tip

Create a virtual environment for Python library installation to maintain environment isolation

Device
sudo apt install python3-venv
python3 -m venv .venv
source .venv/bin/activate

Build qai_appbuilder Wheel​

Device
pip3 install setuptools
python3 setup.py bdist_wheel

After successful compilation, a qai_appbuilder-2.34.0-cp312-cp312-linux_aarch64.whl file will be generated in the dist directory.

Install qai_appbuilder​

Install qai_appbuilder Wheel​

Device
cd dist
pip3 install ./qai_appbuilder-2.34.0-cp312-cp312-linux_aarch64.whl

Application Examples​