Real-ESRGAN-x4plus Example

This document explains how to use the QAI AppBuilder Python API to perform inference with the Real-ESRGAN-x4plus image super-resolution model using the Qualcomm® Hexagon™ Processor (NPU).

Supported Devices

Device	SoC
Dragon Q6A	QCS6490
Dragon Q8B	SC8280XP
Fogwise® AIRbox Q900	QCS9075

Install QAI AppBuilder

tip

1. Please install QAI AppBuilder according to the QAI AppBuilder Installation Guide.

2. Please configure the ADSP environment variables according to Configuring ADSP Environment Variables.

Run Example

Install Dependencies

Device

pip3 install requests tqdm qai-hub py3_wget opencv-python torch torchvision

Run the Script

• Navigate to the example directory

QCS6490

Device

cd ai-engine-direct-helper/samples/linux/python

SC8280XP

Device

cd ai-engine-direct-helper/samples/linux/python

QCS9075

Device

cd ai-engine-direct-helper/samples/python

• Prepare the input image. The following image is used as an example:

  

  Input image

• Execute inference

  Device

  python3 real_esrgan_x4plus/real_esrgan_x4plus.py

  $ python3 real_esrgan_x4plus/real_esrgan_x4plus.py
       0.0ms [WARNING]  <W> Initializing HtpProvider
  
  /prj/qct/webtech_scratch20/mlg_user_admin/qaisw_source_repo/rel/qairt-2.37.1/point_release/SNPE_SRC/avante-tools/prebuilt/dsp/hexagon-sdk-5.5.5/ipc/fastrpc/rpcmem/src/rpcmem_android.c:38:dummy call to rpcmem_init, rpcmem APIs will be used from libxdsprpc
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
     152.5ms [WARNING] Time: Read model file to memory. 44.96
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
     631.4ms [WARNING] Time: contextCreateFromBinary. 478.81
  
     631.4ms [WARNING] Time: UnmapViewOfFile. 0.00
  
     633.3ms [WARNING] Time: model_initialize realesrgan 633.22
  
    2532.0ms [WARNING] Time: model_inference realesrgan 1851.89
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
  /usr/bin/xdg-open: 882: www-browser: not found
  /usr/bin/xdg-open: 882: links2: not found
  /usr/bin/xdg-open: 882: elinks: not found
  /usr/bin/xdg-open: 882: links: not found
  /usr/bin/xdg-open: 882: lynx: not found
  /usr/bin/xdg-open: 882: w3m: not found
  xdg-open: no method available for opening '/tmp/tmpczsph22w.PNG'
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
  /prj/qct/webtech_scratch20/mlg_user_admin/qaisw_source_repo/rel/qairt-2.37.1/point_release/SNPE_SRC/avante-tools/prebuilt/dsp/hexagon-sdk-5.5.5/ipc/fastrpc/rpcmem/src/rpcmem_android.c:42:dummy call to rpcmem_deinit, rpcmem APIs will be used from libxdsprpc
    8196.8ms [WARNING] Time: model_destroy realesrgan 164.68

  

  Output image