XLSR Example

This document describes using the QAI AppBuilder Python API to perform inference with the XLSR image super-resolution model using Qualcomm® Hexagon™ Processor (NPU).

Supported Devices

Device	SoC
Dragon Q6A	QCS6490
Dragon Q8B	SC8280XP

Install QAI AppBuilder

tip

1. Please install QAI AppBuilder according to QAI AppBuilder Installation Guide.

2. Please configure ADSP environment variables according to Create ADSP Environment Variables.

Run Example

Install Dependencies

Device

pip3 install requests tqdm qai-hub py3_wget opencv-python torch torchvision matplotlib easyocr qai_hub_models transformers openai-clip

Run Script

• Navigate to the example directory

  QCS6490

  Device

  cd ai-engine-direct-helper/samples/linux/python

  SC8280XP

  Device

  cd ai-engine-direct-helper/samples/linux/python

• Prepare input image, using the following image as input example

  

  input image

• Execute inference

  Device

  python3 xlsr/xlsr.py

    $ python3 xlsr/xlsr.py
    Current file directory: /mnt/ssd/qualcomm/701/zzf_fork/ai-engine-direct-helper/samples/linux/python/xlsr
         0.0ms [WARNING]  <W> Initializing HtpProvider
  
    /prj/qct/webtech_scratch20/mlg_user_admin/qaisw_source_repo/rel/qairt-2.37.1/point_release/SNPE_SRC/avante-tools/prebuilt/dsp/hexagon-sdk-5.4.0/ipc/fastrpc/rpcmem/src/rpcmem_android.c:38:dummy call to rpcmem_init, rpcmem APIs will be used from libxdsprpc
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       113.4ms [WARNING] Time: Read model file to memory. 0.41
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
       121.2ms [WARNING] Time: contextCreateFromBinary. 7.83
  
       121.3ms [WARNING] Time: UnmapViewOfFile. 0.00
  
       121.5ms [WARNING] Time: model_initialize xlsr 121.46
  
       164.3ms [WARNING] Time: model_inference xlsr 7.48
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
         0.0ms [WARNING]  <W> This META does not have Alloc2 Support
  
    /prj/qct/webtech_scratch20/mlg_user_admin/qaisw_source_repo/rel/qairt-2.37.1/point_release/SNPE_SRC/avante-tools/prebuilt/dsp/hexagon-sdk-5.4.0/ipc/fastrpc/rpcmem/src/rpcmem_android.c:42:dummy call to rpcmem_deinit, rpcmem APIs will be used from libxdsprpc
       300.2ms [WARNING] Time: model_destroy xlsr 6.65
  
    /usr/bin/xdg-open: 882: www-browser: not found
    /usr/bin/xdg-open: 882: links2: not found
    /usr/bin/xdg-open: 882: elinks: not found
    /usr/bin/xdg-open: 882: links: not found
    /usr/bin/xdg-open: 882: lynx: not found
    /usr/bin/xdg-open: 882: w3m: not found
    xdg-open: no method available for opening '/tmp/tmp5i2_qhdq.PNG'

  

  output image