Hello,
I have been following the tutorial in https://developer.qualcomm.com/docs/snpe/tutorial_inceptionv3.html to run the inceptionv3 model on a Qualcomm Robotics RB5 Platform. I followed each step, only modifying the target architecture to export SNPE_TARGET_ARCH=aarch64-linux-gcc4.9, and everything (including inference on the CPU and DSP) seems to work until, in the Running on Android using AIP Runtime section, I try to run inference on the target with
snpe-net-run --container inception_v3_quantized.dlc --input_list target_raw_list.txt --use_aip
at which point I get
Error: failed to deserialize graph due to version mismatch, current compiler graph version [103] < input graph version [104]
Fail to serialize the blob: ret=2
get_graph error
* NPU_Stats: npu_compile_get_objs(): 0.44 ms npu_handle_blob_v2: Error: -1000
* NPU_Stats: npu_load_network(): 31.21 ms error_code=1410; error_message=AIP runtime system error. error_code=1410; error_message=AIP runtime system error.
Failed to load network. Error code: -1000.; error_component=AIP Runtime; line_no=783; thread_id=548265287920; error_component=AIP Runtime; line_no=263; thread_id=548427051024
The full log output is as follows:
adb shell
sh-4.4# export SNPE_TARGET_ARCH=aarch64-linux-gcc4.9 sh-4.4# export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/data/local/tmp/snpeexample/$SNPE_TARGET_ARCH/lib
sh-4.4# export PATH=$PATH:/data/local/tmp/snpeexample/$SNPE_TARGET_ARCH/bin
sh-4.4# export ADSP_LIBRARY_PATH="/data/local/tmp/snpeexample/dsp/lib;/system/lib/rfsa/adsp;/system/vendor/lib/rfsa/adsp;/dsp"
sh-4.4# cd /data/local/tmp/inception_v3
sh-4.4# snpe-net-run --container inception_v3_quantized.dlc --input_list target_raw_list.txt --use_aip
npu_get_property status: 0
npu_get_property status: 0
FW CAPS [0] = 0x2007
FW CAPS [1] = 0x1
FW CAPS [2] = 0x0
FW CAPS [3] = 0x0
FW CAPS [4] = 0x0
FW CAPS [5] = 0x0
FW CAPS [6] = 0x0
FW CAPS [7] = 0x0
npu_get_property status: 0
NPU User Driver: npu_read_info 0
npu_get_property status: 0
npu_get_property status: 0
FW CAPS [0] = 0x2007
FW CAPS [1] = 0x1
FW CAPS [2] = 0x0
FW CAPS [3] = 0x0
FW CAPS [4] = 0x0
FW CAPS [5] = 0x0
FW CAPS [6] = 0x0
FW CAPS [7] = 0x0
npu_get_property status: 0
NPU driver built on: Oct 28 2020 10:53:34
npu_get_property status: 0
npu_get_property status: 0
FW CAPS [0] = 0x2007
FW CAPS [1] = 0x1
FW CAPS [2] = 0x0
FW CAPS [3] = 0x0
FW CAPS [4] = 0x0
FW CAPS [5] = 0x0
FW CAPS [6] = 0x0
FW CAPS [7] = 0x0
npu_get_property status: 0
Error: failed to deserialize graph due to version mismatch, current compiler graph version [103] < input graph version [104]
Fail to serialize the blob: ret=2
get_graph error
* NPU_Stats: npu_compile_get_objs(): 0.44 ms
npu_handle_blob_v2: Error: -1000
* NPU_Stats: npu_load_network(): 31.21 ms
error_code=1410; error_message=AIP runtime system error. error_code=1410; error_message=AIP runtime system error. Failed to load network. Error code: -1000.; error_component=AIP Runtime; line_no=783; thread_id=548265287920; error_component=AIP Runtime; line_no=263; thread_id=548427051024
What could I do to resolve this and be able to run inference on the RB5 platform?
Any ideas will be welcome. Thank you in advance.
Same issue here. Did you ever find a fix?
Unfortunately I haven't yet found a solution. Have you made any progress on your side?
Usually you will see errors like these:
When you have a model converted to DLC with SNPE version X and want to run this model on target.
The libraries that you sideload/push to target should be at least version X or greater.
Qualcomm Robotics RB5 and QCS610 are shipping with SNPE libraries (v1.40.0) preinstalled (within /usr/lib and /usr/bin).
This will cause unintended issues like the one above.
If its possible, please update the SNPE version on the target and see if it works.