I'm trying to run an initial model using the documentation provided in the QNN sdk. The model runs successfully on CPU HTP on android phone and CPU on Snapdragon 8295. On android Snapdragon 8295 HTP,, but the output directory is empty and has no .raw file.
this is the logcat.
command:
./qnn-net-run --backend libQnnHtp.so --input_list target_raw_list.txt --retrieve_context Inception_v3_quantized.serialized.bin
output:
2000-01-01 00:18:31.046 14252-14252 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/rpcmem_android.c:159: rpcmem_init_internal: opened ION device fd 4, configured heap IDs: system (0x2000000), contig (0x10), secure (0x400), secure flags (0x80080000)
2000-01-01 00:18:31.046 14252-14252 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:3087: fastrpc_apps_user_init done with default domain:3 and &fastrpc_trace:0x75f8df20b4
2000-01-01 00:18:31.046 14252-14252 qnn-net-run pid-14252 D /prj/qct/webtech_hyd1/mlg_user_admin/projects/qnn_tools/QNNTools/Toolchain/Hexagon/hexagon-sdk-4.2.0/ipc/fastrpc/rpcmem/src/rpcmem_android.c:38:dummy call to rpcmem_init, rpcmem APIs will be used from libxdsprpc
2000-01-01 00:18:31.047 14252-14252 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:2039: remote_session_control DSP info request for domain 3, thread priority -1, stack size 17408
2000-01-01 00:18:31.047 14252-14252 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/fastrpc_config.c:200: Reading configuration file: qnn-net-run.debugconfig
2000-01-01 00:18:31.066 14252-14252 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:2843: Created user PD on domain 3 (attrs 0x8, debug_trace 0x0)
2000-01-01 00:18:31.067 14252-14253 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:484: Successfully set remote user thread priority to 192 and stack size to 17408 for domain 3
2000-01-01 00:18:31.067 14252-14253 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/listener_android.c:111: listener thread starting
2000-01-01 00:18:31.068 14252-14252 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/fastrpc_perf.c:273: fastrpc_perf_init: enabled systrace 0x0 and RPC traces (kernel 0, dsp 0) with frequency 1000
2000-01-01 00:18:31.068 14252-14254 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/log_config.c:345: file_watcher_thread starting for domain 3
2000-01-01 00:18:31.068 14252-14254 qnn-net-run pid-14252 E vendor/qcom/proprietary/adsprpc/src/log_config.c:268:Error 0x200: fopen failed for /data/local/tmp/inception_v3/qnn-net-run.farf. (No such file or directory)
2000-01-01 00:18:31.069 14252-14254 qnn-net-run pid-14252 E vendor/qcom/proprietary/adsprpc/src/log_config.c:268:Error 0x200: fopen failed for /vendor/lib/rfsa/adsp/qnn-net-run.farf. (No such file or directory)
2000-01-01 00:18:31.069 14252-14254 qnn-net-run pid-14252 E vendor/qcom/proprietary/adsprpc/src/log_config.c:268:Error 0x200: fopen failed for /vendor/dsp/qnn-net-run.farf. (No such file or directory)
2000-01-01 00:18:31.071 14252-14253 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/mod_table.c:687: open_mod_table_open_from_static: reverse module apps_std opened with handle 0xf8df47e0 (idx 0)
2000-01-01 00:18:31.071 14252-14253 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/apps_std_imp.c:879: Successfully opened file /data/local/tmp/inception_v3/libQnnHtpV68Skel.so
2000-01-01 00:18:31.072 14252-14253 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/mod_table.c:687: open_mod_table_open_from_static: reverse module apps_mem opened with handle 0xf8df48e0 (idx 1)
2000-01-01 00:18:31.113 14252-14253 qnn-net-run pid-14252 W vendor/qcom/proprietary/adsprpc/src/apps_std_imp.c:892: Warning: apps_std_fopen_with_env failed with 0x2 for libc++.so.1 (No such file or directory)
2000-01-01 00:18:31.123 14252-14252 qnn-net-run pid-14252 E vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:1325: Error 0x80000406: remote_handle_open_domain: dynamic loading failed for file:///libQnnHtpV68Skel.so?qnn_skel_handle_invoke&_modver=1.0&_dom=cdsp on domain 3 (dlerror _rtld_map_object_ex: cannot open libc++.so.1, errno 2 (no such file or directory)) (errno
2000-01-01 00:18:31.123 14252-14252 qnn-net-run pid-14252 E vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:1398: Error 0x80000406: remote_handle64_open failed for file:///libQnnHtpV68Skel.so?qnn_skel_handle_invoke&_modver=1.0&_dom=cdsp (errno Success)
2000-01-01 00:18:31.124 14252-14253 qnn-net-run pid-14252 E vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:1200: Error 0x4e: remote_handle_invoke failed for handle 0x3, method 4 on domain 3 (sc 0x4020200) (errno Operation not permitted)
2000-01-01 00:18:31.124 14252-14253 qnn-net-run pid-14252 E vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:1200: Error 0x4e: remote_handle_invoke failed for handle 0x3, method 4 on domain 3 (sc 0x4020200) (errno Operation not permitted)
2000-01-01 00:18:31.125 14252-14253 qnn-net-run pid-14252 E vendor/qcom/proprietary/adsprpc/src/listener_android.c:221:Error 0x4e: listener response with result 0x0 for ctx 0x116b, handle 0xf8df48e0, sc 0xffffffff failed : listener thread exited (errno Operation not permitted)
2000-01-01 00:18:31.126 14252-14253 qnn-net-run pid-14252 E vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:1222: Error 0x4e: remote_handle64_invoke failed for handle 0xabf58b10, method 3 on domain 3 (sc 0x3000000) (errno Operation not permitted)
2000-01-01 00:18:31.126 14252-14254 qnn-net-run pid-14252 W vendor/qcom/proprietary/adsprpc/src/log_config.c:361:Warning: file_watcher_thread received exit for domain 3, file qnn-net-run.farf
2000-01-01 00:18:31.126 14252-14254 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/log_config.c:408: file_watcher_thread exiting for domain 3
2000-01-01 00:18:31.129 14252-14252 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/mod_table.c:772: open_mod_table_close: closed reverse module apps_mem with handle 0xf8df48e0
2000-01-01 00:18:31.129 14252-14252 qnn-net-run pid-14252 E vendor/qcom/proprietary/adsprpc/src/listener_android.c:64::error: 512: AEE_SUCCESS == (nErr = mod_table_close(handle, errStr, errStrLen, dlErr))
2000-01-01 00:18:31.129 14252-14252 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/mod_table.c:772: open_mod_table_close: closed reverse module apps_std with handle 0xf8df47e0
2000-01-01 00:18:31.129 14252-14252 qnn-net-run pid-14252 E vendor/qcom/proprietary/adsprpc/src/listener_android.c:64::error: 512: AEE_SUCCESS == (nErr = mod_table_close(handle, errStr, errStrLen, dlErr))
2000-01-01 00:18:31.131 14252-14252 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/rpcmem_android.c:192: rpcmem_deinit_internal: closed ION fd 4
2000-01-01 00:18:31.131 14252-14252 qnn-net-run pid-14252 I vendor/qcom/proprietary/adsprpc/src/fastrpc_apps_user.c:3019: fastrpc_apps_user_deinit done
Thank you!
For Auto QNN, suggest raising case to Qualcomm CE team.
You can use --log_level verbose in qnn-net-run and check logcat logs to see if any clues.
One possible is related with QNN SDK version, even QNN API is same b/w different platform, but different QNN SDK may support different soc_id. I suspect the issue may related with this.
8295 is Auto platform, we have dedicated QNN_SDK for 8295 like fp16 supported, you can download it from chipcode if have account.
Dear developer,
Which version of QNN sdk are you using? Can you upload the log where you encountered the problem?
BR.
Mengwei
I have already uploaded the log, could you provide me some help?
Thank you!