Hi,
I had tried to run a model using snpe-net-run which has an unsupported layer on DSP ,but supported on CPU.
SNPE doc quotes "setCPUFallbackMode(): When the CPU fallback functionality is enabled, layers in model that violates runtime constraints will run on CPU while the rest of non-violating layers will run on the chosen runtime processor"
Assuming the same for enable_cpu_fallback option in snpe-net-run ,
1. Is it is expected to run unsupported layer on CPU and rest layers on DSP?The following command is used :
./snpe-net-run_1.51 --container dlc/xyz.dlc --input_list data/raw_list.txt --set_unconsumed_as_output --use_dsp --enable_cpu_fallback
2. If yes,I have also used snpe-diagview tool to get the information of timing and runtime of model inference on board,but the runtime for every layers was CPU.
Kindly guide us to resolve this.
Thanks,
Sithara Tresa Chacko
Hello Sithara Tresa Chacko,
Did you use quantized model? If yes, is it throwing any error without CPU Fallback option enabled.