NPE can use CPU, GPU, DSP and so on.
So, I am confued about the runtime usage when doing infer, such as use VGG16 to do classification.
Could NPE auto select the runtime?
i.e., when doing VGG16 infer, NPE can use all the computing resource at the same time?
Or NPE can only use one computing resource at the same time? such as only use GPU.
Or NPE can auto decide which computing should be used?
Or user should make decision?
If i want to use all the resource at the same time to do VGG16 inference, how?
thanks and best regards
Hello luntingh,
If you're using snpe-net-run, by default it uses CPU as the runtime. Also you can specify the runtime order by using --runtime_order <VAL,VAL,VAL>, where VAL can be any of the supported runtime specified here.
Incase you're building a C++ application that uses SNPE, you can use setRuntimeProcessorOrder method of SNPE builder class to define the order of precedence for runtime.