Hi Experts,
I have a CNN model that needs to run 40 frames a second, but I found that its running speed is only 5ms/frame on dsp, and about 5ms/frame on aip.
My question is:
if I used the thread library of cpp to create two threads and then one thread calls the dsp runtime, and one thread calls the aip runtime, so whether it can process two pictures in 5ms?
Hi
If you run snapdragon NPE and select the AIP runtime, it will have a part of model running on HTA and parts on HVX.
And the snapdragon NPE loads the library on the DSP which communicates with AIP runtime.
So if you use the command of --use_aip it will run the DSP Executor on the respective cores and return the proper output for snapdragon runtime.
Note: AIP and DSP options cannot be used at the same time as aip is a superset of DSP.
Thanks.
Hi sanjjey,
Thanks for your reply.
I have re-wrote the cpp sample code of snpe-example, added two sub-threads and load two model and run them in sub-threads seperately.
I tryed two models(both using aip runtime, and in two threads seperately) and I found they are running parallel.
But when I tryed one model on aip and one on dsp, the speed is not ideal, and It seems not running parallel.
So my question is : why AIP and AIP can run parallel in two threads, but AIP and DSP cannot?