Forums - Snapdragon Example GPU not faster than CPU

4 posts / 0 new
Last post
Snapdragon Example GPU not faster than CPU
simon.ziegler
Join Date: 30 Nov 17
Posts: 4
Posted: Thu, 2017-12-21 11:57

Hello,

i am currently using the Snapdragon NPE Android example with a converted tensorflow model on a Lenovo PB2-690M. I switched the runtime from CPU to GPU for the network inference, however i get the more or less the same execution time as on CPU. Also, the execution time is very slow, it is a shorter network than the inception, and has about 1.2 inferences per second. 

Best Regards,
Simon

  • Up0
  • Down0
lattinpe
Join Date: 21 Dec 17
Posts: 3
Posted: Thu, 2017-12-21 21:45

Which version of SNPE do you use? Can you please try other one?

Btw, what's the chipset that PB2-690M is using?

  • Up0
  • Down0
simon.ziegler
Join Date: 30 Nov 17
Posts: 4
Posted: Sat, 2017-12-23 06:18

Thank you for the reply! I am using SNPE version 1.8.0, this should be the current one. The hardware of the smartphone is:

 

Architecture
 
64bit - Qualcomm Snapdragon 652 MSM8976 (28nm)
 
 
CPU
 
Octa-Core, 2 processors:
1.8Ghz Quad-Core ARM Cortex-A72
1.4Ghz Quad-Core ARM Cortex-A53
 
 
GPU
 
Qualcomm Adreno 510
 
 
Best Regards,
Simon

 

 

  • Up0
  • Down0
simon.ziegler
Join Date: 30 Nov 17
Posts: 4
Posted: Tue, 2018-01-02 06:12

It seems i fixed the problem. In the tutorial source i had to set GPU or CPU in the LoadNetworkTask.java:

mTargetRuntime=NeuralNetwork.Runtime.GPU;

Setting CPU/GPU inside the app does not work, it always chooses CPU no matter what has been selected. Compared to the CPU, the GPU is in average 2 times as fast, using a relatively small network (5mb non-quantized).

Best Regards,
Simon

  • Up0
  • Down0
or Register

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.