Forums - Quantized Mobilenet-SSD DLC failes on device using the DSP runtime

9 posts / 0 new
Last post
Quantized Mobilenet-SSD DLC failes on device using the DSP runtime
hongbing.hu
Join Date: 31 May 18
Posts: 4
Posted: Thu, 2018-06-07 13:48

Converted a sample MoibleNetSSD mode to a DLC file following the tutorial at https://developer.qualcomm.com/docs/snpe/convert_mobilenetssd.html.  The converted DLC  model runs successuly on device using GPU or CPU.  However, when using the quantized version of the DLC for the DSP runtime, the following error is observed. 

- Execute the quantized DLC for the DSP runtime

snpe-net-run --container mobilenet_ssd_quantized.dlc  --input_list mobilenet_target_raw_list.txt  --use_dsp

- Error
 
error_code=902; error_message=Layer parameter value is invalid in DSP. Layer concat_1: DSP runtime only supports concat of the last axis.  Axis (1) and output dims 1x1917x91 provided.; error_component=DSP Runtime; line_no=181; thread_id=548074363544
 

Thanks a lot.

  • Up0
  • Down0
xing.wang
Join Date: 2 May 18
Posts: 5
Posted: Wed, 2018-06-13 18:00

Hi Hongbing,

Have you figured out why this happens? I just met the same error.

Actually I can not run quantized MobileNetSSD in GPU mode as well. Here's the error:

error_code=802; error_message=Layer parameter value is invalid in GPU. Layer Postprocessor/Slice:0: depth offset must be multiple of four; error_component=GPU Runtime; line_no=96; thread_id=-294177624

Do you know why?

Thanks,

Xing
 

  • Up0
  • Down0
jesliger
Join Date: 6 Aug 13
Posts: 75
Posted: Wed, 2018-06-13 18:39

Make sure you enable CPU fallback. There are layers that won't run on GPU or DSP, so CPU fallback must be enabled.

 

  • Up0
  • Down0
xing.wang
Join Date: 2 May 18
Posts: 5
Posted: Thu, 2018-06-14 09:49

Hi jesliger,

Thanks for the reply, but I have no idea how to enable CPU fallback.

Could you elaborate a little bit on how to achieve that? Do I enable it during runtime or do I have to modify the source code?

Thanks in advance,

Xing

  • Up0
  • Down0
jesliger
Join Date: 6 Aug 13
Posts: 75
Posted: Thu, 2018-06-14 10:50

snpe-net-run -h .  There's an option --enable_cpu_fallback .

 

  • Up0
  • Down0
xing.wang
Join Date: 2 May 18
Posts: 5
Posted: Thu, 2018-06-14 14:04

Hi jesliger,

I just tried to add this option to the runtime and it works well on both GPU and DSP cores.

But I still have some questions considering the output result.

After executing snpe-net-run on Snapdragon 820 board and adb pull the results to laptop for analyzing, I used snpe-diagview to check the timing statistics of MobileSSD runnning under GPU and DSP modes.

It shows some weird number after 110 layers which I guess doesn't belong to the original net at all.

GPU mode: 4294934528: 109 us

DPS mode: 100000: 95 us
                      100001: 0 us
                      100002: 0 us
                     100003: 0 us
                     100004: 334 us
                     100005: 46 us

I'm not sure if it's something related to CPU fallback, have you ever experienced this kind of situation before?

Thanks,

Xing

  • Up0
  • Down0
karishmapal3671
Join Date: 8 Jun 18
Posts: 1
Posted: Thu, 2018-06-21 10:21

Hp printer support will help you to do this mobile net SSD mode to a DLC file. This will now work in any cup or GPU. Now try this it will work at runtime.

  • Up0
  • Down0
xing.wang
Join Date: 2 May 18
Posts: 5
Posted: Thu, 2018-06-21 10:40

What??? HP printer support?? Seriously?

  • Up0
  • Down0
jannywatson1999
Join Date: 4 Oct 18
Posts: 1
Posted: Thu, 2018-10-04 03:03

I am not getting a successful solution for how to Do I enable CPU Fallback it during runtime or do I have to modify the source code? and thanks to that tutorial which I very helpful ad I also get HP Support for the help and with both of your help, I set my device code all fix.

  • Up0
  • Down0
or Register

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.