Forums - snpe benchmark failed

2 posts / 0 new

or Register

Last post

snpe benchmark failed

guohaot

Join Date: 24 Jan 22

Posts: 1

Posted: Wed, 2022-06-29 00:07

Top

Hi,

My platfrom is RB5.

I'm trying to profile a model with snpe_bench.py. But all result is zero.

Could you please tell me how to solve this problem?

log:

SNPE SDK version:,1.59.0.3230,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Configuration used:,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Name,tf_ssdmobilenetv1_coco_300_300,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

HostRootPath,/workspace/snpe-1.63.0.3523/benchmarks/tf_ssdmobilenetv1_coco_300_300,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

HostResultsDir,/workspace/snpe-1.63.0.3523/benchmarks/tf_ssdmobilenetv1_coco_300_300/results,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

DevicePath,/data/local/tmp/snpebm,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Devices,ZTR43S19009C,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

HostName,localhost,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Runs,50,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Model:Name,tf_ssdmobilenetv1_coco_300_300,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Model:Dlc,/workspace/dlc/tf_ssdmobilenetv1_coco_300_300.dlc,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Model:UDO,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Model:InputList,random_raw_list.txt,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Model:RandomInput,100,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Model:InputDimensions,"image_tensor:0:1,300,300,3",,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Runtimes,"CPU,CPU_ub_float,GPU,GPU_ub_float,DSP,DSP_ub_float,DSP_ub_tf8,AIP,AIP_ub_float,AIP_ub_tf8",,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Architectures,arm,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Compiler,clang6.0,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

C++ Standard Library,libc++_shared.so,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Measurements,timing,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

PerfProfile,high_performance,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ProfilingLevel,detailed,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Date,39:44.2,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Device Info:,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ro.product.name,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ro.serialno,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ro.product.model,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ro.product.board,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ro.product.brand,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ro.product.device,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ro.product.manufacturer,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ro.product.cpu.abi,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ro.build.au_rev,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ro.build.description,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

ro.build.version.sdk,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Meta_Build_ID,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

OS_Type,unknown,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

,, ,CPU_timing(50 runs), , , ,CPU_ub_float_timing(50 runs), , , ,GPU_timing(50 runs), , , ,GPU_ub_float_timing(50 runs), , , ,DSP_timing(50 runs), , , ,DSP_ub_float_timing(50 runs), , , ,DSP_ub_tf8_timing(50 runs), , , ,AIP_timing(50 runs), , , ,AIP_ub_float_timing(50 runs), , , ,AIP_ub_tf8_timing(50 runs), , ,

,, ,avg (us),max (us),min (us),runtime,avg (us),max (us),min (us),runtime,avg (us),max (us),min (us),runtime,avg (us),max (us),min (us),runtime,avg (us),max (us),min (us),runtime,avg (us),max (us),min (us),runtime,avg (us),max (us),min (us),runtime,avg (us),max (us),min (us),runtime,avg (us),max (us),min (us),runtime,avg (us),max (us),min (us),runtime

,,Load,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,Deserialize,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,Create,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,Init,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,De-Init,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,Create Network(s),0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,RPC Init Time,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,Snpe Accelerator Init Time,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,Accelerator Init Time,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,Total Inference Time,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,Forward Propagate,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,RPC Execute,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,Snpe Accelerator,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,Accelerator,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

,,Misc Accelerator,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU,0,0,0,CPU

Forum vote up/down

Re: snpe benchmark failed #1

weihuan

Join Date: 12 Apr 20

Posts: 270

Posted: Sat, 2022-07-09 19:31

Top

Dear customer,

Could you please help to check the logcat on devices. From the issue description, it seems like some reasons as below

1 wrong input list format you provided.

2 need to verify with snpe-platform-validator.

BR.

Wei

or Register

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.

Sort By

Filter Results