Forums - [RB5] Benchmark result is slow in SNPE v2.7

2 posts / 0 new
Last post
[RB5] Benchmark result is slow in SNPE v2.7
RyoT
Join Date: 27 Jul 22
Posts: 1
Posted: Wed, 2023-03-29 01:37

Hi

I am measuring the inference time of the model with snpe_bench.py

I compared the inference time of Inception v3 using snpe-2.7.0.4264 with snpe-1.63.0.3523 and found that the speed of the DSP and AIP has become very slow in snpe-2.7.0.4264.

Why is snpe-2.7.0.4264 slower

Benchmark results
version2.7.0.4264
CPU:194084[us]
GPU:85238[us]
DSP:23568[us]
AIP:26291[us]
 
version1.63.0.3523
CPU:188491[us]
GPU:86744[us]
DSP:14542[us]
AIP:15327[us]

Device:RB5
I followed the below tutorial to get inception_v3
 
I ran the benchmark with the following command

python snpe_bench.py -c inception_v3.json -a -t ubuntu64_gcc75

The config file is below

{

    "Name":"inceptionV3",
    "HostRootPath": "inception_v3",
    "HostResultsDir":"inception_v3/results",
    "DevicePath":"/tmp/data/snpe_sample",
    "Devices":["<Device id>"],
    "HostName": "localhost",
    "Runs":5,
    "Model": {
        "Name": "Inception_v3",
        "Dlc": "../models/inception_v3/dlc/inception_v3_quantized.dlc",
        "InputList": "../models/inception_v3/data/target_raw_list.txt",
        "Data": [
            "../models/inception_v3/data/cropped"
        ]
    },
    "Runtimes":["GPU", "CPU", "DSP", "AIP"],
    "Measurements": ["timing"],
    "ProfilingLevel":"detailed"
}
  • Up0
  • Down0
weihuan
Join Date: 12 Apr 20
Posts: 270
Posted: Sat, 2023-04-01 23:46

Dear developer,

Could you please help to test your model on SNPE SDK standalone instead of inside bench_mark?

We don't know what's conversion and execution commands you used.

BR.

Wei

  • Up0
  • Down0
or Register

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.