Forums - Benchmarking

2 posts / 0 new
Last post
Benchmarking
22imonreal
Join Date: 10 Feb 21
Posts: 80
Posted: Wed, 2021-06-09 04:00

Hello,

I have tried to follow the benchmarking guide https://developer.qualcomm.com/docs/snpe/benchmarking.html with snpe-1.50.0.2622 and android-ndk-r21e and ran:

python3 snpe_bench.py -c alexnet_sample.json -a

But the terminal just waits after diplaying the following:


snpe-1.50.0.2622/benchmarks/snpebm/snpebm_parser.py:262: SyntaxWarning: "is" with a literal. Did you mean "=="?
  if(layer_runtimes is ""):
snpe-1.50.0.2622/benchmarks/snpebm/snpebm_config.py:278: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if not self._cfg_from_json[CONFIG_PERF_PROFILE_KEY] is 'null':
snpe-1.50.0.2622/benchmarks/snpebm/snpebm_config.py:284: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if not self._cfg_from_json[CONFIG_PROFILING_LEVEL_KEY] is 'null':
snpe-1.50.0.2622/benchmarks/snpebm/snpebm_config.py:338: SyntaxWarning: "is" with a literal. Did you mean "=="?
  if self._cfg_from_json[_key] is 'null':
snpe-1.50.0.2622/benchmarks/snpebm/snpebm_config.py:603: SyntaxWarning: "is" with a literal. Did you mean "=="?
  if self.buffertypes is "All":
snpe-1.50.0.2622/lib/python/common_utils/protocol/adb.py:64: SyntaxWarning: "is not" with a literal. Did you mean "!="?
  if returncode is not 0:
2021-06-09 12:55:46,188 - INFO - snpe_bench: Running snpe_bench with {'config_file': 'alexnet_sample.json', 'output_base_dir_override': None, 'device_id_override': None, 'host_name': None, 'run_on_all_connected_devices_override': True, 'device_os_type_override': 'android', 'debug': False, 'sleep': 0, 'userbuffer_mode': '', 'perfprofile': '', 'profilinglevel': '', 'generate_json': False, 'profile_mode': False, 'enable_init_cache': False}
'Timer' object has no attribute 'isAlive'

How would I be able to resolve this?

Thanks.

  • Up0
  • Down0
Re: Benchmarking Best Answer
kpoliset
Join Date: 28 Aug 19
Posts: 8
Posted: Wed, 2021-07-14 18:26

Hello,

The benchmarking script as well as other SNPE examples expect you to be using 

-Ubuntu 18.04

-Python3.6

-Android NDK (android-ndk-r17c-linux-x86)

Any case out of the SNPE setup documentation has not been tested. Can you please make sure to follow the prerequisites stated in the SNPE setup.

Also, are you running this script on Ubuntu PC or RB5?

Thank you

 

  • Up0
  • Down0
or Register

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.