Forums - Unable to run model on more than 14 HTP cores through SoC 1

2 posts / 0 new
Last post
Unable to run model on more than 14 HTP cores through SoC 1
niranjans4
Join Date: 13 Apr 22
Posts: 3
Posted: Fri, 2022-08-05 08:31

Issue: 

We are able to generate binaries for more than 14 HTP cores, but while running it on hardware, it is throwing Failed to allocate NSP resources.

Steps followed:

1. Create binaries:

     /opt/qti-aic/exec/qaic-exec -aic-hw -aic-num-cores=15 -compile-only -aic-hw-version=2.0 -m=/home/kpit/Videos/QDrive/SA8540_testing/mobilenet/mobilenetv2-12_batch_1.onnx -aic-binary-dir=/home/kpit/Videos/QDrive/SA8540_testing/mobilenet/OUTPUT_FP32_SOC1SA900/ -device-id=0 -vvv

2. Extract and copy binaries onto hardware

3. Execute Qaic-runner with copied binaries.

     # qaic-runner -t ./ -i ./jellyfish.raw --write-output-dir ./all_out/ -v -d 0

Error faced is:

 # Device 0 activate failed: Failed to allocate NSP resources

Note:

Using Qaic-util section we tried to see how many HTP cores are available. we got as below.

# qaic-util -q | grep Nsp    
 Nsp Total:14     Nsp Free:13     Nsp Total:1     Nsp Free:1     Nsp Total:1     Nsp Free:1
 
Ideally in Qride 3.0, we should have 14 HTP cores in SA9000, 2 HTP cores in SoC 1 and 2 HTP cores in Soc2.
 
Please guide us.
 

 

  • Up0
  • Down0
gmcgrath
Join Date: 21 Aug 13
Posts: 65
Posted: Thu, 2022-09-01 13:53

It may be that "-aic-num-cores=15" expects 15 NSPs but Qdrive has only 14 NSPs.

 

  • Up0
  • Down0
or Register

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.