We are able to generate binaries for more than 14 HTP cores, but while running it on hardware, it is throwing Failed to allocate NSP resources.
1. Create binaries:
/opt/qti-aic/exec/qaic-exec -aic-hw -aic-num-cores=15 -compile-only -aic-hw-version=2.0 -m=/home/kpit/Videos/QDrive/SA8540_testing/mobilenet/mobilenetv2-12_batch_1.onnx -aic-binary-dir=/home/kpit/Videos/QDrive/SA8540_testing/mobilenet/OUTPUT_FP32_SOC1SA900/ -device-id=0 -vvv
2. Extract and copy binaries onto hardware
3. Execute Qaic-runner with copied binaries.
# qaic-runner -t ./ -i ./jellyfish.raw --write-output-dir ./all_out/ -v -d 0
Error faced is:
# Device 0 activate failed: Failed to allocate NSP resources
Using Qaic-util section we tried to see how many HTP cores are available. we got as below.
Nsp Total:14 Nsp Free:13 Nsp Total:1 Nsp Free:1 Nsp Total:1 Nsp Free:1