Forums - Question about AI performance of RB5

1 post / 0 new
or Register
Question about AI performance of RB5
robert.wang
Join Date: 5 Oct 22
Posts: 1
Posted: Wed, 2022-10-19 10:57
Top

Are there any details about how the official AI performance of RB5 are tested? The result is much different from what I have got from my RB5. Especially for the result of DSP (int8). For example, for RestNet50, my test result is 68.8 images/s but the official result is 125.1 inf/s. There are almost 2x speed gap. My results are tested with snpe-benchmark tool and the input resolution is 224x224x3 with batch size 1. I have set it to be run on burst mode. I also test with batch size 4 and it seems that for ResNet50, RB5 cannot really benefit from the large batch size. The speed for batch size 4 even slower than the speed for the batch size 1.

My result:

Models | DSP | G16

ResNet50 | 68.8 | 30.5

Models
RB5 RB5 (images/s)DSPG16ResNet3479.541.2ResNet5068.830.5MobilentV2193.1129.7RepVGG_B0154.254.8EfficientNet_B032.137.5

 

AI performance from Qualcomm:

Models | DSP | G16

ResNet50 | 125.1 | 37.4

  • Up0
  • Down0

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.