I notice that the data transfer between the SNPE and the CPU takes considerable time. The input and output data type always seem to be fp32. I don't need that many bits as the input and output of the model are both images and uint8 would be fine. How can I ensure input and output is uint8?
I ask this for the setting of snpe-tflite-to-dlc and spne-quant.
Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.
