Hi,
Use runtime of GPU_FLOAT16, GPU load Non-quantize model takes too long.
It takes 4s to load a model in the app.
What can I do to solve this problem? I tried Init-caching but it didn't work.
BR.
Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.
Dear developer,
What's version SNPE SDK you used?
It seems like your question was about the model initialization time. It's not normal time for 4s except input the large mode.
BR.
Wei
Dear weihuan
SNPE SDK version: 2.5.0.4052
model input: 1*1024*1024*3
What can I do to solve this problem?
BR.