Hello, I have a model that I already quantized in snpe 1.5.2. Unfortunately, I don't have the raw images.
When switching to snpe 1.6.3 ,Its takes more time to load the network (using the htp) I thought that maybe re-quantized the model in the newer version will help. Can I re-quantize the already quantized model without images?
Tnks ,Dan
HTP use a new arch, if you use quantized DLC, it will do graph optimizaiton in init stage, this is why you observe the long time when loading the network.
1 with float model, you can use snpe-dlc-quantize xxx --enable-htp
2 with quant model, you can use a another tool called snpe-dlc-graph-prepare. This tool will help you generate a optimization graph with quantized dlc.
Note: for some reasons, optimization graph is not compatible b/w snpe version. If you use SNPE 1.6.x in future, you need to call snpe-dlc-graph-prepare to generate optimization graph again.
@hazelmaris.sa1
For your issue, it is tricky, I do not meet similar issue before. Not sure whether you can push float model to device.