Forums - Linux HTP run quantized mod

2 posts / 0 new
Last post
Linux HTP run quantized mod
f10.liu
Join Date: 22 Mar 18
Posts: 15
Posted: Tue, 2024-04-02 20:19
I run mobilenetv3 with CPU successfully. But I want to run quantized model falied, I got error: 0.0ms [ INFO ] QnnDsp QnnTensor_createGraphTensor started, graph = 0x1 0.0ms [ INFO ] QnnDsp QnnTensor_createGraphTensor graph 1 0.0ms [ INFO ] QnnDsp QnnTensor_createGraphTensor done. graph = 0x1, status 0x0 0.0ms [ INFO ] QnnDsp QnnBackend_validateOpConfig started, backend = 0x1 0.0ms [ ERROR ] QnnDsp Input[0] has incorrect Value 1032, expected < 1032. 0.0ms [ ERROR ] QnnDsp validateNativeOps _blocks_blocks_3_blocks_3_1_se_Mul:qti.aisw:ElementWiseMultiply op validator (quantized and FP16) failed 3110 and 3110 0.0ms [ ERROR ] QnnDsp QnnBackend_validateOpConfig failed 3110 0.0ms [ ERROR ] QnnDsp Failed to validate op _blocks_blocks_3_blocks_3_1_se_Mul with error 0xc26 [ ERROR ] QnnModel::addNode() validating node _blocks_blocks_3_blocks_3_1_se_Mul failed. [ ERROR ] model.addNode(QNN_OPCONFIG_VERSION_1, "_blocks_blocks_3_blocks_3_1_se_Mul", "qti.aisw", "ElementWiseMultiply", nullptr, 0, inputs__blocks_blocks_3_blocks_3_1_se_Mul, 2, outputs__blocks_blocks_3_blocks_3_1_se_Mul, 1 ) expected MODEL_NO_ERROR, got MODEL_GRAPH_ERROR [ ERROR ] addNode__blocks_blocks_3_blocks_3_1_se_Mul(mobilenetv3_small_050_Opset16_quant) expected MODEL_NO_ERROR, got MODEL_GRAPH_ERROR 175.0ms [ ERROR ] Failed in composeGraphs() 175.0ms [ ERROR ] ComposeGraphs Failed with error = 1 Graph Prepare failure The input[0] in *_quant_net.json: "x": { "id": 1, "type": 0, "dataFormat": 0, "data_type": 1032, "unquantized_data_type": 562, "axis_format": "NHWC", "src_axis_format": "NCHW", "quant_params": { "definition": 1, "encoding": 0, "is_overridden": false, "scale_offset": { "bitwidth": 8, "minimum": 0.0, "maximum": 255.0, "scale": 1.0, "offset": 0, "is_symmetric": false, "is_fixed_point": true } }, "dims": [ 1, 224, 224, 3 ], "is_quantizable": true } }, The input I have save int8 binary data, does it not right?
  • Up0
  • Down0
sanjjey.a.sanjjey
Join Date: 17 May 22
Posts: 67
Posted: Tue, 2024-04-16 00:17

Hi,

Please share the command, where you are facing issue.

 

  • Up0
  • Down0
or Register

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.