Forums - The inference results of instance with batchsize = 1 and instance with batchsize = 2 are different

2 posts / 0 new
or Register
Last post
The inference results of instance with batchsize = 1 and instance with batchsize = 2 are different
373303429
Join Date: 22 Jan 21
Posts: 4
Posted: Wed, 2022-08-10 02:06
Top

The inference results of instance with batchsize = 1 and instance with batchsize = 2 are different

It's something like this

snpe_bs1 = init_snpe(dlc_quat,1)

snpe_bs2 = init_snpe(dlc_quat,2)

result1_bs1 = snpe_bs1(image1)

result12_bs2 = snpe_bs2(image1, image2)

result1_bs1 and result12_bs2[0]  are different here

My expectation is that they(result1_bs1 and result12_bs2[0]) should be the same. I guess this should be caused by model quantification.

Is there any good solution

 

SNPE version : snpe-1.61.0.3358

  • Up0
  • Down0
Re: The inference results of instance with batchsize = 1 and...
weihuan
Join Date: 12 Apr 20
Posts: 270
Posted: Sun, 2022-09-04 06:24
Top

Dear customer,

SNPE has sppported to multiple bactch already.

Could you please help to share your conversion and quantization commands to us?

BR.

Wei

  • Up0
  • Down0
or Register

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.