The inference results of instance with batchsize = 1 and instance with batchsize = 2 are different
It's something like this
snpe_bs1 = init_snpe(dlc_quat,1)
snpe_bs2 = init_snpe(dlc_quat,2)
result1_bs1 = snpe_bs1(image1)
result12_bs2 = snpe_bs2(image1, image2)
result1_bs1 and result12_bs2[0] are different here
My expectation is that they(result1_bs1 and result12_bs2[0]) should be the same. I guess this should be caused by model quantification.
Is there any good solution
SNPE version : snpe-1.61.0.3358
Dear customer,
SNPE has sppported to multiple bactch already.
Could you please help to share your conversion and quantization commands to us?
BR.
Wei