I try to convert transformer model to snpe dlc model. In version 1.59.0, it can sucess to convert https://github.com/facebookresearch/detr to a dlc file. It can convert a set of ReduceMean Sqrt Div Sub operations into a single layernorm operation. But it shows that layernorm can only run on CPU. When will layernorm be run on DSP and GPU ? When will transformer model be supported?
Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.
Dear customer,
Please help to track the SNPE docs further for that supporting. We're planing do that but not sure about the timeline.
BR.
Wei
+1 for supporting layer norm operations, in order to support Transformer models.
Hi, is there any updates?