Forums - Running UDO on CPU while model runs on GPU

2 posts / 0 new
or Register
Last post
Running UDO on CPU while model runs on GPU
anirudhm84
Join Date: 13 Jun 17
Posts: 8
Posted: Mon, 2021-11-29 02:17
Top

 

Hi,

Is it possible to have the UDO custom layers run on CPU  while the main model runs on GPU ? This was possible while using UDL. However while running the alexnet model UDO example with --use_gpu mode via snpe-net-run,  I get the followng error -

 

error_code=1010; error_message=UDO Layer failed network validation. error_code=1010; error_message=UDO Layer failed network validation. UDO Constraint Validation Failed; error_component=Model Validation; line_no=2550; thread_id=3912205280; error_component=Model Validation; line_no=271; thread_id=4096339984

 

Can I get some clarification if this is possible or not.

 

Thanks,

Anirudh

  • Up0
  • Down0
Re: Running UDO on CPU while model runs on GPU
weihuan
Join Date: 12 Apr 20
Posts: 270
Posted: Mon, 2021-12-27 01:23
Top

Dear customer,

You need to write the code of OpenCL into UDO for GPU. Regarding the OpenCL implementation inside SNPE UDO, you can prepare the env for the OpenCL compiling.

BR.

Wei

  • Up0
  • Down0
or Register

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.