Forums - No display while running Gstreamer

2 posts / 0 new
Last post
No display while running Gstreamer
balavignesh.g
Join Date: 12 Apr 22
Posts: 3
Posted: Wed, 2022-05-25 03:42

I have converted Yolo tflite to .dlc but after running the below command there is no display showing....

gst-launch-1.0 qtiqmmfsrc name=camsrc camera=0 ! video/x-raw\(memory:GBM\),f
ormat=NV12,width=1280,height=720,framerate=30/1, camera=0 ! qtimlesnpe config=/d
ata/misc/camera/mle_snpe.config model=/data/misc/camera/yolov4snpe.dlc labels=/d
ata/misc/camera/coco.txt postprocessing=detection ! queue ! qtioverlay ! wayland
sink fullscreen=true async=true sync=false
 
Output:
gbm_create_device(156): Info: backend name is: msm_drm
Setting pipeline to PAUSED ...
gbm_create_device(156): Info: backend name is: msm_drm
 
** (gst-launch-1.0:31776): WARNING **: 02:02:46.975: Wayland compositor is missing the ability to scale, video display may not work properly. - No viewporter present
 
** (gst-launch-1.0:31776): WARNING **: 02:02:46.975: Could not bind to zwp_linux_dmabuf_v1
Pipeline is live and does not need PREROLL ...
Setting pipeline to PLAYING ...
New clock: GstSystemClock
 
 
 
No display after this command just showing grey screen and qualcomm processor is getting hot. Please put a document on how to run a custom trained model in Qualcomm which should be able to run using Gstreamer. Thanks.

 

  • Up0
  • Down0
hs.chaya
Join Date: 20 Mar 20
Posts: 20
Posted: Tue, 2022-06-14 00:06

Hi,

To run sample tflite model with Gstreamer plugin qtimletflite on Qualcomm RB5 board follow below steps

Download the sample tflite model coco ssd mobilenet model on host pc using below command                 wget https://storage.googleapis.com/download.tensorflow.org/models/tflite/coc... -outfile coco_ssd_mobilenet_v1_1.0_quant_2018_06_29.zip

Unzip the file

Push the detect.tflite and labelmap.txt to /data/misc/camera folder

Create configuration file by gstreamer property. File extension should be .config

To change delegate, open the config file and change the delegate value to cpu or gpu or dsp.

gst-launch-1.0 v4l2src ! jpegdec ! videoconvert ! qtimletflite config=/data/misc/camera/mle_tflite.config model=/data/misc/camera/detect.tflite labels=/data/misc/camera/labelmap.txt postprocessing=detection ! videoconvert ! jpegenc ! filesink location=image.jpeg

Above pipeline takes the inference frames from the camera source and are delivered to the GStreamer TF Lite plugin along with a model tflite. The TF Lite runtime can be running on the DSP, GPU or CPU. Inference results are gathered back in the GStreamer TF sink for postprocessing and that metadata is stored in the file.

 

  • Up0
  • Down0
or Register

Opinions expressed in the content posted here are the personal opinions of the original authors, and do not necessarily reflect those of Qualcomm Incorporated or its subsidiaries (“Qualcomm”). The content is provided for informational purposes only and is not meant to be an endorsement or representation by Qualcomm or any other party. This site may also provide links or references to non-Qualcomm sites and resources. Qualcomm makes no representations, warranties, or other commitments whatsoever about any non-Qualcomm sites or third-party resources that may be referenced, accessible from, or linked to this site.