Solutions Resources
Refer to GitHub repository for examples of how to exercise multimedia subsystems and other sample applications on the Qualcomm Robotics RB5 development kit. omxaacenc Previous
The omxaacenc GStreamer element is part of the gst-omx plugin. The gst-omx plugin is an adapter for the available OpenMAX IL components and maps the OpenMAX APIs and states to the Gstreamer APIs and states. The omxhaacenc element is an OpenMAX AAC audio encoder that provides h/w accelerated AAC...
The QTI's qtimletflite GStreamer element exposes TensorFlow Lite (TFLite) capabilities to GStreamer. It can load and execute TFLite models. It supports preprocessing and postprocessing functionality. The preprocessing supports downscale, color convert, mean subtraction and padding. The...
The QTI's qtimlesnpe GStreamer element exposes Qualcomm Neural Processing SDK capabilities to GStreamer. It can load and execute AI models. It supports preprocessing and post processing functionality. The preprocessing supports downscale, color convert, mean subtraction and padding. The...
The QTI's qtioverlay GStreamer element has the capability of drawing and blitting RGB or YUV contents to YUV frames. it is in-place GStreamer element and supports only one source and sink pad. It supports bliting - static image, bounding boxes, custom user text and date/time overlays ontop of YUV...
This GStreamer plugin has the capability to resize, flip, rotate, and color covert incoming YUV or RGB video frames.
The main class of the plugin is called GstVideoTransform and it is responsible for capability negotiations between this plugin and any other plugin connected to it, as well as...
The waylandsink element is a video sink element that uses the wayland's weston compositor implementation. It maps weston's client APIs and states to the appropriate GStreamer APIs and states. It is based on the GStreamer GstVideoSink base class for video sinks. For more information on the methods...
The omxh264enc GStreamer element is part of the gst-omx plugin. The gst-omx plugin is an adapter for the available OpenMAX IL components and maps the OpenMAX APIs and states to the Gstreamer APIs and states. The omxh264enc element is an OpenMAX H264 video encoder that provides h/w accelerated H264...
The QTI's qtivdec gstreamer element is V4L2 based video decoder that uses QTI's video hardware cores for decoding video. The qtivdec plugin is derived from the GstVideoDecoder gstreamer base class for video decoders. GstVideoDecoder calls start when the element is activated. GstVideoDecoder calls...
QTI's qtiqmmfsrc plugin can be used to capture video frames via the Qualcomm MMF service. The plugin consists of the main class called GstQmmfSrc which acts as a wrapper on top of the Qualcomm MMF Recorder Client with separate pads for video and image streams. The pads store the creation time...
qtiqmmfsrc qtivdec omxh264enc waylandsink qtivtransform qtioverlay qtimlesnpe qtimletflite omxaacenc Application Semantics Previous qmmfsrc Next
The following diagram shows a typical hybrid application flow using the different subsystems of the QRB5165 platform. In this diagram, at the top level, are the GST plug-in(s) that can be leveraged by the application developer to exercise the subsystem. To abstract out...
Qualcomm Hexagon SDK The Qualcomm® Hexagon™ SDK provides a set of tools, software, and documentation that assists developers in running applications on Qualcomm Technologies-powered devices and leveraging the Hexagon DSPs. The Hexagon SDK is a software development kit that enables...
Qualcomm Computer Vision SDK Qualcomm Computer Vision SDK (formally known as FastCV) enables new user experiences in camera-based apps such as: Gesture recognition Face detection, tracking, and recognition Text recognition and tracking Augmented reality...
The display architecture uses the Wayland protocol. The GST waylandsink element talks to the Weston subsystem to render the display. The following diagram shows the Weston architecture. For X11, standard applications from Ubuntu package are available. The architecture is the OSS...
The audio subsystem allows a user space application to capture audio and request playback. The audio DSP (ADSP) is the component responsible for capture and playback. There is a compute DSP (CDSP) component available which can also be leveraged for any high-performance audio use cases including...
Refer to the Qualcomm Developer Network for comprehensive documentation for Hexagon SDK, SNPE (Snapdragon Neural Processing Engine), Qualcomm Computer Vision SDK (FastCV), and Tensor Flow. Qualcomm Neural Processing SDK for AI Tensorflow Video Decode...
The Qualcomm RB5 platform has a dedicated hardware block called the video processing unit (VPU) for hardware decoding and encoding. The VPU supports up to 4K240/8K60 decoding and 4K120/8K30 encoding. Native decode support is is also provided for the H.265 Main 10, H.265 Main, H.264 High, and...
Camera capture (encoding) of streams has the following highlights: GStreamer SRC plugin (qmmfsrc) Can be used to capture camera frames via the Qualcomm MMF service Is capable of providing multiple encoded (AVC/HEVC) bitstreams and YUV streams. Is a...
The following diagram shows the architecture for the camera subsystem (including video). The architecture highlights the use of the Qualcomm MMF SRC GStreamer plugin. This plugin handles the encoding of the camera frames. The camera subsystem includes the following...