AI is changing everything. Combined with powerful, energy efficient processors and ubiquitous connectivity to the wireless edge, intelligence is moving to more devices, changing industries, and inventing new experiences.
On-device AI allows for real-time responsiveness, improved privacy, and enhanced reliability along with better overall performance and with or without a network connection. Our Qualcomm Artificial Intelligence (AI) Engine along with our AI Software and Hardware tools as outlined below, are designed to accelerate your on-device AI-enabled applications and experiences.
The Qualcomm Artificial Intelligence (AI) Engine is available on supported Qualcomm® Snapdragon™ 888, 865, 855, 845, 835, 821, 820 and 660 mobile platforms, and with cutting-edge on-device AI processing found in the Snapdragon 888.
Snapdragon core hardware architectures – Qualcomm® Hexagon™ Vector eXtensions (HVX), Qualcomm® Adreno™ GPU and Qualcomm® Kryo™ CPU – are supported within the AI Engine, so your AI applications can run quickly and efficiently on smartphones and other edge devices. This heterogeneous computing approach makes it easy for you to choose the optimal Snapdragon core for your target performance, thermal, and power efficiency requirements.
AI SOFTWARE DEVELOPMENT TOOLS
We have a number of resources available to help you create and optimize your AI and Machine Learning applications and solutions for rich, on-device experiences
- Neural Network Optimization: Qualcomm Neural Processing SDK is designed to help you save time and effort in optimizing the performance of trained neural networks on devices powered by Snapdragon mobile platforms. Deep Learning algorithms are computationally intensive, so having this dedicated tool helps you determine how best to run your applications on device, without a connection to the cloud.
The Neural Processing SDK supports the following frameworks:
- App Performance Optimization: Snapdragon Developer Tools to help you optimize your applications running on Snapdragon mobile platforms. It includes the Snapdragon Profiler and Snapdragon Power Optimization SDK.
- Specialized Core Optimization: SDKs for specific processor cores are also available
- Smart Camera Solutions: From social media apps to robotics solutions, the following SDKs help you utilize the full capabilities of QTI processors for Smart Camera and other vision based solutions you create:
- Machine Vision SDK - engineered to supply cutting-edge computer vision algorithms for localization, feature recognition, and obstacle detection on Qualcomm processors.
- FastCV SDK - offers a mobile-optimized computer vision (CV) library that includes the most frequently used vision processing functions and helping you to add new user experiences into your camera-based apps like gesture recognition, face detection, tracking, text recognition, and augmented reality (AR).
- Anchor Box Processing (ABP) - Algorithm: IoU based library for NMS and Anchor Box Processing (ABP) processing.
AI HARDWARE DEVELOPMENT TOOLS
We have a number of resources available to help you create AI and Machine Learning applications and resources for different types of devices
- Smartphones: These HDKs are dynamically featured Android development platforms designed to provide an ideal starting point for creating high-performance mobile devices and applications
- IoT and Embedded Solutions: The following hardware boards and development kits are designed to support your IoT projects
- DragonBoard 820c Development Board - supports a wide range of interfaces and is ideal for prototyping complex embedded computing applications, from realistic visual and audio immersion for virtual reality and AR applications, to machine vision and artificial intelligence for commercial drones and robots.
- Vision AI Development Kit
- TurboX AI Development Kit
- Vertical Platforms: We have kits designed for specific AI-fueled device use cases
- Qualcomm 624 Home Hub SOM & Development Kit - offers edge computing, multimedia, video and touch display capabilities for the creation of AI-supported home hub products
QUALCOMM AI RESEARCH
Qualcomm AI Research works to advance AI and make its core capabilities – perception, reasoning, and action – ubiquitous across devices. The goal is to make breakthroughs in fundamental AI research and scale them across industries. One way we contribute innovative and impactful AI research to the rest of the community is through novel papers at academic conferences.
Beyond papers, the Qualcomm Innovation Center (QuIC) actively contributes code based on this breakthrough research to open source projects.
The AI Model Efficiency Toolkit (AIMET) is a library that provides advanced quantization and compression techniques for trained neural network models. QuIC open sourced AIMET on GitHub to collaborate with other leading AI researchers, provide a simple library plugin for AI developers, and help migrate the ecosystem toward integer inference. Read the blog post or watch some informational AIMET videos to learn more.
The AIMET Model Zoo, another GitHub project, provides the recipe for quantizing popular 32-bit floating point (FP32) models to 8-bit integer (INT8) models with little loss in accuracy. Read the blog post to learn more. Check out the Qualcomm Innovation Center YouTube channel for informational videos on our open source projects to help developers get started.
Data is another crucial element for machine learning. If you need the Qualcomm Abstract Syntax Tree (QAST) dataset that was used to support the experiments in our workshop paper at ICLR 2019: Simulating Execution Time of Tensor Programs Using Graph Neural Networks, check out our QAST Project Page. We hope this new dataset will benefit the graph research community and raise interest in Optimizing Compiler research.
Explore these links about the latest trends and key features of AI and Machine Learning for more ideas and insight into your own projects:
- Introduction to Qualcomm Neural Processing SDK
- Benchmarking Artificial Intelligence on Snapdragon 855
- Artificial Intelligence Object Classification on Snapdragon 855
Here you will find a number of engineering sourced resources to help you with your artificial intelligence development using the Qualcomm Neural Processing SDK.
If you are new to AI, check our eBook, A Developer’s Guide to Artificial Intelligence (AI), for a primer including its Machine Learning (ML) and Deep Learning (DL) subsets.
If you are looking for a deeper dive into some key areas of artificial intelligence, we collaborated with MoorInsights for a new white paper, Qualcomm: Ubiquitous AI For 5G. Topics include distributed intelligence, importance of on-device AI, AI engine, IoT and auto, Cloud AI 100 and the importance of bridging device to cloud with 5G.
If you are looking for inspiration on how other developers are implementing AI within their solutions, we encourage you to check out our AI Projects to see how the community is working with AI.
- AI Based Safety Detection Using Deep Learning Algorithm project available on Hackster.io