On-Device AIML Dashcam Android Application

DashCam

The project is designed to utilize the Qualcomm Neural Processing SDK, a deep learning software from Qualcomm Snapdragon platforms for object detection in Android platform. The Android application uses any built-in/connected camera to capture the objects on roads and use machine learning model to get the prediction/inference and location of the respective objects.

Pre-requisites

• Before starting the Android application, please follow the instructions for setting up Qualcomm Neural Processing SDK using the link provided. https://developer.qualcomm.com/docs/snpe/setup.html.
• Android device 6.0 and above which uses below mentioned Snapdragon processors/Snapdragon HDK with display can be used to test the application

List of Supported Snapdragon Devices

• Qualcomm Snapdragon 855
• Qualcomm Snapdragon 845
• Qualcomm Snapdragon 835
• Qualcomm Snapdragon 821
• Qualcomm Snapdragon 820
• Qualcomm Snapdragon 710
• Qualcomm Snapdragon 660
• Qualcomm Snapdragon 652
• Qualcomm Snapdragon 636
• Qualcomm Snapdragon 630
• Qualcomm Snapdragon 625
• Qualcomm Snapdragon 605
• Qualcomm Snapdragon 450

The above list supports the application with CPU and GPU.For more information on the supported devices, please follow this link https://developer.qualcomm.com/docs/snpe/overview.html

Parts used

Below are the items used in this project.

• Mobile Display with QC Dash Cam app
• Snapdragon HDK - development board
• External camera setup

Snapdragon_HDK.jpg

Deploying the project

• Download code from the GitHub Repository.
• Compile the code and run the application from Android Studio to generate application (apk) file.

How to install Android application

• Android Phone with version 7.0 and above.
• QCA Snapdragon - Board connected via USB to the device.
• ADB installed in the Windows/ Linux system
• How to install adb in the system can be found here https://developer.android.com/studio/command-line/adb.html

APP Installation

• ADB tool can be used to install the Application (on both Windows and Linux)

$ adb install qc_dashCam.apk

• Run the Application in the phone.

How does it work?

QC_DashCam Android application opens a camera preview, collects all the frames and converts it to bitmap. The network is built via Neural Network builder by passing caffe_mobilenet.dlc as the input.The bitmap is then given to model as inference, which returns object prediction and localization of the respective object.

Sample Screenshot of the application with model prediction