Created September 3, 2024

Smart Hiking Assistant for Visually Impaired Individuals

Enhance hiking safety for visually impaired users with real-time environmental data and audio feedback through a smart system integrating it

Things used in this project

Hardware components

Seeed Studio XIAO ESP32S3 Sense

NRF52840 Development Kit

Nordic Semiconductor nRF52 Development Kit

Navigation Assistance

Story

Overview
The project is intended to provide a smart hiking assistant to the visually impaired hikers to gather real-time environmental information using the NRF52840 Development Kit in collaboration with the XIAO ESP32S3 Sense. These will provide the required view of the surroundings with voice feedback on their smartphones, which will let them hike more safely and enjoyably.

Required Components
NRF52840 Development Kit: Used for data processing and Bluetooth communication.
XIAO ESP32S3 Sense: This will be used for environmental sensing, which includes temperature and humidity and air quality.
Smartphone with Bluetooth Capability: This is for receiving data from the NRF52840 and providing audio feedback.
Optional: Bluetooth Earphones or Headset: In case audio feedback is required but the smartphone isn't directly used for audio output.
System Components and Workflow
Environmental Sensing (XIAO ESP32S3 Sense):

The XIAO ESP32S3 Sense shall read the temperature, humidity, and air quality, respectively, through its onboard sensors.
Data from these sensors will be periodically transferred using BLE to the NRF52840 Development Kit.
Data Processing and Bluetooth Communication-NRF 52840 Development Kit:

NRF52840 will receive environmental data from the XIAO ESP32S3 Sense.
Data will then be processed and formatted for further transfer to a smartphone.
NRF52840 will also ensure BLE communication and that data are correctly transferred.
Smartphone Application:

Develop a smartphone application on an Android or IOS-based operating system that interfaces with the NRF52840 via BLE. The application would receive environmental data and drive real-time audio feedback to the user. Examples include:
Temperature: "The current temperature is 22°C."
Humidity: "The humidity level is at 45%."
Air Quality: "The air quality is good."
Thresholds of environmental conditions can also be set within the application and warn users when exceeded. Such environmental conditions include high humidity or poor air quality.
Navigation Assistance: Optional

Integrate GPS functionality with the smartphone application to enable navigation support.
The application has to give voice-based navigation commands such as directions in which to turn or notifications of obstacles and/or hazards on the trail.
Implementation Steps
Hardware Setup:
Interface XIAO ESP32S3 Sense with NRF52840 Development Kit.
Ensure that both the devices can communicate with each other over BLE.
Firmware Development :

This firmware, XIAO ESP32S3 Sense, needs to read the data from sensors and send it to NRF52840 using BLE communication.
Firmware to be developed should provide BLE communication, and data processing on the NRF52840. Smartphone Application:

Develop a smartphone application able to connect with NRF52840 and retrieve information on environmental parameters.
Include functionalities of audio feedback and if possible navigation support.
Testing:

The system shall be tested in real hiking conditions; it should be accurate regarding data transmission and reliable.
Modify the firmware and application based on users' feedback.
Deployment:

Deploy once tested and when the system is reliable for use by visually impaired hikers. Potential Enhancements Voice Commands: Users can request specific environmental data or ask for navigation data through voice commands. Emergency Alerts: The features that will involve alerting emergency contacts when the user is in distress. Integration with Wearables: Expand the system to be integrated with smartwatches or any other wearable technology for easier interaction.
This project makes hiking more accessible and at the same time improves the overall safety and experience of visually impaired persons.

Code

code

#include "nrf_ble_gatt.h"
#include "nrf_ble_qwr.h"
#include "nrf_ble_scan.h"
#include "ble_advertising.h"
#include "app_error.h"
#include "bsp.h"
#include "nrf_log.h"
#include "nrf_log_ctrl.h"
#include "nrf_log_default_backends.h"

#define DEVICE_NAME                     "NRF52840"
#define SERVICE_UUID                    0x1234
#define CHARACTERISTIC_UUID             0x1235

static nrf_ble_gatt_t m_gatt;
static nrf_ble_qwr_t m_qwr;
static ble_advertising_t m_advertising;
static uint16_t m_conn_handle = BLE_CONN_HANDLE_INVALID;

static void on_ble_evt(ble_evt_t const * p_ble_evt, void * p_context) {
    if (p_ble_evt->header.evt_id == BLE_GAP_EVT_CONNECTED) {
        m_conn_handle = p_ble_evt->evt.gap_evt.conn_handle;
    }
    else if (p_ble_evt->header.evt_id == BLE_GAP_EVT_DISCONNECTED) {
        m_conn_handle = BLE_CONN_HANDLE_INVALID;
    }
}

static void ble_stack_init(void) {
    uint32_t err_code;
    nrf_ble_gatt_init(&m_gatt, NULL);
    ble_advertising_init_t init;
    memset(&init, 0, sizeof(init));
    init.advdata.name_type = BLE_ADVDATA_FULL_NAME;
    init.advdata.include_appearance = false;
    init.advdata.flags = BLE_GAP_ADV_FLAGS_LE_ONLY_LIMITED_DISC_MODE;
    init.advdata.p_service_data_array = NULL;
    init.advdata.service_data_count = 0;
    init.advdata.p_manuf_data = NULL;
    init.advdata.manuf_data_len = 0;
    init.advdata.p_service_uuid_array = NULL;
    init.advdata.service_uuid_count = 0;
    init.advdata.include_ble_version = false;
    init.advdata.p_slave_conn_interval = NULL;

    init.advdata.name_type = BLE_ADVDATA_NO_NAME;
    init.advdata.include_appearance = false;
    init.advdata.p_service_uuid_array = NULL;
    init.advdata.service_uuid_count = 0;

    init.srdata.name_type = BLE_ADVDATA_NO_NAME;
    init.srdata.include_appearance = false;
    init.srdata.p_service_uuid_array = NULL;
    init.srdata.service_uuid_count = 0;

    init.srdata.include_tx_power_level = false;

    ble_advertising_init(&m_advertising, &init);
}

static void advertising_start(void) {
    uint32_t err_code;
    err_code = ble_advertising_start(&m_advertising, BLE_ADV_MODE_FAST);
    APP_ERROR_CHECK(err_code);
}

int main(void) {
    // Initialize the logger.
    NRF_LOG_INIT(NULL);
    NRF_LOG_DEFAULT_BACKENDS_INIT();

    // Initialize BLE stack
    ble_stack_init();

    // Start advertising
    advertising_start();

    for (;;) {
        NRF_LOG_FLUSH();
        __WFE();
    }
}

Credits

1NH21CE005_Adnan_Aadil_Burhan

1 project • 1 follower

Smart Hiking Assistant for Visually Impaired Individuals

Things used in this project

Hardware components

Story

Schematics

image 1

Code

code

Credits

1NH21CE005_Adnan_Aadil_Burhan

Comments

Embed the widget on your own site

Smart Hiking Assistant for Visually Impaired Individuals

Smart Hiking Assistant for Visually Impaired Individuals

Things used in this project

Hardware components

Story

Schematics

image 1

Code

code

Credits

1NH21CE005_Adnan_Aadil_Burhan

Comments