Step 1: Required parts
Step 2: Setting up gateway device
Step 3: Train the brainium module
Step 3: Record the data by artificially creating motions and gestures
Step 4: Setting up alerts
Step 5: Working Video
Step 6: Home automation

Published March 5, 2020 © CC BY-NC-SA

Jeeva - AI Based Smart Assist for Elderly

A smart wearable device which can be trained to detect variations in walking which can also control home appliances thereby helping elders.

IntermediateFull instructions providedOver 2 days1,313

Jeeva - AI Based Smart Assist for Elderly

Things used in this project

Hardware components

Avnet SmartEdge Agile Brainium

Raspberry Pi 3 Model B+

Arduino Nano R3

Adafruit RGB Backlight LCD - 16x2

Arduino 4 Relays Shield

Software apps and online services

brainium smart edge agile

Arduino IDE

Hand tools and fabrication machines

Soldering iron (generic)

Story

It would be easy for a healthy human being to get around places and do some aerobic exercises without any external aid, but the life is completely different when you have a disability even the involuntary tasks such as breathing walking might become a nightmare. In order to help this kind of people, we developed a smart cane which has quite a lot of sensors and can do quite a bit of AI processing onboard. We use Avnet brainium module to detect obstacles and gestures so that it can help an end-user like a blind or physically challenged individual. In current economic conditions, the earning for the home has to be done by both male and female individual in order to pay out the bills at the end of the month. This is a common practice in an urban area where basic living costs are exorbitant. As a result of this practice, elderly people are left back in the home when young ones go out for earning. Older people as they age they will need support for even walking like a cane or wheelchair. The use of a stick as a support for walking is there from stone ages.

Designing anassistive tech device :

1 / 2 • Here are some designs I came up with before realising it.

But all these years these canes are nothing but a stick, apart from material changes and adjustable heights there are no other significant changes. Our solution will focus on making this dumb stick a smart one by integrating a smart sensor system and advanced onboard embedded AI will learn new gestures and can be used to control devices in a smart home environment.

Or the device can be worn as watch to the legs. This will monitor the walking behaviour and can detect anomalies in walking i.e gait and can report if something happens like if they fall or if there are more severe issues like seizure etc. It will directly email the caretaker about the occurrence.

So I would like to call this device as Jeeva which translates to Life in Sanskrit as it's a life saviour device with AI at Edge.

Step 1: Required parts

Gather all the required parts mentioned above.

Step 2: Setting up gateway device:

Pi gateway

Brainium gateway application has to be installed on raspberry pi. This can be done by following this link.

Upon connecting brainium module to the gateway we can train the module and deploy trained modules on it.

Step 3: Train the brainium module.

There are already tons of tutorials on the hackster.io website itself about how to train avnet smart edge agile.

For our applications, I will be training it with

1. Fall detection

2. Seizure detection

3. Home automation

4. Walking

5. Sleeping.

These motions are trained on the device.

Step 3: Record the data by artificially creating motions and gestures.

AI model application

Some actions such as fall and seizure might be difficult to perform but one can move his/her legs in a rapid kicking action to simulate seizure as this happens during the seizure. Home automation motions are recorded by particular letter motions like, if it is a fan it will be F motion through legs and L motion for Lights etc.

Step 4: Setting up alerts

After training the model alerts can be set based on the number of motions

Alerts can be a notification or an email in the case of an emergency.

Email recceived when there was a seizure attack

various alerts

Step 5: Working Video :

Working Video

Step 6: Home automation:

This can be directly implemented on the raspberry pi gateway to control relays which in turn can control the devices.

As this module is being trained on Artificial Intelligence there will be no programming requirement.

Here's a link to relay shield to pi which does a better job than connecting a microcontroller to pi.

Home automation

#include<LiquidCrystal.h>
String voice;
int
tv = 2, //Connect tv To Pin #2
fan = 3, //Connect fan To Pin #3
light = 4, //Connect light To Pin #4
heater = 5, //Connect heater To Pin #5
ac = 6; //Connect AC to Pin #6

LiquidCrystal lcd(7, 8, 9, 10, 11, 12);

void allon() {
  digitalWrite(tv, LOW);
  digitalWrite(fan, LOW);
  digitalWrite(light, LOW);
  digitalWrite(heater, LOW);
  digitalWrite(ac, LOW);
}
void alloff() {
  digitalWrite(tv, HIGH);
  digitalWrite(fan, HIGH);
  digitalWrite(light, HIGH);
  digitalWrite(heater, HIGH);
  digitalWrite(ac, HIGH);
}

void setup() {
  Serial.begin(38400);


  // rtc.adjust(DateTime(2017, 10, 14, 00, 46, 00));
  lcd.begin(16, 2); // 16x2 LCD
  lcd.clear(); // blank the display
  pinMode(tv, OUTPUT);
  pinMode(fan, OUTPUT);
  pinMode(light, OUTPUT);
  pinMode(heater, OUTPUT);
  pinMode(ac, OUTPUT);
  digitalWrite(tv, HIGH);
  digitalWrite(fan, HIGH);
  digitalWrite(light, HIGH);
  digitalWrite(heater, HIGH);
  digitalWrite(ac, HIGH);
}

void loop() {
  ;
  lcd.setCursor(0, 0);
  lcd.print("Hi, Jarvis Here");



  while (Serial.available()) { //Check if there is an available byte to read
    delay(10); //Delay added to make thing stable
    char c = Serial.read(); //Conduct a serial read
    if (c == '#') {
      break; //Exit the loop when the # is detected after the word
    }
    voice += c; //Shorthand for voice = voice + c
  }
  if (voice.length() > 0) {
    Serial.println(voice);

    if (voice == "*switch on all") {
      allon(); //Turn Off All Pins (Call Function)
      lcd.clear();
      lcd.setCursor(0, 1);

      lcd.print("Switched ON all");
    }
    else if (voice == "*switch off all") {
      alloff(); //Turn On  All Pins (Call Function)
      lcd.clear();
      lcd.setCursor(0, 1);
      lcd.print("Switched off all");
    }


    else if (voice == "*TV on") {
      digitalWrite(tv, LOW);
      lcd.clear();
      lcd.setCursor(0, 1);
      lcd.print("Switched ON  TV");
    }
    else if (voice == "*fan on") {
      digitalWrite(fan, LOW);
      lcd.clear();
      lcd.setCursor(0, 1);
      lcd.print("Switched ON fan");
    }
    else if (voice == "*lights on") {
      digitalWrite(light, LOW);
      lcd.clear();
      lcd.setCursor(0, 1);

      lcd.print("Lights ON");
    }
    else if (voice == "*heater on") {
      digitalWrite(heater, LOW);
      lcd.clear();
      lcd.setCursor(0, 1);

      lcd.print("Heater ON");
    }
    else if (voice == "*AC on") {
      digitalWrite(ac, LOW);
      lcd.clear();
      lcd.setCursor(0, 1);
      lcd.print("Switched ON AC");

    }

    else if (voice == "*TV off") {
      digitalWrite(tv, HIGH);
      lcd.clear();
      lcd.setCursor(0, 1);

      lcd.print("Switched OFF TV");
    }
    else if (voice == "*fan off") {
      digitalWrite(fan, HIGH);
      lcd.clear();
      lcd.setCursor(0, 1);

      lcd.print("Switched OFF Fan");
    }
    else if (voice == "*lights off") {
      digitalWrite(light, HIGH);
      lcd.clear();
      lcd.setCursor(0, 1);

      lcd.print("Lights OFF");
    }
    else if (voice == "*heater off") {
      digitalWrite(heater, HIGH);
      lcd.clear();
      lcd.setCursor(0, 1);

      lcd.print("Heater OFF ");
    }
    else if (voice == "*AC off") {
      digitalWrite(ac, HIGH);
      lcd.clear();
      lcd.setCursor(0, 1);

      lcd.print("Switched OFF AC");
    }

    voice = ""; //Reset the variable after initiating
  }
}

Credits

Vishwas Navada

25 projects • 89 followers

Full stack hardware engineer.

Jeeva - AI Based Smart Assist for Elderly