Assistive Door for the Deaf and Hard of hearing

INTRODUCTION/DESCRIPTION OF THE PROJECT

We all know the problems faced by differently-abled people. For instance, a hearing-impaired might miss his/her flight because he/she couldn't hear the announcement about his flight leaving an hour early or waste his/her time at the airport because he/she couldn’t hear the announcement about the flight being canceled. Not being able to make out what other people are trying to say due to a lack of proper lighting in the room. These are just a few problems faced by any hearing impaired and differently-abled people in general. A similar problem faced by the hearing impaired in their day to day life is not getting the information about a visitor at the door as they would not be able to hear the knock or the doorbell. Our system intends to help such people in getting to know about the visitor at the door. It not only alerts the owner about the visitor but also takes a picture of the visitor and send it to the owner so that the owner can decide if he/she wants the person to come in. The owner can not only view the picture of the person at the door but also control the opening and closing of the door and send a customized message for the visitor to read through his/her mobile phone. This system can also be used by others who don’t have a hearing problem.

Design

CIRCUIT DIAGRAM:

Circuit Diagram of the Arduino Board connected to LCD, Proximity Sensor, Buzzer, LED, Servo, and Bolt Wi-Fi module is shown below :

Circuit Diagram of Arduino Board connected to OV7670 Module is shown below:

DESIGN EXPLANATION:

• The proximity sensor continually checks for the arrival of a person at the door.
• When the distance between the person and the sensor is less than 25cm ( Temporarily), the LED’s present in all the rooms starts glowing and the Arduino Board connected to the Bolt Wi-Fi Module sends a “1” to the Bolt Cloud through the Wi-Fi Module.
• The Python Program which was continuously running at the server side on receiving a “1” from the Bolt Cloud, creates a subprocess that clicks an image via the OV7670 camera module. The captured image along with the link to the web application (present on the Bolt Cloud ) is sent to the owner of the house via a telegram message by the python program.
• Once the message is sent to the owner, the buzzer at the door is activated and a message saying “Please Wait….” is displayed on the LCD Screen.
• The program then waits for 3 minutes for the owner to reply back to the person at the door. If no reply arrives, then a message saying “Owner Did Not Respond, Sorry” will be displayed on the LCD Screen and the LED’S turn off.
• When the owner clicks on the link, he/she will be redirected to an application where he/she will be able to type a message manually, which will go through the cloud application to the local Bolt Wi-Fi module to the Arduino board connected to the Wi-Fi module after which the message will be displayed on the LCD Screen, following which he/she will be given 20 seconds to decide whether he/she (Owner) wants to open or close the door.
• If the owner decides to open the door, once he/she clicks on the open door button in the application, a command “o” is sent to the Arduino board connected to the servo motor, which then indicates to the servo motor to rotate by 90 degrees which results in the opening of the door. If the owner decides not to open the door, then he/she can click the“No” button in the application or just type the message and send it and the door will remain shut.
• The door can be closed manually, via the application or it will be closed automatically, 20 seconds after it was opened.

Implementation

STEPS TO BE FOLLOWED TO EXECUTE THE PROJECT:

• The GitHub repository link for the code of the project is given at the end. Clone it to your local machine.
• Make the connections between various components as shown in the circuit diagram in the circuit-diagram folder.
• Click on the following link to set up the camera with the Arduino “https://create.arduino.cc/projecthub/techmirtz/visual-capturing-with-ov7670-on-arduino-069ebb”.
• Create a product in the Bolt cloud and link it to the Bolt Wifi module. In the Hardware section of the product, configure a CSV pin, and name it csv0. In the code section, select language as HTML and copy the code from web_app.html, and paste it there.
• Upload the Arduino program SimpleRead.ino present in the SimpleRead folder to the Arduino connected to the camera.
• Upload the Arduino program ultrasonic-serial.ino present in the ultrasonic-serial.ino folder to the other Arduino.
• Once the Arduino program ultrasonic-serial.ino is running in the arduino, connect the arduino to the laptop and run the python program bolt-arduino-RxTx.py which clicks and sends the image of the visitor.
• The owner must join the channel @alerts_boltIOT19 to receive the alert/notification about the visitor.
• The owner must also have an account on Bolt cloud (https://cloud.boltiot.com/) to send the message to the door and control the door.