Published February 9, 2022 © GPL3+

Control Led with Open-cv python(Hand gestures) and arduino

Here I'm demonstrating a simple led circuit being controlled by hand gestures using python-openCv and arduino

IntermediateFull instructions providedOver 1 day12,547

Things used in this project

Hardware components

Breadboard (generic)

5 mm LED: Red

5 mm LED: Green

3 mm LED: Yellow

Jumper wires (generic)

Resistor 330 ohm

Arduino UNO

Software apps and online services

Arduino IDE

Jupyter Notebook

OpenCV

Story

INTRODUCTION:

Gesture recognition helps computers to understand human body language. This helps to build a more potent link between humans and machines, rather than just the basic text user interfaces or graphical user interfaces (GUIs).

In this project, we are using gestures(by extracting the key points from the library), setting conditions based on the gestures that the code reads and sending data to arduino to turn the LEDs on/off.

The gesture 1 lets you turn on LED-1, 2 for LED- 2, 3 for LED-3, 5 for turning all the LEDs off and 0 for exiting.

OpenCv:

OpenCV (Open-Source Computer Vision Library) is an open-source computer vision and machine learning software library. OpenCV was built to provide a common infrastructure for computer vision applications and to accelerate the use of machine perception in commercial products.

Mediapipe:

Mediapipe is an open-source machine learning library of Google, which has some solutions for face recognition and gesture recognition and provides encapsulation of python, js, and other languages. MediaPipe Hand is a high-fidelity hand and finger tracking solution. It uses machine learning (ML) to infer 21 key 3D hand information from just one frame.

Google

CvZone:

Cvzone is the library that develops a bridge between Arduino and python. With the help of the SerialObject module in Cvzone we can connect the arduino port with python as well as send data to arduino and can link any python code with it.

Note: This is not officially available for arduino ide, you can refer this link for downloading it.

APPROACH:

1) Detect hand gestures.

2) Code reads the gestures.

3) Every gestures has different conditions.

4) Based on the condition, send the data to arduino.

ARDUINO-SETUP:

Refer the circuit diagram below for making the connections.

After making the above connections, refer to the python code below!

Simulation Output:

Code

#include <cvzone.h>

SerialData serialData(2, 1); //(numOfValsRec,digitsPerValRec)
// no of values recieved : 1:(0-1);2(1-99)
//here we take 2 as we have range between 1-5
int valsRec[1]; // array of int with size numOfValsRec 

void setup() {
  serialData.begin();
  pinMode(3, OUTPUT);
  pinMode(7, OUTPUT);
  pinMode(13, OUTPUT);
  
  
}

void off(){
  if(valsRec[0]==5){
    digitalWrite(13, LOW);
    digitalWrite(7, LOW);
    digitalWrite(3, LOW);
  }
}

void loop(){
  int v;
   serilData.Get(valsRec);//get value from python code

  v=valsRec[0];//take the first element of array
  if(v==1){
    
    off(); 
    digitalWrite(3, HIGH);
  }
  else if(v==2){
    
    off(); 
    digitalWrite(7, HIGH);
  }
  else if(v==3){
    
    off(); 
    digitalWrite(13, HIGH);
  }
  else{
    off();
  }
}

Credits

Aarush Sood

5 projects • 9 followers

Technology enthusiast , ECE graduate from India. An electronics hobbyist who loves working with arduino's and esp's.

Control Led with Open-cv python(Hand gestures) and arduino

Things used in this project

Hardware components

Software apps and online services

Story

INTRODUCTION:

OpenCv:

Mediapipe:

CvZone:

APPROACH:

ARDUINO-SETUP:

Simulation Output:

Schematics

Schematics-I

Schematics-II

Code

Arduino Code

Connect Python with Arduino

Credits

Aarush Sood

Comments

Embed the widget on your own site

Control Led with Open-cv python(Hand gestures) and arduino

Control Led with Open-cv python(Hand gestures) and arduino

Things used in this project

Hardware components

Software apps and online services

Story

INTRODUCTION:

OpenCv:

Mediapipe:

CvZone:

APPROACH:

ARDUINO-SETUP:

Simulation Output:

Schematics

Schematics-I

Schematics-II

Code

Arduino Code

Connect Python with Arduino

Credits

Aarush Sood

Comments

Related channels and tags