I developed my first thermal camera app using a simple MLX90640 sensor that I got on sale and a Wio terminal that I already owned. After that, I was hooked. I loved the functionality but I wanted better resolution! I started looking into the FLIR Lepton modules, but they were pretty pricey ($250-300 USD). I found a solution in the Leptop FS, which cost $99 USD but has a little less functionality than the regular Leptons. I ended up also getting an Open MV H7 cam (the H7 Plus is out of stock until mid 2022) and an adaptor module. Still expensive, but you get 160x120 resolution as opposed to the 32x24 resolution of the MLX90640. And what a difference! The detail in the Lepton sensor is impressive. See the comparison photos below:
I was walking around my house with the Lepton and I noticed that I could see my reflection pretty clearly in windows and on glass picture frames and other glass objects. I did some googling and found out that infrared (IR) energy is reflected off of glass, much like visible light is reflected off of mirrors. A light bulb then went off. I wonder if I could set up the thermal camera to point towards a picture frame to covertly look around corners (or behind you). It turns out it works!
To add a little spin to it, I developed a person identification model using Edge Impulse to identify if a person is approaching. Very cool!
There are plenty of Edge Impulse tutorials on here, so I won't go through the workflow of how I did it. It is essentially the same as other image classification projects, except I'm using thermal images instead of regular images. Unfortunately, because I have the regular H7 instead of the H7 Plus, I'm limited in the size of the model I can use. I'm hoping to try this out again with the H7 Plus with a larger model in the future.
This was the first time I used the EON Tuner in Edge Impulse, and I think that helped a lot in optimizing the model size and inference time.
With the OpenMV IDE and python, it's actually really easy to create a script that detects a person and then saves the image. See the code at the bottom of this project. You can then do whatever you want. If you have the Wifi shield, you could send an alert, or you could trigger an LED.
I hope you enjoyed this project. It was interesting to learn new things about how the non-visible light spectrum works! I look forward to continuing to explore this cool sensor!
Comments
Please log in or sign up to comment.