Published February 12, 2021 © CC BY-NC-SA

The AI Label Maker

Next level home organization is... using AI to label all your stuff?!

IntermediateFull instructions provided20 hours7,689

Things used in this project

Hardware components

Raspberry Pi 3B+ Starter Kit

Raspberry Pi Camera

Adafruit Mini Thermal Receipt Printer

Wall Mount AC Adapter 5V 2A

Power Plug Terminal Adapter

Arcade Button

Thermal Sticker Paper Rolls

Jumper wires

Hand tools and fabrication machines

Hot glue gun

Flamingo Duct Tape

Utility knife

Metal Ruler

Scissors

Giant needle

As an Amazon Associate I earn from qualifying purchases you make using my affiliate links.

Story

How will this artificially intelligent label maker work? The idea is as follows: take a picture of the stuff that needs a label, let AI detect the objects in the image and print out the labels on a piece of sticker paper. Let's get started!

Project Video

Hardware

1 / 2

To create our label maker, we'll be using a number of components, all attached to a Raspberry Pi as you can see in the Fritzing Diagram above.

Raspberry Pi

For this project we used a Raspberry Pi 3B+, but it should also work perfectly with a Raspberry Pi 4.

If you're new to Raspberry Pi's, there's a great getting started tutorial right here.

Raspberry Pi Camera

As described above, the idea is to take a picture of the stuff that needs organizing. A great way to take pictures with a Raspberry Pi is by using a Raspberry Pi Camera. There's an excellent getting started guide about connecting and using a Pi Camera right here.

Adafruit Mini Thermal Receipt Printer

For the printing of the labels, we'll be using the Adafruit Mini Thermal Receipt Printer as it's an excellent way to print a bit of text. To learn more about the printer and how to set it up, check out this great learning guide by Adafruit.

This little receipt printer can print on rolls of thermal paper which is great, but then the labels aren't sticky. After some research, we discovered that rolls of thermal sticker paper meant for Paperang pocket printers have the same size as the rolls for the receipt printer, so we gave it a shot. Turns out it works brilliantly!

Arcade Button

Last but not least, we'll need something to trigger the photo making and label printing. We chose for an arcade button we still had lying around, but you could of course use other types of buttons or things to start the label making process. It's surprisingly difficult to find a good tutorial about wiring up an arcade button. We ended up using the wiring instructions from this arcade button guide and combined them with the code example provided in this button guide.

Code

With all our hardware tested and wired up, we'll need to write a bit of python code to make everything do exactly what we want it to do. No worries though, the complete code is added to this step!

DeepAI DenseCap API

The only part of our label maker we haven't really covered so far is the AI part. To label the objects in the image, we'll be using the DeepAI DenseCap API. Our code sends the taken picture to DeepAI and we get an array of labels back. To use this API, you'll need to make a free account on the DeepAI website and copy-paste your API key into the part of the code that says 'YOUR-API-KEY-HERE'.

Code

In short, the provided code does the following:

In a never-ending loop, it will check if the button has been pressed.

If the button is pushed:

The LED inside the arcade button will be turned on
A unique filename will be made using the current date and time
The Pi Camera turns on for a moment and takes a picture, which is given the unique filename
The picture is sent to the DeepAI DenseCap API
We wait to receive a JSON array containing captions of all the objects detected in the image
We take the first caption, as that is the caption the AI is most certain of, and print that using the thermal receipt printer

If the button isn't pressed:

Turn the LED inside the arcade button off

Boxing

We've got our electronics working, now we just need to put them in something to keep all the bits together!

We measured the dimensions of the hardware and drew a box pattern based on this template on some scrap cardboard. We cut out the template as precisely as possible with a metal ruler and a utility knife.

We folded the box and found a nice place to put all the electronics.

To adjust the box to the label maker hardware we:

Made a hole in the front for the lens of the Raspberry Pi Camera
Used a giant needle to thread a bit of rope through the front of the box and through the attachment holes in the Raspberry Pi Camera to hold it in place
Made a big round hole in the top for the arcade button
Made a rectangular slot at the top for the labels to come out
Added a cardboard platform to position the thermal receipt printer at the top of the box
Made a small hole in the back for the two wires to exit

With all the holes and adjustments made, we first attached the Raspberry Pi Camera and the arcade button. Once these more fiddly parts were set, we glued the walls of the box together, but made sure to keep the top open. We assembled the hardware and used some flamingo duct tape to securely close the box at the top.

Label All the Things!

The time has come, we can finally efficiently label all the things!

For starters, we thought The AI Label Maker should label itself. Maybe it was because we used the Not-So-Smart-But-Very-Wholesome-Yet-Slightly-Creepy Mirror to take the selfie, but somehow the label turned out to be "the window is white"?!

We've been having a great time labelling all our possessions and we'll be taking suggestions of stuff to label and sharing more of the generated labels on our Twitter and Instagram over the next couple of weeks!

So euhm, anyone want a label?

Code

LabelMakerClean.py

# AI Label Maker

# Import libraries
from picamera import PiCamera
from time import sleep
import datetime
import requests
import json
import board
import busio
import adafruit_thermal_printer
import serial
import RPi.GPIO as GPIO
from time import sleep

# Setup the arcade button
GPIO.setwarnings(False)
GPIO.setmode(GPIO.BCM)
# The button GPIO pin
GPIO.setup(26, GPIO.IN, pull_up_down=GPIO.PUD_UP)
# The arcade button's LED GPIO pin
GPIO.setup(16, GPIO.OUT)

# Setup the Adafruit Mini Thermal Receipt Printer
ThermalPrinter = adafruit_thermal_printer.get_printer_class(2.68)
RX = board.RX
TX = board.TX

# For a computer, use the pyserial library for uart access
uart = serial.Serial("/dev/serial0", baudrate=19200, timeout=3000)

# Create the printer instance.
printer = ThermalPrinter(uart, auto_warm_up=True)
camera = PiCamera()

# Function that does all of the label making
def printImageCaption():
    # Set the filename of the picture to the current date and time to give it a unique name
    filename = 'image' + str(datetime.datetime.now().date()) + '_' + str(datetime.datetime.now().time()).replace(':', '.') + '.jpg'

    # Start the camera and sleep for a second to let it settle
    camera.start_preview()
    sleep(1)
    print("taking a picture")
    # Take a picture and give it the unique filename
    camera.capture('/home/pi/Desktop/labelmaker/%s' % filename)
    # Stop the camera
    camera.stop_preview()

    # Set the path to the image location
    imagepath = '/home/pi/Desktop/labelmaker/' + filename
    print("Fetching AI Label")

    # Send a request to DeepAI densecap
    # With the image and API key
    r = requests.post(
        "https://api.deepai.org/api/densecap",
        files={
            'image': open(imagepath, 'rb'),
        },
        headers={'api-key': 'YOUR-API-KEY-HERE'}
    )

    # An array of all the captions
    allcaptions = r.json().get("output").get("captions")

    # The first caption = the label the AI is the most certain of
    firstcaption = allcaptions[0]['caption']

    print(firstcaption)

    # Print the first caption using the Adafruit Mini Thermal Receipt Printer
    print("Printing Label")
    printer.justify = adafruit_thermal_printer.JUSTIFY_CENTER
    printer.print(firstcaption)
    printer.feed(6)

# Run this bit of code forever
while True:
    # If the button has been pressed
    if GPIO.input(26) == GPIO.LOW:
        # Turn on the button's LED
        GPIO.output(16, True)
        print("Button was pushed!")
        # Run the function to take a picture and print the label
        printImageCaption()
    else:
        # Turn off the button's LED
        GPIO.output(16, False)

The AI Label Maker

Things used in this project

Hardware components

Hand tools and fabrication machines

Story

Project Video

Hardware

Code

Boxing

Label All the Things!

Schematics

Wiring Diagram

Box Diagram

Code

LabelMakerClean.py

Credits

Comments

Embed the widget on your own site

The AI Label Maker

The AI Label Maker

Things used in this project

Hardware components

Hand tools and fabrication machines

Story

Project Video

Hardware

Code

Boxing

Label All the Things!

Schematics

Wiring Diagram

Box Diagram

Code

LabelMakerClean.py

Credits

Comments

Related channels and tags