💻 Finger Freeflow Mouse
⏲ Background
💡 Idea
🦸‍♀️ Thank You Project Sponsors
💫 PCBs
🎉 Code
💪 Hardware Setup
🎉 Mouse Utilization
😅 Challenges

Published September 5, 2024 © CC BY-NC-SA

Finger Freeflow Mouse

A tethered mouse with smart touch recognition for comfortable, drift-free, and intuitive control.

IntermediateFull instructions providedOver 2 days72

Runnerup Mobility Impairments

Build2gether 2.0 — Inclusive Innovation Challenge

Things used in this project

Hardware components

PMW3360DM optical mouse sensor

Eye Screws

Large Masonite Board

Seeed Studio XIAO ESP32S3 Sense

Sans Sense, Xiao ESP32S3

Mouse Buddy PCB

Freeflow Mouse PCB

Story

💻 Finger Freeflow Mouse

This project is the "Finger Freeflow Mouse" which is a device inspired by conversations with Vivek from the original Build2Gether competition. Back then I failed to deliver on that vision as my PCB design skills were still in infancy so I ended up with a very different end project. When I heard Build2Gether was back in a 2.0 form I opted to tackle this idea in earnest as there was a mobility section for the contest and I really wanted to build a useful device that could aid people in this way.

⏲ Background

Mice give an unparalleled level of control when PC gaming. You can try to replace it with joysticks but it just isn't the same:

To emulate a mouse with a joystick you need to move the mouse in the direction the controller stick is moved and, most likely, increase or decrease the speed based on how heavily tilted the stick is in that direction. This makes moving the mouse harder as you need to completely pull the stick back in the opposite direction if you over shoot your intended goal. It also makes for very hard precision control relative to a mouse.

💡 Idea

My idea was to create a mouse that opens up possibilities for gaming by reducing the need for the user to physically move it around while still providing all of the same button and high precision control a traditional mouse provides.

The general idea is a bit like this:

The mouse sits on a baseboard centered for use by someone comfortably with limited mobility. The baseboard contains several screw eyes aligning to each side of the mouse allowing for 2.5mm elastic cords to be passed through from the mouse and tightened. The mouse as such is able to hover over the board. Kind of creating the experience of a one person "Ouija board" that defaults back to its normal position but has some resistance from every angle to allow for it to be moved in that direction. It's as accurate as a normal mouse when a user wants to control it (and positioned such that buttons are in a more optimal location) but also still stationary for limited mobility use

Additional buttons on the mouse will provide input means for the user. They need to be very sensitive to toch such that they can trigger immediately on user activation.

🦸‍♀️ Thank You Project Sponsors!

I'd like to thank JLCPCB / JLC3DP for sponsoring the Freeflow Mouse PCB board I used for the project and providing a resin printed piece that I used for the mouse cover. The resin really makes for a nice surface to touch the mouse and it really brings things to life -- I was surprised with how well it came out given it was my first time with a resin print. The team over at JLC3DP was great in that they confirmed about support usage to get it printing perfectly so I didn't have to worry about the intricacies of resin printing. The PCB looks great and has worked great for my needs. The whole process on the JLCPCB and JLC3DP site was straightforward and the product arrived quickly. The connection to EasyEDA made use of the site simple as well as one can export directly to JLCPCB for ordering after creation.

I'd also like to thank the sponsor PCBWay for providing the contest coupon for use with their services. I utilized their services for the Mouse Buddy PCB I designed. It worked great and fit perfectly with my main board PCB. I plan on using the Mouse Buddy for all sorts of projects in the future and it really turned out so well. Their website can be referenced for information about their services but I will say every time I've used them I've been impressed with their quality and speed at which the board arrives.

In addition to the PCB manufacturers I utilized the Xiao ESP32S3 from the sponsor Seeed Studio. I've used the Xiao boards extensively in the past and knew it would make for a great microcontroller for this project as it is small, has no components on the bottom, and price effective.

💫 PCBs

Mouse Buddy

Mouse Buddy PCB Schematic

The Mouse Buddy PCB utilizes a PMW3360 for movement. It acts as a core board for various mouse related projects. It needs 1V9 voltage for powering the device so a voltage regulator was needed. Aside from that it expects only 3V3 and anything more will likely damage the sensor. The components and layout were structured to allow the board to be reused for various projects by either plugging in via the headers or using a cable to connect.

PCB 3D Visualization

1 / 3 • Mouse Core Board Assembled

Freeflow Mouse

The Freeflow Mouse PCB has a few elements that help it work together with the core board to act as a full mouse. Primarily it exposes headers for connecting to the Mouse Core providing it the 3V3 power and additional connections for each of its associated pins. To add to the polish of the experience some sk2812 mini LEDs were also added along with a level shifter to provide 5V for the signal. A MPR121 was utilized to provide touch control for the buttons.

1 / 3

🎉 Code

The code for the project is attached. It's fairly straightforward and really is the combination of neopixel lighting, MPR121 touch button control, and the PMW3360 for movement. It utilized USB-OTG for allowing the device as a USB mouse.

First it's imperative to setup the Xiao as you would normally for Arduino. Seeed's wiki has more information on this process but the short of it is you add the board definition file for the espressif boards to your board definition list in settings and it allows the ESP32 based boards to be added to your list.

Once that's done you'll need the following libraries as well:

With those in place using the attached code you should be able to build and deploy the mouse.

Option in Settings to Enable USB-OTG

💪 Hardware Setup

Print the three STL files. They are assembled by snapping the boards onto the 3D prints. I used heatset inserts to allow m3 screws to hold the cover tightly to the base when it's sandwiched in. To install these I used my soldering iron and pushed them into the holes along the base.

For passing the connectivity I utilized conductive paint painting the buttons but this wasn't enough so I had to use double sided copper tape to further allow the connection to work. You can see it in my images below but placing some below the finger spots attached to the conductive paint and above the buttons on the PCB worked well for this purpose.

1 / 4 • Partially assembled

After the parts are assembled the mouse should be attached to a baseboard to allow it to move around. I used eye screws around the exterior to fix the four points around the print to the outer board. In this way it hovers above the board ever so slightly.

1 / 3 • Mouse with flexible strings

Fully assembled mouse

🎉 Mouse Utilization

The mouse has various buttons including:

Increase and decrease sensitivity (indicated via the onboard LED color as to the level)
Back and forward mouse buttons which move you through browser history (usually on the side of gaming mice)
Left click
Right click
Middle mouse button
LED toggle for the underlying LED effects
Thumb button for toggling movement

The mouse can be used by pressing down on the thumb button and then pushing the device. This will move the cursor until you remove your thumb from the button. Releasing this allows you to spring back to the default position and further push the mouse from there. The benefit to this approach is that by having the mouse reset each time one does not need to pick up the mouse to readjust it but can rely on it going back.

😅 Challenges

I had originally planned on using magnets to further hold the board up but that didn't work out well given the polarity acted odd when the magnet was turned to its side. I opted instead to rely on a lighter board and utilizing the strings more heavily.

1 / 4

The buttons also struggled to respond without heavy amounts of copper tape. In future iterations it would likely make sense to rely less on conductive paint as it wasn't as effective at transmitting the signal as I had hoped. It took a lot of additional tape to get the mouse to where it is today working so I think it's definitely an area it could be further improved.

The elastic bands have worked well but I feel like it's one of the elements of the project that could be replaced in a future iteration for a more effective rebound mechanism. Additional experimentation into better forms of resistance (large rubber bands perhaps) could be useful for future iterations.

One mistake I made earlier on was to use a Xiao ESP32C3. It worked well for my demo code trying out the MPR121 and PMW3360 components but it doesn't support USB-OTG so I had to desolder the microcontroller and replace it to get the final product working.

This was my first project utilizing a QFN-20 footprint component. I struggled heavily getting it in place but ended up succeeding in the end. I found using my heat gun on the footprint with the solder paste initially, dragging the component over the hot solder, and then positioning it perfectly over the solder points worked well. I think in retrospect I'd surface additional test points on the PCB if I were to use a QFN-20 part again to confirm I don't bridge any connections but things luckily worked out here.

Custom parts and enclosures

Sketchfab still processing.

Schematics

Code

FreeflowMouse.ino

#include <Wire.h>
#include "Adafruit_MPR121.h"
#include <PMW3360.h>
#include <Adafruit_NeoPixel.h>
#include "USB.h"
#include "USBHIDMouse.h"

#define SS A0
#define NEOPIXEL_PIN A3
#define NUMPIXELS 5

// Initialize sensors and LEDs
Adafruit_MPR121 cap = Adafruit_MPR121();
PMW3360 sensor;
Adafruit_NeoPixel strip = Adafruit_NeoPixel(NUMPIXELS, NEOPIXEL_PIN, NEO_GRB + NEO_KHZ800);
USBHIDMouse Mouse;

uint16_t lasttouched = 0;
uint16_t currtouched = 0;

bool mouseEnabled = false;
bool neopixelsEnabled = false;
int mouseSpeed = 0;  // 0 to 4, corresponds to different speed levels
unsigned long lastPressTime[9] = {0};
unsigned long lastRainbowTime = 0;
int rainbowWait = 10;
long firstPixelHue = 0;

void setMovementLevelColor(int level) {
  uint32_t color;
  uint8_t brightness = 50;  // Adjust brightness to be less intense
  switch (level) {
    case 0: color = strip.Color(brightness, 0, 0); break; // Red
    case 1: color = strip.Color(brightness, brightness, 0); break; // Yellow
    case 2: color = strip.Color(0, 0, brightness); break; // Blue
    case 3: color = strip.Color(0, brightness, 0); break; // Green
    case 4: color = strip.Color(brightness / 2, 0, brightness / 2); break; // Purple
  }
  strip.setPixelColor(0, color);
  strip.show();
}

void clearStrip() {
  for (int i = 0; i < strip.numPixels(); i++) {
    strip.setPixelColor(i, 0);
  }
  strip.show();
}

void nonBlockingRainbow() {
  if (millis() - lastRainbowTime > rainbowWait) {
    for (int i = 1; i < strip.numPixels(); i++) {
      int pixelHue = firstPixelHue + (i * 65536L / strip.numPixels());
      strip.setPixelColor(i, strip.gamma32(strip.ColorHSV(pixelHue)));
    }
    strip.show();
    firstPixelHue += 256;  // Update the hue for the next frame
    if (firstPixelHue >= 5 * 65536) {
      firstPixelHue = 0;
    }
    lastRainbowTime = millis();  // Update the time
  }
}

void setup() {
  // Setup Touch Sensor
  if (!cap.begin(0x5A, &Wire, 3)) {
    while (1);
  }

  // Setup Mouse Sensor
  sensor.begin(SS);
  
  // Setup Neopixels
  strip.begin();
  strip.show();  // Initialize all pixels to 'off'

  // Initialize LED for mouse scroll speed indicator
  setMovementLevelColor(mouseSpeed);

  // Setup USB HID Mouse
  Mouse.begin();
  USB.begin();
}

void loop() {
  // Poll the touch sensor for button presses
  currtouched = cap.touched();

  for (uint8_t i = 0; i < 9; i++) {
    unsigned long currentMillis = millis();

    if ((currtouched & _BV(i)) && !(lasttouched & _BV(i)) && (currentMillis - lastPressTime[i] > 500)) {
      lastPressTime[i] = currentMillis;

      // Handle touch press actions
      switch (i) {
        case 0:  // Increase speed
          if (mouseSpeed < 4) mouseSpeed++;
          setMovementLevelColor(mouseSpeed);
          break;
        case 1:  // Mouse Forward
          Mouse.press(MOUSE_FORWARD);
          break;
        case 2:  // Enable mouse control (hold down to enable)
          mouseEnabled = true;
          break;
        case 3:  // Middle button
          Mouse.press(MOUSE_MIDDLE);
          break;
        case 4:  // Left click
          Mouse.press(MOUSE_LEFT);
          break;
        case 5:  // Right click
          Mouse.press(MOUSE_RIGHT);
          break;
        case 6:  // Toggle Neopixels
          neopixelsEnabled = !neopixelsEnabled;
          if (!neopixelsEnabled) {
            clearStrip(); 
          }
          break;
        case 7:  // Mouse Backward
          Mouse.press(MOUSE_BACKWARD);
          break;
        case 8:  // Decrease speed
          if (mouseSpeed > 0) mouseSpeed--;
          setMovementLevelColor(mouseSpeed);
          break;
      }
    }

    if (!(currtouched & _BV(i)) && (lasttouched & _BV(i))) {
      // Handle touch release actions
      switch (i) {
        case 1:  // Mouse Forward release
          Mouse.release(MOUSE_FORWARD);
          break;
        case 2:  // Disable mouse control
          mouseEnabled = false;
          break;
        case 3:  // Middle button release
          Mouse.release(MOUSE_MIDDLE);
          break;
        case 4:  // Left click release
          Mouse.release(MOUSE_LEFT);
          break;
        case 5:  // Right click release
          Mouse.release(MOUSE_RIGHT);
          break;
        case 7:  // Mouse Backward release
          Mouse.release(MOUSE_BACKWARD);
          break;
      }
    }
  }

  lasttouched = currtouched;

  // Poll the sensor for movement data
  PMW3360_DATA data = sensor.readBurst();
  
  // Handle mouse movement if enabled
  if (mouseEnabled && data.isOnSurface && data.isMotion) {
    Mouse.move(-data.dx * (mouseSpeed + 1), -data.dy * (mouseSpeed + 1), 0);
  }

  // Run Neopixel rainbow animation if enabled
  if (neopixelsEnabled) {
    nonBlockingRainbow();
  }

  delay(10);
}

Credits

Timothy Lovett

16 projects • 16 followers

Maker. I spent over a decade working on backend systems in various languages.

Comments

Awards

Runnerup Mobility Impairments

Build2gether 2.0 — Inclusive Innovation Challenge

Finger Freeflow Mouse