Project

# Title Team Members TA Documents Sponsor
20 Glove controlled mouse with haptic feedback
 Khushi Kalra
Vallabh Nadgir
Vihaansh Majithia
 Frey Zhao design_document1.pdf
final_paper1.pdf
final_paper2.pdf
final_paper3.pdf
photo1.HEIC
photo2.HEIC
photo3.HEIC
presentation1.pptx
proposal1.pdf
video1.txt
# Problem
For digital artists, traditional mousepads and trackpads are constrained and limit natural hand motion, making writing or drawing on a laptop cumbersome. Existing gesture-based input devices are often expensive, camera-dependent, or occupy significant desktop space. There is a need for a low-cost, wearable, intuitive interface that enables free-form cursor control and natural gesture-based clicking.

# Solution
We propose a wearable glove system that allows users to control a computer cursor using hand movements and perform mouse clicks with natural finger pinches. The system consists of four main subsystems:

1) Hand Motion Tracking Subsystem – captures hand orientation and motion to move the cursor.
2) Finger Gesture Detection Subsystem – detects index and middle finger pinches for left/right clicks.
3) Haptic Feedback Subsystem – provides real-time vibration feedback for click confirmation.
4) Software Subsystem – processes sensor data, maps gestures to mouse actions, and communicates with the computer.

# Components

## Subsystem 1: Hand Motion Tracking
Purpose: Detects hand orientation and movement to control the 2D cursor position.

Components:
IMU sensor (accelerometer + gyroscope + magnetometer) for 3D motion tracking.
Microcontroller (ESP32 or Arduino Nano 33 BLE) for sensor data processing.
Custom PCB to host IMU, microcontroller, and wiring to glove sensors.
A lightweight Lipo battery.

Description:
The IMU measures acceleration and rotation of the hand. Firmware filters and converts these readings into cursor velocity and direction. Provides smooth, real-time hand-to-cursor mapping (targeting cursor movement or click) cursor movement or click) <50 ms.
4) Wearability: Glove and PCB fit comfortably on the hand without restricting motion.
5) Software Functionality: Firmware correctly processes sensors; optional PC software handles calibration and visualization.
6) Haptic Feedback: Vibrations are triggered reliably with each recognized click gesture.

## Subsystem 2: Finger Gesture Detection
Purpose: Detects finger pinches to generate left/right mouse clicks and optional extra gestures.

Components: Flex/bend sensors on index and middle fingers for left/right clicks. Optional thumb flex sensor for gestures like scrolling or drag. Optional capacitive/touch sensor for hover or special gestures. Pull-down resistors and conductive wiring embedded in glove.

Description: Flex sensors detect finger bending; bending past a threshold triggers clicks. Firmware includes debouncing to prevent multiple clicks from one gesture. Optional thumb and touch sensors provide extended functionality.

## Subsystem 3: Haptic Feedback
Purpose: Provides tactile confirmation for detected gestures.

Components: Small vibration motor (coin or pager type). Driver circuitry on PCB to control vibration intensity.

Description: The microcontroller activates vibration briefly when a click gesture is recognized. Enhances user experience by providing immediate feedback without needing visual confirmation.

## Subsystem 4: Software Subsystem
Purpose: Maps sensor data to cursor movement, gestures, and communicates with the computer.

Components: Microcontroller firmware for sensor data acquisition, filtering, and gesture detection. PC-side optional calibration GUI (Python or C++) for sensitivity adjustment and mapping hand motion to screen resolution.

Description: Processes raw sensor data and converts IMU readings into cursor deltas (Δx, Δy) and flex/touch inputs into click commands. Supports USB HID or Bluetooth HID communication to the computer. Optional software smooths cursor motion, calibrates sensors, and visualizes hand gestures for testing (Stretch).

# Criterion for Success
1) Resolution (Equivalent DPI): variable DPI: (Range: 400-1000 DPI)
2) Max Tracking Speed (IPS): ≥50 IPS (so quick flicks don’t drop).
3) Acceleration Tolerance: ≥5 g without loss of tracking (users move hands fast).
4) Polling Rate: ≥100 Hz (every 10 ms or better).
5) End-to-End Latency: ≤20 ms (ideally closer to 10 ms).
6) Click Accuracy: ≥95% reliable detection of intended clicks, false positives ≤1%.
8) Haptic Feedback Response Time: <40 ms after click detection.
9) Cursor Control Accuracy: Hand movements map to cursor position within ±2% of intended location.
10) Wearability: Glove and PCB fit comfortably on the hand without restricting motion.

Modularized Electronic Locker

Jack Davis, Joshua Nolan, Jake Pu

Modularized Electronic Locker

Featured Project

Group Member: Jianhao (Jake) Pu [jpu3], Joshua Nolan [jtnolan2], John (Jack) Davis [johnhd4]

Problem:

Students living off campus without a packaging station are affected by stolen packages all the time. As a result of privacy concerns and inconsistent deployment, public cameras in Champaign and around the world cannot always be relied upon. Therefore, it can be very difficult for victims to gather evidence for a police report. Most of the time, the value of stolen items is small and they are usually compensated by the sellers (Amazon and Apple are very understanding). However, not all deliveries are insured and many people are suffering from stolen food deliveries during the COVID-19 crisis. We need a low-cost solution that can protect deliveries from all vendors.

Solution Overview:

Our solution is similar to Amazon Hub Apartment Locker and Luxer One. Like these services, our product will securely enclose the package until the owners claim the contents inside. The owner of the contents can claim it using a phone number or a unique user identification code generated and managed by a cloud service.

The first difference we want to make from these competitors is cost. According to an article, the cost of a single locker is from $6000 - $20000. We want to minimize such costs so that we can replace the traditional mailbox. We talked to a Chinese manufacturer and got a hardware quote of $3000. We can squeeze this cost if we just design our own control module on ESP32 microcontrollers.

The second difference we want to make is modularity. We will have a sensor module, a control module, a power module and any number of storage units for hardware. We want to make standardized storage units that can be stacked into any configuration, and these storage units can be connected to a control module through a communication bus. The control module houses the hardware to open or close all of the individual lockers. A household can purchase a single locker and a control module just for one family while apartment buildings can stack them into the lockers we see at Amazon Hub. I think the hardware connection will be a challenge but it will be very effective at lowering the cost once we can massively manufacture these unit lockers.

Solution Components:

Storage Unit

Basic units that provide a locker feature. Each storage unit will have a cheap microcontroller to work as a slave on the communication bus and control its electronic lock (12V 36W). It has four connectors on top, bottom, left, and right sides for stackable configuration.

Control Unit

Should have the same dimension as one of the storage units so that it could be stacked with them. Houses ESP32 microcontroller to run control logics on all storage units and uses the built-in WiFi to upload data to a cloud server. If sensor units are detected, it should activate more security features accordingly.

Power Unit

Power from the wall or from a backup battery power supply and the associated controls to deliver power to the system. Able to sustain high current in a short time (36W for each electronic lock). It should also have protection against overvoltage and overcurrent.

Sensor Modules

Sensors such as cameras, motion sensors, and gyroscopes will parlay any scandalous activities to the control unit and will be able to capture a photo to report to authorities. Sensors will also have modularity for increased security capabilities.

Cloud Support

Runs a database that keeps user identification information and the security images. Pushes notification to end-users.

Criterion for Success:

Deliverers (Fedex, Amazon, Uber Eats, etc.) are able to open the locker using a touchscreen and a use- provided code to place their package inside. Once the package is inside of the locker, a message will be sent to the locker owner that their delivery has arrived. Locker owners are able to open the locker using a touchscreen interface. Owners are also able to change the passcode at any time for security reasons. The locker must be difficult to break into and offer theft protection after multiple incorrect password attempts.

Project Videos