Projects


# Title Team Members TA Professor Documents Sponsor
1
Mobile Hive Checker
Fiona Cashin
Olivia Guido
Rawda Abdeltawab
Hossein Ataee Arne Fliflet design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
2
Bird Simulator
Anthony Amella
Eli Yang
Emily Liu
Shiyuan Duan Arne Fliflet design_document1.pdf
final_paper1.pdf
photo1.jpg
photo2.jpg
presentation1.pdf
proposal1.pdf
video
3
Heterodyne Bat Detector
BILL Waltz
Evan McGowan
Kyle Jedryszek
Gayatri Chandran Arne Fliflet design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.pdf
video
Dr. Joy O'Keefe
4
Scorpion-Lift Ant-Weight BattleBot
Chen Meng
Zisu Jiang
Zixin Mao
Zhuoer Zhang Viktor Gruev design_document1.pdf
final_paper4.pdf
other1.docx
presentation1.pdf
video
video
5
ANT-WEIGHT BATTLEBOT
wenhao Zhang
XiangYi Kong
Yuxin Zhang
Zhuoer Zhang Viktor Gruev design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
6
Interactive Desktop Companion Robot for Stress Relief
Jiajun Gao
Yu-Chen Shih
Zichao Wang
Haocheng Bill Yang Craig Shultz design_document1.pdf
final_paper2.pdf
photo1.jpg
photo2.jpg
photo3.jpg
photo4.jpg
presentation1.pdf
proposal1.pdf
video
7
SolarTrack
Rahul Patel
Rishikesh Balaji
Siddhant Jain
Haocheng Bill Yang Arne Fliflet design_document1.pdf
final_paper1.pdf
photo1.jpeg
photo2.jpeg
presentation1.pdf
proposal1.pdf
video
8
Facial Quantum Matching Mirror
Akhil Morisetty
Alex Cheng
Ethan Zhang
Wesley Pang Yang Zhao design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.pdf
video1.mp4
Illinois Quantum and Microelectronics Park.
9
Automated Cocktail/Mocktail Maker
Benjamin Kotlarski
Dominic Andrejek
Nick Kubiak
Wesley Pang Joohyung Kim design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
10
OmniSense-Dual — Dual-Wearable 360° Blind-Spot Detection, Directional Haptic Hazard Alerts, and Belly-Based Navigation for Pedestrian Safety
Alex Jin
Jiateng Ma
Simon Xia
Wesley Pang Yang Zhao design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
11
Ant-weight Durian Battlebot
Matthew Jin
Timothy Fong
Ved Tiwari
Zhuoer Zhang Viktor Gruev design_document1.pdf
final_paper1.pdf
final_paper2.pdf
presentation1.pdf
proposal1.docx
video
12
4-Wheel-Drive Invertible Ant-Weight Battlebot
Haoru Li
Ziheng Qi
Ziyi Wang
Zhuoer Zhang Viktor Gruev design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.pdf
video
13
Invertible-Control Ant-Weight Battle Bot
Ben Goldman
Jack Moran
Haocheng Bill Yang Viktor Gruev design_document1.pdf
final_paper1.pdf
photo1.jpeg
photo2.jpeg
photo3.jpeg
presentation1.pdf
proposal1.pdf
video
14
PocketScope
Aaron Holl
Caleb Peach
Rohan Nagaraj
Lukas Dumasius Craig Shultz design_document1.pdf
final_paper1.pdf
photo1.jpg
presentation1.pptx
proposal1.pdf
video
15
SafeStep: Smart White Cane Attachment for Audio + Haptic Navigation and Emergency Alerts
Abdulrahman Almana
Arsalan Ahmad
Eraad Ahmed
Abdullah Alawad Arne Fliflet design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
17
Shower Music Controller
Amar Patel
Shalin Joshi
Varnith Aleti
Eric Tang Craig Shultz design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
18
Acoustic Stimulation to Improve Sleep
Bakry Abdalla
John Ludeke
Sid Gurumurthi
Mingrui Liu Yang Zhao design_document1.pdf
final_paper1.pdf
photo1.png
photo2.png
presentation1.pdf
proposal1.pdf
video
Sound Sleep
19
Cycloidal Hub motor with FOC driver
Michael Talapin
Nithin Durgam
Eric Tang Joohyung Kim design_document1.pdf
proposal1.pdf
20
Air Guitar
Arturo Arroyo Valencia
Miaomiao Jin
Youngmin Jeon
Eric Tang Yang Zhao design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.pdf
video
21
Vertical Spinner Ant-Weight Battle Bot
Andrew Bajek
Elise Chiang
Giovanni Escamilla
Jiaming Xu Viktor Gruev design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.pdf
video
22
Oscillosketch: Handheld XY Etch-a-Sketch Signal Generator for Oscilloscopes
Eric Vo
Josh Jenks
Xiaodong Ye Yang Zhao design_document1.pdf
final_paper1.pdf
photo1.jpg
photo2.png
presentation1.pdf
proposal1.pdf
video
23
Portable RAW Reconstruction Accelerator for Legacy CCD Imaging
Arnav Gaddam
Guyan Wang
Yuhong Chen
Gerasimos Gerogiannis Viktor Gruev design_document1.pdf
final_paper1.pdf
other1.docx
other2.pdf
video
24
Circular Antweight Battlebot (Shovel/Lifter)
Junyan Bai
Yuxuan Guo
Zhuoer Zhang Joohyung Kim design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.pdf
video
25
Building Interior Reconnaissance Drone (BIRD)
Jack Lavin
Jacob Witek
Mark Viz
Shiyuan Duan Joohyung Kim design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
26
AdheraScent Pill Container
Albert Liu
Anshul Rao
Chia-Ti(Cindy) Liu
Zhuchen Shao Arne Fliflet design_document1.pdf
final_paper1.pdf
photo1.jpg
photo2.jpg
presentation1.pdf
proposal1.pdf
video
Adherascent
27
Kombucha Fermentation Control System
Edwin Xiao
John Puthiaparambil
Rudy Beauchesne
Haocheng Bill Yang Yang Zhao design_document1.pdf
final_paper1.pdf
photo1.jpeg
photo2.jpeg
presentation1.pdf
proposal1.pdf
video
28
Modular Screen
Dale Morrison
Sean Halperin
Yuzhe He
Wesley Pang Craig Shultz design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
29
EV Battery Thermal Fault Early Detection & Safety Module
RJ Schneider
Skyler Yoon
Troy Edwards
Wenjing Song Arne Fliflet video
30
American Sign Language Robot Hand Interpreter
Ankur Prasad
Matthew Uthayopas
Tunc Gozubuyuk
Mingrui Liu Yang Zhao design_document1.pdf
final_paper1.pdf
final_paper2.pdf
proposal1.pdf
video
32
Plant Notification System (Soilmate)
Emma Hoeger
Sigrior Vauhkonen
Ysabella Lucero
Zhuchen Shao Arne Fliflet final_paper1.pdf
other1.pdf
photo1.jpg
photo2.jpg
presentation1.pdf
proposal1.pdf
video
33
HelpMeRecall
Michael Jiang
Sravya Davuluri
William Li
Hossein Ataee Craig Shultz design_document2.pdf
final_paper2.pdf
proposal3.pdf
video
34
LabEscape Ultrasonic Directional Speaker
Arthur Zaro
Piotr Nowobilski
Sam Royer
Mingrui Liu Arne Fliflet design_document1.pdf
final_paper1.pdf
other1.pdf
photo1.jpg
photo2.png
presentation1.pdf
proposal1.pdf
video
LabEscape Escape Room
35
Electric Scooter Battery Management System with Integrated SOC and SOH Estimation
Edward Chow
Jay Goenka
Samar Kumar
Xiaodong Ye Arne Fliflet design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
36
Slow Wave Sleep Enhancement System RFA
Aidan Stahl
Kavin Bharathi
Vikram Chakravarthi
Hossein Ataee Yang Zhao design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
proposal2.pdf
proposal3.pdf
video
Sound Sleep
37
Ant-Weight Battlebot - DC Hammer
Carson Sprague
Gage Gathman
Ian Purkis
Haocheng Bill Yang Viktor Gruev design_document1.pdf
final_paper1.pdf
other1.pdf
photo1.png
photo2.png
photo3.png
presentation1.pptx
proposal1.docx
proposal2.pdf
video
39
Auto-Tuner with LCD Display
John Driscoll
Lee Susara
Nicholas Chan
Eric Tang Yang Zhao design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.pdf
video
40
Bilateral Earlobe Pulse Timing Measurement Device
Joshua Joseph
Mark Schmitt
Zhikuan Zhang
Shiyuan Duan Yang Zhao design_document1.pdf
final_paper1.pdf
other1.pdf
video
41
BetaSpray - Bouldering Route Assistance
Ingi Helgason
Maxwell Beach
Prakhar Gupta
Gayatri Chandran Viktor Gruev design_document1.pdf
final_paper1.pdf
proposal1.pdf
video1.mp4
video
42
Autonomous Cold Salad Bar
Siddhaarta Venkatesh
Tejas Alagiri Kannan
Tinhsu Wen
Aniket Chatterjee Craig Shultz design_document1.pdf
final_paper1.pdf
photo1.png
photo2.png
presentation1.pdf
proposal1.jpeg
proposal2.pdf
video
43
LeafLink
Hannah Pushparaj
Hassan Shafi
Praveen Natarajan
Aniket Chatterjee Craig Shultz design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video1.pdf
video
44
Voice-Activated Geographic Reference Globe
Mahathi Jayaraman
Rijul Roy
Varsha Mullangi
Chihun Song Joohyung Kim design_document1.pdf
final_paper1.pdf
photo1.webp
photo2.webp
photo3.webp
presentation1.pptx
proposal2.pdf
video
45
Focus Dial: A Tactile Hardware Interface for Distraction-Free Focus
Ahan Goel
Amogh Mehta
Benjamin Loo
Frey Zhao Craig Shultz design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
video
video
46
Snooze-Cruiser
Alex Wang
Jiachen Hu
Jizhen Chen
Jiaming Xu Joohyung Kim design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.pdf
video
47
Combative Hardened Ultra Tumbler
Abhinav Garg
Rahul Ramanathan Krishnamoorthy
Shobhit Sinha
Xiaodong Ye Viktor Gruev final_paper1.pdf
proposal1.pdf
video
48
Sleep Position Trainer
Brian Park
Kyle Lee
Nick Tse
Po-Jen Ko Yang Zhao design_document1.pdf
final_paper1.pdf
proposal1.pdf
video1.mp4
video
49
Move Displaying Chess Board
Jeanjuella Tipan
Matthew Trela
Tim Chen
Wenjing Song Joohyung Kim design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.pdf
video
50
Crowdsurf: Realtime Crowd-Monitoring for indoor spaces
Ananya Krishnan
John Abraham
Tanvika Boyineni
Aniket Chatterjee Joohyung Kim design_document1.pdf
final_paper1.pdf
photo1.jpeg
photo2.PNG
presentation1.pdf
proposal1.pdf
video
51
Networked Physical Chessboard for Remote Play
Danny Guller
Payton Schutte
Quinn Athas
Wenjing Song Arne Fliflet design_document2.pdf
final_paper1.pdf
other2.pptx
presentation1.pptx
video
52
LED Sphere Display
Ashley Saju
David Heydinger
Stephanie Eze
Shiyuan Duan Craig Shultz final_paper2.docx
proposal1.pdf
LabEscape POV
53
[Updated RFA] - Efficient Card Shuffler with Cut Card Insert
Alex Lo Faso
Matt Garrity
Steve Mathew
Aniket Chatterjee Joohyung Kim design_document1.pdf
final_paper2.pdf
photo1.HEIC
photo2.png
presentation1.pdf
proposal1.pdf
video
54
E-PEEL: Electronic Peeling Equipment for Easier Living
Hyun Jun Paik
Saathveek Gowrishankar
Varun Ramprakash
Manvi Jha Arne Fliflet design_document1.jpeg
design_document2.pdf
final_paper1.pdf
proposal1.pdf
proposal2.pdf
video
55
HydroFlora ( A Context-Aware Watering Can )
Charis Wang
Delilah Dzulkafli
Idris Ispandi
Mingrui Liu Viktor Gruev design_document1.pdf
final_paper1.pdf
photo1.png
presentation1.pptx
proposal1.pdf
video1.mp4
56
Automatic Bike Light
Magdalene Noftz
Nathanael Salazar
Pesandi Gunasekera
Chihun Song Arne Fliflet design_document1.pdf
final_paper1.pdf
photo1.HEIC
photo2.HEIC
photo3.HEIC
photo4.HEIC
presentation1.pptx
proposal1.pdf
video
57
Solar Scrubber
Jonathan Sengstock
Sandra Georgy
Yehia Ahmed
Chihun Song Joohyung Kim design_document1.pdf
final_paper2.pdf
other1.pdf
photo1.png
photo2.jpg
presentation1.pptx
video
58
Adherescent (Team 2) Auto Time Setting Scent Reminder
Megan Shapland
Wenchang Qi
Jiaming Xu Craig Shultz design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.pdf
video
Adherascent
59
Gesture Controlled Surveillance Robot
Kushl Saboo
Roshni Mathew
Suvid Singh
Argyrios Gerogiannis Yang Zhao photo1.jpeg
photo2.jpeg
photo3.jpeg
video
60
FadeX: Automated Nicotine Tapering Device
Ian Zentner
Justin Leith
Malik Kelly
Jiaming Xu Viktor Gruev design_document1.pdf
design_document2.pdf
final_paper1.pdf
final_paper4.pdf
proposal1.pdf
video
FadeX
61
Automatic Motorized Satellite Tracker/GroundStation & Down Converter Subsystem/RF frontend
Jumana Schmidt
Rishan Patel
Wiley Tong
Jason Jung Arne Fliflet design_document1.pdf
final_paper1.pdf
other1.jpg
photo1.jpg
presentation1.pdf
proposal1.pdf
video1.mp4
video
video
62
AI-Nutritious Culinary Assistant
Griffin Kelley
Jackson Brown
Tony Liu
Aniket Chatterjee Viktor Gruev design_document1.pdf
final_paper1.pdf
photo1.png
photo2.png
presentation1.pptx
proposal1.pdf
video
65
Active Postural Correction Vest
Aparna Srinivasan
Jordyn Andrews
Sophia Sulkar
Frey Zhao Yang Zhao design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
66
Self-playing Programmable Chromatic Harmonica
David Zhang
Robert Zhu
Sean Jasin
Wenjing Song Yang Zhao design_document2.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
67
Roomify: A Smart Room System
Benjamin Chang
Owen Wang
Warren Lam
Lukas Dumasius Craig Shultz design_document1.pdf
final_paper1.pdf
other1.png
other2.png
presentation1.pdf
proposal1.pdf
video
68
Insole Pressure Sensing System for Running
Aarush Sivanesan
Joseph Casino
Matthew Weng
Xiaodong Ye Craig Shultz design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
69
Paint Color and Gloss Classification Device
James Lee
Victoria Lee
Chihun Song Arne Fliflet design_document1.pdf
final_paper1.pdf
photo1.png
photo2.png
presentation1.pdf
proposal1.pdf
video
70
EduGrid Microgrid Demonstrator
Ahmet Colak
Jason Hart
Srijan Kunta
Abdullah Alawad Viktor Gruev design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.docx
video
71
E-Bike Theft Detection System
John Paul Hanley
Kacper Bakun
Paul Harris
Yulei Shen Craig Shultz design_document1.pdf
final_paper1.pdf
other1.pdf
presentation1.pdf
video
72
Single-Phase AC Power Analyzer
Isaac Herink
Jeffrey Pohlman
Joseph Kim
Eric Tang Arne Fliflet design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
73
Circle of Life: Automated Desktop Aquaponics System
Aishwarya Manoj
Anjali Aravindhan
Estela Medrano Gutierrez
Manvi Jha Joohyung Kim design_document1.pdf
final_paper1.pdf
photo1.jpg
photo2.jpg
photo3.png
photo4.png
presentation1.pdf
proposal1.pdf
video
74
Sensor Integrated Putter for Putting Stroke Analysis
Kyle Smith
Mithesh Ballae Ganesh
Nathan Hwang
Abdullah Alawad Craig Shultz design_document1.pdf
final_paper1.pdf
proposal1.pdf
video1.mp4
75
RailRider (Reaction-Wheel Uni-Wheel Inspection Robot with Vision)
James Recera
Varun Sharma
Zhanshuo Zhang
Abdullah Alawad Joohyung Kim design_document1.pdf
design_document2.pdf
final_paper1.pdf
proposal1.pdf
video
76
FPGA-based stock market data feed handler
Neel Ghosal
Saksham Jairath
Sara Sehgal
Gerasimos Gerogiannis Viktor Gruev design_document2.pdf
final_paper1.pdf
proposal1.pdf
video
78
Wearable Basketball Jumpshot Mechanics Analyzer
Aiden Zack
Arjun Vyas
Tanmay Nair
Mingrui Liu Joohyung Kim design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
79
Universal Gesture Interface
Connor Michalec
Kenobi Carpenter
Kobe Duda
Lukas Dumasius Yang Zhao design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
80
Edge-AI based audio classifier
Ahaan Joishy
Kavin Manivasagam
Om Dhingra
Gayatri Chandran Joohyung Kim design_document1.pdf
final_paper1.pdf
proposal1.pdf
proposal2.pdf
video
81
Controllable, User-Friendly 3-Phase Inverter
Alex Chirita
Johnathan Vogt
Shyam Peden
Frey Zhao Arne Fliflet appendix1.png
appendix2.png
appendix3.png
design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
proposal2.pdf
video
82
Real-Time Form Correction Device
Bhanu Kunam
Ishank Pujari
Sree Akkina
Po-Jen Ko Craig Shultz design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
84
AutoServe (Automated Room Service Bot)
Ethan Jiang
Johan Martinez
Nikhil Vishnoi
Po-Jen Ko Joohyung Kim design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
85
Modular Desktop Audio Mixer Control
Aarushi Sharma
Dylan Moon
Yulei Shen Craig Shultz design_document1.pdf
final_paper3.pdf
presentation1.pdf
proposal1.pdf
video
86
Any-Surface-Stylus for Computer
Alex Camaj
Ethan Forsell
John Bledsoe
Manvi Jha Craig Shultz design_document1.pdf
final_paper1.pdf
photo1.JPG
photo2.JPG
presentation1.pdf
proposal1.pdf
video
88
Catching Z's
Prineet Parhar
Srikar Palani
Suprathik Vinayakula
Zhuchen Shao Viktor Gruev design_document1.pdf
final_paper1.pdf
photo1.png
photo2.png
presentation1.pptx
proposal1.pdf
video
89
Screentime Habit Correction Headband
Colin Moy
Jake Chen
Zhiyuan Chen
Gayatri Chandran Craig Shultz design_document1.pdf
final_paper1.pdf
photo1.jpg
photo2.jpg
photo3.jpg
presentation1.pdf
proposal1.pdf
video
91
Automatic Bike Collision Prevention System
Charlie Wang
Nathan Zhu
Rahul Nayak
Frey Zhao Craig Shultz design_document1.pdf
final_paper1.pdf
presentation1.pptx
proposal1.pdf
video
93
Dynamic Violin Fingerboard Attachment
Adrian Ignaci
Kamil Waz
Sophia Wilhelm
Manvi Jha Yang Zhao design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
94
RFID Automatic Self Checkout Basket
Jacob Slabosz
Jada-Marie Griggs
Oscar Kaplon
Yulei Shen Joohyung Kim design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
95
Chair-Mounted Anti-Sedentary Detection System with Enforced Movement Clearing
Chris Huang
Jack Gaw
Melissa Wang
Gayatri Chandran Joohyung Kim design_document1.pdf
final_paper1.pdf
other1.mp4
presentation1.pptx
proposal1.pdf
96
Motion Sensing Guitar Pedal System
Luke Hilgart
Nicholas Oberts
Spencer Siegellak
Po-Jen Ko Yang Zhao design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
97
Facial Matching Display Mirror w/ Motion Sensor
Connor Tan
Keenan Peris
Krish Sahni
Argyrios Gerogiannis Yang Zhao design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
98
Real Time Piano Input Visualizer For Learning
Jay Park
Nuwan Singhal
Sarayu Suresh
Wenjing Song Yang Zhao design_document1.pdf
final_paper1.pdf
presentation1.pdf
proposal1.pdf
video
99
Predictive Indoor Ventilation Control Using Air Quality Estimation
Arka Kolay
Gulnaaz Sayyad
Noah Rockoff
Hossein Ataee Arne Fliflet design_document1.pdf
final_paper1.pdf
proposal1.pdf
video
100
Drone-Mounted GPR System
Anna Sako
Elijah Sutton
James Tang
Lukas Dumasius Craig Shultz design_document1.pdf
final_paper1.pdf
photo1
photo2.png
presentation1.pdf
video
101
Optimization of Hemispherical Imaging System for Subterraneum Root Detection
Alan Ilinskiy
Areg Gevorgyan
Liam Thompson
Jason Jung Arne Fliflet design_document2.pdf
final_paper1.pdf
proposal1.pdf
video
103
Adaptive Solar Panel Canopy for Vineyard Microclimate Control
Titouan Louis Matthieu Morel
Zikora Okonkwo
Zhuchen Shao Joohyung Kim design_document1.pdf
final_paper1.pdf
photo1.jpg
photo2.HEIC
photo3.jpeg
photo4.jpeg
photo5.jpeg
presentation1.pptx
proposal1.pdf
video

Smart Glasses for the Blind

Siraj Khogeer, Abdul Maaieh, Ahmed Nahas

Smart Glasses for the Blind

Featured Project

# Team Members

- Ahmed Nahas (anahas2)

- Siraj Khogeer (khogeer2)

- Abdulrahman Maaieh (amaaieh2)

# Problem:

The underlying motive behind this project is the heart-wrenching fact that, with all the developments in science and technology, the visually impaired have been left with nothing but a simple white cane; a stick among today’s scientific novelties. Our overarching goal is to create a wearable assistive device for the visually impaired by giving them an alternative way of “seeing” through sound. The idea revolves around glasses/headset that allow the user to walk independently by detecting obstacles and notifying the user, creating a sense of vision through spatial awareness.

# Solution:

Our objective is to create smart glasses/headset that allow the visually impaired to ‘see’ through sound. The general idea is to map the user’s surroundings through depth maps and a normal camera, then map both to audio that allows the user to perceive their surroundings.

We’ll use two low-power I2C ToF imagers to build a depth map of the user’s surroundings, as well as an SPI camera for ML features such as object recognition. These cameras/imagers will be connected to our ESP32-S3 WROOM, which downsamples some of the input and offloads them to our phone app/webpage for heavier processing (for object recognition, as well as for the depth-map to sound algorithm, which will be quite complex and builds on research papers we’ve found).

---

# Subsystems:

## Subsystem 1: Microcontroller Unit

We will use an ESP as an MCU, mainly for its WIFI capabilities as well as its sufficient processing power, suitable for us to connect

- ESP32-S3 WROOM : https://www.digikey.com/en/products/detail/espressif-systems/ESP32-S3-WROOM-1-N8/15200089

## Subsystem 2: Tof Depth Imagers/Cameras Subsystem

This subsystem is the main sensor subsystem for getting the depth map data. This data will be transformed into audio signals to allow a visually impaired person to perceive obstacles around them.

There will be two Tof sensors to provide a wide FOV which will be connected to the ESP-32 MCU through two I2C connections. Each sensor provides a 8x8 pixel array at a 63 degree FOV.

- x2 SparkFun Qwiic Mini ToF Imager - VL53L5CX: https://www.sparkfun.com/products/19013

## Subsystem 3: SPI Camera Subsystem

This subsystem will allow us to capture a colored image of the user’s surroundings. A captured image will allow us to implement egocentric computer vision, processed on the app. We will implement one ML feature as a baseline for this project (one of: scene description, object recognition, etc). This will only be given as feedback to the user once prompted by a button on the PCB: when the user clicks the button on the glasses/headset, they will hear a description of their surroundings (hence, we don’t need real time object recognition, as opposed to a higher frame rate for the depth maps which do need lower latency. So as low as 1fps is what we need). This is exciting as having such an input will allow for other ML features/integrations that can be scaled drastically beyond this course.

- x1 Mega 3MP SPI Camera Module: https://www.arducam.com/product/presale-mega-3mp-color-rolling-shutter-camera-module-with-solid-camera-case-for-any-microcontroller/

## Subsystem 4: Stereo Audio Circuit

This subsystem is in charge of converting the digital audio from the ESP-32 and APP into stereo output to be used with earphones or speakers. This included digital to audio conversion and voltage clamping/regulation. Potentially add an adjustable audio option through a potentiometer.

- DAC Circuit

- 2*Op-Amp for Stereo Output, TLC27L1ACP:https://www.ti.com/product/TLC27L1A/part-details/TLC27L1ACP

- SJ1-3554NG (AUX)

- Connection to speakers/earphones https://www.digikey.com/en/products/detail/cui-devices/SJ1-3554NG/738709

- Bone conduction Transducer (optional, to be tested)

- Will allow for a bone conduction audio output, easily integrated around the ear in place of earphones, to be tested for effectiveness. Replaced with earphones otherwise. https://www.adafruit.com/product/1674

## Subsystem 5: App Subsystem

- React Native App/webpage, connects directly to ESP

- Does the heavy processing for the spatial awareness algorithm as well as object recognition or scene description algorithms (using libraries such as yolo, opencv, tflite)

- Sends audio output back to ESP to be outputted to stereo audio circuit

## Subsystem 6: Battery and Power Management

This subsystem is in charge of Power delivery, voltage regulation, and battery management to the rest of the circuit and devices. Takes in the unregulated battery voltage and steps up or down according to each components needs

- Main Power Supply

- Lithium Ion Battery Pack

- Voltage Regulators

- Linear, Buck, Boost regulators for the MCU, Sensors, and DAC

- Enclosure and Routing

- Plastic enclosure for the battery pack

---

# Criterion for Success

**Obstacle Detection:**

- Be able to identify the difference between an obstacle that is 1 meter away vs an obstacle that is 3 meters away.

- Be able to differentiate between obstacles on the right vs the left side of the user

- Be able to perceive an object moving from left to right or right to left in front of the user

**MCU:**

- Offload data from sensor subsystems onto application through a wifi connection.

- Control and receive data from sensors (ToF imagers and SPI camera) using SPI and I2C

- Receive audio from application and pass onto DAC for stereo out.

**App/Webpage:**

- Successfully connects to ESP through WIFI or BLE

- Processes data (ML and depth map algorithms)

- Process image using ML for object recognition

- Transforms depth map into spatial audio

- Sends audio back to ESP for audio output

**Audio:**

- Have working stereo output on the PCB for use in wired earphones or built in speakers

- Have bluetooth working on the app if a user wants to use wireless audio

- Potentially add hardware volume control

**Power:**

- Be able to operate the device using battery power. Safe voltage levels and regulation are needed.

- 5.5V Max

Project Videos