Entrepreneurial Resources

Ingenuity Article on ECE

"If you have a dream, it's better to try and start a company and fail than to not try at all," said Whoola's founder Iyer, who is currently working with venture capitalists to hire a seasoned management team to help oversee his company's growth. Iyer appreciates the university's efforts to incubate start-up companies. "Some of the greatest companies got started in a garage," Iyer said. "This university is providing a five-star garage," he added, referring to the TCL, "so anybody who does not think the U of I is doing enough should maybe not be an entrepreneur."

MRM's Peck believes the timing is right for more entrepreneurs to enter the arena. "Students interested in pursuing this kind of a route are going to see tremendous resources begin to come into place over the next few years both on and off campus," predicted Peck.

Design Competitions

Available Grants

1) Leung Fund

Eligibility: ECE Students, individually or in teams of up to 4 students, at least one being in ECE, may apply for funds up to a maximum of $2,000 for use in accomplishing projects beyond normal classroom activities. These projects may be done as part of a normal class, but should in some way be extraordinary for that class. Projects may also be part of an individual study supervised by a faculty member or may be done within the context of a student organization.

Use of funds: Funds may be used for material costs, services (e.g. machine shop time), and, in special circumstances, travel.

Application materials: Students should submit: 

1. An abstract describing the project in 200-400 words.

2. An itemized budget and accompanying budget justification.

3. A list of deliverables. A final report should always be included in this list.

4. A timeline.

5. An outlook for plans beyond the project and long term impact.

Application process: Materials should be emailed to leungfund@illinois.edu with the subject line "Leung Student Venture Fund." Applications should be received by the end of the fourth week of the semester for full consideration, but will be reviewed on an ad hoc basis after that and funded contingent on remaining budget.

Dispersal of funds: Students should obtain supplies through the ECE Store whenever possible. Otherwise, reimbursements will be handled in the ECE Business Office. Orders and receipts should be consistent with the approved budget and will be reviewed. Major changes in budget should be approved by the review committee. Small adjustments in price or specific component choice do not require additional approval.

 

2) NCIIA

Advanced E-Team Grants
Grants range from $1,000 to $20,000 and may be used for further development and plans for commercialization of their ideas. Funding can be used for project expenses, legal fees, or student internships. These grants will be renewable for up to three years in declining amounts.

3) OSBI

As the consulting arm of the Illinois MBA program, OSBI finds solutions for companies as big Procter & Gamble or as small as technology startups here at the University of Illinois. OSBI conducts 30-40 projects at one time. Clients include General Electric, Dow AgroSciences, Lucent Technologies, Mayo Medical Ventures, and many technology start-ups and commercialization efforts.

If you have an interest in developing your projects further, please use their Contact page to request further information.

Intellectual Property

In the Intellectual Property world, there are four distinct types of safeguards for your ideas: Patents, Copyrights, Trade Secrets, and Trademarks.

  1. PATENTS: A patent is a license by the government that permits its owner to exclude members of the public from making, using, or selling the claimed invention.

    Important things to remember about patents:
    • To receive a patent, the invention must be useful, novel, and unobvious.
    • Disclosure: When an invention is publicly disclosed, inventors have one year to file a patent. Public disclosure means that the invention was seen in a public setting or similarly accessible to the public.
    • Cost: A patent application process will cost anywhere from $2000 - $10,000, and protection lasts from 14 to 20 years.
    • Laboratory notebooks are VERY important.
    • A provisional patent application (PPA) is a low-cost way of delaying the filing of a full patent application for one year. The filing fee is $75 - $150.
    • Priority goes to the first to invent, not the first to file.
    A presentation by Joe Barich on Patent Engineering and intellectual property is available for your perusal.
    Disclaimer: This presentation does not constitute legal advice. This presentation does not create an attorney-client relationship. This presentation was accurate as of the date it was originally given, but may become inaccurate due to changes in the underlying legal framework.
     
  2. COPYRIGHTS: A copyright covers only the expression of a work and does not do anything to stop people from approaching clever ideas that happened to be embodied in that work. A Copyright extends to software, meaning no one can copy it. No registration is mandatory, though registration could make for stronger claims later in case of infringement. Competitors could still look at software and come close to it without actually copying it. However, with a patent on the full invention, including the software, competitors are forbidden to design something like it.
     
  3. TRADE SECRETS: A trade secret is a duty to keep an invention secret, thus protecting it until a patent is issued or an invention is publicly disclosed. It is possible that this protection can be lost if secrets are not protected.
     
  4. TRADEMARKS: A trademark is either a word, phrase, symbol, or design that identifies and distinguishes the source of the goods or services of one party from those of others.

Here is the official Illinois Policy Concerning Ownership of Intellectual Property Created by Students as Class Work.

Here is a list of Web Resources maintained by the OTM for the University's Patent Office. For more specific instructions, see the following section.

Invention or Software Copyright Disclosures

Here are instructions for dealing with invention disclosures or software copyright disclosures, should the need arise:

  1. Go to the OTM (Office of Technology Management) Web site: http://www.otm.illinois.edu/
     
  2. Under the "For Campus" tab, there is the (1) Invention Disclosure Form, (2) Software Disclosure Form, and (3) Mobile App Disclosure Form. Complete and submit -- through the ECE Department -- the applicable Disclosure Form.
     
  3. The Invention Disclosure Form, under Section 14, contains the following statement:

    I (We) hereby agree to assign all right, title and interest to this invention to the UI and agree to execute all documents as requested, assigning to UI our rights in any patent application filed on this invention and to cooperate with the RTMO in the protection of this invention. UI will share any royalty income derived from the invention with the inventor(s) according to the General Rules, Article III, Section 8.

    Cross out/strike that paragraph -- and write in something like SEE ATTACHED LETTER -- and then add a letter that explains what you want from the University and why, giving as much detail as necessary for the OTM to check out the situation fully (i.e., that is not already covered by answering the questions in the Disclosure Form).
     
  4. After completing the Form, send it to the ECE Assistant to the Department Head in the Business Office (2120 ECEB). The form will be forwarded to OTM with a cover letter. OTM will then assign the Disclosure to a Tech Manager who will follow up as needed and coordinate a response to the students involved.

Transferring Intellectual Property Rights

Some projects proposed by mentors external or internal to the University, may require that you transfer the rights to intellectual property developed as part of the project they propose. Whether you agree to transfer the rights or decide to undertake a different project is completely up to you, the student.

If you do decide to undertake the proposed project, you will need to sign over your rights using this pre-approved form.

Smart Glasses for the Blind

Siraj Khogeer, Abdul Maaieh, Ahmed Nahas

Smart Glasses for the Blind

Featured Project

# Team Members

- Ahmed Nahas (anahas2)

- Siraj Khogeer (khogeer2)

- Abdulrahman Maaieh (amaaieh2)

# Problem:

The underlying motive behind this project is the heart-wrenching fact that, with all the developments in science and technology, the visually impaired have been left with nothing but a simple white cane; a stick among today’s scientific novelties. Our overarching goal is to create a wearable assistive device for the visually impaired by giving them an alternative way of “seeing” through sound. The idea revolves around glasses/headset that allow the user to walk independently by detecting obstacles and notifying the user, creating a sense of vision through spatial awareness.

# Solution:

Our objective is to create smart glasses/headset that allow the visually impaired to ‘see’ through sound. The general idea is to map the user’s surroundings through depth maps and a normal camera, then map both to audio that allows the user to perceive their surroundings.

We’ll use two low-power I2C ToF imagers to build a depth map of the user’s surroundings, as well as an SPI camera for ML features such as object recognition. These cameras/imagers will be connected to our ESP32-S3 WROOM, which downsamples some of the input and offloads them to our phone app/webpage for heavier processing (for object recognition, as well as for the depth-map to sound algorithm, which will be quite complex and builds on research papers we’ve found).

---

# Subsystems:

## Subsystem 1: Microcontroller Unit

We will use an ESP as an MCU, mainly for its WIFI capabilities as well as its sufficient processing power, suitable for us to connect

- ESP32-S3 WROOM : https://www.digikey.com/en/products/detail/espressif-systems/ESP32-S3-WROOM-1-N8/15200089

## Subsystem 2: Tof Depth Imagers/Cameras Subsystem

This subsystem is the main sensor subsystem for getting the depth map data. This data will be transformed into audio signals to allow a visually impaired person to perceive obstacles around them.

There will be two Tof sensors to provide a wide FOV which will be connected to the ESP-32 MCU through two I2C connections. Each sensor provides a 8x8 pixel array at a 63 degree FOV.

- x2 SparkFun Qwiic Mini ToF Imager - VL53L5CX: https://www.sparkfun.com/products/19013

## Subsystem 3: SPI Camera Subsystem

This subsystem will allow us to capture a colored image of the user’s surroundings. A captured image will allow us to implement egocentric computer vision, processed on the app. We will implement one ML feature as a baseline for this project (one of: scene description, object recognition, etc). This will only be given as feedback to the user once prompted by a button on the PCB: when the user clicks the button on the glasses/headset, they will hear a description of their surroundings (hence, we don’t need real time object recognition, as opposed to a higher frame rate for the depth maps which do need lower latency. So as low as 1fps is what we need). This is exciting as having such an input will allow for other ML features/integrations that can be scaled drastically beyond this course.

- x1 Mega 3MP SPI Camera Module: https://www.arducam.com/product/presale-mega-3mp-color-rolling-shutter-camera-module-with-solid-camera-case-for-any-microcontroller/

## Subsystem 4: Stereo Audio Circuit

This subsystem is in charge of converting the digital audio from the ESP-32 and APP into stereo output to be used with earphones or speakers. This included digital to audio conversion and voltage clamping/regulation. Potentially add an adjustable audio option through a potentiometer.

- DAC Circuit

- 2*Op-Amp for Stereo Output, TLC27L1ACP:https://www.ti.com/product/TLC27L1A/part-details/TLC27L1ACP

- SJ1-3554NG (AUX)

- Connection to speakers/earphones https://www.digikey.com/en/products/detail/cui-devices/SJ1-3554NG/738709

- Bone conduction Transducer (optional, to be tested)

- Will allow for a bone conduction audio output, easily integrated around the ear in place of earphones, to be tested for effectiveness. Replaced with earphones otherwise. https://www.adafruit.com/product/1674

## Subsystem 5: App Subsystem

- React Native App/webpage, connects directly to ESP

- Does the heavy processing for the spatial awareness algorithm as well as object recognition or scene description algorithms (using libraries such as yolo, opencv, tflite)

- Sends audio output back to ESP to be outputted to stereo audio circuit

## Subsystem 6: Battery and Power Management

This subsystem is in charge of Power delivery, voltage regulation, and battery management to the rest of the circuit and devices. Takes in the unregulated battery voltage and steps up or down according to each components needs

- Main Power Supply

- Lithium Ion Battery Pack

- Voltage Regulators

- Linear, Buck, Boost regulators for the MCU, Sensors, and DAC

- Enclosure and Routing

- Plastic enclosure for the battery pack

---

# Criterion for Success

**Obstacle Detection:**

- Be able to identify the difference between an obstacle that is 1 meter away vs an obstacle that is 3 meters away.

- Be able to differentiate between obstacles on the right vs the left side of the user

- Be able to perceive an object moving from left to right or right to left in front of the user

**MCU:**

- Offload data from sensor subsystems onto application through a wifi connection.

- Control and receive data from sensors (ToF imagers and SPI camera) using SPI and I2C

- Receive audio from application and pass onto DAC for stereo out.

**App/Webpage:**

- Successfully connects to ESP through WIFI or BLE

- Processes data (ML and depth map algorithms)

- Process image using ML for object recognition

- Transforms depth map into spatial audio

- Sends audio back to ESP for audio output

**Audio:**

- Have working stereo output on the PCB for use in wired earphones or built in speakers

- Have bluetooth working on the app if a user wants to use wireless audio

- Potentially add hardware volume control

**Power:**

- Be able to operate the device using battery power. Safe voltage levels and regulation are needed.

- 5.5V Max

Project Videos