Skip to content

Smart assistant using iris tracking for paralyzed and bed-ridden people.

Notifications You must be signed in to change notification settings

rushatgabhane/Claire

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

27 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Claire - Smart Assistant for the paralyzed

Paralyzed people are unable to move or communicate effectively and are highly dependent on others. They can only use a limited number of muscles including the muscles in their eyes and eyelids. This project proposes a Smart Assistant controlled using iris movements like gaze left, right, and up.

Control home appliances like light, fan etc or facilitate a conversation using commonly used phrases which the app reads out aloud. All using iris movements.

Because of a low initial setup cost of $3 and availability of a smartphone in almost all households, this project can be leveraged as a cost-effective and highly accessible method, and extended to practically every household in a country like India.

Hardware: EM relay switch Y32F-SS-105HM and ESP8266 wifi module.
Built with TensorFlow, and React Native.

Build Instructions

Make sure you have react native with expo setup https://reactnative.dev/docs/environment-setup.

  • npm install to install dependencies.
  • expo start to run the app.

Snapshots

UI

image

Proposed setup

A phone is mounted in front of the paralyzed person. And an electromagnetic relay switch Y32F-SS-105HM with the ESP8266 wifi module is attached to the home appliance.

image

Flow chart

image

About

Smart assistant using iris tracking for paralyzed and bed-ridden people.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published