About NeuroScroll
NeuroScroll, also known as JustBlink, is an innovative AI-powered system designed for real-time human-computer interaction. It allows users to control documents and navigate interfaces using eye gestures, offering a hands-free and intelligent solution.
Key Features:
- AI-Powered Eye Gesture Control: Utilizes AI and computer vision to detect blinks and other eye movements for document control.
- Real-time Processing: Processes live video streams to provide immediate feedback and control.
- Eye Aspect Ratio (EAR) Calculation: Accurately measures eye openness to differentiate between blinks and normal eye states.
- Blink Detection Logic: Employs a Finite State Machine for robust detection of single blinks, long blinks, and double blinks.
- Gesture Recognition: Translates detected eye gestures into specific actions like scrolling down, scrolling up, and clicking.
- Full-Stack Architecture: Integrates frontend (Next.js, React) and backend (FastAPI, WebSockets) for a seamless experience.
- Visual System Interface: Provides a live camera feed with facial mesh overlay and real-time AI simulation for user feedback.
Technology Stack:
- Frontend: Next.js (App Router), React, MediaPipe FaceMesh, WebSocket API, Tailwind CSS.
- Backend: FastAPI, Uvicorn, NumPy, MongoDB, Python-dotenv.
- AI & Vision: MediaPipe FaceMesh, Eye Aspect Ratio (EAR), Blink State Machine, Gesture Classification Engine.
This project is ideal for research and educational purposes, demonstrating advanced concepts in computer vision, human-computer interaction, and full-stack AI integration.