This project is a cross-platform desktop application designed to help forgetful individuals and those with Alzheimer's by automatically logging daily events from their environment. Using the user’s webcam and microphone, the system will monitor and record important moments – for example, noting where the user placed their keys – and listen to conversations to create reminders, daily summaries, and conversation feeds. The application emphasizes privacy by running entirely locally (no cloud storage) and uses AI for intelligent motion detection, image understanding, and speech analysis.
This application is packaged with Electron to run as a standalone desktop app.
-
Install Dependencies: First, install the necessary Node.js modules and Python packages.
npm install cd Backend pip install -r requirements.txt cd ..
-
Run the Application: From the root directory, run the following command to launch the application:
npm run electron:dev
This will start the backend server, the frontend, and open the application window.
To create a distributable desktop application for your operating system (e.g., .dmg for macOS, .exe for Windows), run the following command from the root directory:
npm run electron-packThe packaged application will be located in the dist folder.
For developers who want to work on the source code, the frontend and backend can be run separately.
-
Navigate to the Backend Directory:
cd Backend -
Install Python Dependencies: It is recommended to use a virtual environment.
pip install -r requirements.txt
-
Run the Backend Server:
python3 app.py
The backend server will be running on http://localhost:5000.
-
Install JavaScript Dependencies: From the root directory of the project:
npm install
-
Start the Frontend Development Server:
npm start
The app will open at http://localhost:3000.
- React 18.2.0
- Create React App 5.0.1
- Tailwind CSS
- Python 3
- Flask
- OpenCV
- Google Gemini
- SQLite
- Electron
- Electron Builder
- Concurrently
- Fixing Motion Detection - Recording UI/Backend
- Adding way to delete timeline events
- Secret Pivot (TOP SECRET)