Aianomdetect - Analytics Engine

The Aianomdetect Analytics Engine is a Python-based platform designed for automated data processing, analytics, and reporting. It features seamless integration with Google Sheets and includes an automated mailing system for error reporting and status updates.

Features

• Google Sheets Integration: Automated reading and writing to Google Sheets using OAuth2 credentials.
• Data ORM: A structured approach to handling data sources and sinks.
• Automated Mailing: Sends automated notifications and error reports via Gmail.
• Anomaly Detection: Includes modules for identifying irregularities in large datasets.
• Encryption: Built-in utilities for secure handling of sensitive credentials.

Tech Stack

• Core: Python 3.x
• Data Analysis: Pandas, NumPy
• Google Sheets API: gspread, PyDrive
• Security: cryptography
• Machine Learning: scikit-learn

Configuration

Sensitive credentials have been removed. Before running the application, set the following environment variables or provide a valid .env file:

• GOOGLE_CLIENT_ID: Your Google OAuth Client ID.
• GOOGLE_CLIENT_SECRET: Your Google OAuth Client Secret.
• GOOGLE_REFRESH_TOKEN: Your Google Refresh Token.
• CRYPT_KEY: The Fernet key used for encrypting/decrypting sensitive strings.

Installation

1. Clone the repository.
2. Install dependencies:

   pip install -r requirements.txt

Usage

The analytics engine can be triggered via:

python src/analytics_engine/mtb_daily_engine_correction.py

License

This project is licensed under the MIT License - see the LICENSE file for details.