divelog

A maps thingy to keep track of my dives. Done with Vibe Coding.

ToDo

install script and get started

install script: install script: "Database setup file not found. Please place your database_setup.sql file in the application's root directory." after succesfully enter credentials
install script: in the end I get a "Not Found The requested URL was not found on this server."
install script: make sure to copy the needed files from the github source
if install script reruns make sure it shall check before what is there already
add a proper admin panel to manage all aspects of the application from a single interface
implement HTTPS support by default for better security
create user role system for multiple divers sharing the same installation
add readme section about installing and the script

Installation Guide

Using the One-File Installer

The simplest way to install Divelog is using our one-file installer:

Download the Installer: Get the install.php file from the repository
Upload to Server: Upload only this file to your web server via FTP or file manager
Run the Installer: Navigate to https://your-domain.com/install.php in your browser
Follow the Steps: The installer will guide you through:
- System requirements check
- Directory creation
- Database configuration
- Database setup
- Final configuration

The installer automatically:

Checks if your server meets all requirements
Creates necessary directories with proper permissions
Sets up database connection
Imports the database schema
Creates the configuration file
Adds sample data (optional)
Self-deletes after completion for security (recommended)

What to Expect During Installation

The installation process consists of 5 easy steps:

Requirements Check:
- PHP version compatibility (PHP 8.0+ recommended)
- Required PHP extensions (mysqli, gd, fileinfo, zip)
- Server settings (execution time, file uploads, etc.)
Directory Setup:
- Creates required folders (uploads, backups, temp)
- Sets proper permissions (0755)
- Verifies write access
Database Configuration:
- Enter database connection details
- Tests the connection
- Creates configuration file
Database Setup:
- Downloads or imports database schema
- Creates all required tables
- Handles existing tables (with backup option)
Finalize Installation:
- Completes the setup process
- Provides links to the application
- Option to delete installer script for security

Troubleshooting Installation

If you encounter issues during installation:

Database Connection Errors: Verify your database credentials and ensure the database server is running.
Permission Issues: Make sure the web server user has write access to the installation directory.
Download Failures: If automatic downloads fail, you can manually upload the required files.
Existing Installation: The installer will detect and warn about existing installations, offering options to proceed safely.

For manual troubleshooting, check the installer's detailed error messages or your server's error logs.

Dealing with Permission Issues

If you see errors like "directory creation failed" or "write failed" during installation:

Check Server Permissions:
- Most shared hosting environments restrict PHP's ability to create directories or write files
- Contact your hosting provider to confirm the correct permissions and directories where PHP can write
Manual Installation Alternative:
- Download the complete application package from GitHub
- Extract it on your local computer
- Upload all files to your server via FTP
- Ensure directories have proper permissions:
```
uploads/          (755 or 775)
uploads/dive_images  (755 or 775)
uploads/fish_images  (755 or 775)
backups/          (755 or 775)
temp/             (755 or 775)
```
- Manually create config.php using the template below
- Run the installer with ?step=3 to continue with database setup
Host-Specific Settings:
- Some hosts require files and directories to be in specific locations
- For cPanel hosting: place upload directories in /home/username/public_html/uploads
- For Plesk hosting: use /var/www/vhosts/domain.com/httpdocs/uploads
Using FTP for Setup:
- Upload all files via FTP
- Create the required directories manually
- Set correct permissions using your FTP client
- Run the installer with ?skip_file_creation=1 to bypass file creation steps

Config File Template:

<?php
// Database configuration
define('DB_HOST', 'localhost');
define('DB_USER', 'your_username');
define('DB_PASS', 'your_password');
define('DB_NAME', 'divelog');

// Create connection
$conn = new mysqli(DB_HOST, DB_USER, DB_PASS, DB_NAME);

// Check connection
if ($conn->connect_error) {
  die("Connection failed: " . $conn->connect_error);
}

// Set charset
$conn->set_charset('utf8mb4');
?>

Advanced Installation Options

The installer provides advanced options for specific needs:

Custom MySQL Socket: If your database uses a non-standard socket path
Custom Port: For database servers running on non-default ports
Force Installation: Override existing installation checks when needed
Manual Download: Option to manually download and place required files

Security During Installation

The installer implements several security measures:

Verification of token authenticity for form submissions
Secure handling of database credentials
Creation of proper file permissions
Option to delete the installer after completion (recommended)
Detection of existing installations to prevent accidental data loss

Post-Installation Steps

After completing the installation:

Set Up HTTPS: Configure SSL for secure connections (recommended)
Configure Backups: Set up regular database backups
Test the Application: Try adding a dive and verify all features work
Update Password: If using sample data, change any default passwords

Recent Changes

Added Admin Panel:
- Created comprehensive admin dashboard to manage all aspects of the application
- Centralized interface for managing dives, fish, database operations, and settings
- Intuitive navigation with quick access to all administrative functions
- Responsive design that works on mobile devices and desktops
- Enhanced security with confirmation dialogs for destructive actions
- Real-time statistics and system information display
HTTPS Support by Default:
- Implemented automatic HTTPS redirection for better security
- Added HSTS headers to enforce secure connections
- Updated documentation with SSL configuration guidance
- Ensured all assets load securely to prevent mixed content warnings
- Added fallback for development environments without SSL certificates
New One-File Installer Script:
- Added a single-file PHP installer that automates the setup process
- Guides users through system requirements verification
- Creates necessary directories with proper permissions
- Handles database configuration and initialization
- Populates sample data for immediate testing
- Self-deletes after successful installation for security
- Provides a user-friendly step-by-step interface with progress tracking
Standardized CSV Format and Import/Export:
- Improved CSV file handling for consistent formatting
- Fixed issues with decimal separators (standardized to periods)
- Added proper quoting for text fields containing special characters
- Enhanced handling of duplicate entries
- Removed inconsistencies in field formatting
- Fixed coordinate formatting for proper geocoding
- Improved data validation during import process
- Standardized empty field handling
Fixed SQL Error for Empty Numeric Fields:
- Fixed "Incorrect integer value" error when submitting empty values for numeric fields like visibility
- Improved form handling to convert empty string inputs to NULL values in database
- Enhanced error handling for all numeric fields (visibility, water temperature, air temperature, etc.)
- Ensures robust form submissions even with incomplete dive data
Enhanced Error Handling in Map Display:
- Added robust error handling for fetch requests in map.js
- Implemented user-friendly error messages for various error types (network errors, server errors, JSON parsing issues)
- Created dismissable error notifications with retry functionality
- Added detailed logging for debugging server response issues
- Improved data validation for non-standard API responses
Enhanced User Interface Aesthetics:
- Redesigned dive popups with consistent styling, improved alignment, and better icon usage
- Updated statistics cards to match map width and provide a cohesive visual experience
- Added visual indicators for technical dive details (air consumption, weight, suit type, water type)
- Implemented responsive layout that adapts to different screen sizes
- Improved color coding and visual hierarchy for better scan-ability
- Integrated comprehensive dive statistics dashboard directly on the map page showing dive metrics:
  - Total dives count and unique locations
  - Maximum depth achieved
  - Average dive duration
  - Total underwater time
  - Latest dive information
CSV Import Fixes and Enhancements:
- Fixed "Choose File" button functionality to properly open the file selection dialog
- Added PHP 8 compatibility fixes for handling null values in string functions
- Resolved deprecation warnings related to trim() function
- Improved error handling in CSV processing
Enhanced CSV Import Performance and Reliability:
- Added timeout prevention with increased execution time limit (5 minutes)
- Implemented geocoding optimization with location caching
- Added batch processing with progress tracking for large imports
- Added real-time progress indicator for better user feedback
- Added internet connectivity check before geocoding attempts
- Improved error handling for missing coordinates
- Added option to enable/disable automatic geocoding
Fish Management Integration: Removed fish list from navigation menu while maintaining full fish sighting functionality within dive details.
Enhanced CSV Import Reliability: Fixed errors related to ENUM fields and improved handling of suit_type and water_type entries.
Enhanced Data Privacy: Added .gitignore rules to prevent sensitive data from being uploaded.
Fixed File Upload Issues: Improved file input handling for CSV imports.
Removed Snorkeling Option: Streamlined activity tracking to focus solely on diving.
Clarified Field Purposes: Distinction between "Description" and "Comments" fields.
Added Technical Dive Details: Included tracking for air consumption, weight, suit type, and water type.
Improved CSV Import: Enhanced detection of CSV delimiters and error handling.
Added Country Information and Flags:
- Enhanced dive popups with country information display
- Added Unicode flag emojis based on country names
- Implemented a robust country name to ISO code mapping system
- Styled country display with responsive design for all device sizes
- Added visual separation between country information and other dive details
Enhanced Installer Script:
- Fixed issues with script execution and duplicated content
- Added detection for existing installations to prevent accidental overwrites
- Implemented automatic backup of existing database before reinstallation
- Improved user interface with clear warnings and options for existing installations
- Added force flag option to bypass existing installation checks when needed
- Enhanced cleanup functionality with multiple methods for removing installation markers
- Added advanced "Force Cleanup" option for resolving stubborn installation issues
- Improved handling of inconsistent installation states with clear guidance
- Added detailed feedback on cleanup operations for better troubleshooting

Project Changes

This project has undergone a major restructuring:

Moved from Node.js/Express/MongoDB stack to PHP/MySQL implementation
Created dive log system with robust database schema
Added support for:
- Dive location tracking with interactive map visualization
- Comprehensive dive metrics (depth, duration, temperature, etc.)
- Image uploads for each dive
- Year-based filtering
- Dive site categorization
- Ratings system
- Fish species tracking with images from both uploads and web sources
- Recording fish sightings linked to specific dives
- Database backup functionality (schema and content)
- Mobile-first responsive design using Bootstrap 5
Simplified architecture for easier maintenance and self-hosting

Features

Interactive Map:
- View all dive locations on a map with detailed popups
- Advanced marker clustering for better visualization of dive sites
- Intelligent grouping of nearby dive locations
- Interactive cluster popups showing location summaries
- Comprehensive statistics dashboard showing dive metrics:
  - Total dives count and unique locations
  - Maximum depth achieved
  - Average dive duration
  - Total underwater time
  - Latest dive details
- Year filtering for focused analysis
Dive Log Management:
- Add, edit, and delete dive entries with detailed information
- Record comprehensive dive metrics:
  - Basic: depth, duration, water/air temperature, visibility
  - Technical: air consumption (start/end pressure), weight, suit type, water type
- Track dive buddies and site types
- Rate dives on a 1-5 scale
- Add comments and descriptions
Image Management: Upload and manage dive images
Fish Species Tracking: Record and manage fish species with images
Fish Sightings: Link fish sightings to specific dives
Year Filtering: Filter dives by year
Backup & Export:
- Database backup and restore functionality
- Export dive logs to CSV format
- Database management options:
  - Delete all entries for fresh start
  - Populate with sample data for testing
  - Selective export of dive logs
OCR Import: Convert handwritten dive logs to digital entries using OCR technology
- Batch process multiple logbook pages
- Automatic data extraction for:
  - Date
  - Location
  - Depth
  - Duration
  - Temperature
  - Visibility
  - Comments
- Manual review and correction of extracted data
Responsive Design:
- Mobile-first approach ensures optimal viewing on all devices
- Touch-friendly interface elements
- Adaptive layout that scales from phones to desktop screens
- Optimized map controls for touch screens
Export & Import:
- Export dive logs to CSV format with all dive data
- Import dive logs from CSV with flexible field mapping
- Intelligent handling of duplicate detection for multiple dives:
  - Uses time slot to differentiate between dives at the same location on the same day
  - Provides helpful warnings when time information might be needed
- Automatic geocoding of locations without coordinates
- Support for various CSV formats (comma or semicolon delimiters)
- European number format support (comma as decimal separator)
- Detailed error feedback and import result summary

Usage

View Dive Log: Open index.php to see the interactive map with all dives
Manage Database: Use manage_db.php to:
- Create and manage database backups
- Restore from backup files
- Export dive logs to CSV format
- Delete database entries
- Populate database with sample data for testing
Manage Dive Entries: Use populate_db.php to add, edit, or delete dive entries
Fish Species: Use fish_manager.php to manage fish species and sightings
Import Logs: Use import.php to convert handwritten logs using OCR

OCR Requirements

To use the OCR functionality, you need to install Tesseract OCR on your server:

# On macOS
brew install tesseract

# On Ubuntu/Debian
sudo apt-get install tesseract-ocr

The OCR feature supports:

Multiple image formats (JPEG, PNG, etc.)
Batch processing of multiple logbook pages
Automatic data extraction with manual review
Saving processed data directly to the database

Easy Installation

The Divelog application now includes a simple installer script that makes deployment on a new server quick and easy.

Using the Installer

Upload a Single File: Only upload install.php to your server
Access the Installer: Navigate to install.php in your web browser
Follow the Steps: The installer will guide you through:
- System requirements check
- Directory creation with proper permissions
- Database configuration setup
- Database schema and sample data initialization
- Final configuration settings

The installer will check your server's compatibility, create necessary directories, help you set up your database connection, and initialize the database with the required tables and sample data.

Database Setup

The application provides an easy way to download the database setup file:

Download the Setup File: Click the "Download Database setup file" button from the installer
Import the SQL File: Use phpMyAdmin or any MySQL client to import the downloaded file
Complete the Installation: Follow the remaining steps in the installer to connect to your newly created database

This ensures you have the correct database schema with all necessary tables for the application to function properly.

Existing Installation Detection

The installer now includes smart detection for existing installations:

Automatically detects if Divelog is already installed on the server
Provides clear warnings when existing components are found
Offers options to either continue with the existing installation or start fresh
Creates automatic backups before overwriting existing database tables
Includes a force mode option to bypass checks when needed

Enhanced Cleanup Features

The installer includes powerful cleanup capabilities to handle problematic installations:

Multiple Cleanup Methods: Uses several approaches to ensure all installation markers are properly removed
Force Cleanup Option: Advanced cleanup functionality for stubborn cases where standard methods fail
Detailed Feedback: Clear reporting on which files were successfully removed and which might need manual intervention
Session Handling: Properly resets all session variables to ensure a truly fresh start
Inconsistency Detection: Identifies and provides specific solutions for inconsistent installation states (like when markers exist but configuration files don't)

Security Features

The installer includes security features:

Verification of server requirements before proceeding
Secure database creation
Proper file permission settings
Optional self-deletion after installation

Post-Installation

After installation:

The application will be fully configured and ready to use
You can log in and start adding your dive logs
Sample data will be available for you to test and explore features

This one-file approach eliminates the need to manually copy files, create directories, set permissions, or run SQL scripts.

Setup Guide

Prerequisites

Web Server
- Apache or Nginx web server
- PHP 8.0 or higher
- PHP extensions:
  - mysqli
  - gd (for image processing)
  - fileinfo (for file uploads)
  - zip (for database backups)
Database
- MySQL 5.7 or higher
- phpMyAdmin (recommended for database management)

Installation Steps

Clone the Repository

git clone https://github.com/yourusername/divelog.git
cd divelog

Configure Web Server
- Point your web server's document root to the project directory
- Ensure the following directories are writable:
  - uploads/
  - backups/

Database Setup

Create a new MySQL database
Import the initial schema from database_setup.sql

Create a config.php file with the following template:

<?php
// Database configuration
define('DB_HOST', 'localhost');
define('DB_USER', 'your_username');
define('DB_PASS', 'your_password');
define('DB_NAME', 'divelog');

// Create connection
$conn = new mysqli(DB_HOST, DB_USER, DB_PASS, DB_NAME);

// Check connection
if ($conn->connect_error) {
  die("Connection failed: " . $conn->connect_error);
}
?>

Alternatively, after database creation, navigate to update_database.php in your browser to automatically set up the required tables and columns

File Permissions

chmod 755 uploads/
chmod 755 backups/
chmod 644 config.php

Security Configuration
- Set up proper .htaccess rules to protect sensitive files
- Configure PHP settings in php.ini:
```
upload_max_filesize = 10M
post_max_size = 10M
max_execution_time = 300
```
Testing the Installation
- Access the application through your web browser
- Try to add a new dive entry
- Verify image uploads work
- Check if the map displays correctly

Troubleshooting

Database Connection Issues
- Verify database credentials in config.php
- Check if MySQL service is running
- Ensure database user has proper permissions
Image Upload Problems
- Check file permissions on uploads directory
- Verify PHP GD extension is installed
- Check PHP error logs for specific issues
Map Display Issues
- Ensure JavaScript is enabled in browser
- Check browser console for errors
- Verify internet connection for map tiles
CSV Import Performance Issues
- Check PHP execution time limit in php.ini (should be at least 300 seconds)
- Ensure internet connection is available for geocoding functionality
- Consider disabling automatic geocoding for large imports
- Provide complete coordinates in CSV files when possible
- For large imports, process files in smaller batches
- Check browser console for AJAX errors during progress tracking

Backup and Maintenance

Regular Backups
- Use the built-in backup functionality in manage_db.php
- Create manual backups before major changes
- Schedule automated backups using cron jobs
- Store backups in a secure location
- Restore from backups when needed
Database Management
- Use manage_db.php for comprehensive database operations:
  - Reset/delete database entries when needed
  - Populate with sample data for testing or demonstrations
  - Export selected dive logs to CSV format
  - Manage database backup files (download/delete)
Updates
- Pull latest changes from repository
- Check for database schema updates
- Test all functionality after updates

Security Enhancement Plan

To address the remaining security concerns, the following improvements should be implemented:

Database Protection

Confirmation Dialogs for Destructive Actions
- Current status: Basic JavaScript confirmation dialogs are in place but could be enhanced
- Needed: Add more robust confirmation for database truncation operations with a required typing verification
User Privilege Management
- Current status: No user privilege system in place
- Needed: Add basic user roles (admin, regular user) with different access levels to destructive operations
Transaction Safety
- Current status: Using transactions in some critical operations
- Needed: Ensure all database modifications use transactions consistently with proper error handling

SQL Injection Prevention

Prepared Statements Usage
- Current status: Most queries use prepared statements, but some direct queries exist
- Needed: Convert all direct $conn->query() calls to use prepared statements with parameter binding
Input Validation
- Current status: Basic validation exists but could be more comprehensive
- Needed: Add consistent input validation for all form submissions using a centralized validation library
Query Building Safety
- Current status: Some queries are built dynamically with concatenation
- Needed: Replace string concatenation in queries with parameterized alternatives

Implementation Timeline

Immediate Actions
- Add confirmation typing verification for database truncation operations
- Convert direct queries to prepared statements in critical files
Short-term Improvements
- Create a centralized validation library
- Add database logging for all destructive operations
Long-term Enhancements
- Implement user role management
- Add comprehensive audit logging system

Expected Outcomes

Prevention of accidental database table deletions
Protection against SQL injection vulnerabilities
Improved operational safety with better confirmation mechanisms
Enhanced error handling and recovery procedures

Name		Name	Last commit message	Last commit date
Latest commit History 84 Commits
backups		backups
uploads		uploads
.gitignore		.gitignore
.htaccess		.htaccess
README.md		README.md
add_sample_fish.php		add_sample_fish.php
backup_db.php		backup_db.php
check_import_progress.php		check_import_progress.php
csv_template.php		csv_template.php
database_setup.sql		database_setup.sql
db.php		db.php
divelist.php		divelist.php
divelog_functions.php		divelog_functions.php
edit_dive.php		edit_dive.php
edit_dive_form.php		edit_dive_form.php
export_csv.php		export_csv.php
fish_details.php		fish_details.php
fish_manager.php		fish_manager.php
get_dive_data.php		get_dive_data.php
get_fish_sightings.php		get_fish_sightings.php
import.php		import.php
import_csv.php		import_csv.php
index.php		index.php
install.php		install.php
manage_db.php		manage_db.php
map.js		map.js
navigation.php		navigation.php
ocr_import_section.php		ocr_import_section.php
populate_db.php		populate_db.php
process_ocr.php		process_ocr.php
save_ocr_data.php		save_ocr_data.php
script.js		script.js
style.css		style.css
update_database.php		update_database.php
view_dive.php		view_dive.php

sw82/divelog

Folders and files

Latest commit

History

Repository files navigation