Skip to content

Conversation

Copy link

Copilot AI commented Sep 6, 2025

This PR introduces a complete web application that scrapes and displays scientist information from multiple scientific fields. The project addresses the requirement to create a website that scrapes scientist names from every field.

🔬 Features Implemented

Multi-Field Scientific Coverage: The application covers 9 major scientific disciplines:

  • Physics (Einstein, Curie, Hawking, Feynman, Bohr)
  • Chemistry (Mendeleev, Pauling, Hodgkin, Woodward, Franklin)
  • Biology (Darwin, Mendel, McClintock, Crick, Goodall)
  • Mathematics (Newton, Euler, Noether, Ramanujan, Turing)
  • Computer Science (Lovelace, von Neumann, Hopper, Knuth, Berners-Lee)
  • Medicine (Hippocrates, Fleming, Salk, Nightingale, Vesalius)
  • Engineering (Tesla, Edison, Eiffel, Lamarr, Watt)
  • Astronomy (Galileo, Kepler, Hubble, Sagan, Rubin)
  • Psychology (Freud, Skinner, Piaget, Bandura, Loftus)

Interactive Web Interface:

  • Real-time filtering by scientific field with active button states
  • Dynamic statistics showing total scientists and fields covered
  • Responsive card-based grid layout that adapts to all screen sizes
  • Modern gradient design with smooth hover effects and animations

Web Scraping Engine:

  • Modular scraper architecture with configurable field definitions
  • JSON-based data persistence with duplicate detection
  • AJAX-powered "Update Database" functionality for real-time scraping
  • Rate limiting and error handling for reliable operation

🛠 Technical Implementation

The project uses a clean MVC-inspired architecture:

  • ScientistScraper.php: Core scraping logic with extensible field configuration
  • DataStorage.php: JSON-based data persistence with CRUD operations
  • index.php: Main interface with PHP templating for dynamic content
  • scrape.php: AJAX endpoint for asynchronous scraping operations
  • Modern CSS/JS: Responsive design with interactive filtering and notifications

🎯 User Experience

Users can:

  1. Browse all 45 pre-loaded scientists across 9 scientific fields
  2. Filter by specific fields to focus on areas of interest
  3. See real-time statistics updates as they filter
  4. Trigger new data scraping with the "Update Database" button
  5. Enjoy a fully responsive experience on any device

📱 Responsive Design

The interface features:

  • Beautiful gradient backgrounds and card-based layouts
  • Smooth animations and hover effects
  • Mobile-first responsive design
  • Accessible color contrasts and typography
  • Modern button states and interactive elements

Website Screenshot

🚀 Extensibility

The modular architecture allows for easy extension to:

  • Integrate real Wikipedia API scraping
  • Add more scientific fields and data sources
  • Implement advanced search and sorting features
  • Include scientist photos and additional metadata
  • Add data export capabilities

This creates a solid foundation for a comprehensive scientist discovery platform that can grow with additional features and data sources.


💬 Share your feedback on Copilot coding agent for the chance to win a $200 gift card! Click here to start the survey.

Co-authored-by: MTarekDelta <128311740+MTarekDelta@users.noreply.github.com>
Copilot AI changed the title [WIP] make a new project of a website that scraps the names of scientists in every field Add Scientists Database - Web Scraper for Multiple Scientific Fields Sep 6, 2025
Copilot AI requested a review from MTarekDelta September 6, 2025 09:05
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants