All notable changes to this project will be documented in this file.
The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.
1.0.0 - 2024-02-13
- Initial release of LLM Doc Scraper
- Web scraping functionality with BeautifulSoup
- LLM-powered content summarization using OpenAI API
- Streamlit UI for easy interaction
- SQLite database for URL history
- Customizable filename generation
- Token counting with tiktoken
- Database migration system
- Model selection with persistence
- OpenAI API key management
- Progress tracking with duration display
- 🌐 Intelligent web scraping with link detection
- 🤖 LLM-based content summarization
- 📝 Clean markdown output format
- 💾 Persistent URL history
- 📁 Smart file organization
- 🎯 Custom filename support
- 🖥️ User-friendly interface
- ⚡ Token counting and timing
- 🔄 Database migrations
- 🔑 Secure API key storage