v1.0.8

Release v1.0.8 (2026-01-05)

Added

• AI Agent Integration Guides:
  • AGENTS.md - Comprehensive guide for integrating IterableData with LangChain, CrewAI, and AutoGen agents
  • GEMINI.md - Complete guide for using IterableData with Google Gemini AI for data processing and analysis
• Documentation Enhancements:
  • Added docs/docs/api/capabilities.md - Capability matrix showing read/write/bulk/totals/streaming support by format
  • Updated Docusaurus configuration and sidebars
• Development Tools:
  • dev/benchmarks/bench_import_open.py - Benchmarking tool for import performance
  • dev/scripts/inspect_zip.py - Utility for inspecting ZIP file contents
  • dev/scripts/verify_output.py - Output verification script
  • Moved find_missing_fixtures.py to dev/scripts/ directory
• Examples:
  • examples/zipxml/ - New example demonstrating ZIP XML processing with README
  • Updated existing examples with improvements
• Test Data:
  • Added testdata/test_zipxml.zip - Test fixture for ZIP XML processing
  • Added tests/test_property_roundtrip.py - New test for property roundtrip functionality

Improved

• Format Detection: Enhanced iterable/helpers/detect.py with improved detection logic and better error handling
• Compression Codecs: Updated all codec implementations (brotli, bz2, gzip, lz4, lzma, lzo, raw, snappy, szip, zip, zstd) with consistent patterns and improved error handling
• Data Type Handlers: Refactored all datatype modules for better consistency, error handling, and code organization
• Conversion Core: Improved iterable/convert/core.py with better format handling
• Pipeline Processing: Enhanced iterable/pipeline/core.py with improved state management and error handling
• Helper Utilities: Updated iterable/helpers/utils.py and iterable/helpers/schema.py with new functionality
• Base Classes: Improved iterable/base.py with better abstraction and error handling
• Test Suite: Comprehensive updates to all test files with improved fixtures and test coverage
• Test Data: Updated compression test fixtures (br, bz2, gz, lz4, xz, zst) with corrected data
• Documentation: Updated installation instructions and GitHub Pages setup documentation

Fixed

• Removed obsolete test data files (test_convert_csv_json.json, test_mysqldump_*.sql, test_warc_roundtrip.warc)
• Fixed compression codec implementations for better consistency
• Improved error messages and handling across all modules