Skip to content

Latest commit

 

History

History
103 lines (79 loc) · 4.05 KB

File metadata and controls

103 lines (79 loc) · 4.05 KB

Changelog

[0.7.1] - 2026-05-27

Added

  • Multi-source aggregation via MultiSourceAggregator with inner, left, right, and outer joins.
  • Merge strategies (flat, namespace) and conflict resolution (prefer_first, prefer_last, error).
  • ApiLinker.aggregate_sources(), aggregate_source_data(), and register_source() for parallel multi-connector fetch and join workflows.
  • HTTP byte streaming on ApiConnector: stream_response() and download_stream() with Range resume, progress callbacks, and optional per-endpoint streaming configuration.
  • User guide: Multi-Source Aggregation and example examples/multi_source_aggregation.py.

Changed

  • Public exports in apilinker for aggregation types and enums.

Fixed

  • Release alignment: the v0.7.0 tag did not include aggregation or byte-streaming code; both ship in v0.7.1.

Notes

  • Multi-source aggregation is library/API only in this release (YAML/CLI configuration is planned for v0.7.2).

[0.7.0] - 2026-02-09

Added

  • Version bump and release packaging for the 0.7.x advanced data processing milestone.

[0.6.0] - 2025-12-01

Added

  • Webhook server and routing (apilinker[webhooks]).
  • Message queue connector plugins and worker pipeline (apilinker[mq]): RabbitMQ, Redis Pub/Sub, AWS SQS, Kafka.
  • Server-Sent Events (SSE) streaming with reconnection and backpressure policies.

[0.5.0] - 2025-10-01

Added

  • Enterprise secret management (Vault, AWS Secrets Manager, Azure Key Vault, Google Secret Manager).
  • OpenTelemetry observability integration.
  • Advanced rate limiting and production monitoring/alerting.

[0.4.0] - 2025-07-16

Added

  • JSON Schema validation for responses/requests with optional strict mode and readable diffs
  • Schema probing CLI (apilinker probe-schema) to infer minimal schemas and mapping templates
  • Provenance & audit: run metadata (config hash, git SHA, timings, events) to JSONL and sidecar JSON
  • Idempotency support with stable keys and in-memory de-duplication
  • State & resumability: file/SQLite stores; auto-inject updated_since; apilinker state CLI

Changed

  • Bump version to 0.4.0 across codebase and docs

[0.3.0] - 2025-01-28

  • Updated version to 0.3.0
  • Added 8 research connectors for scientific workflows
  • Comprehensive documentation enhancement and consolidation
  • Enhanced authentication system with multiple methods
  • Improved error handling and testing coverage
  • GitHub URL updates to correct username (kkartas)
  • Added local benchmarks suite under benchmarks/ with mock server and harness; docs in docs/benchmarks.md

[0.2.0] - 2025-07-16

Added

  • Robust error handling and recovery system:
    • Circuit breaker pattern to prevent cascading failures
    • Dead Letter Queue (DLQ) for storing and retrying failed operations
    • Configurable recovery strategies based on error types
    • Error analytics and monitoring
  • Enhanced error categorization and context tracking
  • Integration with existing retry mechanisms
  • Advanced security features:
    • Secure credential storage (optional)
    • Removed custom request/response encryption in favor of HTTPS-only usage guidance
    • Fine-grained access control for multi-user environments
    • Additional OAuth flows: PKCE and Device Flow
  • Added cryptography dependency for enhanced security features

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

[0.1.0] - 2025-07-14

Added

  • Initial release of ApiLinker
  • Core components:
    • API Connector for REST APIs
    • Field Mapper with transform capabilities
    • Authentication manager (API Key, Bearer, Basic, OAuth2)
    • Scheduler for recurring syncs
    • Plugin system for extensibility
  • Command line interface
  • YAML configuration support
  • Environment variable resolution
  • Documentation
  • Test suite
  • JOSS paper draft

[Unreleased]

See ROADMAP.md for planned features and version roadmap.