v0.5.5

🚀 Release v0.5.5: Enhanced Integrations and New Features

This release introduces significant enhancements to the Integration Connector Agent with new integrations, comprehensive item type schemas, and improved functionality.

🔗 New Integration Sources

• Confluence Integration: Full support for Confluence pages and spaces with configurable authentication and event tracking
• Enhanced GitHub Integration: Improved GitHub integration with app-based authentication support
• Enhanced GitLab Integration: Extended GitLab integration with web hook support and CI/CD monitoring capabilities
• Azure DevOps Integration: New integration for Azure DevOps pipeline and project monitoring

📋 New Item Types and Schemas

Azure Item Types

• azure-resource.json for Azure resource tracking

Confluence Item Types

• confluence-page.json for page tracking
• confluence-space.json for space management

GitHub Item Types

• github-issue.json for issue tracking
• github-member.json for team management
• github-pull-request.json for PR workflow
• github-release.json for release management
• github-repository.json for repository metadata
• github-star.json for star tracking
• github-workflow-run.json for CI/CD monitoring

GitLab Item Types

• gitlab-merge-request.json for MR workflow
• gitlab-pipeline.json for CI/CD tracking
• gitlab-project.json for project management
• gitlab-release.json for release tracking

⚡ Enhanced Features

• Cloud Vendor Aggregator: New Azure processor for cloud resource aggregation
• Console Catalog Sink: Enhanced console catalog integration with improved client interface
• Authentication Migration: Added GitHub authentication migration documentation
• Azure Permissions: New troubleshooting documentation for Azure permissions

📝 Configuration Examples

• Complete Azure pipeline configurations (simple, conditional, and complete)
• Confluence integration configuration examples
• GitHub app and token-based authentication examples
• GitLab CI monitoring and web hook configuration examples

🔧 Improvements

• Improved error handling and logging across all integrations
• Enhanced web hook processing capabilities
• Better configuration validation and schema support
• Improved test coverage for all new integrations

📚 Documentation Updates

• Updated source documentation for all new integrations
• Added troubleshooting guides for Azure permissions
• Enhanced GitHub authentication migration guide
• Comprehensive examples for all new configurations

v0.5.4

🎉 Major New Features

Note: this new feature is using the new id for item type to sopport custom types. Migrate type to

"itemTypeDefinitionRef": {
    "name": "my-item-type",
    "namespace": "my-namespace"
  }

1. JBoss/WildFly Source Integration 🚀

A comprehensive new source integration for monitoring JBoss/WildFly application servers through their management API.

Key Features:

• Polling Integration: Monitors JBoss/WildFly deployments via management interface
• HTTP Digest Authentication: RFC 2617 compliant authentication for secure API access
• Configurable Monitoring: Adjustable polling intervals and comprehensive deployment tracking
• Rich Event Data: Generates detailed jboss:deployment_status events with deployment metadata, subsystem information, and servlet metrics

Configuration:

{
  "type": "jboss",
  "wildflyUrl": "http://localhost:9990/management",
  "username": "admin",
  "password": { "fromEnv": "JBOSS_PASSWORD" },
  "pollingInterval": "30s"
}

Event Schema:

• Event Type: jboss:deployment_status
• Primary Key: deploymentName
• Data: Deployment status, runtime information, content hashes, and subsystem details

🔧 Enhanced Features

Console Catalog Sink Improvements

Breaking Change: Updated to use modern Console Catalog API

• New Configuration: itemTypeDefinitionRef replaces deprecated itemType
• Namespace Support: Full namespace-aware item type definitions
• Custom Types: Enhanced support for custom catalog item types

Migration Required:

{
  "type": "console-catalog",
  "itemTypeDefinitionRef": {
    "name": "your-item-type",
    "namespace": "your-namespace"
  }
  // ... other config
}

Authentication & Security Enhancements

• OAuth2 Token Renewal: Fixed automatic token refresh for Console Catalog sink
• Digest Authentication: Robust HTTP Digest auth implementation for JBoss
• Enhanced SecretSource: Improved secure credential handling across all integrations

🐛 Bug Fixes

Critical Fixes

• Console Catalog Authentication: Fixed OAuth2 token renewal mechanism
• Resource Deletion: Improved handling of unsupported resource deletion operations
• MongoDB Integration: Resolved broken integration tests and improved connection reliability

Code Quality Improvements

• Error Formatting: Enhanced error messages following errorlint rules
• Lint Compliance: Fixed all linting issues across the codebase
• Test Stability: Improved test reliability and coverage

🏗️ Build & Infrastructure

Development Environment

• Go Toolchain: Updated to Go 1.25.1 with explicit toolchain specification
• Dependency Updates: Comprehensive security and stability updates
• Build Tools: Updated golangci-lint and other development tools

Container & Dependencies

• Base Images: Updated to latest secure base images
• Library Updates:
  • github.com/gofiber/fiber/v2 updated to v2.52.9
  • Updated Azure, AWS, and GCP SDK versions
  • Enhanced Kafka client libraries

📚 Documentation

New Documentation

• JBoss/WildFly Source: Complete integration guide
• Apache Kafka Sink: Configuration and usage documentation
• Azure DevOps Source: Webhook setup and import procedures

Updated Documentation

• Configuration Schema: Updated JSON schema with new source and sink types
• API Examples: Enhanced configuration examples for all integrations
• Migration Guides: Console Catalog sink migration instructions

🚀 Getting Started

Quick Start Examples

JBoss Monitoring Pipeline

{
  "integrations": [{
    "source": {
      "type": "jboss",
      "wildflyUrl": "http://localhost:9990/management",
      "username": "admin",
      "password": { "fromEnv": "JBOSS_PASSWORD" },
      "pollingInterval": "30s"
    },
    "pipelines": [{
      "processors": [{
        "type": "filter",
        "celExpression": "eventType == 'jboss:deployment_status'"
      }],
      "sinks": [{
        "type": "kafka",
        "topic": "jboss-deployments",
        "producerConfig": {
          "bootstrap.servers": "kafka:9092"
        }
      }]
    }]
  }]
}

Azure DevOps to Console Catalog

{
  "integrations": [{
    "source": {
      "type": "azure-devops",
      "azureDevOpsOrganizationUrl": "https://dev.azure.com/myorg",
      "azureDevOpsPersonalAccessToken": { "fromEnv": "AZDO_PAT" },
      "webhookHost": "https://integration-agent.mycompany.com"
    },
    "pipelines": [{
      "sinks": [{
        "type": "console-catalog",
        "url": "https://console.mia-platform.eu",
        "tenantId": "my-tenant",
        "itemTypeDefinitionRef": {
          "name": "git-repository",
          "namespace": "my-tenant"
        },
        "clientId": "my-client-id",
        "clientSecret": { "fromEnv": "CONSOLE_SECRET" },
        "itemNameTemplate": "{{repository.name}}"
      }]
    }]
  }]
}

🔄 Migration Guide

Console Catalog Sink Migration

Before (v0.5.3):

{
  "type": "console-catalog",
  "itemType": "my-item-type"
}

After (v0.5.4):

{
  "type": "console-catalog",
  "itemTypeDefinitionRef": {
    "name": "my-item-type",
    "namespace": "my-namespace"
  }
}

📊 Performance & Scalability

New Capabilities

• Concurrent Processing: Improved pipeline concurrency for high-throughput scenarios
• Resource Optimization: Enhanced memory usage for large-scale deployments
• Connection Pooling: Better connection management for external services

Monitoring Improvements

• Enhanced Logging: More detailed debug information for troubleshooting
• Metrics: Improved observability for source and sink performance
• Health Checks: Better health endpoint reporting

🛡️ Security

Authentication Enhancements

• Multi-factor Auth Support: Enhanced authentication mechanisms
• Certificate Handling: Improved TLS certificate management
• Credential Rotation: Better support for credential rotation scenarios

Compliance

• Security Scanning: Enhanced container security scanning
• Dependency Auditing: Regular security audits of all dependencies
• Secure Defaults: More secure default configurations

🔮 What's Next

This release significantly expands the Integration Connector Agent's capabilities with:

• Enterprise Application Monitoring: JBoss/WildFly integration for Java enterprise environments
• Modern Event Streaming: Native Kafka support for real-time data pipelines
• DevOps Platform Integration: Azure DevOps connectivity for development workflow monitoring
• Enhanced Cloud Integration: Improved Console Catalog compatibility

The Integration Connector Agent now provides a comprehensive solution for monitoring and integrating data across enterprise infrastructure, application servers, and development platforms.

---

For Support: GitHub Issues
Documentation: docs/
Docker Hub: miaplatform/integration-connector-agent:v0.5.4

#£ Changes

• ci(deps): bump the minor-actions-dependencies group with 5 updates by @dependabot[bot] in #74
• chore(deps): bump github.com/gofiber/fiber/v2 from 2.52.5 to 2.52.9 by @dependabot[bot] in #75
• ci(deps): bump actions/checkout from 4.2.2 to 5.0.0 by @dependabot[bot] in #78
• ci(deps): bump the minor-actions-dependencies group with 5 updates by @dependabot[bot] in #76
• ci(deps): bump google-github-actions/auth from 2.1.12 to 3.0.0 by @dependabot[bot] in #79
• ci(deps): bump actions/download-artifact from 4.3.0 to 5.0.0 by @dependabot[bot] in #77
• Microsoft Azure DevOps Source by @JGiola in #80
• Feat add Kafka sink by @JGiola in #73
• ci(deps): bump the minor-actions-dependencies group with 6 updates by @dependabot[bot] in #82
• ci(deps): bump actions/checkout from 4.2.2 to 5.0.0 by @dependabot[bot] in #83
• ci(deps): bump actions/setup-go from 5.5.0 to 6.0.0 by @dependabot[bot] in #84
• build(deps): bump distroless/base-debian12 from 06c713c to 10136f3 by @dependabot[bot] in #85
• build(deps): bump library/golang from c4bc074 to 2960a1d by @dependabot[bot] in #81
• Jboss source by @giulioroggero in #86

New Contributors

• @giulioroggero made their first contribution in #86

Full Changelog: v0.5.3...v0.5.4

v0.5.3

What's Changed

Other Changes

• fix: azure deletes are now executed only when the original event status is Succeded by @JGiola in #72

Full Changelog: v0.5.2...v0.5.3

v0.5.2

What's Changed

Exciting New Features 🎉

• feat: reworked the azure processor client and add new resource support by @JGiola in #71, specifically added support to:
  • Virtual Machine
  • Public IP Address
  • Virtual Network
  • Network Interface
  • Network Security Group
  • Disks

Other changes

• ci: named publish docker job by @fredmaggiowski in d796238
• feat: added useful logs to console catalog itemID generation by @fredmaggiowski in 124856f

Full Changelog: v0.5.1...v0.5.2

v0.5.1

What's Changed

Bug fixes 🐛

• fix: unstuck eventhub if message is unparseable by @JGiola in aaea4f0

Full Changelog: v0.5.0...v0.5.1

v0.5.0

What's Changed

Breaking Changes 🧨

• feat: catalog sink generates itemId from event PKs by @fredmaggiowski in #70

Other Changes

• docs: infrastructure import use cases by @fredmaggiowski in #63

Full Changelog: v0.4.0...v0.5.0

v0.4.0

What's Changed

Breaking Changes 🧨

• fix: uniform cloud vendor sources webhook response interface by @fredmaggiowski in #65

Exciting New Features 🎉

• feat: console catalog sink by @fredmaggiowski in #66

Bug fixes 🐛

• fix: schema to validate console-catalog sink configuration by @fredmaggiowski in #67
• deps: upgrade hclog package to v1 by @fredmaggiowski in #68
• fix: missing catalog lifecycle status + correct api paths by @fredmaggiowski in #69

Other Changes

• build(deps): bump library/alpine from 3.22.0 to 3.22.1 by @dependabot[bot] in #64

Full Changelog: v0.3.0...v0.4.0

v0.3.0

What's Changed

Exciting New Features 🎉

• feat: cloud vendor aggregator processors by @fredmaggiowski in #51

  • feat: event timestamp by @fredmaggiowski in #54
  • feat: gcp inventory import api by @fredmaggiowski in #59
  • feat: AWS source import API by @fredmaggiowski in #60
  • feat: first import azure by @JGiola in #61

• feat: crud sink impl by @fredmaggiowski in #57

Other Changes

• ci(deps): bump the minor-actions-dependencies group with 5 updates by @dependabot[bot] in #48
• feat: GCP authn support from credentials configuration by @fredmaggiowski in #50
• docs: added cloud vendor aggregator docs by @fredmaggiowski in #56
• refactor: extract source setup in standalone func by @fredmaggiowski in #58
• refactor: centralize aws client in source to be used elsewhere by @fredmaggiowski in #62
• fix: AWS cloud aggregator processor context management by @fredmaggiowski in #52
• fix: aws cloud trail event resource name extractor integrated in services by @fredmaggiowski in #53
• fix: prevent panics for missing azure data by @fredmaggiowski in #55

Full Changelog: v0.3.0-rc.3...v0.3.0

v0.3.0-rc.3

What's Changed

Exciting New Features 🎉

• feat: aws sqs lambda tag management events by @fredmaggiowski in #49

Full Changelog: v0.3.0-rc.2...v0.3.0-rc.3

v0.3.0-rc.2

What's Changed

Other Changes

• refactor: export discard event to be used by third party plugins and make aws credential optional for workload identity support by @fredmaggiowski in #47

Full Changelog: v0.3.0-rc.1...v0.3.0-rc.2