add ml_inference processor for offline batch inference

[Zhangxunmt]

Description

Adding a new ml_inference processor to interact with ml-commons plugin in OpenSearch for ML related applications.

Some examples that work well:

ml-batch-job-pipeline:
  source:
    s3:
      codec:
        ndjson:
      compression: none
      aws:
        region: "us-east-1"
      default_bucket_owner: <your account>
      scan:
        scheduling:
          interval: PT2M
        buckets:
          - bucket:
              name: "offlinebatch"
              data_selection: metadata_only
              filter:
                include_prefix:
                  - bedrock-multisource/my_batch
                exclude_suffix:
                  - .out
          - bucket:
              name: "offlinebatch"
              data_selection: data_only
              filter:
                include_prefix:
                  - bedrock-multisource/output-multisource/
                exclude_suffix:
                  - manifest.json.out

  buffer:
    bounded_blocking:
      buffer_size: 2048 # max number of records the buffer accepts
      batch_size: 512 # max number of records the buffer drains after each read

  processor:
    - ml_inference:
        host: "<your host>"
        aws_sigv4: true
        action_type: "batch_predict"
        service_name: "bedrock"
        model_id: "<your model id in search>"
        output_path: "s3://offlinebatch/bedrock-multisource/output-multisource/"
        aws:
          region: "us-east-1"
        ml_when: /bucket == "offlinebatch"
    - copy_values:
        entries:
          - to_key: chapter
            from_key: /modelInput/inputText
          - to_key: chapter_embedding
            from_key: /modelOutput/embedding
    - delete_entries:
        with_keys: [modelInput, modelOutput, recordId, s3]

  route:
      - ml-ingest-route: "/chapter != null and /chapter_embedding != null"

  sink:
    - opensearch:
        hosts: ["<your host>"]
        aws_sigv4: true
        index: "my-nlp-index-bedrock"
        routes: [ml-ingest-route]

Issues Resolved

#5470
#5433
#5509

Check List

• New functionality includes testing.
• New functionality has a documentation issue. Please link to it in this PR.
  • New functionality has javadoc added
• Commits are signed with a real name per the DCO

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

[dlvenable]

@Zhangxunmt , Thank you for this great processor!

We will also need some unit tests. I'm ok accepting this PR without them as long as we have the @Experimental annotation.

[Zhangxunmt]

@Zhangxunmt , Thank you for this great processor!

We will also need some unit tests. I'm ok accepting this PR without them as long as we have the @Experimental annotation.

dlvenable Thanks David for the comments. Looks like there're no major concerns. I will add the remaining UTs soon and the @experimental annotation.

[Zhangxunmt]

@dlvenable Please review the latest commit for the updates to requested changes, after a rebase to the main. The Gradle Builds somehow fail due to unrelated tests.

[kkondaka]

This will increase quite fast with number of retries. We should use import com.linecorp.armeria.client.retry.Backoff; and the code should be similar to exponential backoff code in https://github.com/kkondaka/kk-data-prepper-f2/blob/main/data-prepper-plugins/opensearch/src/main/java/org/opensearch/dataprepper/plugins/sink/opensearch/BulkRetryStrategy.java

[Zhangxunmt]

updated to use similar backoff logic with linecorp.armeria.client

[dlvenable]

Thank you @Zhangxunmt for this contribution!