[BUG] Remote model with internal connector failed to run predict

[ylwu-amzn]

Create a remote model with internal connector. Then run predict, it failed

{
  "error": {
    "root_cause": [
      {
        "type": "status_exception",
        "reason": "Failed to get data object from index .plugins-ml-connector"
      }
    ],
    "type": "status_exception",
    "reason": "Failed to get data object from index .plugins-ml-connector",
    "caused_by": {
      "type": "action_request_validation_exception",
      "reason": "Validation Failed: 1: id is missing;"
    }
  },
  "status": 500
}

Error log

[2025-09-26T05:58:17,109][ERROR][o.o.m.m.MLModelManager   ] [node1] Failed to get ML connector null
org.opensearch.OpenSearchStatusException: Failed to get data object from index .plugins-ml-connector
	at org.opensearch.remote.metadata.client.impl.LocalClusterIndicesClient.lambda$innerGetDataObjectAsync$5(LocalClusterIndicesClient.java:205) ~[opensearch-remote-metadata-sdk-3.3.0.0-SNAPSHOT.jar:?]
	at org.opensearch.core.action.ActionListener$1.onFailure(ActionListener.java:90) ~[opensearch-core-3.3.0.jar:3.3.0]
	at org.opensearch.action.support.TransportAction$1.onFailure(TransportAction.java:124) ~[opensearch-3.3.0.jar:3.3.0]
	at org.opensearch.action.support.TransportAction.execute(TransportAction.java:181) ~[opensearch-3.3.0.jar:3.3.0]
	at org.opensearch.action.support.TransportAction.execute(TransportAction.java:109) ~[opensearch-3.3.0.jar:3.3.0]
	at org.opensearch.transport.client.node.NodeClient.executeLocally(NodeClient.java:113) ~[opensearch-3.3.0.jar:3.3.0]
	at org.opensearch.transport.client.node.NodeClient.doExecute(NodeClient.java:100) ~[opensearch-3.3.0.jar:3.3.0]
	at org.opensearch.transport.client.support.AbstractClient.execute(AbstractClient.java:501) ~[opensearch-3.3.0.jar:3.3.0]
	at org.opensearch.transport.client.support.AbstractClient.get(AbstractClient.java:597) ~[opensearch-3.3.0.jar:3.3.0]
	at org.opensearch.remote.metadata.client.impl.LocalClusterIndicesClient.lambda$innerGetDataObjectAsync$6(LocalClusterIndicesClient.java:199) ~[opensearch-remote-metadata-sdk-3.3.0.0-SNAPSHOT.jar:?]
	at org.opensearch.secure_sm.AccessController.doPrivileged(AccessController.java:77) ~[opensearch-agent-policy-3.3.0.jar:3.3.0]
	at org.opensearch.remote.metadata.client.impl.LocalClusterIndicesClient.innerGetDataObjectAsync(LocalClusterIndicesClient.java:197) ~[opensearch-remote-metadata-sdk-3.3.0.0-SNAPSHOT.jar:?]
	at org.opensearch.remote.metadata.client.impl.LocalClusterIndicesClient.lambda$getDataObjectAsync$3(LocalClusterIndicesClient.java:170) ~[opensearch-remote-metadata-sdk-3.3.0.0-SNAPSHOT.jar:?]
	at org.opensearch.secure_sm.AccessController.doPrivileged(AccessController.java:77) ~[opensearch-agent-policy-3.3.0.jar:3.3.0]
	at org.opensearch.remote.metadata.client.impl.LocalClusterIndicesClient.getDataObjectAsync(LocalClusterIndicesClient.java:168) ~[opensearch-remote-metadata-sdk-3.3.0.0-SNAPSHOT.jar:?]
	at org.opensearch.remote.metadata.client.SdkClient.getDataObjectAsync(SdkClient.java:101) ~[opensearch-remote-metadata-sdk-3.3.0.0-SNAPSHOT.jar:?]
	at org.opensearch.remote.metadata.client.SdkClient.getDataObjectAsync(SdkClient.java:112) ~[opensearch-remote-metadata-sdk-3.3.0.0-SNAPSHOT.jar:?]
	at org.opensearch.ml.model.MLModelManager.getConnector(MLModelManager.java:2078) [opensearch-ml-3.3.0.0-SNAPSHOT.jar:3.3.0.0-SNAPSHOT]
	at org.opensearch.ml.model.MLModelManager.deployRemoteOrBuiltInModel(MLModelManager.java:1461) [opensearch-ml-3.3.0.0-SNAPSHOT.jar:3.3.0.0-SNAPSHOT]
	at org.opensearch.ml.model.MLModelManager.lambda$deployModel$1(MLModelManager.java:1224) [opensearch-ml-3.3.0.0-SNAPSHOT.jar:3.3.0.0-SNAPSHOT]
	at org.opensearch.core.action.ActionListener$1.onResponse(ActionListener.java:82) [opensearch-core-3.3.0.jar:3.3.0]
	at org.opensearch.action.support.ThreadedActionListener$1.doRun(ThreadedActionListener.java:78) [opensearch-3.3.0.jar:3.3.0]
	at org.opensearch.common.util.concurrent.ThreadContext$ContextPreservingAbstractRunnable.doRun(ThreadContext.java:975) [opensearch-3.3.0.jar:3.3.0]
	at org.opensearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:52) [opensearch-3.3.0.jar:3.3.0]
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1095) [?:?]
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:619) [?:?]
	at java.base/java.lang.Thread.run(Thread.java:1447) [?:?]

[ylwu-amzn]

This is a breaking change from this PR #4003

Check this comment https://github.com/opensearch-project/ml-commons/pull/4003/files#r2380952002