I use the es7 database to configure oap to start the error report

[Ther44]

I use the es7 database to configure oap to start the error report.
elasticsearch.yml：
path.data: /usr/local/elasticsearch-7.11.0/data/
path.logs: /usr/local/elasticsearch-7.11.0/logs/
network.host: 0.0.0.0
discovery.seed_hosts: ["127.0.0.1"]
cluster.initial_master_nodes: ["node-1"]

skywalkiing---application.yml：
storage:
selector: ${SW_STORAGE:elasticsearch}
elasticsearch:
namespace: ${SW_NAMESPACE:""}
clusterNodes: ${SW_STORAGE_ES_CLUSTER_NODES:127.0.0.1:9200}
protocol: ${SW_STORAGE_ES_HTTP_PROTOCOL:"http"}
connectTimeout: ${SW_STORAGE_ES_CONNECT_TIMEOUT:3000}
socketTimeout: ${SW_STORAGE_ES_SOCKET_TIMEOUT:30000}
.........

And my database can be accessed normally.And I also tried elasticsearch7.17.0 and elasticsearch7.17.13.But they can not connet to sykwaling.I don't know why.

The error message of OAPService is as follows：
2023-09-21 09:37:51,188 - com.linecorp.armeria.common.util.SystemInfo - 525 [main] INFO [] - IPv6: disabled (no IPv6 network interface)
2023-09-21 09:37:51,225 - com.linecorp.armeria.common.Flags - 1393 [main] INFO [] - useOpenSsl: true (default)
2023-09-21 09:37:51,342 - com.linecorp.armeria.common.Flags - 534 [main] INFO [] - Using OpenSSL: BoringSSL, 0x1010107f
2023-09-21 09:37:51,342 - com.linecorp.armeria.common.Flags - 1393 [main] INFO [] - dumpOpenSslInfo: false (default)
2023-09-21 09:38:06,611 - org.apache.skywalking.library.elasticsearch.ElasticSearch - 155 [armeria-eventloop-epoll-5-3] WARN [] - [creqId=737b4887, preqId=bea6b4ba][http://UNKNOWN/#GET] Request: {startTime=2023-09-21T01:38:06.599Z(1695260286599000), length=0B, duration=3375µs(3375078ns), cause=com.linecorp.armeria.client.UnprocessedRequestException: com.linecorp.armeria.client.endpoint.EndpointSelectionTimeoutException: Failed to select within 15000 ms an endpoint from: HealthCheckedEndpointGroup{endpoints=[], numEndpoints=0, candidates=[Endpoint{127.0.0.1:9200, weight=1000}], numCandidates=1, selectionStrategy=class com.linecorp.armeria.client.endpoint.WeightedRoundRobinStrategy, initialized=false}, scheme=none+http, name=GET, headers=[:method=GET, :path=/, :scheme=http, :authority=UNKNOWN]}
2023-09-21 09:38:06,612 - org.apache.skywalking.library.elasticsearch.ElasticSearch - 186 [armeria-eventloop-epoll-5-3] WARN [] - [creqId=737b4887, preqId=bea6b4ba][http://UNKNOWN/#GET] Response: {startTime=2023-09-21T01:38:06.602Z(1695260286602000), length=0B, duration=0ns, totalDuration=3602µs(3602707ns), cause=com.linecorp.armeria.client.UnprocessedRequestException: com.linecorp.armeria.client.endpoint.EndpointSelectionTimeoutException: Failed to select within 15000 ms an endpoint from: HealthCheckedEndpointGroup{endpoints=[], numEndpoints=0, candidates=[Endpoint{127.0.0.1:9200, weight=1000}], numCandidates=1, selectionStrategy=class com.linecorp.armeria.client.endpoint.WeightedRoundRobinStrategy, initialized=false}, headers=[:status=0]}
com.linecorp.armeria.client.UnprocessedRequestException: com.linecorp.armeria.client.endpoint.EndpointSelectionTimeoutException: Failed to select within 15000 ms an endpoint from: HealthCheckedEndpointGroup{endpoints=[], numEndpoints=0, candidates=[Endpoint{127.0.0.1:9200, weight=1000}], numCandidates=1, selectionStrategy=class com.linecorp.armeria.client.endpoint.WeightedRoundRobinStrategy, initialized=false}
at com.linecorp.armeria.client.UnprocessedRequestException.of(UnprocessedRequestException.java:45) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.HttpClientDelegate.earlyFailedResponse(HttpClientDelegate.java:226) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.HttpClientDelegate.execute(HttpClientDelegate.java:63) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.HttpClientDelegate.execute(HttpClientDelegate.java:48) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.logging.AbstractLoggingClient.execute(AbstractLoggingClient.java:137) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.internal.client.ClientUtil.pushAndExecute(ClientUtil.java:156) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.internal.client.ClientUtil.executeWithFallback(ClientUtil.java:144) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.retry.RetryingClient.doExecute0(RetryingClient.java:322) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.retry.RetryingClient.lambda$doExecute$0(RetryingClient.java:252) ~[armeria-1.18.0.jar:?]
at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) ~[?:1.8.0_265]
at java.util.concurrent.CompletableFuture.uniHandleStage(CompletableFuture.java:848) ~[?:1.8.0_265]
at java.util.concurrent.CompletableFuture.handle(CompletableFuture.java:2168) ~[?:1.8.0_265]
at com.linecorp.armeria.client.retry.RetryingClient.doExecute(RetryingClient.java:247) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.retry.RetryingClient.doExecute(RetryingClient.java:59) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.retry.AbstractRetryingClient.execute(AbstractRetryingClient.java:90) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.internal.client.ClientUtil.pushAndExecute(ClientUtil.java:156) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.internal.client.ClientUtil.initContextAndExecuteWithFallback(ClientUtil.java:110) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.internal.client.ClientUtil.lambda$initContextAndExecuteWithFallback$0(ClientUtil.java:84) ~[armeria-1.18.0.jar:?]
at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) ~[?:1.8.0_265]
at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) ~[?:1.8.0_265]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_265]
at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1609) ~[?:1.8.0_265]
at com.linecorp.armeria.common.RequestContext.lambda$makeContextAware$3(RequestContext.java:566) ~[armeria-1.18.0.jar:?]
at io.netty.util.concurrent.AbstractEventExecutor.runTask(AbstractEventExecutor.java:174) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:167) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:470) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:406) [netty-transport-classes-epoll-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
Caused by: com.linecorp.armeria.client.endpoint.EndpointSelectionTimeoutException: Failed to select within 15000 ms an endpoint from: HealthCheckedEndpointGroup{endpoints=[], numEndpoints=0, candidates=[Endpoint{127.0.0.1:9200, weight=1000}], numCandidates=1, selectionStrategy=class com.linecorp.armeria.client.endpoint.WeightedRoundRobinStrategy, initialized=false}
at com.linecorp.armeria.client.endpoint.EndpointSelectionTimeoutException.get(EndpointSelectionTimeoutException.java:48) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.endpoint.AbstractEndpointSelector.lambda$select$0(AbstractEndpointSelector.java:96) ~[armeria-1.18.0.jar:?]
at io.netty.util.concurrent.PromiseTask.runTask(PromiseTask.java:98) ~[netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:153) ~[netty-common-4.1.81.Final.jar:4.1.81.Final]
... 8 more
2023-09-21 09:38:06,761 - com.linecorp.armeria.client.endpoint.healthcheck.HealthCheckedEndpointGroup - 174 [armeria-eventloop-epoll-5-1] WARN [] - The first health check failed for all endpoints. numCandidates: 1 candidates: [Endpoint{127.0.0.1:9200, weight=1000}]
java.util.concurrent.CompletionException: com.linecorp.armeria.client.ResponseTimeoutException
at java.util.concurrent.CompletableFuture.reportJoin(CompletableFuture.java:375) ~[?:1.8.0_265]
at java.util.concurrent.CompletableFuture.join(CompletableFuture.java:1947) ~[?:1.8.0_265]
at com.linecorp.armeria.common.util.EventLoopCheckingFuture.join(EventLoopCheckingFuture.java:87) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.endpoint.healthcheck.HealthCheckContextGroup.lambda$initialize$2(HealthCheckContextGroup.java:85) ~[armeria-1.18.0.jar:?]
at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) ~[?:1.8.0_265]
at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) ~[?:1.8.0_265]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_265]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_265]
at com.linecorp.armeria.client.endpoint.healthcheck.DefaultHealthCheckerContext.updateHealth(DefaultHealthCheckerContext.java:174) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.endpoint.healthcheck.HttpHealthChecker$HealthCheckResponseSubscriber.updateHealth(HttpHealthChecker.java:306) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.endpoint.healthcheck.HttpHealthChecker$HealthCheckResponseSubscriber.onError(HttpHealthChecker.java:233) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.common.stream.AbstractStreamMessage$CloseEvent.notifySubscriber(AbstractStreamMessage.java:269) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.common.stream.DefaultStreamMessage.notifySubscriberOfCloseEvent0(DefaultStreamMessage.java:300) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.common.stream.DefaultStreamMessage.notifySubscriberOfCloseEvent(DefaultStreamMessage.java:292) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.common.stream.DefaultStreamMessage.handleCloseEvent(DefaultStreamMessage.java:429) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.common.stream.DefaultStreamMessage.notifySubscriber0(DefaultStreamMessage.java:372) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.common.stream.DefaultStreamMessage.notifySubscriber(DefaultStreamMessage.java:328) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.common.stream.DefaultStreamMessage.addObjectOrEvent(DefaultStreamMessage.java:314) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.common.stream.DefaultStreamMessage.tryClose(DefaultStreamMessage.java:458) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.common.stream.DefaultStreamMessage.close(DefaultStreamMessage.java:447) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.client.HttpResponseDecoder$HttpResponseWrapper$1.run(HttpResponseDecoder.java:428) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.internal.common.CancellationScheduler.invokeTask(CancellationScheduler.java:483) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.internal.common.CancellationScheduler.lambda$init0$2(CancellationScheduler.java:123) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.common.RequestContext.lambda$makeContextAware$3(RequestContext.java:566) ~[armeria-1.18.0.jar:?]
at io.netty.util.concurrent.PromiseTask.runTask(PromiseTask.java:98) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:153) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.AbstractEventExecutor.runTask(AbstractEventExecutor.java:174) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:167) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:470) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:406) [netty-transport-classes-epoll-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
Caused by: com.linecorp.armeria.client.ResponseTimeoutException
at com.linecorp.armeria.client.ResponseTimeoutException.get(ResponseTimeoutException.java:38) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.internal.common.CancellationScheduler.invokeTask(CancellationScheduler.java:469) ~[armeria-1.18.0.jar:?]
... 12 more
2023-09-21 09:38:06,768 - org.apache.skywalking.oap.server.telemetry.api.HealthCheckMetrics - 50 [armeria-eventloop-epoll-5-1] WARN [] - Health check fails. reason: No healthy endpoint
2023-09-21 09:38:06,768 - org.apache.skywalking.oap.server.telemetry.api.HealthCheckMetrics - 50 [armeria-eventloop-epoll-5-1] WARN [] - Health check fails. reason: No healthy endpoint
2023-09-21 09:38:06,781 - org.apache.skywalking.library.elasticsearch.ElasticSearchBuilder - 155 [armeria-eventloop-epoll-5-1] WARN [] - [creqId=5ad93694, chanId=7fa4e365, laddr=127.0.0.1:47770, raddr=127.0.0.1:9200][http://127.0.0.1:9200/_cluster/health#GET] Request: {startTime=2023-09-21T01:37:51.515Z(1695260271515000), length=0B, duration=231ms(231227813ns), scheme=none+h1c, name=health-check, headers=[:method=GET, :path=/_cluster/health, :scheme=http, :authority=127.0.0.1:9200]}
2023-09-21 09:38:06,781 - org.apache.skywalking.library.elasticsearch.ElasticSearchBuilder - 186 [armeria-eventloop-epoll-5-1] WARN [] - [creqId=5ad93694, chanId=7fa4e365, laddr=127.0.0.1:47770, raddr=127.0.0.1:9200][http://127.0.0.1:9200/_cluster/health#GET] Response: {startTime=2023-09-21T01:38:06.772Z(1695260286772000), length=0B, duration=0ns, totalDuration=15258ms(15258337831ns), cause=com.linecorp.armeria.client.ResponseTimeoutException, headers=[:status=0]}
com.linecorp.armeria.client.ResponseTimeoutException: null
at com.linecorp.armeria.client.ResponseTimeoutException.get(ResponseTimeoutException.java:38) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.internal.common.CancellationScheduler.invokeTask(CancellationScheduler.java:469) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.internal.common.CancellationScheduler.lambda$init0$2(CancellationScheduler.java:123) ~[armeria-1.18.0.jar:?]
at com.linecorp.armeria.common.RequestContext.lambda$makeContextAware$3(RequestContext.java:566) ~[armeria-1.18.0.jar:?]
at io.netty.util.concurrent.PromiseTask.runTask(PromiseTask.java:98) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:153) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.AbstractEventExecutor.runTask(AbstractEventExecutor.java:174) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:167) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:470) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:406) [netty-transport-classes-epoll-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) [netty-common-4.1.81.Final.jar:4.1.81.Final]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]

Does anyone know why? Has anyone ever met?

[Ther44]

By the way, my skywalking use 9.3.0, my java version is jdk_1.8.0_261

[wu-sheng]

All screenshots are not available. I can't see anything.

[wu-sheng]

ResponseTimeoutException indicates the OAP can't connect with the elasticsearch. I can't see more. It is your local env.

[Ther44]

Yes, I set up skywalkling and stand-alone es7 locally and found that it didn't start properly. In addition, I have re-edited my question, you can have a look, please.

[wu-sheng]

I don't have time to debug and check your local env. Sorry. Personally, I would suggest you to check on your own. This is not a hard issue.

[Ther44]

Well, I have no problem using mysql on skywalking. I guess it's the ES7 database. I really don't know much about ES7 database. I'll take a look at it again. Thank you any way.

[chenhaipeng]

It is recommended to check whether your es cluster is working properly
curl -s -XGET -u user:password http://host:port/_cluster/health