TS_INFO information retrieval command by leontyevdv · Pull Request #142721 · elastic/elasticsearch

leontyevdv · 2026-02-19T16:56:34Z

Adds the TS_INFO command, a time-series metadata introspection command built on top of METRICS_INFO (#141667). While METRICS_INFO returns one row per distinct metric across all time series, TS_INFO returns one row per (metric, time-series) combination, providing finer-grained visibility into individual time series.

TS_INFO produces the same 6 columns as METRICS_INFO plus an additional dimensions column:

TS k8s | METRICS_INFO | SORT metric_name

metric_name	data_stream	unit	metric_type	field_type	dimension_fields
network.eth0.rx	k8s	packets	gauge	integer	[cluster, pod, region]
network.eth0.tx	k8s	packets	gauge	integer	[cluster, pod, region]
network.total_bytes_in	k8s	bytes	counter	long	[cluster, pod, region]
network.total_cost	k8s	usd	counter	double	[cluster, pod, region]

TS_INFO expands this to one row per time series, adding the dimensions column:

TS k8s | TS_INFO | KEEP metric_name, dimensions | WHERE metric_name == "network.eth0.rx" | SORT dimensions

metric_name	dimensions
network.eth0.rx	{"cluster": "prod", "pod": "one", "region": "[eu, us]"}
network.eth0.rx	{"cluster": "prod", "pod": "three", "region": "[eu, us]"}
network.eth0.rx	{"cluster": "prod", "pod": "two", "region": "[eu, us]"}
network.eth0.rx	{"cluster": "qa", "pod": "one"}
network.eth0.rx	{"cluster": "qa", "pod": "three"}
network.eth0.rx	{"cluster": "qa", "pod": "two"}
network.eth0.rx	{"cluster": "staging", "pod": "one", "region": "us"}
network.eth0.rx	{"cluster": "staging", "pod": "three", "region": "us"}
network.eth0.rx	{"cluster": "staging", "pod": "two", "region": "us"}

This PR contains generative tests for both METRICS_INFO and TS_INFO commands.

Closes #139296
Closes #141413

Add METRICS_INFO command to retrieve metrics-related metadata. Part of elastic#139296

Add mata.unit to the k8s-mappings.json Part of elastic#139296

# Conflicts: # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParser.interp # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParser.java

Regenerate ESQL parser to fix conflicts Part of elastic#139296

Change METRICS_INFO to scan documents with unique _tsid to retrieve metrics and dimensions metadata from them. Part of elastic#139296

Improve JavaDoc Part of elastic#139296

Polish code Part of elastic#139296

# Conflicts: # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java

Fix a compilation error occurred due to the merge with main. Part of elastic#139296

- Address review comments. - Optimize DistinctByOperator - Optimize collection of metrics and dimensions Part of elastic#139296

Change grouping by adding a concept of MetricSignature and 2 steps of grouping. Part of elastic#139296

Add MetricsInfoOperatorTests Part of elastic#139296

Ban PipelineBreakers before METRICS_INFO. Part of elastic#139296

Make MetricsInfo a PipelineBreaker. Add deduplication of information.

# Conflicts: # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java

Make MetricsInfo a PipelineBreaker. Add deduplication of information.

Change grouping to take into account a data stream name

Fix test

# Conflicts: # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java

# Conflicts: # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseLexer.interp # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseLexer.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/plan/PlanWritables.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/planner/LocalExecutionPlanner.java

Add INTERMEDIATE reduction

# Conflicts: # x-pack/plugin/esql/src/main/antlr/EsqlBaseLexer.tokens # x-pack/plugin/esql/src/main/antlr/EsqlBaseParser.tokens # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseLexer.interp # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseLexer.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParser.interp # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParser.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/planner/LocalExecutionPlanner.java # x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/approximation/ApproximationSupportTests.java # x-pack/plugin/src/yamlRestTest/resources/rest-api-spec/test/esql/60_usage.yml

…eat/ts-info-information-retrieval-command # Conflicts: # x-pack/plugin/esql/src/main/antlr/EsqlBaseLexer.tokens # x-pack/plugin/esql/src/main/antlr/EsqlBaseParser.tokens # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseLexer.interp # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseLexer.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParser.interp # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParser.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/telemetry/FeatureMetric.java

# Conflicts: # x-pack/plugin/esql/qa/server/multi-clusters/src/javaRestTest/java/org/elasticsearch/xpack/esql/ccq/MultiClusterSpecIT.java # x-pack/plugin/esql/src/main/antlr/EsqlBaseLexer.tokens # x-pack/plugin/esql/src/main/antlr/EsqlBaseParser.g4 # x-pack/plugin/esql/src/main/antlr/EsqlBaseParser.tokens # x-pack/plugin/esql/src/main/antlr/lexer/Expression.g4 # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/optimizer/rules/physical/ProjectAwayColumns.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseLexer.interp # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseLexer.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParser.interp # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParser.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParserBaseListener.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParserBaseVisitor.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParserListener.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/EsqlBaseParserVisitor.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/parser/LogicalPlanBuilder.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/plan/PlanWritables.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/planner/LocalExecutionPlanner.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/planner/PlannerUtils.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/planner/mapper/LocalMapper.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/planner/mapper/Mapper.java # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/telemetry/FeatureMetric.java # x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/CsvTests.java # x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/analysis/VerifierTests.java # x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/approximation/ApproximationSupportTests.java # x-pack/plugin/esql/src/test/java/org/elasticsearch/xpack/esql/optimizer/PhysicalPlanOptimizerTests.java

elasticsearchmachine · 2026-02-19T16:57:02Z

Pinging @elastic/es-analytical-engine (Team:Analytics)

elasticsearchmachine · 2026-02-19T16:57:02Z

Pinging @elastic/es-storage-engine (Team:StorageEngine)

elasticsearchmachine · 2026-02-19T16:57:02Z

Hi @leontyevdv, I've created a changelog YAML for you.

elasticsearchmachine · 2026-02-19T16:59:31Z

Hi @leontyevdv, I've updated the changelog YAML for you.

leontyevdv and others added 30 commits February 2, 2026 16:25

feat: Add METRICS_INFO command

dea78d5

Add METRICS_INFO command to retrieve metrics-related metadata. Part of elastic#139296

feat: Add METRICS_INFO command

ed11965

Add mata.unit to the k8s-mappings.json Part of elastic#139296

feat: Add METRICS_INFO command

5b29c92

Regenerate ESQL parser to fix conflicts Part of elastic#139296

feat: Add METRICS_INFO command

fb83617

Change METRICS_INFO to scan documents with unique _tsid to retrieve metrics and dimensions metadata from them. Part of elastic#139296

feat: Add METRICS_INFO command

8701483

Improve JavaDoc Part of elastic#139296

feat: Add METRICS_INFO command

7b92561

Polish code Part of elastic#139296

feat: Add METRICS_INFO command

0142de5

Polish code Part of elastic#139296

Merge branch 'main' into feat/metrics-info-information-retrieval-command

0a82028

# Conflicts: # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java

Update docs/changelog/141667.yaml

c912907

feat: Add METRICS_INFO command

6547fcd

Fix a compilation error occurred due to the merge with main. Part of elastic#139296

feat: Add METRICS_INFO command

8a642e0

- Address review comments. - Optimize DistinctByOperator - Optimize collection of metrics and dimensions Part of elastic#139296

Merge branch 'main' into feat/metrics-info-information-retrieval-command

0cc2759

feat: Add METRICS_INFO command

f702cce

Change grouping by adding a concept of MetricSignature and 2 steps of grouping. Part of elastic#139296

Merge branch 'main' into feat/metrics-info-information-retrieval-command

2fd2cea

feat: Add METRICS_INFO command

9512d89

Add MetricsInfoOperatorTests Part of elastic#139296

Merge branch 'main' into feat/metrics-info-information-retrieval-command

27d3e04

feat: Add METRICS_INFO command

698a417

Ban PipelineBreakers before METRICS_INFO. Part of elastic#139296

[CI] Auto commit changes from spotless

6ffaf42

Address PR comments

2ddf789

Make MetricsInfo a PipelineBreaker. Add deduplication of information.

Merge branch 'main' into feat/metrics-info-information-retrieval-command

bd90f04

# Conflicts: # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java

Address PR comments

84ebc5e

Make MetricsInfo a PipelineBreaker. Add deduplication of information.

Address PR comments

9f5cb03

Change grouping to take into account a data stream name

Merge branch 'main' into feat/metrics-info-information-retrieval-command

61fae7d

Address PR comments

bc72a16

Fix test

Address PR comments

ad8516c

Fix test

Address PR comments

c84eae3

Fix test

Merge branch 'main' into feat/metrics-info-information-retrieval-command

7ac4384

# Conflicts: # x-pack/plugin/esql/src/main/java/org/elasticsearch/xpack/esql/action/EsqlCapabilities.java

Address PR comments

f38d9a1

Add INTERMEDIATE reduction

leontyevdv added 11 commits February 18, 2026 17:49

Add TS_INFO command

96a0dfd

Fix tests

3150232

Merge main

fbe1d83

Merge main

bcbf0eb

Merge branch 'main' into feat/metrics-info-information-retrieval-command

2665825

Merge main

ccbc904

Add generative tests

4030af8

Merge main

27eca88

leontyevdv requested review from a team, dnhatn and kpatticha February 19, 2026 16:56

leontyevdv self-assigned this Feb 19, 2026

leontyevdv added >enhancement Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) :Analytics/ES|QL AKA ESQL Team:StorageEngine :StorageEngine/ES|QL Timeseries / metrics / PromQL / logsdb capabilities in ES|QL v9.4.0 labels Feb 19, 2026

Update docs/changelog/142721.yaml

7d67dbb

Update docs/changelog/142721.yaml

2fc8c68

leontyevdv added 3 commits February 19, 2026 18:01

Update changelog yaml

37d3a16

Cleanup code

19abb84

Fix tests

e068aa2

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

TS_INFO information retrieval command#142721

TS_INFO information retrieval command#142721
leontyevdv wants to merge 54 commits intoelastic:mainfrom
leontyevdv:feat/ts-info-information-retrieval-command

leontyevdv commented Feb 19, 2026 •

edited

Loading

Uh oh!

elasticsearchmachine commented Feb 19, 2026

Uh oh!

elasticsearchmachine commented Feb 19, 2026

Uh oh!

elasticsearchmachine commented Feb 19, 2026

Uh oh!

elasticsearchmachine commented Feb 19, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Comments

Conversation

leontyevdv commented Feb 19, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

elasticsearchmachine commented Feb 19, 2026

Uh oh!

elasticsearchmachine commented Feb 19, 2026

Uh oh!

elasticsearchmachine commented Feb 19, 2026

Uh oh!

elasticsearchmachine commented Feb 19, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Comments

leontyevdv commented Feb 19, 2026 •

edited

Loading