Get chargeback data results from loki and validate by ayefimov-1 · Pull Request #335 · infrawatch/feature-verification-tests

ayefimov-1 · 2026-02-03T20:28:51Z

Assisted-by: Cursor

Validates chargeback synthetic data upload and download

uses synth data generated via script

Closes: https://issues.redhat.com/browse/OSPRH-26066
Closes: https://issues.redhat.com/browse/OSPRH-26361
Closes: https://issues.redhat.com/browse/OSPRH-26969

softwarefactory-project-zuul · 2026-02-04T23:37:50Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/3653e0a8dd2e4ddea41c10ef97a7d073

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 07m 55s
✔️ functional-chargeback-tests-osp18 SUCCESS in 1h 20m 22s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 FAILURE in 1h 50m 06s

softwarefactory-project-zuul · 2026-02-05T22:03:19Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/e14cf51447bc425d874de78466d0ea27

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 1h 57m 21s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 07m 17s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 FAILURE in 1h 39m 09s

ayefimov-1 · 2026-02-05T22:06:24Z

recheck

softwarefactory-project-zuul · 2026-02-06T18:55:50Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/4d8e228d62f2458bb70aaf51d23d0edb

❌ telemetry-openstack-meta-content-provider-master FAILURE in 15m 22s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

softwarefactory-project-zuul · 2026-02-06T19:23:44Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/ef2941d8a8c842d0ba8fb8832d217602

❌ telemetry-openstack-meta-content-provider-master FAILURE in 14m 27s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

ayefimov-1 · 2026-02-06T19:30:15Z

recheck

softwarefactory-project-zuul · 2026-02-06T19:45:54Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/ef445a39c5e347aa955c54db965f5a6f

❌ telemetry-openstack-meta-content-provider-master FAILURE in 14m 30s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

ayefimov-1 · 2026-02-06T21:09:20Z

recheck

softwarefactory-project-zuul · 2026-02-06T21:26:46Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/0a9a2771578a4bd9af5a72501030d667

❌ telemetry-openstack-meta-content-provider-master FAILURE in 16m 10s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

softwarefactory-project-zuul · 2026-02-06T22:12:56Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/d172ce02695b40e593f54c99fc7e9e3b

❌ telemetry-openstack-meta-content-provider-master FAILURE in 14m 56s
⚠️ functional-chargeback-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master
✔️ feature-verification-tests-noop SUCCESS in 5s
⚠️ functional-tests-osp18 SKIPPED Skipped due to failed job telemetry-openstack-meta-content-provider-master

ayefimov-1 · 2026-02-08T20:53:52Z

recheck

softwarefactory-project-zuul · 2026-02-09T19:17:39Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/070a8250ac274f96b5bd8f5a250ef6b2

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 36m 03s
❌ functional-chargeback-tests-osp18 RETRY_LIMIT in 18m 41s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 RETRY_LIMIT in 18m 14s

ayefimov-1 · 2026-02-09T19:20:25Z

recheck

softwarefactory-project-zuul · 2026-03-19T18:24:27Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/e7ceb7c8f38d4f5180338d3a421f7fb6

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 05m 35s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 47m 52s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 FAILURE in 1h 45m 07s

ayefimov-1 · 2026-03-19T18:31:26Z

recheck

softwarefactory-project-zuul · 2026-03-19T20:37:50Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/19ce90f13848409d8e4e805ce5ea05b2

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 04m 47s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 44m 37s
✔️ feature-verification-tests-noop SUCCESS in 4s
❌ functional-tests-osp18 FAILURE in 1h 44m 58s

ayefimov-1 · 2026-03-20T12:57:11Z

recheck

softwarefactory-project-zuul · 2026-03-20T15:04:38Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/8fb833faef5e404a9186c2f70634cb4b

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 06m 09s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 45m 54s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 FAILURE in 1h 46m 40s

ayefimov-1 · 2026-03-20T21:15:46Z

My main question / concern: Does this even work?

I see this is generating data with non-zero quantities and non-zero rates https://logserver.rdoproject.org/724/rdoproject.org/724451a0ee4f495fb6ea4afe1b263b27/controller/ci-framework-data/artifacts/test_dyn_basic-synth_data.json

But the rate returned by CloudKitty is apparently 0: https://logserver.rdoproject.org/724/rdoproject.org/724451a0ee4f495fb6ea4afe1b263b27/controller/ci-framework-data/artifacts/test_dyn_basic-loki_totals.yml

Yes, the job works! Is it complete? No, this is the epic that holds the list of improvements needed to be "complete"

Current validation state is as follows. If the job runs to completion without error, then the uploaded data and the downloaded data are the same.

Further on manual inspection of the logs shows the rating data is being reported here and here and seems to be consistent

softwarefactory-project-zuul · 2026-03-21T02:25:06Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/6b4c3a5b4b864ff1847196d7582a70a3

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 07m 10s
✔️ functional-chargeback-tests-osp18 SUCCESS in 1h 44m 52s
✔️ feature-verification-tests-noop SUCCESS in 4s
❌ functional-tests-osp18 FAILURE in 1h 48m 31s

softwarefactory-project-zuul · 2026-03-23T15:20:08Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/53caf65535954a1db50b94f7cf9f8b1f

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 10m 37s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 45m 52s
✔️ feature-verification-tests-noop SUCCESS in 6s
❌ functional-tests-osp18 FAILURE in 1h 51m 37s
✔️ functional-logging-tests-osp18 SUCCESS in 1h 23m 14s

ayefimov-1 · 2026-03-23T15:29:25Z

recheck

softwarefactory-project-zuul · 2026-03-23T17:39:37Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/36f89c31e59745929159ac723efb00ba

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 08m 47s
❌ functional-chargeback-tests-osp18 FAILURE in 1h 51m 30s
✔️ feature-verification-tests-noop SUCCESS in 5s
❌ functional-tests-osp18 FAILURE in 1h 50m 48s
✔️ functional-logging-tests-osp18 SUCCESS in 1h 23m 58s

ayefimov-1 · 2026-03-24T12:26:28Z

recheck

softwarefactory-project-zuul · 2026-03-24T14:40:40Z

Build failed (check pipeline). Post recheck (without leading slash)
to rerun all jobs. Make sure the failure cause has been resolved before
you rerun jobs.

https://softwarefactory-project.io/zuul/t/rdoproject.org/buildset/2c746a9c630e4e919eb487406591b813

✔️ telemetry-openstack-meta-content-provider-master SUCCESS in 2h 12m 42s
✔️ functional-chargeback-tests-osp18 SUCCESS in 1h 55m 05s
✔️ feature-verification-tests-noop SUCCESS in 6s
❌ functional-tests-osp18 FAILURE in 1h 35m 53s
✔️ functional-logging-tests-osp18 SUCCESS in 1h 22m 23s

ayefimov-1 · 2026-03-24T15:18:41Z

recheck

ayefimov-1 force-pushed the alexy_ck_get_cost branch 3 times, most recently from eac0578 to 81c746b Compare February 4, 2026 21:28

ayefimov-1 force-pushed the alexy_ck_get_cost branch 6 times, most recently from 63c23a2 to df89225 Compare February 5, 2026 20:04

ayefimov-1 force-pushed the alexy_ck_get_cost branch 2 times, most recently from 2421fe3 to cae4835 Compare February 6, 2026 18:39

ayefimov-1 force-pushed the alexy_ck_get_cost branch from 04d648f to 5e40438 Compare February 6, 2026 19:07

ayefimov-1 force-pushed the alexy_ck_get_cost branch from e95dd39 to ec89594 Compare February 6, 2026 21:10

ayefimov-1 force-pushed the alexy_ck_get_cost branch from abc403a to 2def821 Compare February 9, 2026 18:40

ayefimov-1 force-pushed the alexy_ck_get_cost branch 3 times, most recently from 7e94bdd to d2866b4 Compare February 11, 2026 20:47

Making changes suggested in PR-335

6e2c750

ayefimov-1 force-pushed the alexy_ck_get_cost branch from 7641780 to 6e2c750 Compare March 18, 2026 18:12

add format consistency to tasks yamls files

b3535eb

ayefimov-1 force-pushed the alexy_ck_get_cost branch from 1baa2de to b3535eb Compare March 19, 2026 16:15

Fix erroring of "Extract CA Bundle" task

f20dac6

ayefimov-1 added 2 commits March 20, 2026 11:08

fixing CA bundle error

3334fa0

Fix CA bundle error

1f63f96

ayefimov-1 force-pushed the alexy_ck_get_cost branch from 8bbbd09 to 1f63f96 Compare March 20, 2026 15:16

updated with more requested changes.

f722e58

ayefimov-1 force-pushed the alexy_ck_get_cost branch from 9fc37ae to f722e58 Compare March 20, 2026 18:49

ayefimov-1 requested a review from vyzigold March 20, 2026 21:23

ayefimov-1 force-pushed the alexy_ck_get_cost branch from 6b58ae5 to e6cf1b4 Compare March 23, 2026 12:58

remove commented lines

d85b0e7

ayefimov-1 force-pushed the alexy_ck_get_cost branch from e6cf1b4 to d85b0e7 Compare March 23, 2026 13:04

Merge branch 'master' into alexy_ck_get_cost

1ce36b1

ayefimov-1 mentioned this pull request Mar 24, 2026

Add the ability get the chargeback rate and diff against the calculated rate #340

Merged

ayefimov-1 mentioned this pull request Mar 24, 2026

Add chargeback rating testing for Cloudops FVT #341

Draft

Conversation

ayefimov-1 commented Feb 3, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

softwarefactory-project-zuul bot commented Feb 4, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 5, 2026

Uh oh!

ayefimov-1 commented Feb 5, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 6, 2026

Uh oh!

ayefimov-1 commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 6, 2026

Uh oh!

ayefimov-1 commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 6, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 6, 2026

Uh oh!

ayefimov-1 commented Feb 8, 2026

Uh oh!

softwarefactory-project-zuul bot commented Feb 9, 2026

Uh oh!

ayefimov-1 commented Feb 9, 2026

Uh oh!

softwarefactory-project-zuul bot commented Mar 19, 2026

Uh oh!

ayefimov-1 commented Mar 19, 2026

Uh oh!

softwarefactory-project-zuul bot commented Mar 19, 2026

Uh oh!

ayefimov-1 commented Mar 20, 2026

Uh oh!

softwarefactory-project-zuul bot commented Mar 20, 2026

Uh oh!

ayefimov-1 commented Mar 20, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

softwarefactory-project-zuul bot commented Mar 21, 2026

Uh oh!

softwarefactory-project-zuul bot commented Mar 23, 2026

Uh oh!

ayefimov-1 commented Mar 23, 2026

Uh oh!

softwarefactory-project-zuul bot commented Mar 23, 2026

Uh oh!

ayefimov-1 commented Mar 24, 2026

Uh oh!

softwarefactory-project-zuul bot commented Mar 24, 2026

Uh oh!

ayefimov-1 commented Mar 24, 2026

Uh oh!

Reviewers

Assignees

Labels

Milestone

Development

Uh oh!

4 participants

ayefimov-1 commented Feb 3, 2026 •

edited

Loading

ayefimov-1 commented Mar 20, 2026 •

edited

Loading