feat(vertexai): add google_vertex_ai_online_evaluator resource

[guvenenb]

Release Note Template for Downstream PRs (will be copied)

See Write release notes for guidance.

`google_vertex_ai_online_evaluator` (beta)

[github-actions]

Googlers: For automatic test runs see go/terraform-auto-test-runs.

@roaks3, a repository maintainer, has been assigned to review your changes. If you have not received review feedback within 2 business days, please leave a comment on this PR asking them to take a look.

You can help make sure that review is quick by doing a self-review and by running impacted tests locally.

[github-actions]

@roaks3 This PR has been waiting for review for 3 weekdays. Please take a look! Use the label disable-review-reminders to disable these notifications.

[github-actions]

@GoogleCloudPlatform/terraform-team @roaks3 This PR has been waiting for review for 1 week. Please take a look! Use the label disable-review-reminders to disable these notifications.

[roaks3]

Overall looks good, but left a few comments, mainly to align with common practices

[roaks3]

LGTM, just one minor comment on the tests

[modular-magician]

Hi there, I'm the Modular magician. I've detected the following information about your changes for commit 1c349d6:

Diff report

Your PR generated the following diffs in downstream repositories:

Repository	Diff Link	Changes
google provider	View Diff	2 files changed, 356 insertions(+)
google-beta provider	View Diff	6 files changed, 2405 insertions(+)
terraform-google-conversion	View Diff	1 file changed, 465 insertions(+)

Missing test report

Your PR includes resource fields which are not covered by any test.

Resource: google_vertex_ai_online_evaluator (3 total tests)
Please add an acceptance test which includes these fields. The test should include the following:

resource "google_vertex_ai_online_evaluator" "primary" {
  cloud_observability {
    log_view   = # value needed
    trace_view = # value needed
  }
  metric_sources {
    metric_resource_name = # value needed
  }
}

Missing service labels

The following new resources do not have corresponding service labels:

• google_vertex_ai_online_evaluator

If you believe this detection to be incorrect please raise the concern with your reviewer. Googlers: This error is safe to ignore once you've completed go/fix-missing-service-labels.
An override-missing-service-label label can be added to allow merging.

Test report

Analytics

Total Tests	Passed	Skipped	Affected
101	95	4	2

Affected Service Packages

• vertexai

Learn how VCR tests work

---

Step 1: Replaying Mode

Action taken

Found 2 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit.

Click here to see the affected tests

• TestAccVertexAIOnlineEvaluator_update
• TestAccVertexAIOnlineEvaluator_vertexAiOnlineEvaluatorBasicExample

View the replaying VCR build log

---

Step 2: Recording Mode

Recording Mode	Replaying Rerun	Test Name
❌ Error · Log	-	TestAccVertexAIOnlineEvaluator_update
❌ Error · Log	-	TestAccVertexAIOnlineEvaluator_vertexAiOnlineEvaluatorBasicExample

Caution

Issues requiring attention before PR completion

🔴 Initial Recording Failed: Some tests failed during the recording step. See the table above for details.

Please address these issues to complete your PR. If you believe these detections are incorrect or unrelated to your change, please raise the concern with your reviewer.

View the recording VCR build log or the debug logs folder for detailed results.

@guvenenb, @roaks3 VCR tests complete for 1c349d6!

[roaks3]

update test looks like a field is trying to be updated that shouldn't?

=== CONT  TestAccVertexAIOnlineEvaluator_update
    resource_vertex_ai_online_evaluator_test.go:35: Step 1/4 error: After applying this test step, the non-refresh plan was not empty.
        stdout:
        
        
        Terraform used the selected providers to generate the following execution
        plan. Resource actions are indicated with the following symbols:
        -/+ destroy and then create replacement
        
        Terraform will perform the following actions:
        
          # google_vertex_ai_online_evaluator.evaluator must be replaced
        -/+ resource "google_vertex_ai_online_evaluator" "evaluator" {
              ~ create_time     = "2026-06-18T21:35:29.127524Z" -> (known after apply)
              ~ id              = "projects/ci-test-project-188019/locations/us-central1/onlineEvaluators/7049681529206734848" -> (known after apply)
              ~ name            = "7049681529206734848" -> (known after apply)
              ~ state           = "ACTIVE" -> (known after apply)
              ~ state_details   = [] -> (known after apply)
              ~ update_time     = "2026-06-18T21:35:29.127524Z" -> (known after apply)
                # (5 unchanged attributes hidden)
        
              ~ cloud_observability {
                    # (2 unchanged attributes hidden)
        
                  + open_telemetry { # forces replacement
                      + semconv_version = "1.39.0" # forces replacement
                    }
        
                    # (1 unchanged block hidden)
                }
        
                # (2 unchanged blocks hidden)
            }
        
        Plan: 1 to add, 0 to change, 1 to destroy.
--- FAIL: TestAccVertexAIOnlineEvaluator_update (356.67s)

And the basic example probably needs either provider = google-beta, or the example might need min_version: beta, i forget exactly how those interact

[modular-magician]

Hi there, I'm the Modular magician. I've detected the following information about your changes for commit 5a24c63:

Diff report

Your PR generated the following diffs in downstream repositories:

Repository	Diff Link	Changes
google provider	View Diff	2 files changed, 358 insertions(+)
google-beta provider	View Diff	6 files changed, 2398 insertions(+)
terraform-google-conversion	View Diff	1 file changed, 465 insertions(+)

Missing test report

Your PR includes resource fields which are not covered by any test.

Resource: google_vertex_ai_online_evaluator (3 total tests)
Please add an acceptance test which includes these fields. The test should include the following:

resource "google_vertex_ai_online_evaluator" "primary" {
  cloud_observability {
    log_view   = # value needed
    trace_view = # value needed
  }
  metric_sources {
    metric_resource_name = # value needed
  }
}

Test report

Analytics

Total Tests	Passed	Skipped	Affected
101	95	4	2

Affected Service Packages

• vertexai

Learn how VCR tests work

---

Step 1: Replaying Mode

Action taken

Found 2 affected test(s) by replaying old test recordings. Starting RECORDING based on the most recent commit.

Click here to see the affected tests

• TestAccVertexAIOnlineEvaluator_update
• TestAccVertexAIOnlineEvaluator_vertexAiOnlineEvaluatorBasicExample

View the replaying VCR build log

---

Step 2: Recording Mode

Recording Mode	Replaying Rerun	Test Name
✅ Log	✅	TestAccVertexAIOnlineEvaluator_update
✅ Log	✅	TestAccVertexAIOnlineEvaluator_vertexAiOnlineEvaluatorBasicExample

🟢 All tests passed!

View the recording VCR build log or the debug logs folder for detailed results.

@guvenenb, @roaks3 VCR tests complete for 5a24c63!

[modular-magician]

Hi there, I'm the Modular magician. I've detected the following information about your changes for commit a5a761a:

Diff report

Your PR generated the following diffs in downstream repositories:

Repository	Diff Link	Changes
google provider	View Diff	2 files changed, 358 insertions(+)
google-beta provider	View Diff	6 files changed, 2400 insertions(+)
terraform-google-conversion	View Diff	1 file changed, 465 insertions(+)

Missing test report

Your PR includes resource fields which are not covered by any test.

Resource: google_vertex_ai_online_evaluator (3 total tests)
Please add an acceptance test which includes these fields. The test should include the following:

resource "google_vertex_ai_online_evaluator" "primary" {
  cloud_observability {
    log_view   = # value needed
    trace_view = # value needed
  }
  metric_sources {
    metric_resource_name = # value needed
  }
}

Test report

Analytics

Total Tests	Passed	Skipped	Affected
101	97	4	0

Affected Service Packages

• vertexai

Learn how VCR tests work

---

Step 1: Replaying Mode

🟢 All tests passed in Replaying mode! No Recording was needed.

View the replaying VCR build log

@guvenenb, @roaks3 VCR tests complete for a5a761a!