dashboard/app: filter out some entries from the error log

[dvyukov]

Don't show package update errors, they happen in hundreds every day.
Don't show internal datastore bugs (these are not our bugs).

[a-nogikh]

Why not add extra filtering to the query itself?

[dvyukov]

Why not add extra filtering to the query itself?

How can I do that?

[a-nogikh]

We already have some filtering:

syzkaller/dashboard/app/main.go

Lines 2463 to 2471 in 4e5820c

	iter := adminClient.Entries(c,
	logadmin.Filter(
	// We filter our instances.delete errors as false positives. Delete event happens every second.
	// Also, ignore GKE logs since it streams all stderr output as severity=ERROR.
	fmt.Sprintf(`(NOT protoPayload.methodName:v1.compute.instances.delete)`+
	` AND (NOT resource.type="k8s_container") AND timestamp > "%s" AND severity>="ERROR"`,
	lastWeek)),
	logadmin.NewestFirst(),
	)

[dvyukov]

We already have some filtering:

syzkaller/dashboard/app/main.go

Lines 2463 to 2471 in 4e5820c

	iter := adminClient.Entries(c,
	logadmin.Filter(
	// We filter our instances.delete errors as false positives. Delete event happens every second.
	// Also, ignore GKE logs since it streams all stderr output as severity=ERROR.
	fmt.Sprintf(`(NOT protoPayload.methodName:v1.compute.instances.delete)`+
	` AND (NOT resource.type="k8s_container") AND timestamp > "%s" AND severity>="ERROR"`,
	lastWeek)),
	logadmin.NewestFirst(),
	)

How can I filter for that?
I am trying the following query, but it does not return anything at all.

(NOT protoPayload.methodName:v1.compute.instances.delete) AND (NOT resource.type="k8s_container") AND timestamp > "2025-12-20" AND severity>="ERROR" AND (NOT textPayload CONTAINS "datastore_v3: INTERNAL_ERROR") AND (NOT jsonPayload.MESSAGE CONTAINS "packages.GetPackageUpdates()")

[a-nogikh]

This works:

(NOT protoPayload.methodName:v1.compute.instances.delete) AND (NOT resource.type="k8s_container") AND timestamp > "2025-12-20" AND severity>="ERROR" AND (NOT textPayload:"datastore_v3: INTERNAL_ERROR") AND (NOT jsonPayload.message:"packages.GetPackageUpdates()")

(After looking at the results)
I think we also want to filter out Cloud Build messages.

[dvyukov]

This works:

(NOT protoPayload.methodName:v1.compute.instances.delete) AND (NOT resource.type="k8s_container") AND timestamp > "2025-12-20" AND severity>="ERROR" AND (NOT textPayload:"datastore_v3: INTERNAL_ERROR") AND (NOT jsonPayload.message:"packages.GetPackageUpdates()")

Thanks!
Updated the change.
PTAL

(After looking at the results) I think we also want to filter out Cloud Build messages.

Agree. They don't even look like errors. At least it's impossible to understand what's wrong.