API Server errors due to old kine version

[JonnyBDev]

We've upgraded our development TCP and our workers to 1.34.0. After the upgrade we are seeing multiple errors:

E0308 22:09:14.227840       1 compact.go:265] etcd: endpoint ([unix:///uds/kine]): failed to parse compact revision: strconv.ParseInt: parsing "": invalid syntax
I0308 22:09:14.573428       1 stats.go:136] "Error getting keys" err="Timeout: Too large resource version: 62545768, current: 62544754"
E0308 22:09:15.231379       1 compact.go:265] etcd: endpoint ([unix:///uds/kine]): failed to parse compact revision: strconv.ParseInt: parsing "": invalid syntax
E0308 22:09:16.235393       1 compact.go:265] etcd: endpoint ([unix:///uds/kine]): failed to parse compact revision: strconv.ParseInt: parsing "": invalid syntax
I0308 22:09:16.829320       1 stats.go:136] "Error getting keys" err="Timeout: Too large resource version: 62545784, current: 62545779"
I0308 22:09:16.842948       1 stats.go:136] "Error getting keys" err="Timeout: Too large resource version: 62545784, current: 62543661"
E0308 22:09:17.246999       1 compact.go:265] etcd: endpoint ([unix:///uds/kine]): failed to parse compact revision: strconv.ParseInt: parsing "": invalid syntax
E0308 22:09:18.250933       1 compact.go:265] etcd: endpoint ([unix:///uds/kine]): failed to parse compact revision: strconv.ParseInt: parsing "": invalid syntax
I0308 22:09:19.058213       1 stats.go:136] "Error getting keys" err="Timeout: Too large resource version: 62545793, current: 62545747"
E0308 22:09:19.254481       1 compact.go:265] etcd: endpoint ([unix:///uds/kine]): failed to parse compact revision: strconv.ParseInt: parsing "": invalid syntax
I0308 22:09:19.665740       1 stats.go:136] "Error getting keys" err="Timeout: Too large resource version: 62545794, current: 62544020"
E0308 22:09:20.258131       1 compact.go:265] etcd: endpoint ([unix:///uds/kine]): failed to parse compact revision: strconv.ParseInt: parsing "": invalid syntax
I0308 22:09:21.052370       1 stats.go:136] "Error getting keys" err="Timeout: Too large resource version: 62545797, current: 62545623"
E0308 22:09:21.262622       1 compact.go:265] etcd: endpoint ([unix:///uds/kine]): failed to parse compact revision: strconv.ParseInt: parsing "": invalid syntax
I0308 22:09:21.348074       1 stats.go:136] "Error getting keys" err="Timeout: Too large resource version: 62545797, current: 62544125"
E0308 22:09:22.266600       1 compact.go:265] etcd: endpoint ([unix:///uds/kine]): failed to parse compact revision: strconv.ParseInt: parsing "": invalid syntax
I0308 22:09:22.473441       1 stats.go:136] "Error getting keys" err="Timeout: Too large resource version: 62545801, current: 62545472"
E0308 22:09:23.307326       1 compact.go:265] etcd: endpoint ([unix:///uds/kine]): failed to parse compact revision: strconv.ParseInt: parsing "": invalid syntax
I0308 22:09:23.488483       1 stats.go:136] "Error getting keys" err="Timeout: Too large resource version: 62545802, current: 62545626"

After checking we found an issue raised at the k3s repository regarding this error message: k3s-io/k3s#13716

There have been changes to the kine format from v0.14.11. This will result in the mentioned error. Without manually migrating the DataStore database this will be an issue.

The current kind version Kamaji is running is version v0.11.10 from June 2024. That's the commit of the update.

Kine just released version v0.14.14 two days ago. Would it be possible to update the dependency for Kamaji to >= v0.14.11 to fix this issue? I believe we can't be the only one running into these API server error logs. The API server itself is not crashing but logging errors should be something to keep an eye on.

Thanks!