Release Notes for v0.21.0-rc1

⚠️ This is a release candidate and has not been tested yet in production and may be insecure.

Mandatory migration tasks

Ensure RID schema has been migrated to version 4.0.0 since the datastore doesn't fallback anymore on the default database. If that not the case, please use the previous release and upgrade to schema 4.0.0 first.
The RID cronjob has been moved to an external command, see #1261
- If you want to continue to cleanup old entries regularly, run the evict command as needed:
  - Running the following command each 30 minutes will be equivalent to the previous situation
  - db-manager evict --rid_isa=True --rid_sub=True --rid_ttl=30m --scd_oir=False --scd_sub=False
- Helm charts, tanka files and terraform files has been updated with defaults that run RID cleanup as before and disable SCD cleanup
  - Please review new parameters in each module specific documentation and update them as needed.
The test certificate build/test-certs/auth2 public and private keys have been changed, see #1178. Please update your configuration if you used that public key.
A new aux store has been added, which implies a new migration job using schema-manager. If you ran migration jobs manually, make sure you run the migration for this new schema. Schemas are stored in the aux_ folder.
Upgrade terraform version to 12.2 if lower.
The terraform variable crdb_hostname_suffix has been renamed to db_hostname_suffix, please update your configuration accordingly.
The terraform variable crdb_locality has been renamed to locality and is now mandatory, please update your configuration accordingly.
public_endpoint parameter has been added as a mandatory argument. Please set it to the public endpoint of your DSS instance in order to register this instance as a participant in the pool information.
A immutable field has been changed in terraform / tanka
- Please remove any *-schema-manager-* jobs before upgrading chart / applying tanka configuration.
- The job is only used for migrations and can be removed.

Optional migration tasks

Datastores parameters have been renamed to be more vendor-agnostic. The old ones have been deprecated but will continue to work for the time being.
- If you call the dss executable directly, you will need to update parameters as below.
- If you use helm/tanka to deploy the DSS, parameters have been renamed internally, you don't have to do anything.

Old parameter name	New parameter name	Description
cockroach_application_name	datastore_application_name	application name for tagging the connection to the database
cockroach_db_name	datastore_db_name	database name to connect to
cockroach_host	datastore_host	database host to connect to
cockroach_port	datastore_port	database port to connect to
cockroach_ssl_mode	datastore_ssl_mode	database sslmode
cockroach_ssl_dir	datastore_ssl_dir	directory to ssl certificates. Must contain files: ca.crt, client..crt, client..key
cockroach_user	datastore_user	database user to authenticate as
max_open_conns	datastore_max_open_conns	maximum number of open connections to the database, default is 4
max_conn_idle_secs	datastore_max_conn_idle_secs	maximum amount of time in seconds a connection may be idle, default is 30 seconds
cockroach_max_retries	datastore_max_retries	maximum number of attempts to retry a query in case of contention, default is 100

Important information

Yugabyte support has been added to terraform, tanka and helm files. You're encouraged to use Yugabyte for new DSS Pool instances.
The RID evict task is now deleting all expired entries instead of stopping after the first one, see #1253.
- The initial run may take longer than expected when deleting entries that may have been accumulating.
Published images are now signed with sigstore, see how to verify it.
Deployment documentation has been moved to a new website instead of various README in the repository tree.

Minimal database schema version

Schema	CockroachDB	Yugabyte
AUX	1.0.0	1.0.0
RID	4.0.0	1.0.1
SCD	3.2.0	1.0.1

Validation

USS qualifier version: v0.21.0
Test configuration and report: see attachments

What's Changed

Upgrade go version to 1.24; Upgrade golint-ci to 2.1.5; Fix linting issues; Generate new dummy keys for DummyOAuth by @mickmis in #1178
Bump golang.org/x/crypto from 0.32.0 to 0.35.0 by @dependabot[bot] in #1173
Bump golang.org/x/net from 0.33.0 to 0.38.0 by @dependabot[bot] in #1183
[docs] Add DSS pool verification docs by @BenjaminPelletier in #1180
[helm] Add basic support for yugabyte to helm charts by @the-glu in #1159
[terraform-commons-dss] Better defaults for terraform-google-dss by @the-glu in #1187
[yugabyte] certificates management by @the-glu in #1186
[helm] Add TLS support on yugabyte by @the-glu in #1182
[ci] extract unit & integration test coverage report by @Shastick in #1185
[aux] Add CAs endpoint by @the-glu in #1194
[ci] publish coverage data as an artifact for all master builds by @Shastick in #1193
Yugabyte: Working GCP implementation by @the-glu in #1190
[yugabyte] remove useless variable file by @the-glu in #1200
[yugabyte] Working AWS implementation by @the-glu in #1191
[yugabyte] Partially improve documentation by @the-glu in #1201
[aux] Add DAR ID on yugabyte deployments by @the-glu in #1195
[cmd] Add public endpoint flag by @the-glu in #1197
[terraform] Fix cockroachdb condition by @the-glu in #1204
[aux] Add store and basic pool instance informations by @the-glu in #1198
[helm] Fix error with aux_ migration script by @the-glu in #1208
[terraform] Rename crdb_hostname_suffix to db_hostname_suffix by @the-glu in #1203
[terraform] Update example files for yugabyte by @the-glu in #1205
Update Deprecated Terraform resources and set TF provider versions by @ZachHubbs in #1209
[helm] Improve public endpoint setting with backward compatiblity by @the-glu in #1211
[dss] sort cell ids in queries by @Shastick in #1112
[tests] update monitoring image to latest release 0.16.0 by @Shastick in #1223
[deploy] Move locality to a common variable and make it mandatory by @the-glu in #1212
[tanka] Improve tanka configuration file to work with minikube by @the-glu in #1216
[tanka] Add aux migrations by @the-glu in #1217
[tanka] Make job uniques + add way for cleanup by @the-glu in #1218
[tanka] Add public_endpoint argument by @the-glu in #1219
[yugabyte] New pooling documentation by @the-glu in #1207
[tanka] Add parameters to always enable schema manager by @the-glu in #1221
[aux] Add heartbeat functionnality by @the-glu in #1213
[tanka] Yugabyte, preparation by @the-glu in #1222
[tanka] Yugabyte: base service and migrations by @the-glu in #1224
[tanka] Yugabyte: add options to prepare for terraform output by @the-glu in #1227
[tanka/terraform] Update terraform state to support latest tanka files, including yugabyte by...

Contributors

Shastick, barroco, and 7 other contributors

Assets 3

22 Aug 21:17

barroco

interuss/dss/v0.20.1

18c1d34

v0.20.1 Latest

Latest

What's Changed

Deployment

Update Deprecated Terraform resources and set TF provider versions by @ZachHubbs in #1209

New Contributors

@ZachHubbs made their first contribution in #1209

Full Changelog: interuss/dss/v0.20.0...interuss/dss/v0.20.1

Required database schema versions

Schema	CockroachDB	Yugabyte
RID	4.0.0	1.0.1
SCD	3.2.0	1.0.1
AUX	N/A	N/A

Validation

USS qualifier version: v0.18.0
Test configuration and report: see attachment