v0.5.20

[kungfucraig]

See the corresponding milestone for this release.

Highlights

• The Kingdom public API server now supports rate limiting. This can be configured using the --rate-limit-config-file option. The rate limit is applied individually for each server instance and each client certificate authority key identifier. See Kingdom Services Should be Rate Limited #2312.
  • Operators may want to configure the Reporting server to have no rate limit.
• The Kingdom internal API server has a new --max-event-group-read-staleness option that can be used to configure the maximum staleness for stale reads of EventGroups. See Use stale reads for ListEventGroups #2388
  • The default is 30 seconds.
• There is a CLI tool available for printing an entry from the Report post-processing log. See Create CLI tool to read a report post processing log using the blob key and echo it to the stdout. #2265
• Added etags to Requisition Add an etag to Requisition and add the method Requisitions.GetRequistion #2340

Issues Addressed

• Spanner client deadlocks after too many CANCELLED RPCs
• False ALREADY_EXISTS during Computation creation in Duchy Herald resulting in Measurements that get stuck in Pending Requisitions Parameters
• ListEventGroups does not respect order_by
• --grpc-thread-pool-size option does not affect size of thread pool for service implementations
• InvalidateMetric uses reporting.metrics.create permission
• Report processor supports report that does not contain whole campaign reach measurements.
• Report processor enforces overlap constraints.

What's Changed

• build: Update common-jvm dependency to v0.104.0 by @SanjayVas in build: Update common-jvm dependency to v0.104.0 #2324
• refactor(report-processor): remove redundant bucket name from log file path. by @ple13 in refactor(report-processor): remove redundant bucket name from log file path. #2344
• fix: Add reporting.metrics.invalidate permission for invalidateMetric by @tristanvuong2021 in fix: Add reporting.metrics.invalidate permission for invalidateMetric #2336
• feat: Create modules to build measurement results and fulfill requisitions by @jojijac0b in feat: Create modules to build measurement results and fulfill requisitions #2258
• build: Update common-jvm dep for ServiceConfig by @SanjayVas in build: Update common-jvm dep for ServiceConfig #2347
• fix: Use correct status codes for internal CreateModelLine errors by @SanjayVas in fix: Use correct status codes for internal CreateModelLine errors #2352
• feat: Add duchy internal Computation service into dashboard by @renjiezh in feat: Add duchy internal Computation service into dashboard #2326
• feat: implement getModelLine method by @tristanvuong2021 in feat: implement getModelLine method #2346
• feat: Add Model Line to MetricCalculationSpec by @tristanvuong2021 in feat: Add Model Line to MetricCalculationSpec #2308
• feat: replace jar certs with secrets certs in requisition fetcher and event group sync by @Marco-Premier in feat: replace jar certs with secrets certs in requisition fetcher and event group sync #2288
• feat: add deployment for event group sync by @Marco-Premier in feat: add deployment for event group sync #2289
• feat: Ensure all Kingdom Spanner queries are tagged by @SanjayVas in feat: Ensure all Kingdom Spanner queries are tagged #2353
• test: Add in-process integration test for Reporting EventGroups service by @SanjayVas in test: Add in-process integration test for Reporting EventGroups service #2348
• fix: Replace LocalComputationIdGenerator with RandomIdGenerator by @kungfucraig in fix: Replace LocalComputationIdGenerator with RandomIdGenerator #2355
• feat: Implement Postgres Ledger for Edp Aggregator Privacy Budget Manager by @ugur47 in feat: Implement Postgres Ledger for Edp Aggregator Privacy Budget Manager #2286
• feat(edpa): synthetic event generation by @stevenwarejones in feat(edpa): synthetic event generation #2290
• fix: Pass order_by from ListEventGroups by @SanjayVas in fix: Pass order_by from ListEventGroups #2365
• test: Re-enable SpannerModelRolloutsServiceTest by @SanjayVas in test: Re-enable SpannerModelRolloutsServiceTest #2354
• ci: Allow nightly build manual rerun by @laureanobrs in ci: Allow nightly build manual rerun #2361
• feat: MC Simulator for use in EDP Aggregator by @stevenwarejones in feat: MC Simulator for use in EDP Aggregator #2321
• feat: Add EDP Aggregator In Process Components by @stevenwarejones in feat: Add EDP Aggregator In Process Components #2322
• ci: Fix nightly build deployment by @laureanobrs in ci: Fix nightly build deployment #2371
• fix: Make synthetic data generation deterministic by @kungfucraig in fix: Make synthetic data generation deterministic #2369
• refactor: Remove dead Reporting code by @SanjayVas in refactor: Remove dead Reporting code #2343
• feat: Support RPC rate limiting for Kingdom public API services by @SanjayVas in feat: Support RPC rate limiting for Kingdom public API services #2338
• feat: add simple CLI for noise correction. by @ple13 in feat: add simple CLI for noise correction. #2357
• feat: Implement StorageClient ListBlobs Methods by @tristanvuong2021 in feat: Implement StorageClient ListBlobs Methods #2320
• feat: Add GetRequisition and Requisition.Etag by @renjiezh in feat: Add GetRequisition and Requisition.Etag #2356
• feat: Implement ModelSuite commands for ModelRepository CLI by @roaminggypsy in feat: Implement ModelSuite commands for ModelRepository CLI #2306
• feat: Implement public ModelProvidersService by @roaminggypsy in feat: Implement public ModelProvidersService #2317
• fead: add terraform changes needed for cloud test by @Marco-Premier in fead: add terraform changes needed for cloud test #2350
• feat: attach python CLI to release. by @ple13 in feat: attach python CLI to release. #2382
• feat: Implement Landspace utils for Edp aggregator Privacy Budget Manager by @ugur47 in feat: Implement Landspace utils for Edp aggregator Privacy Budget Manager #2314
• fix: event query event generation and requisition creation in MC Simulator by @stevenwarejones in fix: event query event generation and requisition creation in MC Simulator #2390
• feat: implement model repo cli for Population by @roaminggypsy in feat: implement model repo cli for Population #2370
• fix: Respect --grpc-thread-pool-size for Kingdom services by @SanjayVas in fix: Respect --grpc-thread-pool-size for Kingdom services #2383
• fix: remove event group sync iam binding by @Marco-Premier in fix: remove event group sync iam binding #2429
• feat: Create utils file for VID calculations that are done in the edp aggregator by @jojijac0b in feat: Create utils file for VID calculations that are done in the edp aggregator #2253
• feat: add requisition grouper interface and single requisition grouper by @stevenwarejones in feat: add requisition grouper interface and single requisition grouper #2339
• docs: ModelRepository Cli user doc by @roaminggypsy in docs: ModelRepository Cli user doc #2427
• feat: Group Requisitions by Report ID by @stevenwarejones in feat: Group Requisitions by Report ID #2375
• feat: add resources to edp aggregator cloud functions by @Marco-Premier in feat: add resources to edp aggregator cloud functions #2359
• fix: fix internal ListModelProviders result list, add public ListModelProvidersPageToken by @roaminggypsy in fix: fix internal ListModelProviders result list, add public ListModelProvidersPageToken #2432
• build: Update common-jvm dep for Spanner deadlock by @SanjayVas in build: Update common-jvm dep for Spanner deadlock #2428
• fix: Respect --grpc-thread-pool-size for Duchy, Reporting, Access, and SecureComputation services by @SanjayVas in fix: Respect --grpc-thread-pool-size for Duchy, Reporting, Access, and SecureComputation services #2389
• feat: implement ModelLine commands for ModelRepository cli by @roaminggypsy in feat: implement ModelLine commands for ModelRepository cli #2424
• perf: Use stale reads for ListEventGroups by @SanjayVas in perf: Use stale reads for ListEventGroups #2378
• Add exception logging for buildMetricResult failure. by @kungfucraig in Add exception logging for buildMetricResult failure. #2438
• feat: Create results fulfiller by @jojijac0b in feat: Create results fulfiller #2171
• feat: Add Flag to Disable Metrics Reuse by @tristanvuong2021 in feat: Add Flag to Disable Metrics Reuse #2430
• feat: report processor enforces overlap constraints. by @ple13 in feat: report processor enforces overlap constraints. #2436
• fix(report-processor): support reports that do not contain total reaches. by @ple13 in fix(report-processor): support reports that do not contain total reaches. #2439
• feat: model provider cli and tests by @roaminggypsy in feat: model provider cli and tests #2368
• fix: Remove extra double quotes from deploy_edp_aggregator_cloud_functions.yml by @tristanvuong2021 in fix: Remove extra double quotes from deploy_edp_aggregator_cloud_functions.yml #2445

Full Changelog: v0.5.19...v0.5.20

---

This discussion was created from the release v0.5.20.