Releases: umccr/orcahouse
Releases · umccr/orcahouse
Release 0.4.0
What's Changed
- Fixed workflow run detail satellite model by @victorskl in #170
- Improved workflow hub model incremental check by @victorskl in #171
- Updated ODS models by @victorskl in #172
- Improved mart tothill_lims table by @victorskl in #173
- 174 rerun l2500130 l2500351 for dragen wgts dna germline only by @qclayssen in #176
- Added columns to workflow satellite models by @victorskl in #179
- Implemented data mart output model by @victorskl in #181
- Improved data mart output model source location priority by @victorskl in #182
- Improved data mart output model source location filter by @victorskl in #183
- Improved data mart output model logs directory filter by @victorskl in #184
- Improved reusable regex expression as dbt macros function by @victorskl in #185
- Refactored extraction logic on data mining the portal run id by @victorskl in #186
- Refactored extraction logic on data mining the cohort id by @victorskl in #187
- Refactored extraction logic on data mining the library id by @victorskl in #188
- Improved SequenceRunManager Link model tracking satellite to MAS by @victorskl in #189
- Added support for SequencerRunManger samplesheet_content_original by @victorskl in #190
- Fixed GraphQL API node-jws dependencies by @victorskl in #191
- Improved hub_s3object computed satellite incremental strategy by @victorskl in #192
- Improved warehouse aurora serverless capacity configuration by @victorskl in #193
- Improved s3object satellite history details by @victorskl in #194
- Improved s3object satellite Current model by @victorskl in #195
- Improved mart Read inventory with versioned objects support by @victorskl in #196
- Added support for 2026 sheet by @victorskl in #197
- Fixed handling Study column harmonisation for the new sheet by @victorskl in #198
Full Changelog: 0.3.0...0.4.0
Release 0.3.0
What's Changed
- Add default values for event data to avoid null value issues by @reisingerf in #123
- Parse and store more event data by @reisingerf in #124
- Strigify all values from event by @reisingerf in #125
- str every data element by @reisingerf in #126
- Improved DCL BV satellite WorkflowRun ETL strategy by @victorskl in #128
- Stripped LibraryID suffixes from Read inventory tables by @victorskl in #129
- Implemented Same-as Link table for LibraryHub by @victorskl in #130
- Improved data mart LIMS table for alias_library_id by @victorskl in #131
- Fixes special characters in db passwords by @reisingerf in #133
- Fix AppSync RDS Secret ARN by @williamputraintan in #135
- Feat(api): Graphql API for Orcavault by @williamputraintan in #134
- Feat(api): Configuration by @williamputraintan in #139
- Deprecate AppSync by @williamputraintan in #140
- Fixed make logs target phony by @victorskl in #141
- Updated SequenceRunManager Comment table column rename by @victorskl in #142
- feat: deploy aurora tf (dev workspace) by @williamputraintan in #143
- Update Fastq Manager event name by @reisingerf in #144
- Updated DCL satellite model sat_sequencing_run_samplesheet by @victorskl in #145
- Setup OrcaHouse infrastructure in DEV account by @victorskl in #146
- Improved spreadsheet Glue ETL script by @victorskl in #147
- Implemented dedicated mart database view accreditation_lims by @victorskl in #148
- Updated mart db view accreditation_lims with PTC libraries for variant monitoring by @victorskl in #150
- Fixed satellite model incremental based on the hub load datetime by @victorskl in #151
- Update accreditation mart SQL to include sample labelling by @reisingerf in #152
- Reverted PR 151 by @victorskl in #153
- Fixed fastq mart library_id regexp by @victorskl in #154
- Update accreditation mart library mapping by @reisingerf in #156
- Implemented mart.external_lims table by @victorskl in #158
- Added externally sequenced sample into control somatic list by @victorskl in #159
- Updated mart table structure for research groups by @victorskl in #160
- Implemented Error Mart concept by @victorskl in #161
- Implemented data mart table catalog by @victorskl in #162
- Updated research group grimmond_lims implementation by @victorskl in #163
- Bumped dependencies by @victorskl in #164
- Add Lambda DLQ to ingest pipe by @reisingerf in #165
- Ingest pipe dlq alarm by @reisingerf in #166
- Implemented error mart em_library_dns table by @victorskl in #167
- Add library id and sequencing run id for clinical MSI sample by @qclayssen in #169
New Contributors
- @qclayssen made their first contribution in #169
Full Changelog: 0.2.0...0.3.0
Release 0.2.0
What's Changed
- Refactored and fixed Google Spreadsheet extract step via csv by @victorskl in #72
- Improved Link model between Library and InternalSubject by @victorskl in #73
- Refactored hub_s3object computed satellite by @victorskl in #74
- Implemented data marts for warehouse Beta Demo by @victorskl in #75
- Implemented "effsat" model constellation by @victorskl in #76
- Added Sequence Run Manager newer tables as source by @victorskl in #78
- Implemented SRM satellites for HubSequencingRun constellation by @victorskl in #79
- Implemented descriptive satellite on Link table between HubLibrary and HubSequencingRun by @victorskl in #80
- Implemented RO user mart grant refresh by @victorskl in #81
- Implemented FASTQ History data mart view by @victorskl in #82
- Fixed data mart lims filtered satellite library history by load datetime by @victorskl in #83
- Improved business vault s3object current model satellite by @victorskl in #84
- Improved Centre lims data mart to exclude failed sequencing runs by @victorskl in #85
- Fixed WorkflowManager payload can be nullable on workflow terminal status by @victorskl in #87
- Introduced Virtual Cohort ID by @victorskl in #88
- Implemented Centre data mart bam inventory by @victorskl in #89
- Implemented Centre data mart workflow inventory by @victorskl in #90
- Implemented effsat_library_external_subject on link_library_external_subject by @victorskl in #91
- Fixed raw vault satellite sat_sequencing_run_detail incremental load by @victorskl in #92
- Fixed mart lims filter on succeeded sequencing runs by @victorskl in #93
- Feat/service event ingestion by @reisingerf in #94
- Fixed sat_s3object_current model daily cut-over timestamp ranking by @victorskl in #95
- Implemented business vault effectivity satellites on Library to Sample, ExternalSample and Project by @victorskl in #96
- Implemented business vault effectivity satellites on Library to ExternalSubject and Owner by @victorskl in #97
- Implemented OrcaVault Legacy database schema by @victorskl in #98
- Refactor/db user module by @reisingerf in #99
- Feat/srm event ingest by @reisingerf in #100
- Implemented business vault layer satellite model - WorkflowRun by @victorskl in #101
- Improved data mart Workflow table by @victorskl in #102
- Fixed workflow run state can be null by @victorskl in #103
- Add wfr event handler by @reisingerf in #104
- Improved README by @victorskl in #106
- Fixed RDS.16 by enabling copy_tags_to_snapshot by @victorskl in #107
- Implemented orcahouse management instance by @victorskl in #108
- Fix lamnda execution issues after refactor by @reisingerf in #110
- Add DB user for Athena by @reisingerf in #109
- Fix column name mismatch by @reisingerf in #111
- Fixed dbt hook run operation grant select ro user by @victorskl in #112
- Removed reference to legacy portal compute security group by @victorskl in #113
- Improved DCL Library satellite model ranking logic by @victorskl in #114
- Feat/lamnda monitoring by @reisingerf in #115
- Improved DCL effsat Library Experiment link model incremental logic by @victorskl in #117
- Add Metadata event ingestion by @reisingerf in #116
- Improved DCL satellite WorkflowRunComment by @victorskl in #120
- Feat: new
limsgraphql endpoint by @williamputraintan in #119
New Contributors
- @reisingerf made their first contribution in #94
- @williamputraintan made their first contribution in #119
Full Changelog: 0.1.0...0.2.0
Release 0.1.0
What's Changed
- Added OrcaVault hub models Experiment and Sequencing Run by @victorskl in #1
- Added OrcaVault raw schema link models by @victorskl in #2
- Added raw schema link between Library hub to ExternalSubject hub by @victorskl in #3
- Added raw schema link between InternalSubject hub to ExternalSubject hub by @victorskl in #4
- Added raw schema link between Project hub to Contact hub by @victorskl in #5
- Added raw schema link between Library hub to ExternalSample hub by @victorskl in #6
- Added raw schema link between Sample hub to ExternalSample hub by @victorskl in #7
- Added granted to dev toolchain by @victorskl in #8
- Implemented Glue project structure and skel by @victorskl in #9
- Implemented aurora-su stack by @victorskl in #11
- Implemented data import from S3 bucket to Aurora PostgreSQL by @victorskl in #12
- Implemented Glue ETL spreadsheet processing by @victorskl in #13
- Implemented Glue ETL job script deployment using terraform by @victorskl in #14
- Implemented OrcaVault tsa schema by @victorskl in #15
- Improved Glue job script spreadsheet_library_tracking_metadata by @victorskl in #16
- Implemented OrcaVault psa schema by @victorskl in #17
- Fixed Glue job script spreadsheet_library_tracking_metadata OUT_NAME_DOT by @victorskl in #18
- Implemented Glue ETL spreadsheet Google LIMS processing by @victorskl in #19
- Implemented OrcaVault tsa schema spreadsheet Google LIMS by @victorskl in #20
- Implemented OrcaVault psa schema spreadsheet Google LIMS by @victorskl in #21
- Updated OrcaVault hub models from PSA spreadsheet schema by @victorskl in #22
- Updated OrcaVault library-based link models from PSA spreadsheet schema by @victorskl in #23
- Updated OrcaVault project link models from PSA spreadsheet schema by @victorskl in #24
- Updated OrcaVault link models that exhibit internal-external mapping from PSA spreadsheet schema by @victorskl in #25
- Updated OrcaVault hub models incremental materialization by @victorskl in #26
- Fixed OrcaVault hub models incremental differential except query by @victorskl in #27
- Fixed OrcaVault PSA spreadsheet_library_tracking_metadata incremental except query by @victorskl in #28
- Updated OrcaVault link models incremental materialization by @victorskl in #29
- Implemented OrcaVault Library satellite model with incremental materialization by @victorskl in #30
- Implemented OrcaVault Library satellite model - plab by @victorskl in #31
- Implemented OrcaVault Library satellite model - plims by @victorskl in #32
- Implemented OrcaVault Library satellite model - glab by @victorskl in #33
- Implemented OrcaVault Library satellite model - glims by @victorskl in #34
- Implemented OrcaVault link satellite model between Library and SequencingRun - plims by @victorskl in #35
- Implemented OrcaVault link satellite model between Library and SequencingRun - glims by @victorskl in #36
- Implemented OrcaVault Project satellite model - mm by @victorskl in #37
- Implemented OrcaVault Contact satellite model - mm by @victorskl in #38
- Implemented OrcaVault ExternalSubject satellite model - mm by @victorskl in #39
- Implemented OrcaVault InternalSubject satellite model - mm by @victorskl in #40
- Fixed Glue job worker type by @victorskl in #41
- Implemented dbt run operation as ECS Fargate standalone task by @victorskl in #42
- Implemented OrcaHouse Aurora database backup by @victorskl in #43
- Added aurora user orcahouse ro by @victorskl in #44
- Implemented OrcaHouse Athena by @victorskl in #45
- Refactored Glue terraform deployment by @victorskl in #46
- Added orcavault make doc target for dbt docs generate by @victorskl in #47
- Added upstream s3object tables to ODS schema local dev by @victorskl in #48
- Updated db sg to allow traffic within the group by @victorskl in #49
- Implemented raw vault layer s3object hub model by @victorskl in #50
- Implemented raw vault layer s3object satellite model by @victorskl in #51
- Improved raw vault s3object hub model - last_seen_date by @victorskl in #52
- Implemented raw vault layer s3object satellite model - filemanager by @victorskl in #53
- Improved s3object hub model incremental loading strategy by @victorskl in #54
- Added upstream workflow run tables to ODS schema local dev by @victorskl in #55
- Implemented raw vault layer workflow run hub model by @victorskl in #56
- Implemented raw vault Link model between hub_library and hub_workflow_run by @victorskl in #57
- Implemented raw vault Satellite model for hub_workflow_run - portal by @victorskl in #58
- Implemented raw vault Satellite model for hub_workflow_run - Workflow Manager by @victorskl in #59
- Refactored schema name from
rawtodclby @victorskl in #61 - Implemented Business Vault computed satellite on hub_s3object key by @victorskl in #62
- Improved sat_s3object_filemanager satellite by @victorskl in #64
- Refactored DCL layer hub_contact to hub_owner concept by @victorskl in #65
- Implemented DCL layer link_library_ownership model by @victorskl in #66
- Bumped dependencies by @victorskl in #67
- Refactored sat_s3object_filemanager to sat_s3object_history by @victorskl in #68
- Implemented Effectivity satellite sat_s3object_current by @victorskl in #69
- Refined S3Object models constellation by @victorskl in #70
- Refined hub models constellation by @victorskl in #71
Full Changelog: https://github.com/umccr/orcahouse/commits/0.1.0