2.2.0

Highlights

• Incrementally adopting Nextjs for the frontend UI
• Able to support larger size Scan Reports
• Returning to using published releases to deploy the live webapp.

What's Changed

• Add shared package for database models by @AndyRae in #671
• Add serverless mapping rules by @AndyRae in #675
• Restructure Django app by @AndyRae in #686
• Add datasets list index page by @AndrewThien in #693
• Change Mapping Rules reuse to a durable function by @AndyRae in #699
• Add Nextjs deployments by @AndyRae in #704
• Add Scan Report Tables view by @AndrewThien in #708
• Fix rules serializing to views + CSV by @AndyRae in #721
• Update serverless concept creation to use the db by @AndyRae in #720
• Scan Report Fields Next.js Implementation by @Dev-Akashili in #714
• Implement NextJS to Scan Reports Value view by @AndrewThien in #722
• Implementation of NextJS to Dataset - Scanreports list view by @AndrewThien in #728
• Implementation of NextJS to Scanreports - Edit Table view by @AndrewThien in #732

New Contributors

• @AndrewThien made their first contribution in #693

Full Changelog: 2.1.0...2.2.0

2.1.0

This is the first numbered release in over 12 months, marking the initial work for major changes to how Carrot-Mapper is structured and deployed.

Highlights

• The repo has been restructured to separate dependencies.
• The webapp has been updated to use Python 3.11, Django 4.2, and updated other dependencies.
• The Azure functions have been updated to use Python 3.11
• The ProcessQueue Azure function has been extracted into UploadQueue and CreateConcepts. The upload and population of fields and values is standalone. Creating concepts and reusing them are deferred to when the user sets the Person ID and Date Event per table.
• The CSV export function has been updated - the columns reordered and new columns (class, concept, validity and vocabulary) added.
• django-revproxy has been added to reverse proxy the Next.js frontend.
• refresh_mapping_rules management command has been added to run rules refresh offline. This is a temporary measure while the performance is improved.
• The stats counting on the ScanReport main page has been disabled to improve stability.

Bugfixes

• Bug fixed in find_existing_scan_report_concepts() which was causing some SRConcepts to be processed multiple times. This didn't cause any issues, but was misleading and wasteful.
• Fixed hardcoded content_type id used in the backend, client, and workers.

2.0.12

New features

• None

Improvements

• Upgrade black formatter to 23.1.0 from 22.8.0.
• Handle an empty ScanReports page and empty Home page gracefully.

Bugfixes

• Remove psutil from ProcessQueue which was causing errors

2.0.11

New features

• Add pagination to the Dataset list page and the Mapping Rules list page.

Improvements

• Used lazy loading to reduce communication and improve loading speeds.
• Rewritten Dockerfile to speed up rebuilds when editing React files.

Bugfixes

• None

2.0.10

New features

• None

Improvements

• Rewritten get_mapping_rules_list() function to greatly speed up the loading of the /mapping_rules page.

Bugfixes

• None

2.0.9

New features

• None

Improvements

• Removed duplicated ScanReportConcepts which are produced when non-standard codes are mapped via multiple routes to the same standard code.

Bugfixes

• None

2.0.8

New features

• None

Improvements

• Removed get_context_data() from StructuralMappingTableListView, as it was unused and added a large overhead when calling get_mapping_rules_list().

Bugfixes

• None

2.0.7

New features

• None

Improvements

• Improved consistency of presentation of key terms on dashboard
• Analysis of rules moved to trigger only after 'Analyse Rules' button is pressed. This has the benefit that this will not trigger an error in the largest SRs when viewing the mapping rules page (which was something we had seen, which blocks the ability to use the mapping rules page). The downside is that analysis does not load in the background, making the button seem less responsive.
• Added 'Edit Table', 'Scan Report Details' and 'Mapping Rules' buttons to top of Fields and Values pages.
• Add dropdown to "Scan Reports" item in navbar. This makes the "New Scan Report" page accessible from all other pages.

Bugfixes

• Corrected headings in a table on the dashboard

2.0.6

New features:

• None

Improvements:

• None

Bugfixes:

• This PR removes an unnecessary call to mappingrulesfilter/, and adds concept as a filterset_field in that endpoint.

2.0.5

New features:

• None

Improvements:

• None

Bugfixes:

• Paginates a GET request in values.js for ScanReportConcepts. This caused 400 errors when too many ScanReportConcepts were requested on a single Values page.