Skip to content

feat: Error table API#212

Draft
bidhan-nagarro wants to merge 21 commits intomainfrom
feature/error-table
Draft

feat: Error table API#212
bidhan-nagarro wants to merge 21 commits intomainfrom
feature/error-table

Conversation

@bidhan-nagarro
Copy link
Copy Markdown
Collaborator

What type of PR is this?

  • feat: Commits that add a new feature

Summary

What does this PR do

Error Table API's to display errors returned by dagster when files are uploaded

@bidhan-nagarro bidhan-nagarro self-assigned this Mar 10, 2026
bidhan-nagarro and others added 11 commits March 10, 2026 13:08
* feat: reorder columns mapping

Grouped different columns into sections for easier mapping and UX

* feat: add descriptions for column mapping

Related to TECH-8531, adding more precise descriptions for column mapping, indicating some examples and their type.

* fix: css fix and db info for tooltip

have hardcoded data as fallback for first getting the information from the database

* feat: pin id and name to be first items

order as figma
)

* feat: adding helper text as placeholder and metadata form redesign

Explanations are hidden in helper text instead of being embedded in placeholders or labels

Redesign form structure

* fix: adjunt date input and add refiner

Change date input into text input
Add refiner to prevent setting past dates
* feat: removing and replacing uploaded file

Adding feature of removing and replacing an uploaded file

Also adjusting UI according figma design in the ticket.

The template file text has not been added yet.

* feat: add font and text to file removal

Adding text and font to adapt to figma design
Following figma design, changed and updated submission process buttons to be more intuituve for users
* feat: create tabs and tables based on data source

Created tabs in Upload page based on data source

* feat: add coverage and scheemaless  tabs

Add coverage and scheemaless dataset tabs and adding souce to dataset

* feat: filter for datasets

Dataset prefiltering for Coverage and scheemaless

* feat: create separate file for upload metadata

* ✨ feat: Added migration for old data without metadata json file.

* 🔧 chore: Update to refer to metadata.json from the blob

* 🔥 chore: Update sh file to run migrate code for older countries

* 🔥 chore: Migration file updated

* 🔥 chore: Migration file updated

* 🔥 chore: Migration file updated

* 🔥 chore: added command for migrating old metadata

* chore: Addressed Review Comments

* chore: Addressed Review Comments

* chore: Addressed Review Comments

* chore: Addressed Review Comments

* chore: Changed the scripts path and added to infra init jobs yaml

* chore: Fixed metadata path issue.

* chore: Removed code for error fix in ApprovelRequest Model

* chore: Removed code for error fix in FileUpload Model

* chore: Removed code for error fix in ApprovalRequest Model

* refactor: Change in the init jobs to add migrate as a separate job

* chore: disable migrate blob job

* chore: re-enable migrate blob job

* refactor: migrate script modified

* refactor: migrate script modified

* refactor: migrate script modified

* refactor: Migrate Script fixed

* refactor: Migrate Script fixed

* chore: make pre-commit fixes

---------

Co-authored-by: Brian Musisi <brianmusisi@berkeley.edu>

* feat: move filter source and dataset to the backend

Moved the filtering for the tables to query the DB.

TODO: Once source for Giga Sync uploads is not "null", and becomes "gigasync" we should query the Geolocation table to it

---------

Co-authored-by: bidhan-nagarro <bidhan.mondal@nagarro.com>
Co-authored-by: Brian Musisi <brianmusisi@berkeley.edu>
…214)

* Revert "Feature/tech 6769 upload table tabs based on data source (#197)"

This reverts commit 22071a0.

* fix: revert only metadata changes

Restoring UI changes to only revert metadata changes

* feat: remove giga meter tab

Remove giga meter tab until it's added as a working source
* fix: minor UI fixes

Fix tooltip positioning to not be outside the table
Fix Close and run in background button position

* fix: minor UI additions

Placeholder on dropdown
Automatic / on MM/YYYY on metadata input
fix lint errors on import orders from ruff
@Javiershenbc
Copy link
Copy Markdown
Collaborator

Fixed ruff lint errors on imports.

@Javiershenbc Javiershenbc self-requested a review March 19, 2026 22:27
Copy link
Copy Markdown
Collaborator

@Javiershenbc Javiershenbc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lint errors fixed. Test done correctly and code looks fine to me.

Copy link
Copy Markdown
Collaborator

@brianmusisi brianmusisi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just to confirm, we do not need this API here. The API we want is created using delta-sharing

@bidhan-nagarro bidhan-nagarro marked this pull request as draft March 31, 2026 05:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants