Skip to content

IN 1194- merge employee appointment tables #203

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Feb 26, 2025
Merged

Conversation

ghukill
Copy link
Contributor

@ghukill ghukill commented Feb 25, 2025

Purpose and background context

This PR makes two updates to the HRQBClient that runs daily to load data into Quickbase.

1- Commit which pins luigi == 3.5.1

It appears that luigi>= 3.6 introduces some type changes that result in hundreds of linting errors in this project. However, we needed to udpate tornado (a dependency of luigi) that has a security vulnerability. Pinning luigi allows us to avoid the type errors at this time while still updating tornado.

This should also allow for updating the python version of this project from 3.11 to 3.12 at our next convenience, which was paused for the same reasons of luigi.

I can see a couple of paths here:

  1. We keep luigi pinned for the foreseeable future, given the somewhat limited fashion in which we use it.
  2. We update luigi and work to address all type errros, if if that means some targeted, blanket ignores

I would like to follow option 2 soon, but not now.

2- Commit to remove the LibHR Employee Appointments table from this data loader

The more substantative change is removing any mention or management of the table LibHR Employee Appointments. It has been determined that this table is no longer needed, allowing for some dramatic simplification of code in this client.

How can a reviewer manually see the effects of these changes?

Not readily possible.

Includes new or updated dependencies?

YES: all dependencies updates except luigi which is pinnied

Changes expectations for external applications?

YES

What are the relevant tickets?

Developer

  • All new ENV is documented in README
  • All new ENV has been added to staging and production environments
  • All related Jira tickets are linked in commit message(s)
  • Stakeholder approval has been confirmed (or is not needed)

Code Reviewer(s)

  • The commit message is clear and follows our guidelines (not just this PR message)
  • There are appropriate tests covering any new functionality
  • The provided documentation is sufficient for understanding any new functionality introduced
  • Any manual tests have been performed or provided examples verified
  • New dependencies are appropriate or there were no changes

Why these changes are being introduced:

A dependencies update was long overdue but luigui 3.6 brings
a considerable amount of linting errors that will need addressing
(or blanket ignoring).  Currently, this project works well with
luigi 3.5.1 so felt safe to pin this for the time being
and allow other updates to proceed.

How this addresses that need:
* updates dependencies
* pins luigi to 3.5.1

Side effects of this change:
* luigi not automatically updated, but will get revisited
during next maintenance

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/IN-1194
@ghukill ghukill marked this pull request as ready for review February 26, 2025 14:22
@ghukill ghukill requested a review from a team February 26, 2025 14:22
Copy link

@jonavellecuerdo jonavellecuerdo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Just one comment about docstrings.

Why these changes are being introduced:

For reasons beyond the scope of this commit, it has been determined that
having a table like "LibHR Employee Appointments" (LIBHR) distinct from the
more widely used "Employee Appointments" (EA) is more problematic than
it is helpful.  As such, it has been decided that data formerly found
in the LIBHR table will now be directly added and managed in the EA
table.

How this addresses that need:
* Completely removes any tasks associated with the LIBHR table
* Removes any copying of data to the EA table from the LIBHR table

Side effects of this change:
* LIBHR table is no longer a concern for this middleware

Relevant ticket(s):
* https://mitlibraries.atlassian.net/browse/IN-1194
@ghukill ghukill force-pushed the IN-1194-merge-libhr-tables branch from eb50224 to 5498f0a Compare February 26, 2025 16:27
@ghukill ghukill merged commit 009c1eb into main Feb 26, 2025
3 checks passed
Copy link

sentry-io bot commented Feb 27, 2025

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

  • ‼️ IndexError: single positional indexer is out-of-bounds hrqb.utils.quickbase in get_table_id View Issue

Did you find this useful? React with a 👍 or 👎

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants