Skip to content

mito-ds/streamlit-recon-wizard

Repository files navigation

Reconciliation App

Centralize and automate your organizations's data reconciliation. Save your organization hundreds of hours of manual work each quarter.

See the app in action

Users of the reconciliation app interact with three main componets:

  1. Reconciliation Dashboard: shows the current status of all the reconciliations your organization has created. Including:
  • Number of rules checked
  • Number of data points reconciled
  • Total hours saved due to automation
  • The total number of passing and failing checks
  1. Reconciliation Creation Wizard: walks users through the process of building a new reconciliation. Using the Mito spreadsheet, non-technical users are able to create full reconciliation automations without writing any code. Analysts use:
  1. Reconciliation Updating Wizard: walks users through the process of rerunning an existing reconciliation with new data.

App architecture

The 🆕Recon.py file is the entry point for creating a new reconciliation. After the user defines some basic information about the recon, the app sets up a new reconciliation. It does the following:

  1. It duplicates the recon_wizard_template.py into the Pages folder and names it according to the user's input.
  2. It creates a new entry in the recon_metadata.csv file which stores information about the reconciliation that is used by the reconciliation dashboard.

After the user follows the prompts of the recon wizard to set up a new recon, the result of the recon is saved in the outputs folder. These outputs are used by the reconciliation dashboard.

The app relies on the Streamlit framework and the Mito Streamlit Spreadsheet.

Run Locally

  1. Create a virtual environment:
python3 -m venv venv
  1. Start the virtual environment:
source venv/bin/activate
  1. Install the required python packages:
pip install -r requirements.txt
  1. Start the streamlit app
streamlit run Dashboard.py

Developer Utilities

If you make changes to the app's architecture and/or want to clear all previous recons, use the reset_app.sh bash script to reset the app. Use it by running:

bash dev/reset_app.sh

Demoing this app

Step 1: Import database data

  • Custom Import the get_european_real_estate_data

Step 2: Import vendor-provided data

  • Import the Warehouse v1 and Prologis v1
  • In Warehouse v1, Tenant Name column, =SUBSTITUTE('Tenant Name0, 'Grp.', 'Group')
  • In Warehouse v1, rename SQM to Square Meters
  • In Prologis v1, filter the Strategy column to just warehouse
  • Concat the tables on top of eachother. Its better to do Warehouse on top then Prologis

Step 3: Create dataset for recon

  • Merge that datasets together on the Lease ID column. You can use Asset ID also if you want to show off composite key

Step 4: Build the recon

  • Use the =CHECK_STRING_DIFFERENCE formula with a similarity threshold of 90
  • Use the =CHECK_NUMBER_DIFFERENCE formula with a threshold of 10

Step 5: Show recon report in app

  • Generate the recon
  • Scroll down to show the results
  • Click the Save Button

Step 6: Show updated dashboard

  • Show the updated dashboard

Step 7: Rerun the recon

  • Click on the recon you just built and update it by importing the new files
  • Show that in the new dataset, there are no failing tests

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •