Stuck on Fact Table Creation from Staging Area – Need Assistance

[SlimDrira]

After creating my staging area—where I loaded the raw data exactly as they were from the Excel files into my PostgreSQL database—I proceeded to build the dimension tables using the staging data. Now, I’m at the step where I need to create the fact tables. However, I’ve hit a roadblock: I understand that I need to call the staging tables and apply all the necessary transformations to be able to perform merge joins (though I’m not even sure if that’s the right approach). Unfortunately, it’s not working, and I’m really stuck at this point. I would greatly appreciate if someone could assist me via a Teams call, because I’m not making any progress. Thank you.

[gutknecht]

From what I understand, you already have your staging data in a PostgreSQL database. You can:

1. Read the data
   – Use the Table Input transform
2. Write the data
   – Use either the Insert / Update transform or the Table Output transform
3. Transform the data
   • Option A: In your Table Input SQL (e.g. JOIN with other tables, filters, etc.)
   • Option B: In Hop, by chaining additional transforms (Sort Rows, Stream Lookup, etc.) before the insert/update step

Could you clarify where you’re getting stuck?

• Is it the technical ETL mechanics in Hop?
• Or more the underlying data-model design (from staging to fact/dimensions)?