Is your feature request related to a problem? Please describe.
Schema Automator builds a schema only based on the data in data files. We should evaluate whether we can also incorporate information from sources like Data Dictionaries using Schema Sheets.
Describe the solution you'd like
Create schemas from both the data using Schema Automator and from Scheme Sheets using the Data Dictionary and combine these into a single schema synthesizing all of the information and pointing out differences and incompatibilities.
Describe alternatives you've considered
This can be done both manually and using an LLM.
Additional context
One issue is that a lot of Data Dictionaries are not simple to import into Schema Sheets; we need to make this easier. Another important part of this is to show the user where the data does not align with the Data Dictionary.
Is your feature request related to a problem? Please describe.
Schema Automator builds a schema only based on the data in data files. We should evaluate whether we can also incorporate information from sources like Data Dictionaries using Schema Sheets.
Describe the solution you'd like
Create schemas from both the data using Schema Automator and from Scheme Sheets using the Data Dictionary and combine these into a single schema synthesizing all of the information and pointing out differences and incompatibilities.
Describe alternatives you've considered
This can be done both manually and using an LLM.
Additional context
One issue is that a lot of Data Dictionaries are not simple to import into Schema Sheets; we need to make this easier. Another important part of this is to show the user where the data does not align with the Data Dictionary.