feat(source-faker): Add configuration validation and recommendations #752
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
feat(source-faker): Add configuration validation and recommendations
Summary
This PR enhances Source Faker integration in PyAirbyte by adding comprehensive configuration validation and performance recommendations. The enhancement was developed as part of investigating issue #8750 regarding potential Source Faker issues.
Key Changes:
airbyte/sources/faker_utils.py
with validation functions for Source Faker configuration parameterscount
,seed
,parallelism
, andalways_updated
parameters with helpful error messagesget_source()
The validation maintains backward compatibility - existing valid configurations continue to work unchanged, while invalid configurations now provide clear error messages instead of failing silently or with cryptic errors later.
Review & Testing Checklist for Human
Recommended Test Plan:
Diagram
Notes
The validation enhancement improves the user experience by catching configuration errors early with clear messages, while the performance recommendations help users optimize their Source Faker usage for better performance.