User scenarios test for real storage #2294
Draft
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Reference Issues/PRs
What does this implement or fix?
This is initial PR for proof of concept tests for end user scenario testing. The end user scenario testing stress on using arcticdb as a storage platform which handles database operations needed to fulfil certain need. The tests there put arctic db on continious exposure of different types of load, including errorneous. The stress is over correct operation no matter what data is given for certain time or sequence of events
UtilizationProfile - a way to have configurable profile for different types of storages / loads.
AppendGenerator - provides sequence of dataframes to be appended one after another
UpdateGenerator - provides sequence of dataframes to update single dataframe
ErrorDataGenerator (basic implementation) - provides sequence of dataframes that should produce errors if attempted to be written to arctic
There are thre simple test cases undrlying the concept of putting each storage to a series of tests, that simulate possible user actions. The appends/updates/errors(in future deletion etc ) can be in any orger this would put any arcticdb storage we support to a test if all operations can be done without a problem in any sequence of events.
Any other comments?
Checklist
Checklist for code changes...