Skip to content

User scenarios test for real storage #2294

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 4 commits into
base: master
Choose a base branch
from
Draft

Conversation

grusev
Copy link
Collaborator

@grusev grusev commented Apr 7, 2025

Reference Issues/PRs

What does this implement or fix?

This is initial PR for proof of concept tests for end user scenario testing. The end user scenario testing stress on using arcticdb as a storage platform which handles database operations needed to fulfil certain need. The tests there put arctic db on continious exposure of different types of load, including errorneous. The stress is over correct operation no matter what data is given for certain time or sequence of events

UtilizationProfile - a way to have configurable profile for different types of storages / loads.

AppendGenerator - provides sequence of dataframes to be appended one after another
UpdateGenerator - provides sequence of dataframes to update single dataframe
ErrorDataGenerator (basic implementation) - provides sequence of dataframes that should produce errors if attempted to be written to arctic

There are thre simple test cases undrlying the concept of putting each storage to a series of tests, that simulate possible user actions. The appends/updates/errors(in future deletion etc ) can be in any orger this would put any arcticdb storage we support to a test if all operations can be done without a problem in any sequence of events.

Any other comments?

Checklist

Checklist for code changes...
  • Have you updated the relevant docstrings, documentation and copyright notice?
  • Is this contribution tested against all ArcticDB's features?
  • Do all exceptions introduced raise appropriate error messages?
  • Are API changes highlighted in the PR description?
  • Is the PR labelled as enhancement or bug so it appears in autogenerated release notes?

@grusev grusev added enhancement New feature or request test engineer Issue that is good for an engineer in test to work on. labels Apr 7, 2025
@grusev grusev added the patch Small change, should increase patch version label Apr 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request patch Small change, should increase patch version test engineer Issue that is good for an engineer in test to work on.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant