Skip to content

Change the storage paths in S3 to make it easier to manage whole snapshots. #6

@iamthemovie

Description

@iamthemovie

Currently legacy stores it's paths in S3 to mimic the file system:

/{s3-bucket}/{node-hostname}/{data-directory}/{keyspace}/{table}/{snapshot}/...

From a management perspective this makes it much harder to clear up an entire snapshot in S3 without the help of legacy (a feature which does not exist yet).

Change the storage path to:
/{s3-bucket}/{node-hostname}/{data-directory}/{snapshot}/{keyspace}/{table}/...

a) Manual restores would be much easier.
b) Manual cleanups would be much easier.
c) Compile a size of the entire path would be easier (not that it would be difficult to aggregate some directories together but it's still more work).
d) We could very easily store legacy meta-data within each snapshot / per node.

There are many other benefits to this too.

Metadata

Metadata

Assignees

No one assigned

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions