Skip to content

Fix AWS credentials forwarding #214

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 2 commits into
base: master
Choose a base branch
from

Conversation

julienrf
Copy link
Collaborator

@julienrf julienrf commented Sep 10, 2024

The GitHub action we use in our workflow tests-aws.yml exposes the AWS credentials by setting environment variables. We copy them to the Spark containers.

I manually triggered the tests that access AWS. The results can be seen here: https://github.com/scylladb/scylla-migrator/actions/runs/10797896910.

Unfortunately, the tests still fail: the changes applied to the source DynamoDB table after migrating the initial snapshot are never replicated to the target ScyllaDB instance.

The GitHub action we use in our workflow tests-aws.yml exposes the AWS credentials by setting environment variables. We copy them to the Spark containers.
@julienrf julienrf marked this pull request as draft September 10, 2024 18:16
@tarzanek
Copy link
Contributor

interesting, so then kinesis doesn't work?
or in manual tests it works and here in dockerized GH actions env it doesn't ?

@julienrf
Copy link
Collaborator Author

julienrf commented Sep 11, 2024

The test suite that uses Kinesis passed on my machine with my personal AWS credentials. I am not sure what is the difference in the GitHub actions except the credentials. But it is complicated to use those credentials outside the GitHub action (to try to reproduce locally)…

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants