AWS with Spring-cloud

REST API that copies S3 object from source bucket to target bucket and inserts success/failure of this activity to DynamoDB.

Prerequisites:

1. AWS account
2. Set up credentials to aws-credentials.yml
3. SQS queue (set name and queueUrl in application.yml)
4. SNS topic (set topic and topicArn properties in application.yml)
5. S3 buckets: source bucket and destination bucket (set s3.source.bucket and s3.destination.bucket)
6. Local DynamoDB

This is a POC to explore APIs for all above AWS services. External application provides S3 object name, and this object is transfered from source bucket to destination bucket. After this process is done, this file transfer request is inserted in Dynamodb with status.

How it works:

• On application startup, SQS queue subscribes to SNS topic
• External Application can send s3 object name to SNS topic via REST call: http://localhost:8080/spring-aws/messages/send/{message} where message is s3Key that you want to transfer from source to destination bucket
• As SQS is subscribing to SNS, this message is passed on to SQS.
• The S3 object is moved from source bucket to destination bucket.
• After copy process is done, application creates an entry with upload status in DynamoDB in table FileTransferRequest