Big Data Handling Platform

This project is for Big Data and Cloud Computing courses. The goal of the project is a platform for handling big data that is easy to provision to a cloud service (Google Cloud in our case)

Requirements

Terraform

Download the Terraform version from HERE! (Tested on Terraform 0.12.10 and 0.12.12)

Google Cloud account

You can activate one on your normal google account from HERE!

Project on Google Cloud

HOWTO

Enable Compute Engine Api for your project

HOWTO

Create account.json

HOWTO Get the json format key for the google cloud project you want to use, and name it to "account.json"

Create ssh keys

HOWTO Get the public key for our project and name it to "gcloud_id_rsa.pub"

To provision

1. Clone the repository
2. Move account.json file to the project folder (this is used to provision to the correct google cloud project) NOTE: NEVER EVER COMMIT THIS FILE AS IT CAN BE USED TO PROVISION STUFF IN YOUR NAME
3. In variables.tf change the variable project to correspond your own google cloud project name.
4. Move your gcloud_id_rsa.pub and gcloud_id_rsa ssh keys to the project folder (this is used to ssh to the created Compute Engine machines) NOTE: NEVER EVER COMMIT THESE FILES AS THEY CAN BE USED TO ACCESS YOUR MACHINES
5. Go to the project folder on command prompt / terminal
6. Command: terraform init
7. To make sure everything as you plan: Command: terraform plan
8. To provision: Command:terraform apply