Address PR feedback: restore robots.txt and rename Usage.md files to README.md

Signed-off-by: Saburesh07 <220188172+Saburesh07@users.noreply.github.com>

Author: Saburesh07

components/builder-web/robots.txt

@@ -0,0 +1,2 @@
+User-agent: *
+Disallow: /

tools/hab_token/README.md

@@ -0,0 +1,32 @@
+# Habitat Token Helper
+
+This script is a simple helper for managing multiple Habitat personal access tokens.
+It makes is easier to switch between tokens during development / acceptance testing / production usage.
+
+## Prerequisites
+
+1. Copy the `hab-token` script to a directory in your path - e.g., `~/bin`
+2. Create a new file called `.tokens` in your home directory - e.g. '~/.tokens'
+
+The `.tokens` file should have the following format:
+
+```shell
+#!/bin/bash
+TOKEN_LIVE=<your prod token>
+TOKEN_ACCEPTANCE=<your acceptance token>
+TOKEN_DEV=<your dev token>
+```
+
+## Usage
+
+When you want to switch to a specific token, issue a command like the following in your shell:
+
+```shell
+eval $(hab-token live)
+```
+
+This should set and export the `HAB_AUTH_TOKEN` env variable appropriately.  You can confirm that the token is set by doing the following:
+
+```shell
+echo $HAB_AUTH_TOKEN
+```

tools/ssh_helpers/README.md

@@ -0,0 +1,43 @@
+# Usage
+
+## Prerequisites
+
+These scripts make it easy to connect to running Habitat instances. To use them, you'll need to set up a few things first:
+
+* Make sure you've downloaded the `habitat-srv-admin` key and placed it at at `~/.ssh/`.
+* If you haven't already, create an IAM user for yourself in Habitat AWS. You'll need membership in the `admins` group and programmatic access. Note your generated access key ID and secret.
+* Install [the AWS CLI](https://docs.aws.amazon.com/cli/latest/userguide/cli-install-macos.html) and place it on your PATH.
+* Configure the AWS CLI using your Habitat AWS IAM credentials.
+* Install [jq](https://stedolan.github.io/jq/). (e.g., `brew install jq`)
+* Install [tmux](https://github.com/tmux/tmux/wiki). (e.g., `brew install tmux`)
+* Install [tmuxinator](https://github.com/tmuxinator/tmuxinator). (`gem install tmuxinator`)
+
+## Testing AWS CLI
+
+Since we typically use `okta_aws` and you may have multiple profiles, you will likely need to specify the following environment variable: `AWS_PROFILE`.
+Otherwise, you may receive this error: `An error occurred (InvalidClientTokenId) when calling the GetCallerIdentity operation: The security token included in the request is invalid.`
+
+Test AWS credentials:
+
+```bash
+export AWS_PROFILE=habitat
+aws sts get-caller-identity
+```
+
+## Generating and Updating Configuration
+
+Once you're set up with the prerequisites listed above, you should be able to generate SSH and tmuxinator configurations using the following commands (executed from within this directory):
+
+```shell
+./update-habitat-ssh acceptance
+./update-habitat-ssh live
+```
+
+And with that, connect to running environments:
+
+```shell
+./hab-env acceptance
+./hab-env live
+```
+
+Any troubles, ask in #core-dev! Enjoy.