Develop (#26)

* Updating the AWS quickstart document.
* Update AWS-CloudFormation/cloudFormationTemplates/* with newer AMI, added some steps to CloudFormation-QuickStart.md

Co-authored-by: Stuart Moorhouse <[email protected]>

Author: BillFarber

AWS-CloudFormation/CloudFormation-QuickStart.md

@@ -8,14 +8,27 @@ _All the resource files have been configure and compiled specifically for this e
 In particular, IP addresses are in the config files._
 
 ## Requirements
-* You just need to have an AWS account.
+* You need to have an AWS account
+* You need to have subscribed to the [MarkLogic AMI](https://aws.amazon.com/marketplace/pp/B072Z536VB?ref_=aws-mp-console-subscription-detail)
+* You need to have subscribed to the [Kafka Certified by Bitnami AMI](https://aws.amazon.com/marketplace/pp/B01K0IWPVI?qid=1587125714910&sr=0-1&ref_=srh_res_product_title)
 
 ## Create a Key Pair in AWS
-1. Navigate to your [AWS Key Pairs](https://console.aws.amazon.com/ec2/v2/home?region=us-east-1#KeyPairs:sort=keyName)
+Please note: if you are using the default values in the resource files, you will need to be in the us-east-1 (Virginia) region when you follow these steps.
+
+1. Navigate to your [AWS Key Pairs](https://console.aws.amazon.com/ec2/v2/home?region=us-east-1#KeyPairs:sort=keyName). 
+
 1. Click "Create Key Pair".
+
 1. Name the Key Pair, 'kafka', and click "Create".
+
 1. When prompted, save the PEM file locally.
 
+1. Change the file permissions on the PEM file:
+
+   ```
+   chmod 400 kafka.pem
+   ```
+
 ## Build the AWS Resources
 1. Navigate to the [AWS CloudFormation](https://console.aws.amazon.com/cloudformation/home?region=us-east-1) page.
 1. Click "Create Stack"
@@ -29,7 +42,7 @@ In particular, IP addresses are in the config files._
 1. Now wait until initialization is complete.
 
 ## Start the Connector
-1. On the list of you AWS Instances, click on the instance named, "TemplateBased-Kafka-Worker-A".
+1. On the list of your AWS Instances, click on the instance named, "instanceKafkaWorkerA".
 1. Copy the Public DNS (IPv4).
 1. Ssh to the TemplateBased-Kafka-Worker-A server.
 `ssh -i kafka.pem bitnami@<Public DNS>`
@@ -38,9 +51,20 @@ In particular, IP addresses are in the config files._
 
 ## Generate some Messages
 This step uses the JAR file from a small project for producing test messages. It can be found in [my GitHub account](https://github.com/BillFarber/KafkaProducer)
-1. On the list of you AWS Instances, click on the instance named, "TemplateBased-Kafka-Worker-A".
+1. On the list of your AWS Instances, click on the instance named, "instanceKafkaWorkerA".
 1. Copy the Public DNS (IPv4).
 1. Ssh to the TemplateBased-Kafka-Worker-A server.
 `ssh -i kafka.pem bitnami@<Public DNS>`
 1. Send some messages to the Kafka topic
 `java -jar /home/bitnami/kafka-producer-1.0-SNAPSHOT.jar -c 4 -m 5 -h ip-172-31-48-44.ec2.internal:9092 -t marklogic`
+
+## View the Messages in MarkLogic
+
+1. On the list of your AWS instances, click on the instance named "instanceMarkLogicA".
+2. Copy the Public DNS (IPv4)
+3. In a browser, open the page http://\<public DNS>:8000
+   * Enter the username "admin"
+   * Enter the password "admin"
+
+4. In the QConsole UI, change the *Database* to "Kafka"
+5. Click *Explore* to view the documents you created from "Kafka-Worker-A"

AWS-CloudFormation/cloudFormationTemplates/justTheResources.json

@@ -72,7 +72,7 @@
         "DisableApiTermination": "false",
         "InstanceInitiatedShutdownBehavior": "stop",
         "EbsOptimized": "true",
-        "ImageId": "ami-0ceaecbf456a666a4",
+        "ImageId": "ami-0879bd2e59cecb73e",
         "InstanceType": "c5.large",
         "KeyName": "kafka",
         "Monitoring": "false",
@@ -116,7 +116,7 @@
       "Properties": {
         "DisableApiTermination": "false",
         "InstanceInitiatedShutdownBehavior": "stop",
-        "ImageId": "ami-07ae0cb249ac8f87a",
+        "ImageId": "ami-0879bd2e59cecb73e",
         "InstanceType": "t2.large",
         "KeyName": "kafka",
         "Monitoring": "false",

AWS-CloudFormation/cloudFormationTemplates/readyToGo.json

@@ -71,7 +71,7 @@
       "Properties": {
         "DisableApiTermination": "false",
         "InstanceInitiatedShutdownBehavior": "stop",
-        "ImageId": "ami-07ae0cb249ac8f87a",
+        "ImageId": "ami-0879bd2e59cecb73e",
         "InstanceType": "t2.large",
         "KeyName": "kafka",
         "Monitoring": "false",
@@ -127,7 +127,7 @@
       "Properties": {
         "DisableApiTermination": "false",
         "InstanceInitiatedShutdownBehavior": "stop",
-        "ImageId": "ami-07ae0cb249ac8f87a",
+        "ImageId": "ami-0879bd2e59cecb73e",
         "InstanceType": "t2.large",
         "KeyName": "kafka",
         "Monitoring": "false",