|
| 1 | +# Quick Start with an AWS CloudFormation Template |
| 2 | +The purpose of this document is to describe how to quickly build a set of three servers to demonstrate the kafka-marklogic-connector. |
| 3 | +The three servers are the Kafka/Zookeeper server, the MarkLogic server, and a server to run the connector and to produce messages. |
| 4 | + |
| 5 | +_This is not intended to be a description of setting up a production environment._ |
| 6 | + |
| 7 | +_All the resource files have been configure and compiled specifically for this example. |
| 8 | +In particular, IP addresses are in the config files (even in the Jar (sorry)_). |
| 9 | + |
| 10 | +## Requirements |
| 11 | +* You just need to have an AWS account. |
| 12 | + |
| 13 | +## Create a Key Pair in AWS |
| 14 | +1. Navigate to your [AWS Key Pairs](https://console.aws.amazon.com/ec2/v2/home?region=us-east-1#KeyPairs:sort=keyName) |
| 15 | +1. Click "Create Key Pair". |
| 16 | +1. Name the Key Pair, 'kafka', and click "Create". |
| 17 | +1. When prompted, save the PEM file locally. |
| 18 | + |
| 19 | +## Build the AWS Resources |
| 20 | +1. Navigate to the [AWS CloudFormation](https://console.aws.amazon.com/cloudformation/home?region=us-east-1) page. |
| 21 | +1. Click "Create Stack" |
| 22 | +1. Click the "Upload a template file" radio button |
| 23 | +1. Click "Upload File" and upload "readyToGo.json" |
| 24 | +1. Click "Next" |
| 25 | +1. Give your stack a name, and click "Next" |
| 26 | +1. Click "Next" |
| 27 | +1. Click "Create Stack" |
| 28 | +1. Go to the list of your [AWS Instances](https://console.aws.amazon.com/ec2/v2/home?region=us-east-1#Instances:sort=tag:Name) |
| 29 | +1. Now wait until initialization is complete. |
| 30 | + |
| 31 | +## Start the Connector |
| 32 | +1. On the list of you AWS Instances, click on the instance named, "TemplateBased-Kafka-Worker-A". |
| 33 | +1. Copy the Public DNS (IPv4). |
| 34 | +1. Ssh to the TemplateBased-Kafka-Worker-A server. |
| 35 | +`ssh -i kafka.pem bitnami@<Public DNS>` |
| 36 | +1. Start the connector |
| 37 | +`sudo /opt/bitnami/kafka/bin/connect-standalone.sh /opt/bitnami/kafka/config/marklogic-connect-standalone.properties /opt/bitnami/kafka/config/marklogic-sink.properties` |
| 38 | + |
| 39 | +## Generate some Messages |
| 40 | +1. On the list of you AWS Instances, click on the instance named, "TemplateBased-Kafka-Worker-A". |
| 41 | +1. Copy the Public DNS (IPv4). |
| 42 | +1. Ssh to the TemplateBased-Kafka-Worker-A server. |
| 43 | +`ssh -i kafka.pem bitnami@<Public DNS>` |
| 44 | +1. Send some messages to the Kafka topic |
| 45 | +`java -jar /home/bitnami/kafka-producer-1.0-SNAPSHOT.jar -t 1 -m 1` |
0 commit comments