Kubernetes and application observability demo with Cribl

Prerequisites

• Cribl.Cloud. You know, for Search, Lake, Stream and Edge.
• kubectl
• kind
• helm
• terraform and AWS account for Cloud deployments
• k9s - not strictly a must, but super handy when troubleshooting k8s.
• Sign up for ngrok free tier: https://dashboard.ngrok.com/login

Local setup

The Cribl.Cloud part of the setup only needs to be done once for the Search dashboards, Lake datasets, Edge fleet and Stream Worker Group.

• Create a kind k8s cluster

• Manually deploy Cribl components. Alternatively, use the terraform script for fully automated deployment of Cribl Cloud components.

  • Deploy Cribl Stream components. Lake instructions included in Stream.
  • Deploy Cribl Edge components
  • Deploy Cribl Search pack

• Deploy the Elastic stack

• Deploy the otel-demo app

• To support Search replay, deploy the ngrok reverse tunnel

• Cribl Search setup instructions

Once the setup is done, you can quickly turn on and off your demo environment with ./autostart.sh command

Alternative setup with Terraform

Requires local install of Terraform, awscli and access to AWS including all the correct values in ~/.aws/credentials.

• Alternative setup with Terraform and EC2
• Alternative setup with Terraform and EKS

Diagrams

Telemetry forwarding

Searching directly on Edge

Overall connectivity