Skip to content

Cbaxley 737 implement cluster#786

Open
cbaxley wants to merge 73 commits intodevelopfrom
cbaxley-737-implement-cluster
Open

Cbaxley 737 implement cluster#786
cbaxley wants to merge 73 commits intodevelopfrom
cbaxley-737-implement-cluster

Conversation

@cbaxley
Copy link
Collaborator

@cbaxley cbaxley commented Mar 16, 2026

🗣 Description

💭 Motivation and context

📷 Screenshots (DELETE IF UNAPPLICABLE)

🧪 Testing

✅ Pre-approval checklist

  • Changes are limited to a single goal AND
    the title reflects this in a clear human readable format
  • Issue that this PR solves has been selected in the Development section
  • I have read and agree to LME's CONTRIBUTING.md document.
  • The PR adheres to LME's requirements in RELEASES.md
  • These code changes follow cisagov code standards.
  • All relevant repo and/or project documentation has been updated to reflect the changes in this PR.

✅ Pre-merge Checklist

  • All tests pass
  • PR has been tested and the documentation for testing is above
  • Squash and merge all commits into one PR level commit

✅ Post-merge Checklist

  • Delete the branch to keep down number of branches

cbaxley added 30 commits December 11, 2025 07:33
@cbaxley
Initial spec file for cluster deployment
9eae00b
@cbaxley
Merge branch 'develop' into cbaxley-737-cluster
08feb09
@cbaxley
First pass at implementing cluster setup
b8cecb3
@cbaxley
Updated installer documentation and code to support cluster setup
bd6270e
@cbaxley
Fix the redhat install command in build_azure_linux_network
a15b4d2
@cbaxley
Commented out cleanup Azure resources step in cluster_redhat.yml
c6b31c9
@cbaxley
Trying to fix the Windows agent token quoting issue
ee81a5a
@cbaxley
Saves the full JSON response to a file for later inspection
28a805d
@cbaxley
Output the full JSON response to the console on ws1 commands
1935e40
@cbaxley
Revert redhat cluster workflow to the develop branch
c047593
@cbaxley
Output the full JSON on the get policy ID test command
2271851
@cbaxley
Make the default connection in the ansible playbook to be local
9f55a6a
@cbaxley
Fixes .profile not being made for unprivileged user
6393ff7
@cbaxley
Update Dockerfiles and installation scripts to use python3-venv inste…
6f85496 
…ad of python3.10-venv
@cbaxley
Adds a cluster installer script for testing multi-node LME clusters.
3f31e7b
@cbaxley
Update .gitignore and README.md for 24.04 testing
f32c09a
@cbaxley
Refactor testing scripts to improve compatibility with multi-node LME…
c92849d 
… clusters
@cbaxley
Fixes how we distribute secrets to the cluster nodes.
36577ba
@cbaxley
fix: fix how the secrets distribution role works
5a5d4af
@cbaxley
fix: fix how the secrets distribution role works
de7f298
@cbaxley
feat: implement local cluster installation script and docker cluster
bfffd3c
@cbaxley
Cluster install working in docker containers in development
e21dd30
@cbaxley
Loosens permissions for certs and secrets for children in cluster
ab5c08f
@cbaxley
Create a docker container for the cluster installer
173f40d
@cbaxley
fix: create minimal env file for cluster nodes to prevent failure
ed27ec1 
The base role was failing on cluster nodes (es2, es3) because
lme-environment.env only existed on the master node. This adds a task
to create a minimal env file on cluster nodes when one doesn't exist.

Also includes improvements to secrets/certs distribution and cluster
installer scripts.
@cbaxley
Try changing the import on build_azure_linux_network.py to see if it …
50db604 
…fixes the issue.
@cbaxley
Use the 22.04 image in the cluster workflow.
ca65fc7
@cbaxley
Remove the redundant ansible install from the base role
ababf20
@cbaxley
Add cluster inventory tooling and documentation for multi-node Elasti…
9d1a378 
…csearch deployme
@cbaxley
Adds initial cluster installation tooling for RHEL9
c290d2f
@github-project-automation github-project-automation bot moved this to 🆕 Product Backlog in LME-Development Mar 16, 2026
cbaxley added 18 commits March 17, 2026 10:55
@cbaxley
Disables all tests except for the escluster tests
5c223f9
@cbaxley
Escluster workflow fix cleanup step
78a2f03
@cbaxley
Single install on escluster workflow
8d99d90
@cbaxley
Update ESCluster workflow to install es cluster
15853c2
@cbaxley
Adds jq to the development Dockerfile
51ece5c
@cbaxley
Adds nfs mounting to the child nodes in escluster.yml
0f282e3
@cbaxley
Add in a failure test for the cluster in the escluster.yml workflow
78b1e97
@cbaxley
Changes the size of the spare node in the escluster.yml workflow
844eb1a
@cbaxley
Changes the size of the cluster nodes in the escluster.yml workflow
848a0e9
@cbaxley
Tests heredoc file creation in the escluster.yml workflow
eb8349a
@cbaxley
Removes heredoc file creation test from the escluster.yml workflow
320c71d
@cbaxley
Adds in the tests for change passwords and snapshot tests in the escl…
b9287d3 
…uster.yml workflow
@cbaxley
Fix the nfs mounts and paths in the escluster.yml workflow
134774d
@cbaxley
Reapplies the nfs changes to the quadlets on all nodes in the esclust…
92dc391 
…er.yml workflow
@cbaxley
Elasticsearch template now cluster aware and lme_force_config was added
63072f9
@cbaxley
Removes the path replacement for snapshots in the escluster.yml workflow
d92597b
@cbaxley
Change the warning for fs repository in multi-node cluster
791a630
@cbaxley
Updates the path to config files in the cluster guides.
343f795
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

LME-Development
Status: 🆕 Product Backlog

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@cbaxley