Skip to content

slim common and update pattern to pass on openshift 4.17 and 4.18 #60

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 385 commits into from
Mar 25, 2025
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
385 commits
Select commit Hold shift + click to select a range
ad87c84
Fix CI issue
mbaldessari May 30, 2024
e0f09a8
Merge pull request #523 from mbaldessari/ci-fix
mbaldessari May 30, 2024
dfe5b1a
Merge branch 'main' into feature/control-scheduler-for-masters
mbaldessari Jun 3, 2024
c799881
Merge pull request #505 from soukron/feature/control-scheduler-for-ma…
mbaldessari Jun 3, 2024
e3d4185
Merge pull request #507 from soukron/feature/auto-approve-installplans
mbaldessari Jun 3, 2024
beb71a1
Actually use adminServiceAccountName for the auto approve job
mbaldessari Jun 3, 2024
7606d1a
Merge pull request #525 from mbaldessari/imperative-admin-jobs
mbaldessari Jun 3, 2024
39addf2
Make sure that the if condition on chart split is not always true
mbaldessari Jun 4, 2024
6da9afa
Merge pull request #526 from mbaldessari/gh-fix1
mbaldessari Jun 4, 2024
10b0665
Bump super-linter from 5 to 6
mbaldessari Jun 4, 2024
c85ada6
Drop some validations for now
mbaldessari Jun 4, 2024
d923c3b
Merge pull request #527 from mbaldessari/superlinter6
mbaldessari Jun 4, 2024
a232db5
Add some debugging to the chart split action
mbaldessari Jun 4, 2024
6a39172
Merge pull request #528 from mbaldessari/gh-fix2
mbaldessari Jun 4, 2024
821727a
Use a specific git version when running git subtree split
mbaldessari Jun 4, 2024
8f787d9
Merge pull request #529 from mbaldessari/gh-fix3
mbaldessari Jun 4, 2024
3061644
Release clustergroup v0.8.6
mbaldessari Jun 4, 2024
2763a5f
Merge pull request #530 from mbaldessari/clustergroup-0.8.6
mbaldessari Jun 4, 2024
ae14cd2
Add a sudo to apt-get command
mbaldessari Jun 4, 2024
69063d1
Merge pull request #531 from mbaldessari/sudo
mbaldessari Jun 4, 2024
17325d6
Add some READMEs in the individual charts
mbaldessari Jun 6, 2024
5523097
Fix super-linter issues and upgrade local super-linter target
mbaldessari Jun 6, 2024
a450f5a
Merge pull request #532 from mbaldessari/READMEs
mbaldessari Jun 6, 2024
e3babbb
Skip unreachable spokes when setting up vault
mbaldessari Jun 6, 2024
15b92cf
Merge pull request #533 from mbaldessari/resilient-unseal
mbaldessari Jun 6, 2024
3ec1839
Add no_log to spokes initialization task
mbaldessari Jun 7, 2024
d1be1e4
Merge pull request #534 from mbaldessari/nolog-ansible2
mbaldessari Jun 7, 2024
9809c86
Drop initContainers variable and make it the default
mbaldessari Jun 6, 2024
75f8385
Update tests after dropping initContainers
mbaldessari Jun 7, 2024
56378d3
Merge pull request #535 from mbaldessari/dropinitcontainers
mbaldessari Jun 7, 2024
b489135
Release clustergroup v0.8.7
mbaldessari Jun 7, 2024
c04c68a
Merge pull request #536 from mbaldessari/newclustergroup
mbaldessari Jun 7, 2024
d846593
Upgrade ESO to v0.9.19
mbaldessari Jun 7, 2024
488fd39
Merge pull request #537 from mbaldessari/eso-0.9.19
mbaldessari Jun 7, 2024
b907bd5
Update helm version in CI to 3.14.0
mbaldessari Jun 7, 2024
5ffb4d3
Merge pull request #538 from mbaldessari/ci-helm-version
mbaldessari Jun 7, 2024
429f55c
Drop imperative.initcontainers.gitinit
mbaldessari Jun 10, 2024
e967b15
Have unseal work whenever we specifiy HEAD
mbaldessari Jun 10, 2024
32f3a93
Merge pull request #539 from mbaldessari/unseal-head
mbaldessari Jun 10, 2024
85c3a9b
make resourceExclusion configurable
strangiato Jun 5, 2024
05a876b
Update tests after upgrading resourceExclusions tweak
mbaldessari Jun 10, 2024
dc49d9d
Merge pull request #540 from mbaldessari/helathcheck-configurable
mbaldessari Jun 10, 2024
e97b2e7
Make resourcehealthchecks configurable
strangiato Jun 5, 2024
8d1aaab
Update tests after upgrading resourceHealthChecks change
mbaldessari Jun 10, 2024
63b85b2
Merge pull request #541 from mbaldessari/pr-2
mbaldessari Jun 10, 2024
32194d1
Do not quote $BRANCH variable
mbaldessari Jun 10, 2024
c06539f
Merge pull request #542 from mbaldessari/fix-unseal
mbaldessari Jun 10, 2024
97b2afa
Fix initcontainer race on spokes
mbaldessari Jun 10, 2024
42087ea
Merge pull request #543 from mbaldessari/fix-race2
mbaldessari Jun 10, 2024
ffa35ef
Release clustergroup v0.8.8
mbaldessari Jun 10, 2024
a110512
Merge pull request #544 from mbaldessari/clustergroup-0.8.8
mbaldessari Jun 10, 2024
e47dd3f
configure annotation based resource tracking
strangiato Jun 11, 2024
8f7e3b1
Merge pull request #545 from mbaldessari/pr-1
mbaldessari Jun 11, 2024
5b52f0d
Drop imperative.volumes and imperative.volumemounts
mbaldessari Jun 15, 2024
8242abd
Merge pull request #546 from mbaldessari/cleanup1
mbaldessari Jun 15, 2024
28b2d39
Properly quote vault kv command
mbaldessari Jun 18, 2024
6a312d7
Make HUB work when spokes point to in hub cluster gitea
mbaldessari Jun 11, 2024
591a339
update tests
mbaldessari Jun 18, 2024
324a8a2
Merge pull request #548 from mbaldessari/spoke-ca-gitea
mbaldessari Jun 18, 2024
49f75ec
Merge pull request #547 from mbaldessari/password-dollar
mbaldessari Jun 19, 2024
de5647f
ACM chart version 0.0.2
mbaldessari Jun 24, 2024
1fa5746
golang-external-secrets chart version 0.0.4
mbaldessari Jun 24, 2024
89b499b
hashicorp-vault chart version 0.0.2
mbaldessari Jun 24, 2024
ba674d9
Merge pull request #549 from mbaldessari/multi-source
mbaldessari Jun 24, 2024
89a4cad
Implement multi-source
mbaldessari Jun 24, 2024
2e78669
Add tests for proper multisource support on spokes
mbaldessari Jun 29, 2024
b4574ed
Merge pull request #550 from mbaldessari/multisource-new
mbaldessari Jun 29, 2024
9a3aa2b
Release clustergroup v0.8.9
mbaldessari Jun 29, 2024
e67a770
Merge pull request #551 from mbaldessari/clustergroup-0.8.9
mbaldessari Jun 29, 2024
13f3b23
Fix multisource indent error
mbaldessari Jun 29, 2024
ac6640c
Release clustergroup v0.8.10
mbaldessari Jun 29, 2024
fc92a78
Merge pull request #552 from mbaldessari/clustergroup-0.8.10
mbaldessari Jun 29, 2024
5f678b5
Release acm v0.0.3
mbaldessari Jun 29, 2024
2ce3808
Merge pull request #553 from mbaldessari/acm-0.0.3
mbaldessari Jun 29, 2024
ca9e3a2
Fix missing chart field
mbaldessari Jun 29, 2024
95bae32
Merge pull request #554 from mbaldessari/small-multisource-fix
mbaldessari Jun 29, 2024
5bdeff5
Release acm v0.0.4
mbaldessari Jul 9, 2024
98cbcab
Merge pull request #555 from mbaldessari/acm-0.0.4
mbaldessari Jul 9, 2024
bf0c8aa
Update chart versions
mbaldessari Jul 9, 2024
88ab5b3
Merge pull request #556 from mbaldessari/update-chart-versions
mbaldessari Jul 9, 2024
fc675e5
Update vault-helm to v0.28.1 and vault to 1.17.2
mbaldessari Jul 15, 2024
d83b201
Merge pull request #557 from mbaldessari/vault-helm-0.28.1
mbaldessari Jul 15, 2024
0b45eea
Update ESO to 0.9.20
mbaldessari Jul 15, 2024
6b426aa
Merge pull request #558 from mbaldessari/eso-0.9.20
mbaldessari Jul 15, 2024
b71cb0f
Release new hashicorp-vault and golang-external-secrets charts
mbaldessari Jul 15, 2024
912b510
Merge pull request #559 from mbaldessari/new-charts
mbaldessari Jul 15, 2024
0983d0d
Add Ansible playbook
Jul 19, 2024
4ce4d80
Put the playbook in a more normal location for us
Jul 19, 2024
41bc42d
Exclude new playbook
Jul 19, 2024
7bcfbd3
Allow for choice in where file is written
Jul 26, 2024
9a3c487
Merge pull request #561 from mhjacks/provide_kubeconfig_writer
mhjacks Jul 29, 2024
1f08dfe
Merge pull request #506 from soukron/feature/add-labels-to-nodes
mhjacks Jul 31, 2024
98d4312
Fix pki bind mount when using podman machine
mbaldessari Aug 6, 2024
414a252
Merge pull request #562 from mbaldessari/fix-macosx
mbaldessari Aug 6, 2024
ec340b1
Allow originRepo to be set via make install and main.git parameters
mbaldessari Aug 8, 2024
73313cb
resolves #21 rag-llm-gitops
day0hero Aug 8, 2024
af69b30
Merge pull request #564 from day0hero/ragllm-pr21
mbaldessari Aug 8, 2024
9142471
Merge pull request #563 from mbaldessari/main-gitea
mbaldessari Aug 8, 2024
99bc297
Fix vars that were erroneously dropped
mbaldessari Aug 12, 2024
0ec7cc6
Merge pull request #565 from mbaldessari/fix-vars
darkdoc Aug 12, 2024
58b6958
Allow more flexibility with multiSourceConfig schema
mbaldessari Aug 13, 2024
4544bc6
Merge pull request #566 from mbaldessari/extend-multisource-schema
mbaldessari Aug 13, 2024
3c28c4b
Inject VALUES_SECRET env var
mbaldessari Aug 20, 2024
5f4cf89
Merge pull request #567 from mbaldessari/values_secret
mbaldessari Aug 20, 2024
7ed4d1e
Add helmRepoUrl variable
mbaldessari Aug 21, 2024
4e3505c
Merge pull request #568 from mbaldessari/helmrepourl
mbaldessari Aug 21, 2024
9ec9af0
Update letsencrypt to v0.1.1
mbaldessari Aug 22, 2024
6617090
Merge pull request #569 from mbaldessari/letsencrypt-test
mbaldessari Aug 22, 2024
5ec42ac
Allow overriding gitops source on spokes
mbaldessari Aug 23, 2024
e6511e7
Update acm chart to v0.1.1
mbaldessari Aug 23, 2024
1a5cce8
Update clustergroup chart to 0.8.11
mbaldessari Aug 23, 2024
741a52e
Merge pull request #570 from mbaldessari/some-updates
mbaldessari Aug 23, 2024
9ccd486
Extend the schema for disconnected
mbaldessari Aug 23, 2024
654dbae
Merge pull request #571 from mbaldessari/relax-schema-for-gitops
mbaldessari Aug 23, 2024
b3cef81
Update clustergroup chart to 0.8.12
mbaldessari Aug 23, 2024
96c428d
Merge pull request #572 from mbaldessari/clustergroup-0.8.12
mbaldessari Aug 23, 2024
a8d7f94
Update super-linter to v7
mbaldessari Aug 26, 2024
3fbf2e8
Fix action path
mbaldessari Aug 26, 2024
97b9589
Fix action path v2
mbaldessari Aug 26, 2024
02bfd1f
Merge pull request #573 from mbaldessari/super-linter-new
mbaldessari Aug 26, 2024
55beff3
Upgrade ESO to v0.10.0
mbaldessari Aug 26, 2024
6cd5b50
Merge pull request #574 from mbaldessari/eso-0.10.0
mbaldessari Aug 26, 2024
bd74dba
Upgrade vault to 1.17.3
mbaldessari Aug 26, 2024
f8921c3
Merge pull request #575 from mbaldessari/vault-1.17.3
mbaldessari Aug 26, 2024
c7105bc
Update hashicorp-vault to 0.1.2
mbaldessari Aug 26, 2024
86ad342
Update golang-external-secrets to 0.1.2
mbaldessari Aug 26, 2024
29d9d0a
Merge pull request #576 from mbaldessari/hashicorp-vault-0.1.1
mbaldessari Aug 26, 2024
fc3fb1f
Switch to gitops-1.13
mbaldessari Aug 27, 2024
0a20ea6
Merge pull request #577 from mbaldessari/gitops-1.13-support
mbaldessari Aug 27, 2024
051cd8c
Add a pushsecrets policy and vault path for ESO syncing
mbaldessari Aug 29, 2024
9aef778
Fix PyInk warnings
mbaldessari Aug 30, 2024
5acb722
Merge pull request #579 from mbaldessari/push-secrets
mhjacks Aug 30, 2024
1ebca7f
Replace tabs with spaces and add some missing env vars that could be …
mbaldessari Sep 6, 2024
f46898c
Merge pull request #580 from mbaldessari/updates2
mbaldessari Sep 6, 2024
b8e62f2
Also push any changes to operator-install to its own repo
mbaldessari Sep 6, 2024
a64fb4d
Merge pull request #581 from mbaldessari/pattern-install-chart
mbaldessari Sep 6, 2024
907e33b
Update CRD from operator v0.0.55
mbaldessari Sep 6, 2024
b98c8dd
Merge pull request #582 from mbaldessari/crd-update2
mbaldessari Sep 6, 2024
8452d30
Fix chart name in pattern-install branch+split wf
mbaldessari Sep 6, 2024
c2b5bce
Merge pull request #583 from mbaldessari/Fix-workflow
mbaldessari Sep 6, 2024
35576f6
Tweak readme
mbaldessari Sep 6, 2024
cc3d360
Merge pull request #584 from mbaldessari/readme-tweak1
mbaldessari Sep 6, 2024
83976a6
Use $group.name in clusterset metadata
mbaldessari Sep 8, 2024
2154756
Merge pull request #585 from mbaldessari/tiny-cleanup2
mbaldessari Sep 10, 2024
68d731e
Expose originURL as helm value
mbaldessari Sep 11, 2024
2ee7a06
Update tests after common rebase
mbaldessari Sep 11, 2024
d72de95
Merge pull request #586 from mbaldessari/expose-origin
mbaldessari Sep 11, 2024
aaf456b
Release clustergroup v0.8.13
mbaldessari Sep 11, 2024
1c0744d
Merge pull request #587 from mbaldessari/clustergroup-0.8.13
mbaldessari Sep 11, 2024
16c2e4a
Release acm v0.1.2
mbaldessari Sep 11, 2024
31047c2
Merge pull request #588 from mbaldessari/acm-0.1.2
mbaldessari Sep 11, 2024
f608f63
Drop schema required under the Main section
mbaldessari Sep 12, 2024
9a8b7cc
Release clustergroup v0.8.14
mbaldessari Sep 12, 2024
581f32e
Merge pull request #589 from mbaldessari/clustergroup-0.8.14
mbaldessari Sep 12, 2024
47c5923
Update README for the v1 common branch
mbaldessari Sep 13, 2024
4fceb0d
Merge pull request #590 from mbaldessari/v1-update-readme
mbaldessari Sep 13, 2024
1138de9
Drop all the helm charts
mbaldessari Sep 6, 2024
30f1583
README fixes
mbaldessari Sep 6, 2024
04dc89f
Drop the operator-install folder (pattern-install chart)
mbaldessari Sep 6, 2024
0226f50
Start using the OCI chart in lieu of operator-install
mbaldessari Sep 6, 2024
fe568fb
Drop the chart splitting workflows
mbaldessari Sep 13, 2024
554b2ec
Drop the test folder
mbaldessari Sep 13, 2024
ce6afef
Drop the json schema checking job
mbaldessari Sep 13, 2024
eb58b8b
Add a README note on the main branch
mbaldessari Sep 13, 2024
86a0604
Merge pull request #591 from mbaldessari/main-update-readme
mbaldessari Sep 13, 2024
a2369ed
Merge pull request #592 from mbaldessari/slimming
mbaldessari Sep 13, 2024
c37f454
Add a check to see if multisource for clustergroup is enabled
mbaldessari Sep 14, 2024
66e791e
Merge pull request #593 from mbaldessari/check-for-multisource-enabled
mbaldessari Sep 15, 2024
2414796
Move the common slim + multisource test into Makefile
mbaldessari Sep 16, 2024
fabc060
Merge pull request #594 from mbaldessari/fix
mbaldessari Sep 16, 2024
26f0d47
Drop last bit of operator-install and the common symlink
mbaldessari Sep 16, 2024
4ab17da
Merge pull request #595 from mbaldessari/drop-link
mbaldessari Sep 16, 2024
9843d9c
Drop reference-output.yaml as it makes little sense in the slimmed co…
mbaldessari Sep 16, 2024
369d693
Merge pull request #596 from mbaldessari/drop-reference
mbaldessari Sep 16, 2024
63f7ca5
Remove ansible code in favor of external collection
Sep 16, 2024
0b3ac1e
Make adjustments for ansible code moving into separate collection repo
Sep 16, 2024
08cff4f
Allow customizing the clusterGroupChartVersion
mbaldessari Sep 17, 2024
003e011
Release pattern-install v0.0.2
mbaldessari Sep 17, 2024
3331527
Drop the chart splitting workflows
mbaldessari Sep 17, 2024
06a5879
Merge pull request #598 from mbaldessari/v1-operator-install-clusterg…
mbaldessari Sep 17, 2024
0123cde
Make sure we compare lists with lists when doing a difference
mbaldessari Sep 18, 2024
1cceddf
Merge pull request #599 from mbaldessari/v1-unseal-fix
mbaldessari Sep 18, 2024
abb465f
Merge pull request #597 from mhjacks/factor_out_ansible
mbaldessari Sep 24, 2024
3064c77
Add a note about the changes in common
mbaldessari Sep 24, 2024
842d13f
Merge pull request #600 from mbaldessari/add-changes
mbaldessari Sep 24, 2024
27d4919
Add qe-tests target
mbaldessari Sep 25, 2024
dbc4cea
Remove assorted detritus
beekhof Sep 25, 2024
c77f74d
We don't have charts to test anymore
beekhof Sep 25, 2024
ec942a4
Merge pull request #601 from validatedpatterns/cleanup
mbaldessari Sep 26, 2024
bb44195
Drop lint.sh and its target in Makefile
mbaldessari Sep 26, 2024
60d921f
Drop test.sh and its target in Makefile and also kubeconform
mbaldessari Sep 26, 2024
753c85a
Merge pull request #603 from mbaldessari/more-cleanups
mbaldessari Sep 26, 2024
25cf7d1
Merge branch 'main' into qe-test
mbaldessari Sep 27, 2024
37a6d23
Merge pull request #602 from mbaldessari/qe-test
mbaldessari Sep 27, 2024
ac54604
Read PATTERN_INSTALL_CHART from the env as well if it exists
mbaldessari Sep 29, 2024
9e4bc56
Merge pull request #604 from mbaldessari/disconnected-inst
mbaldessari Sep 29, 2024
0d1cda8
Update secret backend change script
darkdoc Sep 30, 2024
b8640e0
Update preview script
darkdoc Sep 30, 2024
07f6584
Merge pull request #605 from darkdoc/fix_scripts
mbaldessari Sep 30, 2024
e9f638a
Introduce PATTERN_DISCONNECTED_HOME
mbaldessari Oct 7, 2024
7a17712
Merge pull request #606 from mbaldessari/disconnected-easier
mbaldessari Oct 7, 2024
7b65170
Update Makefile to reflect a warning if no storageclass is present
soukron Oct 7, 2024
b778406
Merge pull request #608 from soukron/feature/disable-storage-class-re…
mbaldessari Oct 7, 2024
c8c0072
Fix iib loading playbook name
mbaldessari Oct 9, 2024
87776c6
Merge pull request #609 from mbaldessari/fix-iib
mbaldessari Oct 9, 2024
e9f00b1
Improve validate-origin
mbaldessari Oct 14, 2024
8dfad49
Make the make install output less daunting
mbaldessari Oct 15, 2024
393cc67
Merge pull request #610 from mbaldessari/bettercheck
mbaldessari Oct 19, 2024
fd3330d
Merge pull request #611 from mbaldessari/silence-warning
mbaldessari Oct 19, 2024
c9f1fdd
Record the exit code at the right time
mbaldessari Oct 22, 2024
cacdd23
Merge pull request #612 from mbaldessari/fix-issue
darkdoc Oct 22, 2024
9a24f6f
Fix path when invoking the qe run_test.sh script
mbaldessari Nov 25, 2024
7f6043d
Merge pull request #613 from mbaldessari/fix-qe-command
mbaldessari Nov 25, 2024
0d9d51a
Add a warning when pattern folder and pattern name differ
mbaldessari Dec 19, 2024
0cc13f6
Drop some old and unused prereq test
mbaldessari Dec 19, 2024
c0b5d25
Merge pull request #614 from mbaldessari/warning-fixes
mbaldessari Dec 19, 2024
5063467
Fix validated-schema make target
mbaldessari Jan 7, 2025
6be5db5
Merge pull request #615 from mbaldessari/fix-validated-schema
mbaldessari Jan 7, 2025
250c154
Wait some more before giving up
mbaldessari Jan 14, 2025
b630203
Merge pull request #616 from mbaldessari/wait-more
mbaldessari Jan 14, 2025
cc36e1f
Fix argo-healthcheck target
mbaldessari Jan 22, 2025
a472f72
Merge pull request #617 from mbaldessari/improve-check
mbaldessari Jan 22, 2025
e3e7add
Push TARGET_SITE into the in-container variables
mbaldessari Feb 4, 2025
b9140d1
Merge pull request #618 from mbaldessari/target_site
mbaldessari Feb 4, 2025
0746c6e
Do not bind mount /etc/pki blindly
mbaldessari Feb 7, 2025
c0c2c1e
Merge pull request #619 from mbaldessari/etc-pki
mbaldessari Feb 7, 2025
c733989
Merge remote-tracking branch 'common/v1' into multisource
mbaldessari Feb 8, 2025
498bb0a
Merge remote-tracking branch 'common/main' into multisource
mbaldessari Feb 8, 2025
f85286f
Switch to multisource charts
mbaldessari Feb 8, 2025
4e4eb47
Drop old test diffs
mbaldessari Feb 8, 2025
98744fb
Add a CI job for pattern.sh
mbaldessari Feb 9, 2025
7c950f6
Allow TARGET_BRANCH to be overridden
mbaldessari Feb 10, 2025
46af202
Restrict GH actions only to certain files
mbaldessari Feb 10, 2025
2cdaac1
Drop some unused workflows
mbaldessari Feb 10, 2025
4d4de10
Merge pull request #620 from mbaldessari/pattern-sh-ci-job
mbaldessari Feb 10, 2025
f13999d
Fix super-linter complaints
mbaldessari Feb 10, 2025
9b986b0
Switch to newer super-linter
mbaldessari Feb 10, 2025
7806437
Disable some checks in super-linter
mbaldessari Feb 10, 2025
b029ad5
Disable CHECKOV
mbaldessari Feb 10, 2025
8a9a7eb
Drop version from GrafanaDataSource
mbaldessari Feb 11, 2025
1fdba19
Add help line for create-gpu-machineset
mbaldessari Feb 11, 2025
39882c7
propagate the env var EXTRA_PLAYBOOK_OPTS to our ansible-playbook com…
dminnear-rh Feb 25, 2025
5315266
Merge pull request #621 from dminnear-rh/propagate-extra-playbook-opts
mbaldessari Feb 25, 2025
ba9feab
update how to make common subtree
dminnear-rh Feb 27, 2025
7d184fb
Merge pull request #622 from dminnear-rh/update-how-to-use-common-sub…
mbaldessari Feb 27, 2025
b580b7f
Removed previous version of common to convert to subtree from https:/…
dminnear-rh Mar 20, 2025
34e9c41
Add 'common/' from commit '7d184fb5e645e8001a4ff62845b078d6ffb319a0'
dminnear-rh Mar 20, 2025
094354b
use operand image for nfd based on openshift cluster version
dminnear-rh Mar 20, 2025
471f692
Merge remote-tracking branch 'mbaldessari/grafana-version-fix' into s…
dminnear-rh Mar 20, 2025
a56f8e2
Merge remote-tracking branch 'mbaldessari/fix-help' into slim-common
dminnear-rh Mar 20, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
5 changes: 3 additions & 2 deletions .github/linters/.markdown-lint.yml
Original file line number Diff line number Diff line change
Expand Up @@ -2,5 +2,6 @@
"default": true,
"MD003": false,
"MD013": false,
"MD033": false
}
"MD033": false,
"MD036": false
}
17 changes: 0 additions & 17 deletions .github/workflows/ansible-lint.yml

This file was deleted.

72 changes: 0 additions & 72 deletions .github/workflows/jsonschema.yaml

This file was deleted.

65 changes: 0 additions & 65 deletions .github/workflows/linter.yml

This file was deleted.

7 changes: 6 additions & 1 deletion .github/workflows/superlinter.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,17 +21,22 @@ jobs:
# Run Linter against code base #
################################
- name: Lint Code Base
uses: github/super-linter/slim@v6
uses: super-linter/super-linter/slim@v7
env:
VALIDATE_ALL_CODEBASE: true
DEFAULT_BRANCH: main
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
# These are the validation we disable atm
VALIDATE_BASH: false
VALIDATE_CHECKOV: false
VALIDATE_JSCPD: false
VALIDATE_KUBERNETES_KUBECONFORM: false
VALIDATE_YAML: false
VALIDATE_ANSIBLE: false
VALIDATE_PYTHON_PYLINT: false
VALIDATE_MARKDOWN_PRETTIER: false
VALIDATE_SHELL_SHFMT: false
VALIDATE_YAML_PRETTIER: false
# VALIDATE_DOCKERFILE_HADOLINT: false
# VALIDATE_MARKDOWN: false
# VALIDATE_NATURAL_LANGUAGE: false
Expand Down
11 changes: 9 additions & 2 deletions GPU_provisioning.md
Original file line number Diff line number Diff line change
Expand Up @@ -43,11 +43,18 @@ spec:

Use `kubectl` or `oc` command line to create new machineset `oc apply -f gpu_machineset.yaml`

Depending on type of EC2 instance creation of the new machines make take some time. Please note that all nodes with GPU will have labels(`node-role.kubernetes.io/odh-notebook`in our case) and taints (`odh-notebook `) that we have specified in machineset applied automatically
Depending on type of EC2 instance creation of the new machines make take some
time. Please note that all nodes with GPU will have
labels(`node-role.kubernetes.io/odh-notebook` in our case) and taints
(`odh-notebook`) that we have specified in machineset applied automatically

## Install Node Feature Operator

From OperatorHub install `Node Feature Discovery Operator` , accepting defaults . Once Operator has been installed , create `NodeFeatureDiscovery`instance . Use default entries unless you something specific is needed . Node Feature Discovery Operator will add labels to nodes based on available hardware resources
From OperatorHub install `Node Feature Discovery Operator` , accepting
defaults. Once Operator has been installed, create
`NodeFeatureDiscovery`instance. Use default entries unless you something
specific is needed. Node Feature Discovery Operator will add labels to nodes
based on available hardware resources.

![Diagram](images/node-feature-discovery.png)

Expand Down
2 changes: 1 addition & 1 deletion Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ install: operator-deploy post-install ## installs the pattern and loads the secr
@echo "Installed"

.PHONY: create-gpu-machineset
create-gpu-machineset:
create-gpu-machineset: ## Creates a gpu machineset
ansible-playbook ansible/playbooks/create-gpu-machine-set.yaml

.PHONY: post-install
Expand Down
21 changes: 7 additions & 14 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,7 @@ OpenShift to generate project proposals for specific Red Hat products.
- Podman
- Red Hat Openshift cluster running in AWS. Supported regions are : us-east-1 us-east-2 us-west-1 us-west-2 ca-central-1 sa-east-1 eu-west-1 eu-west-2 eu-west-3 eu-central-1 eu-north-1 ap-northeast-1 ap-northeast-2 ap-northeast-3 ap-southeast-1 ap-southeast-2 ap-south-1.
- GPU Node to run Hugging Face Text Generation Inference server on Red Hat OpenShift cluster.
- Create a fork of the [rag-llm-gitops](https://github.com/validatedpatterns/rag-llm-gitops.git) git repository.
- Create a fork of the [rag-llm-gitops](https://github.com/validatedpatterns/rag-llm-gitops.git) Git repository.

## Demo Description & Architecture

Expand All @@ -33,52 +33,45 @@ The application generates a project proposal for a Red Hat product.
- Multiple LLM providers (OpenAI, Hugging Face, NVIDIA).
- Vector Database, such as EDB Postgres for Kubernetes or Redis, to store embeddings of Red Hat product documentation.
- Monitoring dashboard to provide key metrics such as ratings.
- GitOps setup to deploy e2e demo (frontend / vector database / served models).
- GitOps setup to deploy end-to-end demo (frontend / vector database / served models).

![Overview](https://gitlab.com/osspa/portfolio-architecture-examples/-/raw/main/images/intro-marketectures/rag-demo-vp-marketing-slide.png)

_Figure 1. Overview of the validated pattern for RAG Demo with Red Hat OpenShift_


![Logical](https://gitlab.com/osspa/portfolio-architecture-examples/-/raw/main/images/logical-diagrams/rag-demo-vp-ld.png)

_Figure 2. Logical diagram of the RAG Demo with Red Hat OpenShift._


#### RAG Demo Workflow

![Overview of workflow](https://gitlab.com/osspa/portfolio-architecture-examples/-/raw/main/images/schematic-diagrams/rag-demo-vp-sd.png)

_Figure 3. Schematic diagram for workflow of RAG demo with Red Hat OpenShift._


#### RAG Data Ingestion

![ingestion](https://gitlab.com/osspa/portfolio-architecture-examples/-/raw/main/images/schematic-diagrams/rag-demo-vp-ingress-sd.png)

_Figure 4. Schematic diagram for Ingestion of data for RAG._


#### RAG Augmented Query


![query](https://gitlab.com/osspa/portfolio-architecture-examples/-/raw/main/images/schematic-diagrams/rag-demo-vp-query-sd.png)

_Figure 5. Schematic diagram for RAG demo augmented query._


In Figure 5, we can see RAG augmented query. [IBM Granite 3.1-8B-Instruct](https://huggingface.co/ibm-granite/granite-3.1-8b-instruct) model is used for language processing, LangChain to
integrate different tools of the LLM-based application together and to process the PDF
files and web pages, vector database provider such as EDB Postgres for Kubernetes or Redis, is used to store vectors, and [Red Hat OpenShift AI](https://www.redhat.com/en/technologies/cloud-computing/openshift/openshift-ai) to serve the [IBM Granite 3.1-8B-Instruct](https://huggingface.co/ibm-granite/granite-3.1-8b-instruct) model, Gradio is used for user interface and object storage to store language model and other datasets.
Solution components are deployed as microservices in the Red Hat OpenShift cluster.


#### Download diagrams

View and download all of the diagrams above in our open source tooling site.

[Open Diagrams](https://www.redhat.com/architect/portfolio/tool/index.html?#gitlab.com/osspa/portfolio-architecture-examples/-/raw/main/diagrams/rag-demo-vp.drawio)


![Diagram](images/diagram.png)
_Figure 6. Proposed demo architecture with OpenShift AI_

Expand All @@ -93,11 +86,11 @@ _Figure 6. Proposed demo architecture with OpenShift AI_

## Deploying the demo

To run the demo, ensure the Podman is running on your machine.Fork the [rag-llm-gitops](https://github.com/validatedpatterns/rag-llm-gitops) repo into your organization
To run the demo, ensure the Podman is running on your machine.Fork the [rag-llm-gitops](https://github.com/validatedpatterns/rag-llm-gitops) repository into your organization

### Login to OpenShift cluster

Replace the token and the api server url in the command below to login to the OpenShift cluster.
Replace the token and the API server URL in the command below to login to the OpenShift cluster.

```sh
oc login --token=<token> --server=<api_server_url> # login to Openshift cluster
Expand All @@ -112,7 +105,7 @@ cd rag-llm-gitops

### Configuring model

This pattern deploys [IBM Granite 3.1-8B-Instruct](https://huggingface.co/ibm-granite/granite-3.1-8b-instruct) out of box. Run the following command to configure vault with the model Id.
This pattern deploys [IBM Granite 3.1-8B-Instruct](https://huggingface.co/ibm-granite/granite-3.1-8b-instruct) out of box. Run the following command to configure vault with the model ID.

```sh
# Copy values-secret.yaml.template to ~/values-secret-rag-llm-gitops.yaml.
Expand Down Expand Up @@ -254,10 +247,10 @@ By default, Grafana application is deployed in `llm-monitoring` namespace.To lau
![Routes](images/monitoring.png)

## Test Plan

GOTO: [Test Plan](./TESTPLAN.md)

## Licenses

EDB Postgres for Kubernetes is distributed under the EDB Limited Usage License
Agreement, available at [enterprisedb.com/limited-use-license](https://www.enterprisedb.com/limited-use-license).

24 changes: 11 additions & 13 deletions TESTPLAN.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,11 @@
# Test Cases for E2E Demo.
# Test Cases for End-to-End Demo

- [Provisioning of GPU Node](https://github.com/validatedpatterns-sandbox/rag-llm-gitops/blob/main/GPU_provisioning.md)

- MachineSet is created.
- Name of the machine set <clustername>-gpu-<AWSregion>. This should not be a hard requirement though.
- Name of the machine set <clustername>-gpu-<AWSregion>. This should not be a hard requirement though.
- Machine set has taint section

```yaml
taints:
- effect: NoSchedule
Expand All @@ -13,13 +14,15 @@
```

- MachineSet has a label

```yaml
metadata:
labels:
node-role.kubernetes.io/odh-notebook: '' <--- Put your label if needed
```

- MachineSet instance type

```yaml
providerSpec:
value:
Expand All @@ -40,16 +43,16 @@
- Click on the Node Feature Discovery Operator. Under NodeFeatureDiscovery an instance should be created. Status should be Available.
![nfd instance](https://validatedpatterns.io/images/rag-llm-gitops/ragllm-nfd-instance.png)


- Verify NVIDIA GPU Operator is installed.
- NVIDIA GPU Operator is installed

![nvidia operator](https://validatedpatterns.io/images/rag-llm-gitops/ragllm-nvidia-operator.png)

- Click on the NVIDIA GPU Operator and click on ClusterPolicy. A gpu-cluster-policy should exist
![nvidia clusterpolicies](https://validatedpatterns.io/images/rag-llm-gitops/ragllm-nvidia-clusterpolicies.png)
![nvidia clusterpolicies](https://validatedpatterns.io/images/rag-llm-gitops/ragllm-nvidia-clusterpolicies.png)

- Click on the gpu-cluster-policy and click on the YAML tab. The YAML should contain the tolerations

```yaml
tolerations:
- effect: NoSchedule
Expand All @@ -59,13 +62,13 @@

- Application provisioned correctly.
- Click on the rag-llm namespace

- By Default, EDB Operator will be deployed, which will deploy PGVECTOR vector database, 6 pods should be running
![ragllm pgvector pods](https://validatedpatterns.io/images/rag-llm-gitops/rag-llm-pgvector.png)

- If the global.db.type is set to REDIS in the values-global.yaml, four pods should be running
![ragllm pods](https://validatedpatterns.io/images/rag-llm-gitops/rag-llm.png)

- Click on Networking → Routes from the left Navigation panel. An llm-ui route should exist
![llm-ui route](https://validatedpatterns.io/images/rag-llm-gitops/ragllm-application_route.png)

Expand All @@ -88,10 +91,5 @@
- Enter the Grafana admin credentials.
- Ratings are displayed for each model
- Grafana Dashboard is displayed

![llm-ui grafana](https://validatedpatterns.io/images/rag-llm-gitops/ragllm-grafana.png)





![llm-ui grafana](https://validatedpatterns.io/images/rag-llm-gitops/ragllm-grafana.png)
Loading