✨ Automatic cluster formation using DNS

[atpugtihsrah]

Decision Record

• Why: DNS can also be used for service discovery. So we want to also offer service discovery using DNS for FlowG.

• Closes ✨ Automatic cluster formation using DNS discovery #424

Changes

Task List:

• 👷 Add ci e2e workflow for cluster formation using dns
• ✅ Add e2e tests
• ✨ Cluster formation using dns service discovery
  • ✨ Add dns server url to cli and environment variables
  • ✨ Add dns service as a process
  • ✨ Register node with dns server
  • ✨ Fetch other nodes from dns server and form cluster
  • ✨ 🩺 Add consul health checks?
• 📝 Add tutorial to use consul

License Agreement

• I guarantee that I have the rights on the code submitted in this PR
• I accept that this contribution will be released under the terms of the MIT License

[github-actions]

	Tests	Passed ✅	Skipped	Failed
Consul End-To-End Test Report	1 ran	1 passed	0 skipped	0 failed

• View Consul End-To-End Test Report

[github-actions]

	Tests	Passed ✅	Skipped	Failed
API End-To-End Test Report	20 ran	20 passed	0 skipped	0 failed

• View API End-To-End Test Report

[github-actions]

Robot Results

✅ Passed	❌ Failed	⏭️ Skipped	Total	Pass %	⏱️ Duration
19	3	0	22	86.36	2m10.121696s

Passed Tests

Name	⏱️ Duration	Suite
Change Password	6.541 s	Account
Restore Password	5.243 s	Account
Create test role	5.946 s	Admin
Create test user	5.768 s	Admin
Log as test user	4.583 s	Admin
Login With Valid Credentials	4.282 s	Auth
Login With Invalid Credentials	4.019 s	Auth
Logout	4.711 s	Auth
Create new forwarder	5.291 s	Forwarders
Configure forwarder	5.566 s	Forwarders
Create new stream	5.351 s	Storage
Configure stream	5.838 s	Storage
Delete stream	5.267 s	Storage
View logs sent on default pipeline	6.774 s	Stream-Viewer
View logs sent via Syslog (RFC 5424)	7.108 s	Stream-Viewer
View logs sent via Syslog (RFC 3164)	6.978 s	Stream-Viewer
Watch logs	7.552 s	Stream-Viewer
Create new transformer	5.218 s	Transformers
Configure transformer	6.360 s	Transformers

Failed Tests

Name	Message	⏱️ Duration	Suite
Create and Delete Personal Access Token	The element 'id=input:account.tokens.modal.token_uuid' should not be visible, but it is.	12.351 s	Account
Delete forwarder	Page should have contained text 'No forwarder found' but did not.	4.696 s	Forwarders
Delete transformer	Page should have contained text 'No transformer found' but did not.	4.678 s	Transformers

[linkdd]

Hi @atpugtihsrah !

I take the opportunity of this new PR to mention, I created a Discord server for the community ( invite link #686 ) to be able to help if people have troubles when contributing :)

[atpugtihsrah]

@linkdd Awesome, I just joined!

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
10.9% Duplication on New Code

See analysis details on SonarQube Cloud

[linkdd]

Hi @atpugtihsrah, I hope you're doing well.

I am starting work on the Kubernetes automatic cluster formation. To do so, I decided to simplify the way we add a new strategy for cluster formation, you can find the PR here #788.

This will impact your PR, but I hope it will simplify your work.

Let me know what you think and have a good day :)

[atpugtihsrah]

Hey @linkdd Thanks for the heads up. I am slowly making progress, dns has a learning curve (and that's why I picked this task). I have a lot of changes on my machine which I don't want to commit right now because I don't know if those changes work or not. As soon as I make a commit I will check your PR, pull in your changes and rebase.

[sonarqubecloud]

Quality Gate failed

Failed conditions
4 Security Hotspots
C Reliability Rating on New Code (required ≥ A)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE