Skip to content

Conversation

@kevincai
Copy link
Contributor

@kevincai kevincai commented Oct 9, 2025

  • open source staros java source code

Why I'm doing:

What I'm doing:

#63826

What type of PR is this:

  • BugFix
  • Feature
  • Enhancement
  • Refactor
  • UT
  • Doc
  • Tool

Does this PR entail a change in behavior?

  • Yes, this PR will result in a change in behavior.
  • No, this PR will not result in a change in behavior.

If yes, please specify the type of change:

  • Interface/UI changes: syntax, type conversion, expression evaluation, display information
  • Parameter changes: default values, similar parameters but with different default values
  • Policy changes: use new policy to replace old one, functionality automatically enabled
  • Feature removed
  • Miscellaneous: upgrade & downgrade compatibility, etc.

Checklist:

  • I have added test cases for my bug fix or my new feature
  • This pr needs user documentation (for new or modified features or behaviors)
    • I have added documentation for my new feature or new function
  • This is a backport pr

Bugfix cherry-pick branch check:

  • I have checked the version labels which the pr will be auto-backported to the target branch
    • 4.0
    • 3.5
    • 3.4
    • 3.3

Note

Introduce the StarOS Java implementation with shard/worker management, gRPC agent, placement/scheduling, file stores, utilities, and comprehensive tests.

  • Starlet (gRPC) Agent:
    • StarletAgent with heartbeat, add/remove shard RPCs, retries, and channel/stub lifecycle.
    • Mock agents for unit tests.
  • Worker Management:
    • Worker, WorkerGroup, WorkerManager with create/update/delete, heartbeats, dump/load image, and dynamic thread-pool sizing.
    • Resource provisioning via DefaultResourceManager (external or builtin test server) and factory.
  • Shard Management:
    • Shard, ShardGroup, MetaGroup (PACK/SPREAD/EXCLUDE), anonymous group handling, and meta-group operations.
    • Health/balance checker and ShardSchedulerV2 (add/remove to worker/group, batch, balancing, temp replicas).
    • ShardPolicyFilter with EXCLUDE policy.
  • File Store/Path:
    • S3/HDFS/Azure Blob/ADLS2/GS stores, replace/update flows, path and checksum utilities.
  • Utilities/Infra:
    • Config, logging, ID generator, abstract server, metrics, log dumping tool (ReadImage).
  • HTTP/Service:
    • HTTP dispatcher/service endpoints; StarManager orchestration.
  • Tests:
    • Extensive unit tests covering managers, scheduler, shard/replica states, file stores, HTTP, journal replayer, and provisioner.

Written by Cursor Bugbot for commit dfe7079. This will update automatically on new commits. Configure here.

@kevincai kevincai changed the title [Feature] opensource staros [Enhancement] opensource staros Oct 9, 2025
@kevincai kevincai removed the SKIP CASE label Oct 9, 2025
@alvin-celerdata
Copy link
Contributor

@cursor review

@kevincai kevincai changed the title [Enhancement] opensource staros [Enhancement] opensource staros - java code Oct 9, 2025
@kevincai kevincai force-pushed the feature/opensource-staros-java branch 2 times, most recently from e2d96b8 to 19225dd Compare November 5, 2025 09:32
@alvin-celerdata
Copy link
Contributor

@cursor review

Copy link

@cursor cursor bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Bugbot reviewed your changes and found no bugs!


@kevincai kevincai force-pushed the feature/opensource-staros-java branch from 19225dd to 1af418d Compare December 4, 2025 14:40
@mergify
Copy link
Contributor

mergify bot commented Dec 4, 2025

🧪 CI Insights

Here's what we observed from your CI run for dfe7079.

🟢 All jobs passed!

But CI Insights is watching 👀

@kevincai kevincai enabled auto-merge (squash) December 4, 2025 14:41
@alvin-celerdata
Copy link
Contributor

@cursor review

@kevincai kevincai force-pushed the feature/opensource-staros-java branch from 1af418d to e263a0c Compare December 5, 2025 13:48
@alvin-celerdata
Copy link
Contributor

@cursor review

@kevincai kevincai force-pushed the feature/opensource-staros-java branch from e263a0c to 7c3de12 Compare December 8, 2025 02:43
@alvin-celerdata
Copy link
Contributor

@cursor review

@kevincai
Copy link
Contributor Author

kevincai commented Dec 9, 2025

@Mergifyio rebase

@mergify
Copy link
Contributor

mergify bot commented Dec 9, 2025

rebase

✅ Branch has been successfully rebased

@kevincai kevincai force-pushed the feature/opensource-staros-java branch from 7c3de12 to 6db5b8d Compare December 9, 2025 03:02
@alvin-celerdata
Copy link
Contributor

@cursor review

@kevincai
Copy link
Contributor Author

kevincai commented Dec 9, 2025

@Mergifyio rebase

* open source staros java source code

Signed-off-by: Kevin Cai <[email protected]>
Signed-off-by: Kevin Cai <[email protected]>
Signed-off-by: Kevin Cai <[email protected]>
@mergify
Copy link
Contributor

mergify bot commented Dec 9, 2025

rebase

✅ Branch has been successfully rebased

@kevincai kevincai force-pushed the feature/opensource-staros-java branch from 6db5b8d to dfe7079 Compare December 9, 2025 06:48
@sonarqubecloud
Copy link

sonarqubecloud bot commented Dec 9, 2025

Quality Gate Failed Quality Gate failed

Failed conditions
10 Security Hotspots
E Reliability Rating on New Code (required ≥ A)

See analysis details on SonarQube Cloud

Catch issues before they fail your Quality Gate with our IDE extension SonarQube for IDE

@github-actions
Copy link

github-actions bot commented Dec 9, 2025

[Java-Extensions Incremental Coverage Report]

pass : 0 / 0 (0%)

@github-actions
Copy link

github-actions bot commented Dec 9, 2025

[FE Incremental Coverage Report]

pass : 0 / 0 (0%)

@github-actions
Copy link

github-actions bot commented Dec 9, 2025

[BE Incremental Coverage Report]

pass : 0 / 0 (0%)

@alvin-celerdata
Copy link
Contributor

@cursor review

@kevincai kevincai marked this pull request as draft December 10, 2025 05:51
auto-merge was automatically disabled December 10, 2025 05:51

Pull request was converted to draft

@allenfudunhui
Copy link

Is there already a clear plan to opensource staros?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants