Skip to content

[FEATURE] Enhancemnet for CI flow #4222

@Hailong-am

Description

@Hailong-am

Is your feature request related to a problem?

Currently, our GitHub CI workflows require manual approval to run. This creates unnecessary friction, as contributors have to wait for approval before receiving any feedback on their changes.

The main reason for requiring approval is that the CI uses real LLM credentials, and running it automatically could risk exposing these credentials.

To reduce this frustration while still keeping credentials safe, I’d like to propose two possible approaches:

1. Separate unit tests from integration tests

  • Unit tests should not require any LLM credentials and can run automatically without approval.

  • Integration tests, which rely on credentials, can remain restricted.

2. Use credential-free runs by default

  • Run CI without LLM credentials (similar to local development).

  • Add a separate CI workflow that runs with real LLM credentials, only when explicitly approved.

What solution would you like?
A clear and concise description of what you want to happen.

What alternatives have you considered?
A clear and concise description of any alternative solutions or features you've considered.

Do you have any additional context?
Add any other context or screenshots about the feature request here.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

Status

On-deck

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions