Dsl importer download to workspace by VaniHaripriya · Pull Request #625 · VaniHaripriya/data-science-pipelines

VaniHaripriya · 2025-10-10T19:45:48Z

Description of your changes:

Checklist:

You have signed off your commits
The title for your pull request (PR) should follow our title convention. Learn more about the pull request title convention used in this repository.

…2234) Signed-off-by: VaniHaripriya <vmudadla@redhat.com>

…ubeflow#12281) * adding a retry logic to object store s3 configuration Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com> * adding pr suggestion to use actual ctx Co-authored-by: Matt Prahl <mprahl@users.noreply.github.com> Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com> --------- Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com> Co-authored-by: Matt Prahl <mprahl@users.noreply.github.com>

Signed-off-by: ductnn <trannhuduc531998@gmail.com>

Signed-off-by: Aniket Patil <aniketpatil2027@gmail.com>

It was errantly set to install kfp-kubernetes below 2 but the versions were recently aligned. Signed-off-by: mprahl <mprahl@users.noreply.github.com>

…actoring (kubeflow#12279) * Update AGENTS.md with the latest testing changes Signed-off-by: mprahl <mprahl@users.noreply.github.com> * Remove outdated read me on testing infrastructure This also removes an obsolete Makefile. Signed-off-by: mprahl <mprahl@users.noreply.github.com> * Rename the legacy v2 API integration tests workflow for clarity Signed-off-by: mprahl <mprahl@users.noreply.github.com> * Fix syntax error in api-server-tests.yml Signed-off-by: mprahl <mprahl@users.noreply.github.com> * Add retries to GetLatestPipelineVersion helper Signed-off-by: mprahl <mprahl@users.noreply.github.com> * Free up disk space on the GitHub worker for tests Signed-off-by: mprahl <mprahl@users.noreply.github.com> * Remove unnecessary ginkgo call preventings tests from running Signed-off-by: mprahl <mprahl@users.noreply.github.com> --------- Signed-off-by: mprahl <mprahl@users.noreply.github.com>

…#12280) * Fix 7 HIGH and 4 CRITICAL vulns in frontend/package.json Signed-off-by: Anay Sharma <anay20sharma11@gmail.com> * semver vuln fix Signed-off-by: Anay Sharma <anay20sharma11@gmail.com> * vuln fixes CVE-2024-29180 CVE-2022-25858 CVE-2024-37890 Signed-off-by: Anay Sharma <anay20sharma11@gmail.com> * rm semver pin Signed-off-by: Anay Sharma <anay20sharma11@gmail.com> * fixed micromatch and semver vulns Signed-off-by: Anay Sharma <anay20sharma11@gmail.com> --------- Signed-off-by: Anay Sharma <anay20sharma11@gmail.com> Co-authored-by: Anay Sharma <anay20sharma11@gmail.com>

…ubeflow#12287) Remediates: 1. CVE-2020-7720 (HIGH) 2. CVE-2022-24771 (HIGH) 3. CVE-2022-24772 (HIGH) 4. CVE-2022-0235 (HIGH) Signed-off-by: vamsi93 <vamsi93@gmail.com>

Signed-off-by: mprahl <mprahl@users.noreply.github.com>

* feat: bump express version Signed-off-by: eternityduck <bogdan2003bk96@gmail.com> * fix: update jest versions and tests Signed-off-by: eternityduck <bogdan2003bk96@gmail.com> * fix: express 5 route matchers Signed-off-by: eternityduck <bogdan2003bk96@gmail.com> * fix: path regexp version update Signed-off-by: eternityduck <bogdan2003bk96@gmail.com> * fix: tests Signed-off-by: eternityduck <bogdan2003bk96@gmail.com> * chore: sync lock file Signed-off-by: eternityduck <bogdan2003bk96@gmail.com> * fix: missing package Signed-off-by: eternityduck <bogdan2003bk96@gmail.com> * chore: remove unneeded file Signed-off-by: eternityduck <bogdan2003bk96@gmail.com> --------- Signed-off-by: eternityduck <bogdan2003bk96@gmail.com> Co-authored-by: Alex <mythicalsunlight@gmail.com>

…#12288) Signed-off-by: Anay Sharma <anays2@illinois.edu>

Add tests to verify setting of SemaphoreKey and MutexName fields in DSL Implement getter setter functions with latest Pythonic properties Signed-off-by: ddalvi <ddalvi@redhat.com>

Signed-off-by: Aniket Patil <aniketpatil2027@gmail.com>

…ng) (kubeflow#12296) Signed-off-by: kaikaila <lyk2772@126.com>

Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com>

) Signed-off-by: mprahl <mprahl@users.noreply.github.com>

Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com>

…ubeflow#12300) * upgrade http-proxy-middleware Signed-off-by: Anay Sharma <anays2@illinois.edu> * form data fix Signed-off-by: Anay Sharma <anays2@illinois.edu> * form-data fix Signed-off-by: Anay Sharma <anays2@illinois.edu> * upgrade typescript to handle new http-proxy-middleware version Signed-off-by: Anay Sharma <anays2@illinois.edu> * regenerate lock files Signed-off-by: Anay Sharma <anays2@illinois.edu> --------- Signed-off-by: Anay Sharma <anays2@illinois.edu>

…low#12309) This PR set /mnt as the default local path provisioner because it had much more storage but it doesn't seem to be the case recently: kubeflow#12179 This should hopefully fix CI flakes. Signed-off-by: mprahl <mprahl@users.noreply.github.com>

…beflow#12294) - Introduce @dsl.notebook_component for notebook-driven components - Embeds a .ipynb (or a dir with one .ipynb) into the component - Binds dsl.run_notebook(**kwargs) to execute via nbclient at runtime - Streams cell outputs; injects parameters (Papermill semantics) - Installs default runtime deps when unspecified: nbclient, ipykernel, jupyter_client - Add embedded artifact support for lightweight components - Tar+gzip and base64-embed files/dirs; extract to temp dir at runtime - Prepend extracted dir to sys.path; expose __KFP_EMBEDDED_ASSET_DIR/FILE - Warn when compressed payload >1MB - Add EmbeddedInput[...] type (runtime-only) - Excluded from component interface; Executor injects an Artifact to embedded asset - Extend component_factory to support embedded_artifact_path and helper templates - Wire into create_component_from_func and command generation - New DSL helpers and tests - Add dsl/notebook_helpers.run_notebook stub and notebook executor template - Tests for decorator, parameter injection, streaming, EmbeddedInput, large archive warning - Add sample compiled pipeline specs under test_data - Minor: adjust FutureWarning stacklevel in component creation Additive SDK feature; no API server changes. Signed-off-by: mprahl <mprahl@users.noreply.github.com>

* fix[frontend]: replace delete with null assignment Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Co-authored-by: mprahl <mprahl@users.noreply.github.com> * Use the frontend from the PR in CI Signed-off-by: mprahl <mprahl@users.noreply.github.com> * Deprecate first-interaction workflow Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> --------- Signed-off-by: droctothorpe <mythicalsunlight@gmail.com> Signed-off-by: mprahl <mprahl@users.noreply.github.com> Co-authored-by: mprahl <mprahl@users.noreply.github.com>

…es (kubeflow#12302) Signed-off-by: kaikaila <lyk2772@126.com>

Signed-off-by: agoins <alyssacgoins@gmail.com>

Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com>

…low#12082) * Implement TLS option for pod-to-pod communication. Signed-off-by: agoins <alyssacgoins@gmail.com> * Use Envoy ConfigMap in base metadata config. Update from utilizing config added via Dockerfile, to match TLS config formatting. Signed-off-by: agoins <alyssacgoins@gmail.com> --------- Signed-off-by: agoins <alyssacgoins@gmail.com>

kubeflow#12180) Signed-off-by: VaniHaripriya <vmudadla@redhat.com>

* adding myself as a reviewer Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com> * fixing go linting errors Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com> --------- Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com>

Signed-off-by: VaniHaripriya <vmudadla@redhat.com>

The source distribution produced does not include all of the files needed to rebuild the wheel. This change adds a MANIFEST.in file to cause the requirements.txt and requirements-dev.txt files to be included so when the setup.py tries to read them they are present. Signed-off-by: Doug Hellmann <dhellmann@redhat.com>

…line resources (kubeflow#12202) * Add configuration to conditionally disable shared pipeline resources Signed-off-by: Krishan Bhasin <164889026+krishanbhasin-px@users.noreply.github.com> * Add configuration to conditionally disable shared pipeline resources Signed-off-by: Krishan Bhasin <164889026+krishanbhasin-px@users.noreply.github.com> --------- Signed-off-by: Krishan Bhasin <164889026+krishanbhasin-px@users.noreply.github.com>

… (kubeflow#12295) add back additionalinfo as optional make k8s error logs more generic to protect against xss remove verbose logging for minio get artifact handler sanitize rather than remove resource names + revert backend error logs fix typo + add invalid resource name tests add valid namespace check for tensorboard update pipeline upload server responses + log verbose error messages remove error wrap from backend error logs minor updates to satisfy pre commit checks update tensor board file to ensure namespace is a str update frontend code format + backend test cases update pipeline upload test cases to pass pre commit fix minor merge typo fix minor merge typo Signed-off-by: JerT33 <trestjeremiah@gmail.com>

…n Tests (kubeflow#12335) Signed-off-by: VaniHaripriya <vmudadla@redhat.com>

* chore: Release 2.14.3 (kubeflow#12198) Signed-off-by: mprahl <mprahl@users.noreply.github.com> Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com> * chore: release 2.14.4 (kubeflow#12299) * fix(sdk): Align the versions on kfp[kubernetes] install (kubeflow#12283) It was errantly set to install kfp-kubernetes below 2 but the versions were recently aligned. Signed-off-by: mprahl <mprahl@users.noreply.github.com> (cherry picked from commit f07e276) Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com> * chore: Release 2.14.4 Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com> --------- Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com> Co-authored-by: Matt Prahl <mprahl@users.noreply.github.com> * chore: release 2.14.5 automate requirements updates Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com> * chore(release): bump version to 2.14.5 on master branch Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com> * cleanup release docs Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com> * update sdk ver for loaded components Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com> * re-compile workflow yamls to align with ver update Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com> --------- Signed-off-by: mprahl <mprahl@users.noreply.github.com> Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com> Co-authored-by: Matt Prahl <mprahl@users.noreply.github.com>

Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com>

coderabbitai · 2025-10-10T19:46:15Z

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches

🧪 Generate unit tests (beta)

Create PR with unit tests
Post copyable unit tests in a comment
Commit unit tests in branch dsl-importer-download-to-workspace

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

_{Comment @coderabbitai help to get the list of available commands and usage tips.}

…kubeflow#12339) The source distribution produced does not include all of the files needed to rebuild the wheel. This change adds a MANIFEST.in file to cause the requirements.txt file to be included so when the setup.py tries to read it, it is present. Signed-off-by: Doug Hellmann <dhellmann@redhat.com>

Signed-off-by: VaniHaripriya <vmudadla@redhat.com>

VaniHaripriya and others added 30 commits September 24, 2025 13:09

feat(sdk): add compile-time validation for workspace size (kubeflow#1…

6c03bc9

…2234) Signed-off-by: VaniHaripriya <vmudadla@redhat.com>

chore: fix broken link in README (kubeflow#12282)

11a2fe7

Signed-off-by: ductnn <trannhuduc531998@gmail.com>

fix(ci): correct PROXY check in workflow files (kubeflow#12266)

50734e0

Signed-off-by: Aniket Patil <aniketpatil2027@gmail.com>

fix(sdk): Align the versions on kfp[kubernetes] install (kubeflow#12283)

f07e276

It was errantly set to install kfp-kubernetes below 2 but the versions were recently aligned. Signed-off-by: mprahl <mprahl@users.noreply.github.com>

chore(frontend): update node-fetch and node-forge to remediate vulns (k…

42ee9dc

…ubeflow#12287) Remediates: 1. CVE-2020-7720 (HIGH) 2. CVE-2022-24771 (HIGH) 3. CVE-2022-24772 (HIGH) 4. CVE-2022-0235 (HIGH) Signed-off-by: vamsi93 <vamsi93@gmail.com>

doc: Add a KEP for Jupyter notebook components (kubeflow#12238)

83ebc38

Signed-off-by: mprahl <mprahl@users.noreply.github.com>

chore(frontend): vuln fixes in frontend/server package.json (kubeflow…

90d0c70

…#12288) Signed-off-by: Anay Sharma <anays2@illinois.edu>

feat(SDK): Add SemaphoreKey and MutexName fields to DSL (kubeflow#11340)

e4efd5b

Add tests to verify setting of SemaphoreKey and MutexName fields in DSL Implement getter setter functions with latest Pythonic properties Signed-off-by: ddalvi <ddalvi@redhat.com>

Add venv/ to .gitignore (kubeflow#12291)

82f6b7d

Signed-off-by: Aniket Patil <aniketpatil2027@gmail.com>

chore: fix import order and redundance in 15 files (baseline formatti…

348a6f5

…ng) (kubeflow#12296) Signed-off-by: kaikaila <lyk2772@126.com>

chore: Replace sdk in pipeline files (kubeflow#12297)

51ab5e6

Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com>

fix(tests): Fix ginkgo compiler tests for disabled cache (kubeflow#12304

35fb271

) Signed-off-by: mprahl <mprahl@users.noreply.github.com>

chore(ci): adding nsingla as a reviewer and an approver (kubeflow#12311)

9a8edfa

Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com>

chore: refactor pre-commit workflow to correctly detect new lint issu…

4db6595

…es (kubeflow#12302) Signed-off-by: kaikaila <lyk2772@126.com>

chore: remove --whole-files flag from precommit check (kubeflow#12319)

8776242

Signed-off-by: agoins <alyssacgoins@gmail.com>

Remove --whole-file flag from precommit config. (kubeflow#12321)

e51df51

Signed-off-by: agoins <alyssacgoins@gmail.com>

test(refactor): Sdk Tests Refactor (kubeflow#12310)

c866ff3

Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com>

docs(testplan): adding MLMD removal test plan (kubeflow#12323)

e085933

Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com>

chrore: adding myself as a reviewer (kubeflow#12325)

e31038d

Signed-off-by: Nelesh Singla <117123879+nsingla@users.noreply.github.com>

test: Add Integration tests for Kubernetes Native API Migration script (

9e24f70

kubeflow#12180) Signed-off-by: VaniHaripriya <vmudadla@redhat.com>

VaniHaripriya and others added 9 commits October 8, 2025 22:29

fix(test): fix migration script integration test (kubeflow#12331)

0ca6d08

Signed-off-by: VaniHaripriya <vmudadla@redhat.com>

fix(test): fix timeout error caused by KFP Kubernetes Native Migratio…

0ea0983

…n Tests (kubeflow#12335) Signed-off-by: VaniHaripriya <vmudadla@redhat.com>

chore: add publish package workflow (kubeflow#12344)

08ff96b

Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com>

chore: regenerate files for ver upgrade (kubeflow#12341)

f689e86

Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com>

chore: update versioning policy (kubeflow#12342)

d0e85fa

Signed-off-by: Humair Khan <HumairAK@users.noreply.github.com>

VaniHaripriya force-pushed the dsl-importer-download-to-workspace branch from a5bc5b7 to 460db98 Compare October 10, 2025 19:57

dhellmann and others added 4 commits October 10, 2025 16:06

update artifcat types

9cb6115

feat(backend/sdk):Add download_to_workspace option to dsl.importer

9cdc040

Signed-off-by: VaniHaripriya <vmudadla@redhat.com>

fix lint errors

62be884

VaniHaripriya force-pushed the dsl-importer-download-to-workspace branch from 460db98 to 62be884 Compare October 10, 2025 20:11

VaniHaripriya added 2 commits October 10, 2025 15:50

fix import

423b495

update importer

84f633c

VaniHaripriya force-pushed the upstream-kubeflow-pipelines-master branch from 658da50 to b52e764 Compare October 12, 2025 03:28

VaniHaripriya closed this Oct 12, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Dsl importer download to workspace - #625

Dsl importer download to workspace#625
VaniHaripriya wants to merge 45 commits into
upstream-kubeflow-pipelines-masterfrom
dsl-importer-download-to-workspace

VaniHaripriya commented Oct 10, 2025

Uh oh!

coderabbitai Bot commented Oct 10, 2025

Review skipped

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

16 participants

Conversation

VaniHaripriya commented Oct 10, 2025

Uh oh!

coderabbitai Bot commented Oct 10, 2025

Review skipped

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

16 participants