Skip to content

GCSFuse Profiles: Move Profiles to stable#1212

Merged
chrisThePattyEater merged 1 commit intoGoogleCloudPlatform:mainfrom
chrisThePattyEater:stableProfiles
Mar 23, 2026
Merged

GCSFuse Profiles: Move Profiles to stable#1212
chrisThePattyEater merged 1 commit intoGoogleCloudPlatform:mainfrom
chrisThePattyEater:stableProfiles

Conversation

@chrisThePattyEater
Copy link
Copy Markdown
Collaborator

@chrisThePattyEater chrisThePattyEater commented Feb 10, 2026

What type of PR is this?

Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line:

/kind api-change
/kind bug
/kind cleanup
/kind design
/kind documentation
/kind failing-test

/kind feature

/kind flake

What this PR does / why we need it:
This pr moves the profiles feature that has been in development on the profile overlay to stable.
Which issue(s) this PR fixes:

Fixes #

Special notes for your reviewer:
These changes were tested by running e2e tests on the gcsfuseIntegration test suite. The cluster is a 3 node standard gke cluster using n2-standard-8. Command to run the tests:

make e2e-test E2E_TEST_USE_GKE_MANAGED_DRIVER=false E2E_TEST_BUILD_DRIVER=true BUILD_GCSFUSE_FROM_SOURCE=false E2E_TEST_SKIP="should.succeed.in.performance.test" E2E_TEST_FOCUS="gcsfuseIntegration" REGISTRY=gcr.io/fuechr-gke-dev STAGINGVERSION=prow-gob-internal-boskos-chris
Ran 343 of 475 Specs in 9089.036 seconds
SUCCESS! -- 343 Passed | 0 Failed | 0 Pending | 132 Skipped

Does this PR introduce a user-facing change?:

Moves GCSFuse Profiles Feature to stable overlay

@google-oss-prow
Copy link
Copy Markdown

@chrisThePattyEater: The label(s) kind/feature cannot be applied, because the repository doesn't have them.

Details

In response to this:

What type of PR is this?

Uncomment only one /kind <> line, hit enter to put that in a new line, and remove leading whitespaces from that line:

/kind api-change
/kind bug
/kind cleanup
/kind design
/kind documentation
/kind failing-test

/kind feature

/kind flake

What this PR does / why we need it:

Which issue(s) this PR fixes:

Fixes #

Special notes for your reviewer:

Does this PR introduce a user-facing change?:


Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@gemini-code-assist
Copy link
Copy Markdown

Summary of Changes

Hello @chrisThePattyEater, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request significantly enhances the GCSFuse CSI driver by introducing and stabilizing the GCSFuse profiles feature. It provides specialized configurations for various AI/ML workloads through new StorageClasses, enabling optimized data access patterns. The changes involve updating deployment configurations, adding new command-line arguments to driver components, and expanding role-based access control to support the new profile-driven functionalities and resource interactions.

Highlights

  • GCSFuse Profiles Enabled: GCSFuse profiles functionality has been enabled across the controller, node, and webhook components of the CSI driver, allowing for optimized GCS access patterns.
  • New StorageClasses Introduced: Three new StorageClasses (gcsfusecsi-training, gcsfusecsi-serving, gcsfusecsi-checkpointing) have been added, each pre-configured with specific GCSFuse mount options and parameters tailored for different AI/ML workloads.
  • Controller Refactoring and RBAC Updates: The controller deployment was refactored, removing dedicated liveness probe and external provisioner containers, with their responsibilities likely integrated or shifted. New ClusterRoles and ClusterRoleBindings were added to grant necessary permissions for bucket scanning, PV patching, and StorageClass access to support the new profile features.
  • Image Pull Policy Standardized: The imagePullPolicy for the GCSFuse CSI driver and webhook sidecar has been consistently set to Always to ensure the latest images are used.
Changelog
  • deploy/base/controller/controller.yaml
    • Removed liveness-probe and csi-external-provisioner containers.
    • Updated gcs-fuse-csi-driver container's imagePullPolicy to Always.
    • Added new arguments to gcs-fuse-csi-driver for enabling profiles, dataflux settings, leader election, and cluster identification.
    • Modified gcs-fuse-csi-driver liveness probe path and port.
    • Introduced new environment variables for namespace, cluster location, and project number, sourced from metadata and a new ConfigMap.
  • deploy/base/controller/controller_setup.yaml
    • Added a new ClusterRole named gcs-fuse-csi-bucket-scanner-role with permissions for pods, persistent volumes, persistent volume claims, storage classes, and nodes.
    • Created a ClusterRoleBinding to associate the gcs-fuse-csi-controller-sa service account with the new gcs-fuse-csi-bucket-scanner-role.
  • deploy/base/node/node.yaml
    • Updated gcs-fuse-csi-driver container's imagePullPolicy to Always.
    • Added --enable-gcsfuse-profiles=true and --enable-gcsfuse-profiles-internal=true arguments to the gcs-fuse-csi-driver.
  • deploy/base/node/node_setup.yaml
    • Granted additional get, list, watch permissions for persistentvolumes and storageclasses to an existing ClusterRole.
  • deploy/base/setup/kustomization.yaml
    • Included storageclass.yaml in the list of resources for Kustomization.
  • deploy/base/setup/storageclass.yaml
    • Added three new StorageClass definitions: gcsfusecsi-training, gcsfusecsi-serving, and gcsfusecsi-checkpointing.
    • Configured each new StorageClass with specific gke-gcsfuse/profile labels, mountOptions, and parameters tailored for AI/ML workloads, including caching and bucket scanning settings.
  • deploy/base/webhook/deployment.yaml
    • Added --enable-gcsfuse-profiles=true argument to the webhook container.
    • Updated SIDECAR_IMAGE_PULL_POLICY environment variable to Always.
  • deploy/base/webhook/webhook_setup.yaml
    • Granted additional get, list, watch permissions for storageclasses to an existing ClusterRole.
Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here.

You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request enables the GCSFuse Profiles feature and marks it as stable. The changes include enabling feature flags across the controller, node, and webhook components, updating RBAC roles with necessary permissions, and adding predefined StorageClasses for common workloads. A notable improvement is the refactoring of the controller deployment, which consolidates sidecar containers into the main driver, simplifying the architecture. However, I have a critical concern: the controller deployment now depends on a ConfigMap named gcsfusecsi-profiles-config, which is not defined within this pull request. This omission will cause the controller Pod to fail on startup, breaking the deployment.

@chrisThePattyEater
Copy link
Copy Markdown
Collaborator Author

/gemini review

Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request successfully moves the GCSFuse Profiles feature into the stable configuration, enabling it by default. The changes across the various Kubernetes manifests for the controller, node, and webhook components are consistent and correctly apply the necessary feature flags and RBAC permissions. The addition of predefined StorageClass definitions for different profiles is also a key part of this feature enablement. I've identified one critical issue in the Makefile that will cause the generate-spec-yaml target to fail. Please see the detailed comment for the fix.

@uriel-guzman
Copy link
Copy Markdown
Collaborator

uriel-guzman commented Feb 11, 2026

The release note says "Releases the GCSFuse Profiles Feature", but that's not what this PR does. Please change to Move Profiles to stable overlay.

@uriel-guzman
Copy link
Copy Markdown
Collaborator

Please also delete the profiles overlay, now that this is merged to stable, the overlay is redundant and serves no purpose anymore.

@chrisThePattyEater chrisThePattyEater force-pushed the stableProfiles branch 2 times, most recently from b987cfd to 4c497c8 Compare February 11, 2026 23:11
@chrisThePattyEater
Copy link
Copy Markdown
Collaborator Author

/gemini review

Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request moves the GCSFuse Profiles feature to the stable overlay, making it generally available. The changes involve updating the Makefile, Kubernetes manifests for the controller, node, and webhook components to enable the feature by default, and adding new RBAC rules and StorageClasses required for the profiles functionality. My review includes suggestions to improve the Makefile's conciseness, align the node DaemonSet's imagePullPolicy with best practices for stable components, and fix formatting issues in YAML files by adding missing newlines.

@chrisThePattyEater
Copy link
Copy Markdown
Collaborator Author

/gemini review

Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request moves the GCSFuse Profiles feature to the stable configuration. The changes look good overall, modifying Kubernetes manifests for the controller, node, and webhook to enable the feature, and adding the necessary RBAC rules and StorageClass definitions to the base. My review focuses on resource management, production readiness of configurations, and file formatting. I have a few suggestions to improve the code quality.

@chrisThePattyEater chrisThePattyEater force-pushed the stableProfiles branch 3 times, most recently from ac2ca88 to f8d07ed Compare February 13, 2026 21:12
@chrisThePattyEater
Copy link
Copy Markdown
Collaborator Author

/gemini review

Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request graduates the GCSFuse Profiles feature to stable by moving its configuration from the profiles overlay into the base manifests. The changes include removing the profiles overlay, updating the Makefile to always apply profile-related configurations, enabling the feature in the controller, node, and webhook components via command-line flags, and adjusting RBAC permissions accordingly. The overall changes are well-structured and align with the goal of making the feature generally available. I have one minor suggestion to improve the Makefile's conciseness.

@chrisThePattyEater chrisThePattyEater force-pushed the stableProfiles branch 3 times, most recently from c78a0b7 to 7944619 Compare February 17, 2026 19:08
@chrisThePattyEater chrisThePattyEater force-pushed the stableProfiles branch 2 times, most recently from 3bf1da5 to 5fe5cbd Compare February 19, 2026 12:59
@chrisThePattyEater chrisThePattyEater force-pushed the stableProfiles branch 5 times, most recently from efefa42 to 38f1db3 Compare March 18, 2026 23:09
@uriel-guzman
Copy link
Copy Markdown
Collaborator

/gemini review

Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request introduces and enables the "gcsfuse profiles" feature across the GCS Fuse CSI driver's controller, node, and webhook components. Key changes include refactoring the controller deployment to consolidate functionality and enable leader election and profile management, updating Kubernetes RBAC roles and bindings to grant necessary permissions for profile-related operations, and adding a new ConfigMap for profiles. The E2E tests were also updated to verify this new functionality. A review comment noted a potential issue with the removal of the CPU limit for the gcs-fuse-csi-driver container in the controller's base deployment, which could lead to uncontrolled resource consumption and impact cluster stability.

@google-oss-prow google-oss-prow bot added the lgtm label Mar 20, 2026
@google-oss-prow
Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: chrisThePattyEater, uriel-guzman

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@chrisThePattyEater chrisThePattyEater merged commit c78267c into GoogleCloudPlatform:main Mar 23, 2026
7 of 10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants