Skip to content

Conversation

@ZTE-EBASE
Copy link

gpfdist, Cloudberry's parallel file distribution program, traditionally required data files to be co-located with the gpfdist process. This limitation made it cumbersome to load data from remote servers, often requiring an extra data transfer step. This commit addresses the issue of gpfdist logs continuously growing and occupying a large amount of disk space in a persistent working scenario.

libssh2-devel is introduced as a dependency package for the new feature in the PR #1226.

Fixes #ISSUE_Number

What does this PR do?

Type of Change

  • Bug fix (non-breaking change)
  • New feature (non-breaking change)
  • Breaking change (fix or feature with breaking changes)
  • Documentation update

Breaking Changes

Test Plan

  • Unit tests added/updated
  • Integration tests added/updated
  • Passed make installcheck
  • Passed make -C src/test installcheck-cbdb-parallel

Impact

Performance:

User-facing changes:

Dependencies:

Checklist

Additional Context

CI Skip Instructions


protocol

gpfdist, Cloudberry's parallel file distribution program,
traditionally required data files to be co-located with the gpfdist
process. This limitation made it cumbersome to load data from remote
servers, often requiring an extra data transfer step.
This commit addresses the issue of gpfdist logs continuously growing
and occupying a large amount of disk space in a persistent working
scenario.

libssh2-devel is introduced as a dependency package for the new feature
in the PR apache#1226.
@tuhaihe
Copy link
Member

tuhaihe commented Oct 16, 2025

Hi @ZTE-EBASE, please also add the dependency to this Ubuntu Dockerfile: https://github.com/apache/cloudberry/blob/main/devops/deploy/docker/build/ubuntu22.04/Dockerfile.

Installing libssh2 Dependencies on Ubuntu (dockerfile)
@ZTE-EBASE
Copy link
Author

Hi,Could you send the specific information of the error logs and the use cases?

@ZTE-EBASE
Copy link
Author

Hi, What is the command to install the libssh2 dependency on Ubuntu? -- libssh2-1-dev is wrong?

@tuhaihe
Copy link
Member

tuhaihe commented Oct 17, 2025

Hi, What is the command to install the libssh2 dependency on Ubuntu? -- libssh2-1-dev is wrong?

Hi there, libssh2-1-dev is right.

Copy link
Member

@tuhaihe tuhaihe left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks for your contribution.

Copy link

@xtangcode xtangcode left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tuhaihe tuhaihe merged commit 31f58e1 into apache:main Oct 17, 2025
48 of 50 checks passed
@avamingli
Copy link
Contributor

Should we squash the commits into one to keep the history simple and clean?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants