Skip to content

Reuse libcudf dependencies for Java JNI build when they are available #18682

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 11 commits into from
May 13, 2025

Conversation

ttnghia
Copy link
Contributor

@ttnghia ttnghia commented May 6, 2025

This modifies CMake build for Java JNI, adding the environment variable CUDF_INSTALL_DIR that allows to specify the path of packages that have been installed alongside with libcudf. Having this, we can avoid pulling dependencies multiple times when they are already available.

Closes #18656.

@ttnghia ttnghia self-assigned this May 6, 2025
@ttnghia ttnghia requested review from a team as code owners May 6, 2025 18:44
@ttnghia ttnghia requested a review from msarahan May 6, 2025 18:44
@ttnghia ttnghia added feature request New feature or request 3 - Ready for Review Ready for review by team Java Affects Java cuDF API. Spark Functionality that helps Spark RAPIDS labels May 6, 2025
@github-actions github-actions bot added the CMake CMake build issue label May 6, 2025
@ttnghia ttnghia added the non-breaking Non-breaking change label May 6, 2025
ttnghia added 3 commits May 6, 2025 12:00
Signed-off-by: Nghia Truong <[email protected]>
Signed-off-by: Nghia Truong <[email protected]>
Signed-off-by: Nghia Truong <[email protected]>
Copy link
Contributor

@vyasr vyasr left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving the build.sh change for packaging-codeowners since it only affects the Java build.

@ttnghia
Copy link
Contributor Author

ttnghia commented May 13, 2025

/merge

@rapids-bot rapids-bot bot merged commit eaa23f4 into rapidsai:branch-25.06 May 13, 2025
124 checks passed
@ttnghia ttnghia deleted the optimize_cmake_jni branch May 13, 2025 16:39
ttnghia added a commit to NVIDIA/spark-rapids-jni that referenced this pull request May 14, 2025
This modifies CMake build to search for dependency packages that have
been installed alongside with libcudf. Having this, we can avoid pulling
dependencies multiple times when they are already available. There are
also a few minor cleanup are performed in this work.

Depends on:
 * rapidsai/cudf#18682

---------

Signed-off-by: Nghia Truong <[email protected]>
rapids-bot bot pushed a commit that referenced this pull request May 19, 2025
fix #18851,  as a follow-up of #18682. 

Verified with internal pipeline.

Authors:
  - Peixin (https://github.com/pxLi)
  - Nghia Truong (https://github.com/ttnghia)

Approvers:
  - Tim Liu (https://github.com/NvTimLiu)

URL: #18852
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
3 - Ready for Review Ready for review by team CMake CMake build issue feature request New feature or request Java Affects Java cuDF API. non-breaking Non-breaking change Spark Functionality that helps Spark RAPIDS
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[FEA] When building cudf JNI, reuse libcudf dependencies when they are available
3 participants