Skip to content

HDFS-17912. HttpFS: honor HTTPFS_CONFIG when sourcing httpfs-env.sh#8456

Open
eubnara wants to merge 1 commit intoapache:trunkfrom
eubnara:HDFS-17912
Open

HDFS-17912. HttpFS: honor HTTPFS_CONFIG when sourcing httpfs-env.sh#8456
eubnara wants to merge 1 commit intoapache:trunkfrom
eubnara:HDFS-17912

Conversation

@eubnara
Copy link
Copy Markdown
Contributor

@eubnara eubnara commented Apr 25, 2026

Description of PR

hadoop-httpfs.sh sourced httpfs-env.sh from HADOOP_CONF_DIR only, even though HTTPFS_CONFIG is already honored for -Dhttpfs.config.dir in the same script. Use ${HTTPFS_CONFIG:-${HADOOP_CONF_DIR}} so both paths agree. Backward compatible.

See description on https://issues.apache.org/jira/browse/HDFS-17912, please.

How was this patch tested?

Manually test on private cluster

For code changes:

  • Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?

hadoop-httpfs.sh sourced httpfs-env.sh from HADOOP_CONF_DIR only,
even though HTTPFS_CONFIG is already honored for -Dhttpfs.config.dir
in the same script. Use ${HTTPFS_CONFIG:-${HADOOP_CONF_DIR}} so both
paths agree. Backward compatible.
@hadoop-yetus
Copy link
Copy Markdown

💔 -1 overall

Vote Subsystem Runtime Logfile Comment
+0 🆗 reexec 0m 0s Docker mode activated.
-1 ❌ patch 0m 21s #8456 does not apply to trunk. Rebase required? Wrong Branch? See https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute for help.
Subsystem Report/Notes
Console output https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8456/1/console
versions git=2.34.1
Powered by Apache Yetus 0.14.1 https://yetus.apache.org

This message was automatically generated.

Copy link
Copy Markdown

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Aligns hadoop-httpfs.sh behavior so that httpfs-env.sh is sourced from the same configuration directory that -Dhttpfs.config.dir already uses (i.e., honoring HTTPFS_CONFIG when set).

Changes:

  • Source httpfs-env.sh from ${HTTPFS_CONFIG:-${HADOOP_CONF_DIR}} instead of always ${HADOOP_CONF_DIR}.
  • Keeps backward-compatible defaulting to HADOOP_CONF_DIR when HTTPFS_CONFIG is unset/empty.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants