|
15 | 15 | Apache Hadoop ${project.version} |
16 | 16 | ================================ |
17 | 17 |
|
18 | | -Apache Hadoop ${project.version} is an update to the Hadoop 3.4.x release branch. |
| 18 | +Apache Hadoop ${project.version} is the first stable release of the Apache Hadoop 3.5 line. |
19 | 19 |
|
20 | 20 | Overview of Changes |
21 | 21 | =================== |
22 | 22 |
|
23 | 23 | Users are encouraged to read the full set of release notes. |
24 | 24 | This page provides an overview of the major changes. |
25 | 25 |
|
26 | | -New binary distribution |
27 | | ------------------------ |
| 26 | +Java 17 Support |
| 27 | +--------------- |
28 | 28 |
|
29 | | -As of v3.4.2, Hadoop will only be distributed with a lean tarball, which excludes the full AWS SDK v2 bundle to reduce |
30 | | -overall file size. This release has been tested with AWS SDK v2 2.29.52, which can be downloaded from Maven |
31 | | -[here](https://mvnrepository.com/artifact/software.amazon.awssdk/aws-sdk-java/2.29.52). |
| 29 | +This is the first Hadoop release with full support for Java 17. On the server side, Java 17 is required. On the client |
| 30 | +side, Java 17 and Java 21 are supported. |
32 | 31 |
|
33 | | -S3A improvements |
34 | | ----------------- |
| 32 | +HDFS Optimizations |
| 33 | +------------------ |
35 | 34 |
|
36 | | -**Improvement** |
| 35 | +HDFS has implemented new optimizations for finer-grained locking on concurrent NameNode operations and asynchronous RPC |
| 36 | +processing in router-based federation. |
37 | 37 |
|
38 | | -[HADOOP-19363](https://issues.apache.org/jira/browse/HADOOP-19363) S3A: Support analytics-accelerator-s3 input streams |
39 | | -for parquet read performance. |
| 38 | +GCS FileSystem |
| 39 | +-------------- |
40 | 40 |
|
41 | | -[HADOOP-19256](https://issues.apache.org/jira/browse/HADOOP-19256) S3A: Adds support for S3 Conditional Writes. |
| 41 | +Apache Hadoop now includes a `FileSystem` implementation that integrates with Google Cloud Storage buckets. |
42 | 42 |
|
43 | | -ABFS improvements |
44 | | ------------------ |
| 43 | +WASB Removed |
| 44 | +------------ |
45 | 45 |
|
46 | | -**Improvement** |
| 46 | +The WASB `FileSystem` that was previously deprecated has been removed from the codebase. Use ABFS instead. |
47 | 47 |
|
48 | | -[HADOOP-19179](https://issues.apache.org/jira/browse/HADOOP-19179) ABFS: [FnsOverBlob] Support FNS Accounts over |
49 | | -BlobEndpoint. |
| 48 | +YARN Capacity Scheduler UI |
| 49 | +-------------------------- |
50 | 50 |
|
51 | | -[HADOOP-19474](https://issues.apache.org/jira/browse/HADOOP-19474) ABFS: [FnsOverBlob] Listing Optimizations to avoid |
52 | | -multiple iteration over list response. |
| 51 | +This release adds a new modern UI for monitoring the Capacity Scheduler and dynamically editing its configuration. |
53 | 52 |
|
54 | | -[HADOOP-19543](https://issues.apache.org/jira/browse/HADOOP-19543) ABFS: [FnsOverBlob] Remove Duplicates from Blob |
55 | | -Endpoint Listing Across Iterations. |
| 53 | +JUnit 5 Upgrade |
| 54 | +--------------- |
| 55 | + |
| 56 | +For developers working on the codebase, all tests have been upgraded from JUnit 4 to JUnit 5. All new tests must utilize |
| 57 | +JUnit 5 going forward. |
56 | 58 |
|
57 | 59 | Transitive CVE fixes |
58 | 60 | -------------------- |
59 | 61 |
|
60 | 62 | A lot of dependencies have been upgraded to address recent CVEs. |
61 | | -Many of the CVEs were not actually exploitable through the Hadoop |
| 63 | +Many of the CVEs were not actually exploitable through Hadoop |
62 | 64 | so much of this work is just due diligence. |
63 | | -However, applications which have all the library is on a class path may |
| 65 | +However, applications which have all the libraries on a class path may |
64 | 66 | be vulnerable, and the upgrades should also reduce the number of false |
65 | 67 | positives security scanners report. |
66 | 68 |
|
|
0 commit comments