Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bump jetty-server from 9.4.46.v20220331 to 9.4.51.v20230217 #17607

Open
wants to merge 527 commits into
base: main
Choose a base branch
from

Conversation

dependabot[bot]
Copy link
Contributor

@dependabot dependabot bot commented on behalf of github Jun 13, 2023

Bumps jetty-server from 9.4.46.v20220331 to 9.4.51.v20230217.

Release notes

Sourced from jetty-server's releases.

9.4.51.v20230217

Sponsored Release

This is a release of the End of Community Support Jetty 9.x series that was sponsored by a support contract from Webtide.com

Changelog

Dependencies

  • #9269 - Bump ant.version to 1.10.13
  • #9370 - Bump asciidoctorj-diagram to 2.2.4
  • #9364 - Bump eclipse-jarsigner-plugin to 1.4.2
  • #9251 - Bump infinispan.version to 11.0.17.Final
  • #9247 - Bump maven-checkstyle-plugin to 3.2.1
  • #9267 - Bump maven-dependency-plugin to 3.5.0
  • #9365 - Bump maven-deploy-plugin to 3.1.0
  • #9252 - Bump maven-enforcer-plugin to 3.2.1
  • #9363 - Bump maven-invoker-plugin to 3.5.0
  • #9266 - Bump maven-plugin-plugin to 3.7.1
  • #9263 - Bump maven.plugin-tools.version to 3.7.1
  • #9256 - Bump maven.resolver.version to 1.9.4
  • #9368 - Bump maven.surefire.plugin.version to 3.0.0-M9
  • #9362 - Bump maven.version to 3.9.0
  • #9100 - Bump org.apache.aries.spifly.dynamic.bundle to 1.3.6
  • #9103 - Bump org.eclipse.osgi to 3.18.200
  • #9110 - Bump org.eclipse.osgi.services to 3.11.100
  • #9262 - Bump spring-beans to 5.3.25

9.4.50.v20221201

Sponsored Release

This is a release of the End of Community Support Jetty 9.x series that was sponsored by a support contract from Webtide.com

Changelog

  • #8774 - Added SizeLimitHandler
  • #8678 - Jetty client is not responding to GO_AWAY packet received from (Jetty) Server and continue to send traffic on same connection

Dependencies

  • #8826 - Bump infinispan to 11.0.16.Final
  • #8847 - Bump jboss-logmanager to 2.1.19.Final
  • #8849 - Bump jboss-threads to 3.5.0.Final
  • #8961 - Bump jnr-constants to 0.10.4
  • #8951 - Bump protostream to 4.4.4.Final

... (truncated)

Commits
  • b45c405 Updating to version 9.4.51.v20230217
  • 3beaa81 Merge pull request #9368 from eclipse/dependabot/maven/jetty-9.4.x/maven.sure...
  • d382683 Merge pull request #9370 from eclipse/dependabot/maven/jetty-9.4.x/org.asciid...
  • d52d133 Bump maven.surefire.plugin.version from 3.0.0-M8 to 3.0.0-M9
  • 1bc959a Merge pull request #9365 from eclipse/dependabot/maven/jetty-9.4.x/org.apache...
  • 08c89c7 Merge pull request #9364 from eclipse/dependabot/maven/jetty-9.4.x/org.eclips...
  • 2a30aca Merge pull request #9363 from eclipse/dependabot/maven/jetty-9.4.x/org.apache...
  • 6ab783d Merge pull request #9362 from eclipse/dependabot/maven/jetty-9.4.x/maven.vers...
  • 722781d Issue #9181 NPE in SessionHandler (#9346)
  • 922b84b Bump asciidoctorj-diagram from 2.2.3 to 2.2.4
  • Additional commits viewable in compare view

Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

  • @dependabot rebase will rebase this PR
  • @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
  • @dependabot merge will merge this PR after your CI passes on it
  • @dependabot squash and merge will squash and merge this PR after your CI passes on it
  • @dependabot cancel merge will cancel a previously requested merge and block automerging
  • @dependabot reopen will reopen this PR if it is closed
  • @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
  • @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
  • @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
    You can disable automated security fix PRs for this repo from the Security Alerts page.

ssyssy and others added 30 commits May 16, 2023 20:08
### What changes are proposed in this pull request?

This change makes ttl default action be free.
And some changes to make tests passed.

### Why are the changes needed?

Fix #12316

### Does this PR introduce any user facing changes?

No

pr-link: #16823
change-id: cid-142490712d94004a0303f18399d4637e12d81523
… get content hash of uploaded file

Currently when complete is called on a file in Alluxio, a fingerprint of
the file will be created by performing a GetStauts on the file on the
UFS. If due to a concurrent write, the state of the file is different
than what was written through Alluxio, the fingerprint will not actually
match the content of the file in Alluxio. If this happens the state of
the file in Alluxio will always be out of sync with the UFS, and the
file will never be updated to the most recent version.
This is because metadata sync uses the fingerprint to see if the file
needs synchronization, and if the fingerprint does not match the file in
Alluxio there will be inconsistencies.

This PR fixes this by having the contentHash field of the fingerprint be
computed while the file is actually written on the UFS. For object
stores, this means the hash is taken from the result of the call to
PutObject. Unfortunately HDFS does not have a similar interface, so the
content hash is taken just after the output stream is closed to complete
the write. There could be a small chance that someone changes the file
in this window between the two operations.

pr-link: #16597
change-id: cid-64723be309bdb14b05613864af3b6a1bb30cba6d
What changes are proposed in this pull request?
Update cn version of Spark on Kubernetes doc.

Why are the changes needed?
There is no corresponding Chinese documentation for upgrade.

Does this PR introduce any user facing changes?
More Chinese users can access Alluxio documentation more easily.

pr-link: #16855
change-id: cid-59e640d1ad5bd270d71546d226fa9f546607cf93
### What changes are proposed in this pull request?

Rename PROXY_S3_OPTIMIZED_VERSION_ENABLED to PROXY_S3_V2_VERSION_ENABLED
in comment.

### Why are the changes needed?
Using a error property about how to enable the s3 v2 api in
`alluxio.proxy.s3.S3RequestServlet`.

pr-link: #16896
change-id: cid-b10e399e4d94511c1d0c134fe5ab171c95a8f1c8
### What changes are proposed in this pull request?

Fix typo.

### Why are the changes needed?

NA

### Does this PR introduce any user facing changes?

NA

pr-link: #16917
change-id: cid-4bd1a54d173b081b75c97b7132c03f492d8b748e
Fixes Alluxio/Community#624
Alluxio/Community#624

pr-link: #16871
change-id: cid-1c61908eb034cdb6d84b5510798ac8c2c7c029e9
…File

Support overwrite option in createFile

before this change, if we have the same name file existing in Alluxio,
we will try `getStatus`, `deleteFile`, and then create the new one. now
we just need to call `createFile` with overwrite option. no matter in
hdfs api or s3 api. Excessive RPCs are saved.

add a new option in CreateFileOption for overwriting.

pr-link: #16886
change-id: cid-5b84132d9c4da731b7d1bbf35d71885052e8c5b0
### What changes are proposed in this pull request?

Fix typo.

pr-link: #16751
change-id: cid-ef5fa5eab7cbfa6e424d514b9745c0cf41fb5a98
…tyCommandTest

As the title. If Options has a WorkerInfoField which POptions does not
have, or if POptions has a WorkerInfoField which Options does not have,
this test will be failed. The latest test version can not check these
two error, as shown in the PR below.

[Add missing variant in gRPC
WorkerInfoField](#16457)

No.

pr-link: #16507
change-id: cid-23fa04dbd9b0402bff37ddb8ae42f5ec6e18f719
### What changes are proposed in this pull request?
Added benchmarks for `PagedBlockStore` that read from local storage
rather than UFS.

### Why are the changes needed?
This piece is missing as `PagedBlockStore` didn't support creating local
blocks then.

### Does this PR introduce any user facing changes?
No.

pr-link: #16804
change-id: cid-5e0226beb45ae714cae4417c43076f0857cdf7c6
### What changes are proposed in this pull request?

Adding metrics sink to job master.

### Why are the changes needed?

Fix the issue that the job master is unable to sink metrics.

### Does this PR introduce any user facing changes?

Yes, this change will enable users to sink metrics from the job master.

pr-link: #16899
change-id: cid-7394471270d4617007eeb97e1674b90585337624
Add read limit for s3 proxy when getObject return files.

We use NVME to speed up reading algorithm model, but we find that the
reading speed of alluxio is too fast and k8s container will consume a
lot of network card resources, and then affect other containers of the
same host, so we need to limit the reading speed.

Add two properties:
1. `alluxio.proxy.s3.global.read.rate.limit.mb` to limit all connections
rate;
2. `alluxio.proxy.s3.single.connection.read.rate.limit.mb` to limit
single connection rate.

pr-link: #16866
change-id: cid-613baec7d469bb68b3c75343c49d6822ee4bd1a6
### What changes are proposed in this pull request?

Fix potential bugs in freeWorker command.

### Why are the changes needed?

When a worker has been decommissioned, its metadata can not be got by
calling `getWorkerInfolist()`. This method accesses
`LoadingCache<String, List<WorkerInfo>> mWorkerInfoCache` in
`DefaultBlockMaster.java`, which will not refresh instantly.

As to method `removeDecommissionedWorker()` in
`BlockMasterClientServiceHandler.java`, if we don't add FieldRanges, the
list `decommissionedWorkers` would not get enough information to run the
loop below successfully, though the worker has been decommissioned.

### Does this PR introduce any user facing changes?

No.

pr-link: #16458
change-id: cid-101865dc9ec4f40e7561f81f38287c6efc2ae23f
…ss than expected

Fix a bug where `fs head` and `fs tail` output less data than it is
expected to.

The code is buggy: it only calls `read` once, and does not check if the
returned number of bytes read is equal to the total number of bytes to
read as specified by the cli option.

Compare with the `cat` command:

https://github.com/Alluxio/alluxio/blob/73f3ce83c8a3ef77ac3eebb4579bb7d412784ec9/shell/src/main/java/alluxio/cli/fs/command/CatCommand.java#L57-L63

No.

pr-link: #16928
change-id: cid-86b76a3444fa9efe2cd63a4b42a42e4f62b8f21b
…dfsFileInputStream

Implement unbuffer interface for HdfsFileInputStream. Fix #16016.

If the unbuffer method is not implemented, then impala will not be able
to use the file handle cache.

Implement CanUnbuffer and StreamCapabilities for HdfsFileInputStream.

pr-link: #16017
change-id: cid-b50163c7b4f199b8a61d5818a0e4739039f2745c
…sticHashPolicy

Add a new block location policy `CapacityBaseDeterministicHashPolicy`.

We want a `CapacityBaseRandomPolicy` that is deterministic.

See also #16187.

Yes, a new block location policy is available for config item
`alluxio.user.ufs.block.read.location.policy` and
`alluxio.user.block.write.location.policy.class`.

pr-link: #16237
change-id: cid-47ba9b1d197b5ad546ac1a993590d49e963c3811
### What changes are proposed in this pull request?

Incorrect usage of flag in atomic rename for the final step of
completing the target multipart-upload file.

### Why are the changes needed?

if write type is cache_thru or thru, the atomic rename ( delete target
and rename src to target ) will incorrectly delete
alluxio-only instead of deleting UFS, hence making the renaming op in
UFS fail.

### Does this PR introduce any user facing changes?
N/A

pr-link: #16941
change-id: cid-b38904c24dee066adac2f854127f2d877bd21dcd
### What changes are proposed in this pull request?

When the metadata sync descendant type is NONE, stop loading the
children of the sync root.

If a metadata sync is trigged by a GetStatus() call on a directory
Previous behavior: The directory itself, as well as all its sub
directories in the inode store will be synced.
New behavior: ONLY the directory itself will be loaded.

### Why are the changes needed?

This PR addresses #16922.
The incorrect metadata sync behavior on GetStatus for a directory loads
more children of the directory than expected and put a lot of pressure
on UFS side.

### Does this PR introduce any user facing changes?

Yes. The metadata sync behavior has been changed. See the comment above.
The previous behavior was actually wrong and we added a hidden feature
flag to allow customers to fallback.

pr-link: #16935
change-id: cid-2a5a2b4959422ecff74149881e400659d07c2163
…ker for pagestore when free/delete file

Support removeBlock for pagestore.

To remove metadata and data of blocks and pages on worker when free or
delete a file.

N/A

pr-link: #16895
change-id: cid-a6cc6c0074907f62b9778a8a1cfc0e9f61e74135
### What changes are proposed in this pull request?
Fix client stressbench concurrency problem.

### Why are the changes needed?
Reproduce:
Cluster:
1 master and 2 workers

Command:
`bin/alluxio runClass alluxio.stress.cli.client.StressClientIOBench
--operation Write --base alluxio:///stress-client-io-base
--write-num-workers 2 --file-size 1m --threads 8`

Result: user_root.log
<img width="1152" alt="image"
src="https://user-images.githubusercontent.com/42070967/220555496-c275578d-9eb7-4244-b897-9e5142d977d1.png">

### Does this PR introduce any user facing changes?

Please list the user-facing changes introduced by your change, including
1. change in user-facing APIs
2. addition or removal of property keys
3. webui

pr-link: #16934
change-id: cid-10a6a78a50a8a8bcac455a1bc7f7d1fe43c3642a
### What changes are proposed in this pull request?

Fix the wrong option in stress bench doc

### Why are the changes needed?

Please clarify why the changes are needed. For instance,
1. If you propose a new API, clarify the use case for a new API.
2. If you fix a bug, describe the bug.

### Does this PR introduce any user facing changes?

Please list the user-facing changes introduced by your change, including
1. change in user-facing APIs
2. addition or removal of property keys
3. webui

pr-link: #16925
change-id: cid-923b234e2c29b132b5fbafdfdb64b9903ae5a464
It will through ArrayOutOfBoundException if we build alluxio in a node
which have no git installed, and the `VERSION` would be shorter than 8,
even empty string, so substring(8) cannot work anymore.

This PR check there are more than 8 chars in the `VERSION` first,
otherwise, do not cut the `VERSION` string.

pr-link: #16888
change-id: cid-4e02cc9214317d86bba9d00a6121c5f013dd3255
### What changes are proposed in this pull request?
Improve listStatus 5X performance in some scenarios.

### Why are the changes needed?
For instance,
Under the scenario:
1. Use Hadoop compatible system to access Alluxio(listStatus)
2. There are many mount point such as more than 500.
3. There are more than 2000 files in a directory.

The PathUtils.hasPrefix (comes from MountTable.getMountPoint)method will
be called at least 10w (500 * 2000) times.
But actually we don't need the information of mount point.
The test can be reduced from about 400ms to 70ms under the master
branch.
The test can be reduced from about 700ms to about 100ms under 2.7.1
branch.

### Does this PR introduce any user facing changes?

Please list the user-facing changes introduced by your change, including
no

pr-link: #16893
change-id: cid-71d9a351744033426fb1b0633d7b194f94f322b5
…g.org/x/net to 0.7.0 in /integration/docker/csi

Bumps [golang.org/x/net](https://github.com/golang/net) from
0.0.0-20210510120150-4163338589ed to 0.7.0.
<details>
<summary>Commits</summary>
<ul>
<li>See full diff in <a
href="https://github.com/golang/net/commits/v0.7.0">compare
view</a></li>
</ul>
</details>
<br />

[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=golang.org/x/net&package-manager=go_modules&previous-version=0.0.0-20210510120150-4163338589ed&new-version=0.7.0)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot merge` will merge this PR after your CI passes on it
- `@dependabot squash and merge` will squash and merge this PR after
your CI passes on it
- `@dependabot cancel merge` will cancel a previously requested merge
and block automerging
- `@dependabot reopen` will reopen this PR if it is closed
- `@dependabot close` will close this PR and stop Dependabot recreating
it. You can achieve the same result by closing it manually
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)
- `@dependabot use these labels` will set the current labels as the
default for future PRs for this repo and language
- `@dependabot use these reviewers` will set the current reviewers as
the default for future PRs for this repo and language
- `@dependabot use these assignees` will set the current assignees as
the default for future PRs for this repo and language
- `@dependabot use this milestone` will set the current milestone as the
default for future PRs for this repo and language

You can disable automated security fix PRs for this repo from the
[Security Alerts
page](https://github.com/Alluxio/alluxio/network/alerts).

</details>

pr-link: #16947
change-id: cid-6d9f72601394aed56df5d25eeee43eeed668a502
Currently if user specifies `MaxRamPercentage` without specifying `Xmx`,
Alluxio still gives a defualt `Xmx` which will override the
`MaxRamPercentage` because of priority. Fix this by if user specifies
`MaxRamPercentage` we don't give a default `Xmx`.

First step of solving #10083
Replace #15819

pr-link: #16940
change-id: cid-8f52b90408f6d3a2ba8ee0cf6c623fd85e6b9e15
…: Remove the restriction of UFS for local cache

Please outline the changes and how this PR fixes the issue.

Please clarify why the changes are needed. For instance,
1. If you propose a new API, clarify the use case for a new API.
2. If you fix a bug, describe the bug.

Please list the user-facing changes introduced by your change, including
1. change in user-facing APIs
2. addition or removal of property keys
3. webui

pr-link: #16819
change-id: cid-66e83e07bfcb549398dc45942b475a431d777aa7
### What changes are proposed in this pull request?
This pr support display master system status in master's web ui. as
below.
<img width="674" alt="Snipaste_2023-01-17_10-30-54"
src="https://user-images.githubusercontent.com/39544641/212797561-31608c69-f3a7-4fbf-b4cb-b9953f578cbe.png">


### Why are the changes needed?
Sometimes, we want to know cluster info from web ui, and system status
is important to check if master is healthy. so it's more convenient for
users to know master health status on web ui.

### Does this PR introduce any user facing changes?
no

pr-link: #16779
change-id: cid-138f10111eaa5bfa6b13a7919051f510b94d74fd
### What changes are proposed in this pull request?

Modify for DoraCacheFileSystem extensibility

### Why are the changes needed?

Enable create Doraclient outside of DoraCacheFileSystem.

### Does this PR introduce any user facing changes?
NA
			pr-link: #17436
			change-id: cid-4d552f7412c2298b763e371f450cfba797dee80c
### What changes are proposed in this pull request?

Modify for grpc tls config and FileSystemContext extension.

### Why are the changes needed?

It is possible to tell grpc channel to always use TLS connection and user can define their own FileSystemContext extension.

### Does this PR introduce any user facing changes?
NA
			pr-link: #17443
			change-id: cid-31c29d9cf765a6dac8b7cfb6492c97613e164b36
LuQQiu and others added 20 commits June 5, 2023 11:06
			pr-link: #17559
			change-id: cid-eb3629ddd73239a8462465310f2c93f933485030
1. Support more rocksdb options in dora meta store
2. Add a microbench to profile the dora meta store result
3. Removed the memory metadata cache based on the profiling result  
4. Introduced a DoraMetaManager to handle data loading/ page cache invalidation
5. Introduced fingerprint to determine if file contents are changed.  

Performance testing: 
Microbench result on a single worker with a metastore storing 10m metadata entries
Rocks + 32MB rocks block cache:
Read op/s 81k (1 thread)/ 143k (16 threads)
Write op/s 285k (1 thread)/ 196k (16 threads)

Rocks + 1GB rocks block cache:
Read op/s 163k (1 thread)/ 480k (16 threads)
Write op/s 286k (1 thread)/ 134k (16 threads)

Rocks + 4GB on-heap cache:
Read ops 560k (1 thread)/ OOM (16 threads)
Write ops 330k (1 thread)/ 363k (16 threads)
-> Observed severe GC issue when using an on-heap cache 
<img width="1386" alt="Screen Shot 2023-05-29 at 4 16 52 PM" src="https://github.com/Alluxio/alluxio/assets/6771554/b156d4c9-97ba-4216-929c-4c81b4f5ce3c">


Both rocksDB built-in cache approaches meet our performance requirement and given that the GC issue of on-heap cache, we decided to abandon the on-heap memory cache. 

			pr-link: #17458
			change-id: cid-220612ec553b4d747136abe5363280aa07c376d0
### What changes are proposed in this pull request?

Adding the predicates for move jobs in order to be triggered by the policy engine.

### Why are the changes needed?

Adding two predicates:
1. unmodifiedFor
2. dateFromFileNameOlderThan

### Does this PR introduce any user facing changes?

NA

			pr-link: #17525
			change-id: cid-e6b43bc8f0281ba4a3a06c9aa187f7a3331bc4c2
Fix the bug that Alluxio Client is blocked when it requests to write an empty file.
			pr-link: #17562
			change-id: cid-5e05464ac01b3316d0c151a992042ac9a1f1eeca
### What changes are proposed in this pull request?
1. refactor move API for ee
2. add get mount Id API so we can use this API to get correct ufs in ee

### Why are the changes needed?

na

### Does this PR introduce any user facing changes?

na

			pr-link: #17565
			change-id: cid-81489ef469d4134526b38b263dd1ef57f926cc85
### What changes are proposed in this pull request?

Fix LocalPageStore NPE.

### Why are the changes needed?

I encountered the following exception while using local cache

```
2023-05-31T17:25:13.453+0800    ERROR   20230531_092513_00010_uqx2a.1.0.0-7-153 alluxio.client.file.cache.NoExceptionCacheManager       Failed to put page PageId{FileId=76f9c79d5d43c725de31295c263291e0, PageIndex=534}, cacheContext CacheContext{cacheIdentifier=null, cacheQuota=alluxio.client.quota.CacheQuota$1@1f, cacheScope=CacheScope{id=.}, hiveCacheContext=null, isTemporary=false}
java.lang.NullPointerException: Cannot invoke "String.contains(java.lang.CharSequence)" because the return value of "java.lang.Exception.getMessage()" is null
        at alluxio.client.file.cache.store.LocalPageStore.put(LocalPageStore.java:80)
        at alluxio.client.file.cache.LocalCacheManager.putAttempt(LocalCacheManager.java:345)
        at alluxio.client.file.cache.LocalCacheManager.putInternal(LocalCacheManager.java:274)
        at alluxio.client.file.cache.LocalCacheManager.put(LocalCacheManager.java:234)
        at alluxio.client.file.cache.CacheManagerWithShadowCache.put(CacheManagerWithShadowCache.java:52)
        at alluxio.client.file.cache.NoExceptionCacheManager.put(NoExceptionCacheManager.java:55)
        at alluxio.client.file.cache.CacheManager.put(CacheManager.java:196)
        at alluxio.client.file.cache.LocalCacheFileInStream.localCachedRead(LocalCacheFileInStream.java:218)
        at alluxio.client.file.cache.LocalCacheFileInStream.bufferedRead(LocalCacheFileInStream.java:144)
        at alluxio.client.file.cache.LocalCacheFileInStream.readInternal(LocalCacheFileInStream.java:242)
        at alluxio.client.file.cache.LocalCacheFileInStream.positionedRead(LocalCacheFileInStream.java:287)
        at alluxio.hadoop.HdfsFileInputStream.read(HdfsFileInputStream.java:153)
        at alluxio.hadoop.HdfsFileInputStream.readFully(HdfsFileInputStream.java:170)
        at org.apache.hadoop.fs.FSDataInputStream.readFully(FSDataInputStream.java:111)
        at io.trino.filesystem.hdfs.HdfsInput.readFully(HdfsInput.java:42)
        at io.trino.plugin.hive.parquet.TrinoParquetDataSource.readInternal(TrinoParquetDataSource.java:64)
        at io.trino.parquet.AbstractParquetDataSource.readFully(AbstractParquetDataSource.java:120)
        at io.trino.parquet.AbstractParquetDataSource$ReferenceCountedReader.read(AbstractParquetDataSource.java:330)
        at io.trino.parquet.ChunkReader.readUnchecked(ChunkReader.java:31)
        at io.trino.parquet.reader.ChunkedInputStream.readNextChunk(ChunkedInputStream.java:149)
        at io.trino.parquet.reader.ChunkedInputStream.read(ChunkedInputStream.java:93)
```

### Does this PR introduce any user facing changes?

NO

			pr-link: #17556
			change-id: cid-6dd42d35817816cba35fa52afe95d154bf9d9acf
### What changes are proposed in this pull request?

- Add delete/rename/createDirectory RPC.
   Invalidate metadata and data if file/dir is deleted or renamed.
- Continue operations in DoraFileOutStream.close() when exception happens.
- reduce worker block heartbeat interval.
- decrease Netty close timeout value.
- add PropertyKeys in MultiProcessCluster for Dora.
- Add PropertyKeys in AbstractFuseDoraTest for Dora.
- use different names to avoid test conflicts in FuseFileSystemMetadataTest


### Why are the changes needed?

Client writes data synchronously to worker PagingStore as a cache, and to UFS as write through.
So delete/rename/createDirectory RPCs are going to do metadata and data operations and invalidations on worker side.

### Does this PR introduce any user facing changes?

N/A

			pr-link: #17545
			change-id: cid-b8905052e043bbf9142b40ca3d1e3c3773013e98
Update FUSE SDK docs
			pr-link: #17529
			change-id: cid-3a5226a850291041f2ac073371de219330444553
Correct some information in the README.md for docker.
			pr-link: #17387
			change-id: cid-79265df0f0843bc324c950cd8d1eed667c71f30c
### What changes are proposed in this pull request?

Please outline the changes and how this PR fixes the issue.

### Why are the changes needed?

Please clarify why the changes are needed. For instance,
  1. If you propose a new API, clarify the use case for a new API.
  2. If you fix a bug, describe the bug.

### Does this PR introduce any user facing changes?

Please list the user-facing changes introduced by your change, including
  1. change in user-facing APIs
  2. addition or removal of property keys
  3. webui

			pr-link: #17578
			change-id: cid-7df58ee0748c1e25e0eae47e4409bf37bc7a8594
Bump Apache Ratis version to 2.5.1

Followup to #17394.
			pr-link: #17571
			change-id: cid-a247f1042687ead5ac2d3742bc2de4428f42baf3
### What changes are proposed in this pull request?

Modify interface for extension

### Why are the changes needed?

In some situation, eg. permission check, it is requiring to inherit the function to add extra check.

### Does this PR introduce any user facing changes?
NA
			pr-link: #17586
			change-id: cid-a507ccf2453149e4803d8fe1ea135fa1389d299e
### What changes are proposed in this pull request?

1. Introduced an iterable UFS status listing interface
2. Avoid calling getStatus from dora worker. Passing the UfsStatus via grpc request  
3. Add integration test for Dora load command
4. Provide users with an option to only load metadata 

### Why are the changes needed?

Currently during load, for each file, a getStatus() is called and this is inefficient. This PR does the listing on the scheduler side and send it to workers via rpc.


### Does this PR introduce any user facing changes?

load command can run with an --metadataOnly option to only load metadata
			pr-link: #17538
			change-id: cid-be3ea2532d0c7a21ff5d1aa9e9871fb4c0df6fd6
### What changes are proposed in this pull request?

Modify interface for extension

### Why are the changes needed?

Modify interface for extension


			pr-link: #17590
			change-id: cid-473b7ac28483a42c28c63a574d4fb9a533395c05
### What changes are proposed in this pull request?

Update shell of mount ramdisk

### Why are the changes needed?

Alluxio's original tier path is set by `alluxio.worker.tieredstore.level0.dirs.path`. However, in branch main, this property is removed. So I modify `bin/alluxio-common.sh` and let the value of `tier_path` be equal to `worker.page.store.dirs`.

### Does this PR introduce any user facing changes?

No.
			pr-link: #17568
			change-id: cid-dd66f7823dff5afc45737ccb9a3fe0c6c11e5a87
### What changes are proposed in this pull request?

Redirect the err output to stderr, just like how we redirect to stdout

			pr-link: #17600
			change-id: cid-2cea974b7cf5725a6889f7e3bf281279e1487793
### What changes are proposed in this pull request?
Modify the visibility and inheritance of some interfaces

### Why are the changes needed?
Modify the visibility and inheritance of some interfaces


			pr-link: #17601
			change-id: cid-11e1459ed874f67c2cb17fcf31114c8d5e54786c
### What changes are proposed in this pull request?

Make mount command work in dora

### Why are the changes needed?

na

### Does this PR introduce any user facing changes?

na

			pr-link: #17606
			change-id: cid-e8f88e0ae0f0b14dda70d6ca7db4e8935fd4e6f9
### What changes are proposed in this pull request?

Fix move job tasks didn't picking up active workers.

### Why are the changes needed?

Fix move job bugs

### Does this PR introduce any user facing changes?
na

			pr-link: #17604
			change-id: cid-e668e9d50017a6a6c37f15daaec3ac348ab8033d
Bumps [jetty-server](https://github.com/eclipse/jetty.project) from 9.4.46.v20220331 to 9.4.51.v20230217.
- [Release notes](https://github.com/eclipse/jetty.project/releases)
- [Commits](jetty/jetty.project@jetty-9.4.46.v20220331...jetty-9.4.51.v20230217)

---
updated-dependencies:
- dependency-name: org.eclipse.jetty:jetty-server
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <[email protected]>
@dependabot dependabot bot added dependencies Pull requests that update a dependency file java Pull requests that update Java code labels Jun 13, 2023
@alluxio-bot
Copy link
Contributor

Thank you for your pull request.
In order for us to evaluate and accept your PR, we ask that you sign a contribution license agreement (CLA).
It's all electronic and will take just a few minutes. Please download CLA form here, sign, and e-mail back to [email protected]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
cla-missing dependencies Pull requests that update a dependency file java Pull requests that update Java code
Projects
None yet
Development

Successfully merging this pull request may close these issues.