Code

[WIP] Enable FUSE SDK with S3 test#16808

Code

Draft

LuQQiu wants to merge 37 commits intoAlluxio:mainAlluxio/alluxio:mainfrom LuQQiu:enableS3TestsLuQQiu/alluxio:enableS3TestsCopy head branch name to clipboard

+12,026-620

Commits

Commits on Nov 21, 2022

• Remove the restriction of UFS for SDK

  Show description for 600c84e
  JiamingMai

  authored
  600c84e

  Copy full SHA for 600c84e

Commits on Dec 1, 2022

• Add property key to enable dora client read location policy

  Show description for 1e8670c
  beinan

  authored
  1e8670c

  Copy full SHA for 1e8670c

Commits on Dec 5, 2022

• Implement the skeleton of dora worker

  Show description for 97b08d2
  beinan

  authored
  97b08d2

  Copy full SHA for 97b08d2

Commits on Dec 7, 2022

• [SIKPCI]Add method to get file status

  Show description for 2795075
  JiamingMai

  authored
  2795075

  Copy full SHA for 2795075

Commits on Dec 8, 2022

• Fix and improve dora test

  Show description for ad2dab6
  beinan

  authored
  ad2dab6

  Copy full SHA for ad2dab6

Commits on Dec 9, 2022

• Before solving conflicts

  LuQQiu

  committed
  c736475

  Copy full SHA for c736475

• solve conflicts

  LuQQiu

  committed
  35072d7

  Copy full SHA for 35072d7

• Merge branch 'master' of github.com:Alluxio/alluxio into dora

  LuQQiu

  committed
  83ac569

  Copy full SHA for 83ac569

Commits on Dec 22, 2022

• Support S3 range read with buffer cache

  Show description for a5ea9c8
  LuQQiu

  authored
  a5ea9c8

  Copy full SHA for a5ea9c8

Commits on Dec 28, 2022

• Remove unneeded isFile call in UfsBaseFileSystem.getStatus

  Show description for 932c7e4
  LuQQiu

  authored
  932c7e4

  Copy full SHA for 932c7e4

• Remove redundant get file status call in fuse.open()

  Show description for 732ba42
  LuQQiu

  authored
  732ba42

  Copy full SHA for 732ba42

• Remove some overhead in big file read

  Show description for d063972
  LuQQiu

  authored
  d063972

  Copy full SHA for d063972

Commits on Dec 30, 2022

• Enable default metadata cache for FUSE SDK

  Show description for 459d766
  LuQQiu

  authored
  459d766

  Copy full SHA for 459d766

Commits on Jan 5, 2023

• Implement Dora worker

  Show description for a00a787
  dbw9580

  authored
  a00a787

  Copy full SHA for a00a787

Commits on Jan 9, 2023

• Fix NPE in PermissionCheckTest

  Show description for 9690209
  dbw9580

  authored
  9690209

  Copy full SHA for 9690209

• Set default fuse version to 3 and support setting via command line

  Show description for 9cd870e
  LuQQiu

  authored
  9cd870e

  Copy full SHA for 9cd870e

Commits on Jan 10, 2023

• Add missing proto lock content

  Show description for ebcd8fd
  

  qian0817

  authored and

  beinan

  committed
  ebcd8fd

  Copy full SHA for ebcd8fd

• Implement Dora client side affinity

  Show description for bc44b65
  beinan

  authored
  bc44b65

  Copy full SHA for bc44b65

Commits on Jan 11, 2023

• Enable data transmission with Netty

  Show description for 4e47a0d
  JiamingMai

  authored
  4e47a0d

  Copy full SHA for 4e47a0d

• Implement getChannel for PagedBlockReader

  Show description for 74500b7
  dbw9580

  authored
  74500b7

  Copy full SHA for 74500b7

Commits on Jan 13, 2023

• Implement Worker metadata caching

  Show description for 8bd3ee4
  beinan

  authored
  8bd3ee4

  Copy full SHA for 8bd3ee4

Commits on Jan 14, 2023

• Fix File Id

  LuQQiu

  committed
  280a80f

  Copy full SHA for 280a80f

Commits on Jan 18, 2023

• Enable UfsBaseFileSystemTest with different cache configuration

  LuQQiu

  committed
  67c703b

  Copy full SHA for 67c703b

• Bytebuffer with offset

  LuQQiu

  committed
  7b66019

  Copy full SHA for 7b66019

• Enable UfsFileOutStream with different config

  LuQQiu

  committed
  fbb36a5

  Copy full SHA for fbb36a5

• Fix LocalCacheFileInStreamTest

  LuQQiu

  committed
  adae398

  Copy full SHA for adae398

• Enable Fuse SDK with cache configuration

  LuQQiu

  committed
  20255b3

  Copy full SHA for 20255b3

• Refactor Ufs stream tests

  LuQQiu

  committed
  1d3a07c

  Copy full SHA for 1d3a07c

Commits on Jan 19, 2023

• small refactor

  LuQQiu

  committed
  136d74e

  Copy full SHA for 136d74e

• Small fix

  LuQQiu

  committed
  1daf9d0

  Copy full SHA for 1daf9d0

• Remove setting the offset and rely on external buffer with position

  LuQQiu

  committed
  b083d55

  Copy full SHA for b083d55

• Fix Fuse File Id

  LuQQiu

  committed
  69895bf

  Copy full SHA for 69895bf

• Avoid unnecessary code changes at this time

  LuQQiu

  committed
  411c4e1

  Copy full SHA for 411c4e1

• Fix hanging page store test

  Show description for 3051ba2
  LuQQiu

  authored
  3051ba2

  Copy full SHA for 3051ba2

• Merge branch 'dora' of github.com:Alluxio/alluxio into fixFuseFileId

  LuQQiu

  committed
  8f0edf2

  Copy full SHA for 8f0edf2

• Enable S3 testing in UfsBaseFileSystem

  LuQQiu

  committed
  1a8072b

  Copy full SHA for 1a8072b

• Enable S3 in UfsIn/OutStreamTest

  LuQQiu

  committed
  dac03ee

  Copy full SHA for dac03ee