Commit 451d30c
authored
Use Hadoop Filesystem Path URI instead of java.net.URI (#67)
The `java.net.URI` cannot resolve the paths that contain regex patterns,
for example, `'s3a://bucket/{year=2019/month=1,year=2019/month=2}/*'`.
Instead we should use Hadoop Filesystem Path, and then convert the path
to URI using `.toUri()` method.
For example, to obtain the schema from a path:
```scala
new Path(bucketPathString).toUri.getSchema
```1 parent 96fe40a commit 451d30c
3 files changed
Lines changed: 10 additions & 6 deletions
File tree
- src
- main/scala/com/exasol/cloudetl
- bucket
- storage
- test/scala/com/exasol/cloudetl/storage
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
4 | | - | |
5 | 3 | | |
6 | 4 | | |
7 | 5 | | |
| |||
60 | 58 | | |
61 | 59 | | |
62 | 60 | | |
63 | | - | |
| 61 | + | |
64 | 62 | | |
65 | 63 | | |
66 | 64 | | |
| |||
Lines changed: 3 additions & 3 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
4 | | - | |
5 | 3 | | |
6 | 4 | | |
7 | 5 | | |
8 | 6 | | |
9 | 7 | | |
| 8 | + | |
| 9 | + | |
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
| |||
36 | 36 | | |
37 | 37 | | |
38 | 38 | | |
39 | | - | |
| 39 | + | |
40 | 40 | | |
41 | 41 | | |
42 | 42 | | |
| |||
Lines changed: 6 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
44 | 44 | | |
45 | 45 | | |
46 | 46 | | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
47 | 53 | | |
48 | 54 | | |
49 | 55 | | |
| |||
0 commit comments