Skip to content

Commit c490ca5

Browse files
committed
Prepare for release version v0.5.0.
1 parent c87eaac commit c490ca5

5 files changed

Lines changed: 59 additions & 32 deletions

File tree

CHANGES.md

Lines changed: 47 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -1,108 +1,136 @@
1+
## v0.5.0
2+
3+
> 2019 OCT 31 :jack_o_lantern:
4+
5+
* Adds Apach Kafka consumer UDF to import Avro formatted data from Kafka
6+
clusters. [#40](https://github.com/exasol/cloud-storage-etl-udfs/issues/40)
7+
[#39](https://github.com/exasol/cloud-storage-etl-udfs/pull/39)
8+
[#48](https://github.com/exasol/cloud-storage-etl-udfs/pull/48)
9+
10+
* Adds several new Kafka consumer settings as user provided UDF parameters.
11+
[#41](https://github.com/exasol/cloud-storage-etl-udfs/issues/41)
12+
[#43](https://github.com/exasol/cloud-storage-etl-udfs/pull/43)
13+
14+
* Refactors the UDF user properties handling in order to make more robust and
15+
maintainable. [#46](https://github.com/exasol/cloud-storage-etl-udfs/pull/46)
16+
17+
* Reworks the documentation to incorporate the new Kafka import changes.
18+
[#45](https://github.com/exasol/cloud-storage-etl-udfs/issues/45)
19+
[#47](https://github.com/exasol/cloud-storage-etl-udfs/pull/47)
20+
121
## v0.4.4
222

323
> 2019 OCT 27
424
525
* Adds Shared Access Signature (SAS) token authentication when using Azure Blob
6-
Storage [#42](https://github.com/exasol/cloud-storage-etl-udfs/issues/42)
26+
Storage. [#42](https://github.com/exasol/cloud-storage-etl-udfs/issues/42)
727
[#44](https://github.com/exasol/cloud-storage-etl-udfs/pull/44)
828

929
## v0.4.3
1030

1131
> 2019 JUL 01
1232
13-
* Deserialize Orc BYTE format as a Long value
33+
* Deserialize Orc BYTE format as a Long value.
1434
[#33](https://github.com/exasol/cloud-storage-etl-udfs/issues/33)
1535
[#38](https://github.com/exasol/cloud-storage-etl-udfs/pull/38)
16-
* Improve import process
36+
37+
* Improve import process.
1738
[#34](https://github.com/exasol/cloud-storage-etl-udfs/issues/34)
1839
[#38](https://github.com/exasol/cloud-storage-etl-udfs/pull/38)
1940

2041
## v0.4.2
2142

2243
> 2019 MAY 28
2344
24-
* Adds batch size parameter for export that helps exporting large tables
45+
* Adds batch size parameter for export that helps exporting large tables.
2546
[#28](https://github.com/exasol/cloud-storage-etl-udfs/issues/28)
2647
[#32](https://github.com/exasol/cloud-storage-etl-udfs/pull/32)
27-
* Applied some refactoring
48+
49+
* Applied some refactoring.
2850
[#29](https://github.com/exasol/cloud-storage-etl-udfs/pull/29)
2951

3052
## v0.4.1
3153

3254
> 2019 APR 15
3355
34-
* Adds support for Azure Data Lake (Gen1) Storage
56+
* Adds support for Azure Data Lake (Gen1) Storage.
3557
[#22](https://github.com/exasol/cloud-storage-etl-udfs/issues/22)
3658
[#25](https://github.com/exasol/cloud-storage-etl-udfs/pull/25)
37-
* Support ORC formatted data import
59+
60+
* Support ORC formatted data import.
3861
[#23](https://github.com/exasol/cloud-storage-etl-udfs/issues/23)
3962
[#26](https://github.com/exasol/cloud-storage-etl-udfs/pull/26)
4063

4164
## v0.4.0
4265

4366
> 2019 MAR 21
4467
45-
* Add Avro format import support
68+
* Add Avro format import support.
4669
[#18](https://github.com/exasol/cloud-storage-etl-udfs/issues/18)
4770
[#21](https://github.com/exasol/cloud-storage-etl-udfs/pull/21)
4871

4972
## v0.3.1
5073

5174
> 2019 MAR 08
5275
53-
* Adds Google Cloud Storage and Azure Blob Storage export as Parquet format
76+
* Adds Google Cloud Storage and Azure Blob Storage export as Parquet format.
5477
[#17](https://github.com/exasol/cloud-storage-etl-udfs/issues/17)
5578
[#20](https://github.com/exasol/cloud-storage-etl-udfs/pull/20)
5679

5780
## v0.3.0
5881

5982
> 2019 FEB 12
6083
61-
* Adds feature to export Exasol tables into AWS S3 as Parquet format
84+
* Adds feature to export Exasol tables into AWS S3 as Parquet format.
6285
[#14](https://github.com/exasol/cloud-storage-etl-udfs/issues/14)
6386
[#16](https://github.com/exasol/cloud-storage-etl-udfs/pull/16)
64-
* Imports date and timestamp values correctly into Exasol
87+
88+
* Imports date and timestamp values correctly into Exasol.
6589
[#14](https://github.com/exasol/cloud-storage-etl-udfs/issues/14)
6690
[#16](https://github.com/exasol/cloud-storage-etl-udfs/pull/16)
6791

6892
## v0.2.2
6993

7094
> 2018 DEC 13
7195
72-
* Update Hadoop, Exasol Jdbc and Scala versions
96+
* Update Hadoop, Exasol Jdbc and Scala versions.
7397
[#13](https://github.com/exasol/cloud-storage-etl-udfs/pull/13)
74-
* Fixes issue [#12](https://github.com/exasol/cloud-storage-etl-udfs/issues/12)
98+
99+
* Fixes issue.
100+
[#12](https://github.com/exasol/cloud-storage-etl-udfs/issues/12)
75101

76102
## v0.2.1
77103

78104
> 2018 DEC 06
79105
80-
* Add initial Azure Blob Store import support
106+
* Add initial Azure Blob Store import support.
81107
[#10](https://github.com/exasol/cloud-storage-etl-udfs/pull/10)
82108

83109
## v0.2.0
84110

85111
> 2018 DEC 05
86112
87-
* Add initial Google Compute Storage (GCS) import functionality
113+
* Add initial Google Compute Storage (GCS) import functionality.
88114
[#9](https://github.com/exasol/cloud-storage-etl-udfs/pull/9)
89115

90116
## v0.1.1
91117

92118
> 2018 NOV 28
93119
94-
* Added AWS S3 endpoint as a parameter
120+
* Added AWS S3 endpoint as a parameter.
95121
[#8](https://github.com/exasol/cloud-storage-etl-udfs/pull/8)
96122

97123
## v0.1.0
98124

99125
> 2018 NOV 27
100126
101-
* Add Travis based automated build
127+
* Add Travis based automated build.
102128
[#3](https://github.com/exasol/cloud-storage-etl-udfs/pull/3)
103-
* Renamed packages and external files to more generic cloudetl from s3etl
129+
130+
* Renamed packages and external files to more generic cloudetl from s3etl.
104131
[#4](https://github.com/exasol/cloud-storage-etl-udfs/pull/4)
105-
* Added automated Github release when a tag is pushed
132+
133+
* Added automated Github release when a tag is pushed.
106134
[#5](https://github.com/exasol/cloud-storage-etl-udfs/pull/5)
107135

108136
## v0.0.1

docs/developer_guide.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -126,7 +126,7 @@ Follow these steps in order to create a new release:
126126
- Push tags to remote, `git push --tags`.
127127

128128
Please make sure that the new version tag follows the [Semantic Versioning
129-
2.0.0](https://semver.org/)
129+
2.0.0](https://semver.org/).
130130

131131
The next Travis CI run will detect the new tag and create a new Github release
132132
and publish the artifacts.

docs/kafka/import.md

Lines changed: 4 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -15,10 +15,10 @@ clusters.
1515

1616
Before start, you should deploy the latest jar file to the Exasol BucketFS
1717
bucket and create UDF scripts for importing Avro data from Kafka cluster.
18-
Please follow the instructions from [deployment guide](docs/deployment_guide.md)
18+
Please follow the instructions from [deployment guide](../deployment_guide.md)
1919
if you have not done so.
2020

21-
Additionally, you can read the [user guide](docs/user_guide.md) in order to get
21+
Additionally, you can read the [user guide](../user_guide.md) in order to get
2222
familiar with cloud-storage-etl-udfs in general.
2323

2424
In this guide, we will be using `RETAIL` schema and `SALES_POSITIONS` table to
@@ -78,8 +78,7 @@ The **TABLE_NAME** is the Exasol table name that we are going to import Kafka
7878
topic data.
7979

8080
For more information on Kafka import parameters, please refer to the [Kafka
81-
import properties in the user
82-
guide](docs/user_guide.md#kafka-import-properties).
81+
import properties in the user guide](../user_guide.md#kafka-import-properties).
8382

8483
### Usage
8584

@@ -120,7 +119,7 @@ and [Kafka client configurations][kafka-secure-clients] for more information.
120119

121120
Additionally, we have provide extra parameters to the UDF in order to enable
122121
secure connection to Kafka cluster. Please check out the [Kafka import
123-
properties in the user guide](docs/user_guide.md#kafka-import-properties) for
122+
properties in the user guide](../user_guide.md#kafka-import-properties) for
124123
secure property descriptions.
125124

126125
### Usage with SSL enabled

docs/storage/cloud_storages.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -17,9 +17,9 @@ formats.
1717
Before start, you should deploy the latest jar file to the Exasol BucketFS
1818
bucket and create UDF scripts for importing or exporing data from cloud storage
1919
filesystems. Please follow the instructions from [deployment
20-
guide](docs/deployment_guide.md) if you have not done so.
20+
guide](../deployment_guide.md) if you have not done so.
2121

22-
Additionally, you can read the [user guide](docs/user_guide.md) in order to get
22+
Additionally, you can read the [user guide](../user_guide.md) in order to get
2323
familiar with cloud-storage-etl-udfs in general.
2424

2525
In this guide, we will be using `RETAIL` schema and `SALES_POSITIONS` table in

docs/user_guide.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ started with using the cloud-storage-etl-udfs.
1717
In order to use the cloud-storage-etl-udfs, you should deploy the jar file and
1818
create UDF scripts.
1919

20-
Please follow the steps from [deployment guide](docs/deployment_guide.md).
20+
Please follow the steps from [deployment guide](./deployment_guide.md).
2121

2222
## Getting started
2323

@@ -145,15 +145,15 @@ importing or exporting data.
145145
* ``BUCKET_PATH`` - It specifies a path to the cloud storage filesystem.
146146
Additionally, it should start with storage specific schema, such as `s3a`. You
147147
can check out the currently [supported list of cloud storage
148-
systems](docs/storage/cloud_storages.md).
148+
systems](storage/cloud_storages.md).
149149

150150
* ``DATA_FORMAT`` - It defines the data file format in the user provided path.
151151
Currently, we support importing data from **Avro**, **Orc** and **Parquet**
152152
file formats and exporting to only **Parquet** format.
153153

154154
* Additional storage related properties that enable accessing storage
155155
filesystems. Please refer to the [supported cloud storage
156-
systems](docs/storage/cloud_storages.md) documentation for more information.
156+
systems](storage/cloud_storages.md) documentation for more information.
157157

158158
#### Optional Properties
159159

@@ -166,7 +166,7 @@ These are optional parameters that usually have default values.
166166
For example, multiply with a number when importing `PARALLELISM = 'nproc()*4'`
167167
or append additional numbers when exporting `PARALLELISM = 'iproc(),
168168
floor(random()*4)'`. Please check out the [supported cloud storage
169-
systems](docs/storage/cloud_storages.md) for more examples.
169+
systems](storage/cloud_storages.md) for more examples.
170170

171171
* ``PARQUET_COMPRESSION_CODEC`` - This property is only used in export SQL
172172
statement. It defines the compression codec to use when exporting data into
@@ -208,7 +208,7 @@ Kafka topic partitions. That is, when importing data from Kafka topic, we will
208208
be importing from each topic partition in parallel. Therefore, it is important
209209
to configure Kafka topics with several partitions.
210210

211-
Please check out the [Kafka import examples](docs/kafka/import.md) for more
211+
Please check out the [Kafka import examples](kafka/import.md) for more
212212
information.
213213

214214
#### Optional Properties

0 commit comments

Comments
 (0)