Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 25 additions & 0 deletions .github/workflows/checks.yml

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

1 change: 1 addition & 0 deletions doc/changes/unreleased.md
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,7 @@ Code name: T.B.D
* #381: Added Transformation for removing columns from DataFrame
* #353: Added "AI_SENTIMENT" UDF
* #390: Added "AI_CLASSIFY" and "AI_EXTRACT_ENTITIES" UDF's
* #391: Added sql create_script to create all UDF's in Database.

## Security

Expand Down
3 changes: 3 additions & 0 deletions doc/developer_guide/developer_guide.md
Original file line number Diff line number Diff line change
Expand Up @@ -73,6 +73,9 @@ been defined. We created separate UDF scripts for each NLP task. You can find
these tasks and UDF script usage details in the [User Guide](../user_guide/invoke_models.md).
This section shows you step by step how to add a new NLP task to this library.

** Note: ** After you finish adding you UDF, please run the "write_create_script"
function to generate an updated version of the create_script.

### 1. Add a UDF Template
The new task's UDF template should be added to the `exasol_transformers_extension/resources/templates/`
directory. Please pay attention that the UDF script is uses _"SET UDF"_ and the inputs
Expand Down
9 changes: 7 additions & 2 deletions doc/user_guide/setup.md
Original file line number Diff line number Diff line change
Expand Up @@ -21,6 +21,7 @@ Here you find information on prerequisites for using the Transformers Extension,
* [Deploy the Extension to the Database](#deploy-the-extension-to-the-database)
* [The Pre-built Language Container](#the-pre-built-language-container)
* [List of Options](#list-of-options)
* [Create Script](#create-script)

## Prerequisites

Expand All @@ -37,7 +38,7 @@ Normally, the connection object is created as part of the Transformers Extension

This section describes how this object can be created manually.

The format of the connection object is as following:
The format of the connection object is as follows:
```sql
CREATE OR REPLACE CONNECTION <BUCKETFS_CONNECTION_NAME>
TO '<BUCKETFS_ADDRESS>'
Expand All @@ -60,7 +61,7 @@ It is also possible to create this connection manually. This works like
any other Exasol BucketFS connection, but needs to have the name "EXA_AI_MODEL_LOCATION".

```sql
CREATE OR REPLACE CONNECTION <EXA_AI_MODEL_LOCATION>
CREATE OR REPLACE CONNECTION EXA_AI_MODEL_LOCATION
TO '<BUCKETFS_ADDRESS>'
USER '<BUCKETFS_USER>'
IDENTIFIED BY '<BUCKETFS_PASSWORD>'
Expand Down Expand Up @@ -228,3 +229,7 @@ In addition, this extension provides the following installation options:
| `--token-conn-name` | | Optional. Name of the [token connection object](#hugging-face-token) if required. If empty will not create connection object |
| `--token` | | Optional. The [Huggingface token](#hugging-face-token) if required |

#### Create Script

There is a SQL script called in "exasol_transformers_extension/deployment/create_script.sql". You can run this script
to install the udfs (not the SLC) in your Exasol Database.
Loading
Loading