ci(release): Automated merge from release/v2.11.0 workflow

Release `v2.11.0`

Author: voxelbuildbot

docker/README.md

@@ -62,6 +62,7 @@ regarding FiftyOne Enterprise.
   - [:page_facing_up: Optional: Upload Run Logs](#page_facing_up-optional-upload-run-logs)
   - [:desktop_computer: GPU-Enabled Workloads](#desktop_computer-gpu-enabled-workloads)
   - [:bricks: Custom Plugin Images](#bricks-custom-plugin-images)
+  - [:on: On-Demand Delegated Operator Executors](#on-on-demand-delegated-operator-executors)
 - [Step 8: Identity Provider (IdP) and Authentication (CAS)](#step-8-identity-provider-idp-and-authentication-cas)
   - [:information_source: IdP configuration](#information_source-idp-configuration)
   - [:hammer_and_wrench: Optional: CAS Customization Instructions](#hammer_and_wrench-optional-cas-customization-instructions)
@@ -192,7 +193,7 @@ You can override the default image used by any service in
 ```yaml
 services:
   fiftyone-app:
-    image: voxel51/fiftyone-app-torch:v2.10.2
+    image: voxel51/fiftyone-app-torch:v2.11.0
 ```
 
 ## :rocket: Step 4: Initial Deployment
@@ -438,6 +439,12 @@ and deploy **custom plugin images**. You can base them on
 - ML libraries (e.g. PyTorch, OpenCV)
 - Internal SDKs or models
 
+### :on: On-Demand Delegated Operator Executors
+
+FiftyOne Enterprise v2.11 introduces support for on-demand delegated operator
+executors for Databricks and Anyscale. Please refer to the
+[configuration documentation](https://github.com/voxel51/fiftyone-teams-app-deploy/blob/main/docs/configuring-on-demand-orchestrator.md).
+
 ## Step 8: Identity Provider (IdP) and Authentication (CAS)
 
 ### :information_source: IdP configuration
@@ -653,6 +660,7 @@ services:
 | `FIFTYONE_DEFAULT_APP_PORT`                  | The host port that `fiftyone-app` should bind to; the default is `5151`                                                                                                                                                                                                        | Yes                       |
 | `FIFTYONE_ENCRYPTION_KEY`                    | Used to encrypt storage credentials in MongoDB                                                                                                                                                                                                                                 | Yes                       |
 | `FIFTYONE_ENV`                               | GraphQL verbosity for the `fiftyone-teams-api` service; `production` will not log every GraphQL query, any other value will                                                                                                                                                    | No                        |
+| `FIFTYONE_LOGGING_FORMAT`                    | The format to use for log messages; `json` or `text`. The default is `text`.                                                                                                                                                                                                   | No                        |
 | `FIFTYONE_PLUGINS_DIR`                       | Persistent directory inside the containers for plugins to be mounted to. `teams-api` must have write access to this directory, all plugin nodes must have read access to this directory.                                                                                       | No                        |
 | `FIFTYONE_SIGNED_URL_EXPIRATION`             | Set the time-to-live for signed URLs generated by the application in hours. Set in the `fiftyone-app` service.                                                                                                                                                                 | 24                        |
 | `FIFTYONE_SNAPSHOTS_ARCHIVE_PATH`            | Full path to network-mounted file system or a cloud storage path to use for snapshot archive storage. The default `None` means archival is disabled.                                                                                                                           | No                        |

docker/common-services.yaml

@@ -1,7 +1,7 @@
 ---
 services:
   fiftyone-app-common:
-    image: voxel51/fiftyone-app:v2.10.2
+    image: voxel51/fiftyone-app:v2.11.0
     environment:
       API_URL: ${API_URL}
       FIFTYONE_APP_DEFAULT_QUERY_PERFORMANCE: ${FIFTYONE_APP_DEFAULT_QUERY_PERFORMANCE}
@@ -32,15 +32,17 @@ services:
     restart: always
 
   teams-api-common:
-    image: voxel51/fiftyone-teams-api:v2.10.2
+    image: voxel51/fiftyone-teams-api:v2.11.0
     environment:
+      API_EXTERNAL_URL: ${FIFTYONE_API_URI}
       CAS_BASE_URL: ${CAS_BASE_URL:-http://teams-cas:3000/cas/api}
       FIFTYONE_AUTH_SECRET: ${FIFTYONE_AUTH_SECRET}
       FIFTYONE_DATABASE_NAME: ${FIFTYONE_DATABASE_NAME}
       FIFTYONE_DATABASE_URI: ${FIFTYONE_DATABASE_URI}
       FIFTYONE_ENCRYPTION_KEY: ${FIFTYONE_ENCRYPTION_KEY}
       FIFTYONE_ENV: ${FIFTYONE_ENV}
       FIFTYONE_INTERNAL_SERVICE: true
+      FIFTYONE_LOGGING_FORMAT: ${FIFTYONE_LOGGING_FORMAT:-text}
       GRAPHQL_DEFAULT_LIMIT: ${GRAPHQL_DEFAULT_LIMIT}
       LOGGING_LEVEL: ${API_LOGGING_LEVEL:-INFO}
       MONGO_DEFAULT_DB: ${FIFTYONE_DATABASE_NAME}
@@ -59,14 +61,13 @@ services:
     restart: always
 
   teams-app-common:
-    image: voxel51/fiftyone-teams-app:v2.10.2
+    image: voxel51/fiftyone-teams-app:v2.11.0
     environment:
       API_URL: ${API_URL}
       APP_USE_HTTPS: ${APP_USE_HTTPS:-true}
-      FIFTYONE_API_URI:
-        ${FIFTYONE_API_URI:-"Please contact your Admin for an API URI"}
+      FIFTYONE_API_URI: ${FIFTYONE_API_URI:-"Please contact your Admin for an API URI"}
       FIFTYONE_APP_ALLOW_MEDIA_EXPORT: ${FIFTYONE_APP_ALLOW_MEDIA_EXPORT:-true}
-      FIFTYONE_APP_TEAMS_SDK_RECOMMENDED_VERSION: 2.10.2
+      FIFTYONE_APP_TEAMS_SDK_RECOMMENDED_VERSION: 2.11.0
       FIFTYONE_AUTH_SECRET: ${FIFTYONE_AUTH_SECRET}
       FIFTYONE_SERVER_ADDRESS: ""
       FIFTYONE_SERVER_PATH_PREFIX: /api/proxy/fiftyone-teams
@@ -93,7 +94,7 @@ services:
     restart: always
 
   teams-cas-common:
-    image: voxel51/fiftyone-teams-cas:v2.10.2
+    image: voxel51/fiftyone-teams-cas:v2.11.0
     environment:
       CAS_DATABASE_NAME: ${CAS_DATABASE_NAME:-cas}
       CAS_DEFAULT_USER_ROLE: ${CAS_DEFAULT_USER_ROLE:-GUEST}
@@ -128,7 +129,7 @@ services:
         read_only: true
 
   teams-plugins-common:
-    image: voxel51/fiftyone-app-torch:v2.10.2
+    image: voxel51/fiftyone-app-torch:v2.11.0
     environment:
       API_URL: ${API_URL}
       FIFTYONE_AUTH_SECRET: ${FIFTYONE_AUTH_SECRET}
@@ -155,7 +156,7 @@ services:
     restart: always
 
   teams-do-common:
-    image: voxel51/fiftyone-teams-cv-full:v2.10.2
+    image: voxel51/fiftyone-teams-cv-full:v2.11.0
     deploy:
       replicas: ${FIFTYONE_DELEGATED_OPERATOR_WORKER_REPLICAS:-3}
     command: >

docker/docs/configuring-gpu-workloads.md

@@ -65,7 +65,7 @@ services:
       service: teams-do-common
 
   teams-do-with-gpu:
-    image: voxel51/fiftyone-teams-cv-full:v2.10.2
+    image: voxel51/fiftyone-teams-cv-full:v2.11.0
     command: >
       /bin/sh -c "fiftyone delegated launch -t remote  -n 'teams-do-with-gpu'"
     environment:

docker/docs/upgrading.md

@@ -78,9 +78,9 @@ quickstart  0.21.2
 
 ### From FiftyOne Enterprise Version 2.0.0 and Later
 
-1. [Upgrade to FiftyOne Enterprise version 2.10.2](#upgrading-from-previous-versions)
+1. [Upgrade to FiftyOne Enterprise version 2.11.0](#upgrading-from-previous-versions)
 1. Voxel51 recommends upgrading all FiftyOne Enterprise SDK users to FiftyOne Enterprise
-   version 2.10.2
+   version 2.11.0
     1. Login to the FiftyOne Enterprise UI
     1. To obtain the CLI command to install the FiftyOne SDK associated with
       your FiftyOne Enterprise version, navigate to `Account > Install FiftyOne`
@@ -90,7 +90,7 @@ quickstart  0.21.2
    FIFTYONE_DATABASE_ADMIN=true fiftyone migrate --all
    ```
 
-1. To ensure that all datasets are now at version 1.5.2, run
+1. To ensure that all datasets are now at version 1.8.0, run
 
    ```shell
    fiftyone migrate --info
@@ -121,7 +121,7 @@ To utilize the prior image, update your `common-services.yaml` similar to the be
 
 ```yaml
 teams-do-common:
-  image: voxel51/fiftyone-app:v2.10.2
+  image: voxel51/fiftyone-app:v2.11.0
 ```
 
 #### FiftyOne Enterprise v2.2+ Delegated Operator Changes
@@ -156,7 +156,7 @@ Additionally,
 
 ### From FiftyOne Enterprise Versions 1.6.0 to 1.7.1
 
-> **NOTE**: Upgrading to FiftyOne Enterprise v2.10.2 _requires_ a license file.
+> **NOTE**: Upgrading to FiftyOne Enterprise v2.11.0 _requires_ a license file.
 > Please contact your Customer Success Team before upgrading to FiftyOne Enterprise
 > 2.0 or beyond.
 >
@@ -191,29 +191,29 @@ Additionally,
    mv license.key "${LOCAL_LICENSE_FILE_DIR}/license"
    ```
 
-1. [Upgrade to FiftyOne Enterprise version 2.10.2](#upgrading-from-previous-versions)
-1. Upgrade FiftyOne Enterprise SDK users to FiftyOne Enterprise version 2.10.2
+1. [Upgrade to FiftyOne Enterprise version 2.11.0](#upgrading-from-previous-versions)
+1. Upgrade FiftyOne Enterprise SDK users to FiftyOne Enterprise version 2.11.0
     1. Login to the FiftyOne Enterprise UI
     1. To obtain the CLI command to install the FiftyOne SDK associated with
       your FiftyOne Enterprise version, navigate to `Account > Install FiftyOne`
 1. Upgrade all the datasets
-    > **NOTE**: Any FiftyOne SDK less than 2.10.2
+    > **NOTE**: Any FiftyOne SDK less than 2.11.0
     > will lose connectivity at this point.
-    > Upgrading to `fiftyone==2.10.2` is required.
+    > Upgrading to `fiftyone==2.11.0` is required.
 
     ```shell
     FIFTYONE_DATABASE_ADMIN=true fiftyone migrate --all
     ```
 
-1. To ensure that all datasets are now at version 1.5.2, run
+1. To ensure that all datasets are now at version 1.8.0, run
 
     ```shell
     fiftyone migrate --info
     ```
 
 ### From FiftyOne Enterprise Version 1.1.0 and Before Version 1.6.0
 
-> **NOTE**: Upgrading to FiftyOne Enterprise v2.10.2 _requires_
+> **NOTE**: Upgrading to FiftyOne Enterprise v2.11.0 _requires_
 > your users to log in after the upgrade is complete.
 > This will interrupt active workflows in the FiftyOne Enterprise Hosted Web App.
 > You should coordinate this upgrade carefully with your end-users.
@@ -231,7 +231,7 @@ Additionally,
 
 ---
 
-> **NOTE**: Upgrading to FiftyOne Enterprise v2.10.2 _requires_ a license file.
+> **NOTE**: Upgrading to FiftyOne Enterprise v2.11.0 _requires_ a license file.
 > Please contact your Customer Success Team before upgrading to FiftyOne Enterprise
 > 2.0 or beyond.
 >
@@ -283,21 +283,21 @@ Additionally,
         unset FIFTYONE_DATABASE_ADMIN
         ```
 
-1. [Upgrade to FiftyOne Enterprise version 2.10.2](#upgrading-from-previous-versions)
-1. Upgrade FiftyOne Enterprise SDK users to FiftyOne Enterprise version 2.10.2
+1. [Upgrade to FiftyOne Enterprise version 2.11.0](#upgrading-from-previous-versions)
+1. Upgrade FiftyOne Enterprise SDK users to FiftyOne Enterprise version 2.11.0
     1. Login to the FiftyOne Enterprise UI
     1. To obtain the CLI command to install the FiftyOne SDK associated with
       your FiftyOne Enterprise version, navigate to `Account > Install FiftyOne`
 1. Upgrade all the datasets
-    > **NOTE**: Any FiftyOne SDK less than 2.10.2
+    > **NOTE**: Any FiftyOne SDK less than 2.11.0
     > will lose connectivity at this point.
-    > Upgrading to `fiftyone==2.10.2` is required.
+    > Upgrading to `fiftyone==2.11.0` is required.
 
     ```shell
     FIFTYONE_DATABASE_ADMIN=true fiftyone migrate --all
     ```
 
-1. To ensure that all datasets are now at version 1.5.2, run
+1. To ensure that all datasets are now at version 1.8.0, run
 
     ```shell
     fiftyone migrate --info
@@ -322,14 +322,14 @@ Additionally,
 
 ---
 
-> **NOTE**: Upgrading to FiftyOne Enterprise v2.10.2 _requires_ your users to
+> **NOTE**: Upgrading to FiftyOne Enterprise v2.11.0 _requires_ your users to
 > log in after the upgrade is complete.
 > This will interrupt active workflows in the FiftyOne Enterprise Hosted Web App.
 > You should coordinate this upgrade carefully with your end-users.
 
 ---
 
-> **NOTE**: Upgrading to FiftyOne Enterprise v2.10.2 _requires_ a license file.
+> **NOTE**: Upgrading to FiftyOne Enterprise v2.11.0 _requires_ a license file.
 > Please contact your Customer Success Team before upgrading to FiftyOne Enterprise
 > 2.0 or beyond.
 >
@@ -360,18 +360,18 @@ Additionally,
 1. Update your web server routes to include routing
    `/cas/*` traffic to the `teams-cas` service.
    Please see our [example nginx configurations](../) for more information.
-1. [Upgrade to FiftyOne Enterprise v2.10.2](#upgrading-from-previous-versions)
+1. [Upgrade to FiftyOne Enterprise v2.11.0](#upgrading-from-previous-versions)
    with `FIFTYONE_DATABASE_ADMIN=true`
    (this is not the default for this release).
     > **NOTE**: FiftyOne SDK users will lose access to the FiftyOne
-    > Enterprise Database at this step until they upgrade to `fiftyone==2.10.2`
+    > Enterprise Database at this step until they upgrade to `fiftyone==2.11.0`
 
-1. Upgrade your FiftyOne SDKs to version 2.10.2
+1. Upgrade your FiftyOne SDKs to version 2.11.0
     1. Login to the FiftyOne Enterprise UI
     1. To obtain the CLI command to install the FiftyOne SDK associated
       with your FiftyOne Enterprise version, navigate to
       `Account > Install FiftyOne`
-1. Confirm that datasets have been migrated to version 1.5.2
+1. Confirm that datasets have been migrated to version 1.8.0
 
     ```shell
     fiftyone migrate --info

docker/internal-auth/env.template

@@ -1,7 +1,7 @@
 # This should be the URL your end-users will connect to
 BASE_URL=https://example.fiftyone.ai
 
-# This should be set to the URI your end-users will use to connect to the API
+# This should be set to the URI your end-users and external orchestrators will use to connect to the API
 #  This could be the same as BASE_URL if you are using path-based routing
 FIFTYONE_API_URI=https://example-api.fiftyone.ai
 

docker/legacy-auth/env.template

@@ -4,7 +4,7 @@ AUTH0_SECRET=
 # This should be the URL your end-users will connect to
 AUTH0_BASE_URL=https://example.fiftyone.ai
 
-# This should be set to the URI your end-users will use to connect to the API
+# This should be set to the URI your end-users and external orchestrators will use to connect to the API
 #  This could be the same as AUTH0_BASE_URL if you are using path-based routing
 FIFTYONE_API_URI=https://example-api.fiftyone.ai
 

docs/configuring-on-demand-orchestrator.md

@@ -0,0 +1,23 @@
+<!-- markdownlint-disable no-inline-html line-length -->
+<!-- markdownlint-disable-next-line first-line-heading -->
+<div align="center">
+<p align="center">
+
+<img alt="Voxel51 Logo" src="https://user-images.githubusercontent.com/25985824/106288517-2422e000-6216-11eb-871d-26ad2e7b1e59.png" height="55px"> &nbsp;
+<img alt="Voxel51 FiftyOne" src="https://user-images.githubusercontent.com/25985824/106288518-24bb7680-6216-11eb-8f10-60052c519586.png" height="50px">
+
+</p>
+</div>
+<!-- markdownlint-enable no-inline-html line-length -->
+
+---
+
+# Configuring On-Demand Orchestrators
+
+As of FiftyOne Enterprise v2.11.0, delegated operations can be run on-demand
+in select external compute platforms (orchestrators).
+
+This is the list of supported orchestrators and their configuration guides:
+
+- [Anyscale](./orchestrators/configuring-anyscale-orchestrator.md)
+- [Databricks](./orchestrators/configuring-databricks-orchestrator.md)

docs/custom-plugins.md

@@ -46,7 +46,7 @@ With a Dockerfile like this, you could use the following commands to
 build, and publish, your image to your internal registry
 
 ```shell
-FIFTYONE_ENTERPRISE_VERSION=v2.10.2
+FIFTYONE_ENTERPRISE_VERSION=v2.11.0
 docker buildx build --push \
   --build-arg FIFTYONE_ENTERPRISE_IMAGE_NAME="voxel51/fiftyone-app:${FIFTYONE_ENTERPRISE_VERSION}" \
   -t your-internal-registry/fiftyone-app-internal:${FIFTYONE_ENTERPRISE_VERSION} .
@@ -63,7 +63,7 @@ After your custom plugins image is built, you can add it to your
 ```yaml
 services:
   teams-plugins:
-    image: your-internal-registry/fiftyone-app-internal:v2.10.2
+    image: your-internal-registry/fiftyone-app-internal:v2.11.0
 ```
 
 Please see