Remove gates

[JWittmeyer]

• Remove gates #253
• Remove gates refinery-submodule-model#123
• Removes gates submodule-react-components#25
• Removes gates refinery-ui#41
• https://github.com/code-kern-ai/dev-setup/pull/47
• Remove gates refinery-entry#23
• https://github.com/code-kern-ai/cognition-gateway/pull/147
• https://github.com/code-kern-ai/cognition-ui/pull/92
• Remove unused version check refinery-updater#81 (remove of unused, changes are done in alembic)

k8 Cluster PRs:

• https://github.com/code-kern-ai/tf-azure-k8-cluster-cognition/pull/21
• https://github.com/code-kern-ai/tf-azure-refinery-embedder/pull/1
• https://github.com/code-kern-ai/tf-azure-refinery-tokenizer/pull/1
• https://github.com/code-kern-ai/tf-azure-refinery-gateway/pull/4
• https://github.com/code-kern-ai/tf-azure-cognition-gateway/pull/4
• https://github.com/code-kern-ai/k8-cluster-cognition/pull/85
• https://github.com/code-kern-ai/k8-cluster-cognition/pull/89
• https://github.com/code-kern-ai/tf-azure-k8-cluster-cognition/pull/23
• https://github.com/code-kern-ai/tf-azure-refinery-gateway/pull/5

Notes

(After switching dev setup branch) best to start with: bash start -a -b remove-gates

Removed

• commercial proxy => was introduced for gates
• api token in refinery => only for gates/commercial proxy
• welcome screen => not in use anymore / on removal list
• platform-monitoring => not in use anymore / on removal list
• step type retrieval => connects to gates
• step type question enrich => connects to gates
• sync with refinery => works with gates
• cognition project -> refinery project ids & sync fields => not relevant anymore
• wizard code in cognition => not used anymore / needs a new wizard for the new structure if wanted

Checked production DB => nothing to do

• model callbacks (table record_label_association)
• type heuristic for CROWD_LABELER & ZERO_SHOT (table information_source)
• removed step type for retrieval (not necessary if the migration from our SOs works -> added to check in release PR)
• comment data
• [ ]

ToDo

• remove alembic tmp code before mergin to dev
• changes for production PR
• changes for k8 (see above)
• There seems to be a redirect from base origin (e.g. http://localhost:4455/) to /welcome => couldn't find yet where
• add note to delete models downloaded before release in production PR
• delete zero shot from app version
• add project shell import/export
• remove refinery-commercial-proxy from app version (if not used anymore)

[lumburovskalina]

Documentation for gates needs to be removed: https://docs.kern.ai/gates

• resolved
• add to the points on the bottom as not urgent now

[lumburovskalina]

Not sure if related to this (or removal the project wizard), but i tested Neural search with a Clickbait sample project in refinery and the embeddings from the project itself are not directly shown in the neural search.

• resolved
• ignored

Lina: I tested this and it works fine if the embedding is recreated, or if other embedding is added. I think this is an expected behaviour or? @JWittmeyer