Gitlab CICD

⚠️ In progress

_{(toc generated using https://ecotrust-canada.github.io/markdown-toc)}

• CICD/Demo Installation of Versatile Data Kit
• Variables
  • Build and release related variables
  • CICD Demo installation variables

CI is based on Gitlab CI.

The project CICD can be seen at https://gitlab.com/vmware-analytics/versatile-data-kit/-/pipelines Request access to VMware Analytics Group to get access to the CICD

CICD/Demo Installation of Versatile Data Kit

CICD deploys (automatically) on each change the latest version of Control Service and quickstart-vdk. This is used either for demo purposes or by automated release acceptance tests.

Variables

The following variables are used by the CICD

Edited using https://www.tablesgenerator.com/markdown_tables# (use File -> Paste table data ...)

Build and release related variables

Name	Description	(most likely) value
PIP_EXTRA_INDEX_URL	extra index used to download from pypi	https://pypi.org/simple
PIP_REPO_UPLOAD_URL	PyPI URL where python packages are released/uploaded	https://upload.pypi.org/legacy/
PIP_REPO_UPLOAD_USER_NAME	Upload PyPI URL user
PIP_REPO_UPLOAD_USER_PASSWORD	Upload PyPI URL password

CICD Demo installation variables

Name	Description	Value
KUBECONFIG	contains kubeconfig to the kubernetes (in AWS EKS) used to deploy CICD gitlab runners and cicd demo deployment of Versatile Data Kit
AWS_DEFAULT_REGION	Default region where AWS EKS (kubernetes)	us-west-1
AWS_ACCESS_KEY_ID	Used to authenticate against AWS to get access to kubernetes
AWS_SECRET_ACCESS_KEY	Used to authenticate against AWS to get access to kubernetes
CICD_CONTAINER_REGISTRY_URI	Container registry used to house cicd/demo data job images	ghcr.io/tozka
CICD_CONTAINER_REGISTRY_USER_NAME	User used to authenticate against cicd container registry	tozka
CICD_CONTAINER_REGISTRY_USER_PASSWORD	User password used to authenticate against cicd container registry
CICD_GIT_URI	CICD Git uri used to house cicd/demo data jobs sources	https://github.com/tozka/cicd-data-jobs.git
CICD_GIT_USER	User used to authenticate against CICD git
CICD_GIT_PASSWORD	User password used to authenticate against cicd git
VDK_API_TOKEN	OAuth2 (CSP) API token used to authenticate against Control Service API