Update Kubernetes service pod spec and fix batch service test

- K8s Service: Update Kata container job spec with hostNetwork: True, HOST_UID=1337, capabilities: ALL, and standardized volume size. Skip default credential loading if K8S_E2E env var is set.
- K8s Tests: Update unit tests to verify spec generation and mock correctly. Update e2e tests to verify job Running status instead of completion to avoid timeouts with default command. Skip e2e test if K8S_E2E env var is not set.
- Local Tests: Update kubernetes e2e test script with correct filename.
- Batch Service Test: Fix mock return value to be a Job object to resolve AttributeError.
- Deps: Add necessary google-cloud and http libs to root Pipfile for e2e tests.
- CI: Install JDK 21 in kubernetes-e2e-tests workflow for Datastore emulator.

Author: javanlacerda

.github/workflows/kubernetes-e2e-tests.yaml

@@ -32,5 +32,11 @@ jobs:
         with:
           python-version: 3.11
 
+      - name: Set up JDK 21
+        uses: actions/setup-java@v3
+        with:
+          java-version: '21'
+          distribution: 'temurin'
+
       - name: Run Kubernetes e2e tests
         run: ./local/tests/kubernetes_e2e_test.bash

local/tests/kubernetes_e2e_test.bash

@@ -22,6 +22,8 @@ pip install pipenv
 pipenv --python 3.11
 pipenv install
 
+./local/install_deps.bash
+
 # Run the test.
 export K8S_E2E=1
 pipenv run python butler.py py_unittest -t core -p k8s_service_e2e_test.py