Skip to content
This repository was archived by the owner on Jan 19, 2022. It is now read-only.
This repository was archived by the owner on Jan 19, 2022. It is now read-only.

GKE deploy does not work #8

@blazejkrzak

Description

@blazejkrzak

Error is in several places:

Helm

  • ReadWriteMany in common-data and deposit-storage will lead to unsupported on default storageClass. I have tried with workaround with nfs, which could be good path

  • Nimbus 0 after genesis container does not boot properly and stall other clients, which wont be bootstrapped.

kubectl describe pod nimbus-0

Events:
  Type     Reason     Age                    From                                           Message
  ----     ------     ----                   ----                                           -------
  Normal   Scheduled  39m                    default-scheduler                              Successfully assigned default/nimbus-0 to gke-eth20-default-pool-0d802a45-pgc2
  Normal   Pulled     39m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Container image "eth2clients/multinet-nimbus" already present on machine
  Normal   Created    39m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Created container genesis
  Normal   Started    39m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Started container genesis
  Normal   Pulled     38m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Container image "eth2clients/eth2stats-client" already present on machine
  Normal   Created    38m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Created container eth2stats-client
  Normal   Started    38m                    kubelet, gke-eth20-default-pool-0d802a45-pgc2  Started container eth2stats-client
  Normal   Started    35m (x4 over 38m)      kubelet, gke-eth20-default-pool-0d802a45-pgc2  Started container nimbus
  Normal   Pulled     33m (x5 over 38m)      kubelet, gke-eth20-default-pool-0d802a45-pgc2  Container image "eth2clients/multinet-nimbus" already present on machine
  Normal   Created    33m (x5 over 38m)      kubelet, gke-eth20-default-pool-0d802a45-pgc2  Created container nimbus
  Warning  BackOff    3m55s (x122 over 36m)  kubelet, gke-eth20-default-pool-0d802a45-pgc2  Back-off restarting failed container

kubectl get pods

NAME                                  READY   STATUS     RESTARTS   AGE
eth2stats-dashboard-5458757df-n6kjx   1/1     Running    0          40m
eth2stats-server-74859c8ddd-9n9r9     1/1     Running    0          40m
lighthouse-0                          2/2     Running    0          40m
nfs-server-57698dcc79-976rl           1/1     Running    0          21h
nimbus-0                              2/2     Running    11         40m
nimbus-1                              0/2     Init:0/1   0          39m
prysm-0                               2/2     Running    0          40m

kubectl logs nimbus-0 nimbus

Running nimbus
++ dirname ./run_nimbus.sh
+ source ./vars.sh
++ PWD_CMD=pwd
++ uname
++ grep -qi mingw
+++ dirname ./run_nimbus.sh
++ cd .
+++ pwd
++ SIM_ROOT=/root/multinet/repo
++ SPEC_VERSION=mainnet
++ NUM_VALIDATORS=64
++ NUM_NODES=1
++ NUM_MISSING_NODES=2
++ DATA_DIR=/root/multinet/repo/data
++ BUILD_DIR=/root/multinet/repo/build
++ TESTNET_DIR=/root/multinet/repo/data/testnet
++ VALIDATORS_DIR=/root/multinet/repo/data/testnet/validators
++ SECRETS_DIR=/root/multinet/repo/data/testnet/secrets
++ NETWORK_BOOTSTRAP_FILE=/root/multinet/repo/data/testnet/bootstrap_nodes.txt
++ PRESET_FILE=/root/multinet/repo/mainnet.yaml
++ NIMFLAGS='-d:insecure -d:chronicles_log_level=TRACE --warnings:off --hints:off --opt:speed -d:disableMarchNative -d:const_preset=/root/multinet/repo/mainnet.yaml'
++ NIMBUS_BIN=/root/multinet/repo/build/nimbus
+ NIMBUS_DIR=nimbus-eth2
+ MULTINET_POD_NAME=nimbus-0
+ NIMBUS_DATA_DIR=/root/multinet/repo/deposits/nimbus-0
+ chmod -R 750 /root/multinet/repo/deposits/nimbus-0
+ chmod -R 600 /root/multinet/repo/deposits/nimbus-0/validators
+ chmod -R 600 /root/multinet/repo/deposits/nimbus-0/secrets
+ cd nimbus-eth2
+ source env.sh
+++ dirname env.sh
++ REL_PATH=.
+++ cd .
+++ pwd
++ ABS_PATH=/root/multinet/repo/nimbus-eth2
++ '[' -z '' ']'
++ command -v nvm
++ echo

++ source /root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/env.sh
++++ dirname /root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/env.sh
+++ export REL_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
+++ REL_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
++++ cd /root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
++++ pwd
+++ export ABS_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
+++ ABS_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
+++ export NIMBUS_ENV_DIR=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
+++ NIMBUS_ENV_DIR=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts
++++ cd /root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/../vendor/Nim/bin
++++ pwd
+++ export NIM_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/vendor/Nim/bin
+++ NIM_PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/vendor/Nim/bin
++++ cd /root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/../../.nimble
++++ pwd
+++ export NIMBLE_DIR=/root/multinet/repo/nimbus-eth2/vendor/.nimble
+++ NIMBLE_DIR=/root/multinet/repo/nimbus-eth2/vendor/.nimble
+++ export PATH=/root/multinet/repo/nimbus-eth2/vendor/.nimble/bin:/usr/local/cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+++ PATH=/root/multinet/repo/nimbus-eth2/vendor/.nimble/bin:/usr/local/cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+++ [[ '' != \1 ]]
+++ export PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/vendor/Nim/bin:/root/multinet/repo/nimbus-eth2/vendor/.nimble/bin:/usr/local/cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+++ PATH=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/vendor/Nim/bin:/root/multinet/repo/nimbus-eth2/vendor/.nimble/bin:/usr/local/cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
+++ export BUILD_OUTPUTS_DIR=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/../../../build
+++ BUILD_OUTPUTS_DIR=/root/multinet/repo/nimbus-eth2/vendor/nimbus-build-system/scripts/../../../build
+++ [[ -n 5.0.17(1)-release ]]
+++ export 'PS1= [Nimbus env]\$ '
+++ PS1=' [Nimbus env]\$ '
+++ EXPORT_FUNC='export -f'
+++ [[ -n '' ]]
+++ export -f nimble
+++ export -f add_submodule
+++ [[ 0 == 1 ]]
+ ./env.sh nim c -o:/root/multinet/repo/build/nimbus -d:insecure -d:chronicles_log_level=TRACE --warnings:off --hints:off --opt:speed -d:disableMarchNative -d:const_preset=/root/multinet/repo/mainnet.yaml beacon_chain/beacon_node
++ printf 5%04d 0
+ PORT=50000
+ NAT_FLAG=--nat:extip:172.20.0.10
+ '[' 10.0.2.14 '!=' '' ']'
+ NAT_FLAG=--nat:extip:10.0.2.14
+ rm -rf /root/multinet/repo/deposits/nimbus-0/db
+ rm -f /root/multinet/repo/deposits/nimbus-0/beacon_node.enr
+ rm -f /root/multinet/repo/deposits/nimbus-0/genesis.ssz
+ rm -rf /root/multinet/repo/deposits/nimbus-0/dump
+ mkdir -p /root/multinet/repo/deposits/nimbus-0/dump
+ BOOTNODES_ARG=
+ [[ -f /root/multinet/repo/data/testnet/bootstrap_nodes.txt ]]
+ '[' nimbus-0 == nimbus-0 ']'
+ /root/multinet/repo/build/nimbus '--log-level=INFO;TRACE:switch,multistream' --log-file=/root/multinet/repo/nimbus.log --data-dir:/root/multinet/repo/deposits/nimbus-0 --tcp-port:50000 --udp-port:50000 --rpc --rpc-address=0.0.0.0 --rpc-port=7000 --nat:extip:10.0.2.14 --finalized-checkpoint-state:/root/multinet/repo/data/testnet/genesis.ssz --metrics
+ wait_and_register_enr /root/multinet/repo/deposits/nimbus-0/beacon_node.enr
+ echo 'Registering ENR'
Registering ENR
+ wait_file /root/multinet/repo/deposits/nimbus-0/beacon_node.enr
+ MSG_DISPLAYED=0
+ '[' '!' -f /root/multinet/repo/deposits/nimbus-0/beacon_node.enr ']'
+ ((  MSG_DISPLAYED == 0  ))
+ echo 'Waiting for /root/multinet/repo/deposits/nimbus-0/beacon_node.enr to appear...'
Waiting for /root/multinet/repo/deposits/nimbus-0/beacon_node.enr to appear...
+ MSG_DISPLAYED=1
+ sleep 0.1
Error while processing the 'finalized-checkpoint-state' parameter: File doesn't exist
Try nimbus --help for more information.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions