Skip to content

Openebs.ci postgresql pod went crashloop backoff  #255

@bhaskarhc

Description

@bhaskarhc

What happened:

Some times postgresql pod went crashloopbackoff .

Platform :
GCP

logs of postgresql pod :

Working on primary...
+ case "$PG_MODE" in
+ echo 'Working on primary...'
+ initialize_primary
+ echo initialize_primary
initialize_primary
+ '[' '!' -f /pgdata/postgresql-0/postgresql.conf ']'
+ '[' -f /pgconf/postgresql.conf ']'
+ date
+ postgres -D /pgdata/postgresql-0
Mon Dec 30 07:10:50 UTC 2019
+ [[ -v PGAUDIT_ANALYZE ]]
+ wait
2019-12-30 02:10:50 EST [40]: [1-1] user=,db=,app=,client=FATAL:  could not remove old lock file "postmaster.pid": Read-only file system
2019-12-30 02:10:50 EST [40]: [2-1] user=,db=,app=,client=HINT:  The file seems accidentally left over, but it could not be removed. Please remove the file by hand and try again.
Exiting...at end
+ echo 'Exiting...at end

cstor pool pod also went to crashloopbackoff state in openebs namespace

logs :

W1230 07:13:17.948706       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:20.952801       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:23.956290       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:26.959823       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:29.963835       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:32.967654       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:35.971751       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:38.974637       1 pool.go:54] Failed to get zpool status, error: exit status 1, pool container may be initializing,  retry after 2s
W1230 07:13:40.978918       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:43.982456       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:46.986487       1 pool.go:60] No pool available, pool must be creating, retry after 3s
W1230 07:13:49.990016       1 pool.go:60] No pool available, pool must be creating, retry after 3s

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions