core_configrevision.active Error

[barmalej1]

Current Behavior

When upgrading from v4.3.5-Docker-3.3.0 to v4.5.4-Docker-4.4.0 and dumping and restoring the database due to Postgres version upgrade, received the following error in Postgres upon start:

ERROR: column core_configrevision.active does not exist at character 36

I already set CHANGELOG_RETENTION = 0 but that didn't help

Expected Behavior

The app has filed to start

Docker Compose Version

v2.29.7

Docker Version

Client: Docker Engine - Community
 Version:           27.3.1
 API version:       1.47
 Go version:        go1.22.7
 Git commit:        ce12230
 Built:             Fri Sep 20 11:41:00 2024
 OS/Arch:           linux/amd64
 Context:           default

The git Revision

c60defe

The git Status

On branch release
Your branch is up to date with 'origin/release'.

Changes not staged for commit:
  (use "git add <file>..." to update what will be committed)
  (use "git restore <file>..." to discard changes in working directory)
        modified:   configuration/extra.py

Untracked files:
  (use "git add <file>..." to include in what will be committed)
        Dockerfile-Plugins
        plugin_requirements.txt

no changes added to commit (use "git add" and/or "git commit -a")

Startup Command

docker compose up -d

NetBox Logs

netbox-1         | ⚙️ Applying database migrations
netbox-1         | Skipping config initialization (database unavailable)
netbox-1         | 🧬 loaded config '/etc/netbox/config/configuration.py'
netbox-1         | 🧬 loaded config '/etc/netbox/config/extra.py'
netbox-1         | 🧬 loaded config '/etc/netbox/config/logging.py'
netbox-1         | 🧬 loaded config '/etc/netbox/config/plugins.py'
netbox-1         | Operations to perform:
netbox-1         |   Apply all migrations: account, auth, circuits, contenttypes, core, dcim, django_rq, extras, ipam, sessions, social_django, taggit, tenancy, thumbnail, users, virtualization, vpn, wireless
netbox-1         | Running migrations:
netbox-1         | Traceback (most recent call last):
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/utils.py", line 103, in _execute
netbox-1         |     return self.cursor.execute(sql)
netbox-1         |            ^^^^^^^^^^^^^^^^^^^^^^^^
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/psycopg/cursor.py", line 117, in execute
netbox-1         |     raise ex.with_traceback(None)
netbox-1         | psycopg.errors.UndefinedColumn: column "is_staff" of relation "users_user" does not exist
netbox-1         |
netbox-1         | The above exception was the direct cause of the following exception:
netbox-1         |
netbox-1         | Traceback (most recent call last):
netbox-1         |   File "/opt/netbox/netbox/./manage.py", line 10, in <module>
netbox-1         |     execute_from_command_line(sys.argv)
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/__init__.py", line 442, in execute_from_command_line
netbox-1         |     utility.execute()
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/__init__.py", line 436, in execute
netbox-1         |     self.fetch_command(subcommand).run_from_argv(self.argv)
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/base.py", line 420, in run_from_argv
netbox-1         |     self.execute(*args, **cmd_options)
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/base.py", line 464, in execute
netbox-1         |     output = self.handle(*args, **options)
netbox-1         |              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/base.py", line 111, in wrapper
netbox-1         |     res = handle_func(*args, **kwargs)
netbox-1         |           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/core/management/commands/migrate.py", line 353, in handle
netbox-1         |     post_migrate_state = executor.migrate(
netbox-1         |                          ^^^^^^^^^^^^^^^^^
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/migrations/executor.py", line 135, in migrate
netbox-1         |     state = self._migrate_all_forwards(
netbox-1         |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/migrations/executor.py", line 167, in _migrate_all_forwards
netbox-1         |     state = self.apply_migration(
netbox-1         |             ^^^^^^^^^^^^^^^^^^^^^
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/migrations/executor.py", line 255, in apply_migration
netbox-1         |     state = migration.apply(state, schema_editor)
netbox-1         |             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/migrations/migration.py", line 132, in apply
netbox-1         |     operation.database_forwards(
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/migrations/operations/fields.py", line 174, in database_forwards
netbox-1         |     schema_editor.remove_field(
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/base/schema.py", line 829, in remove_field
netbox-1         |     self.execute(sql)
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/postgresql/schema.py", line 48, in execute
netbox-1         |     return super().execute(sql, None)
netbox-1         |            ^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/base/schema.py", line 204, in execute
netbox-1         |     cursor.execute(sql, params)
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/utils.py", line 79, in execute
netbox-1         |     return self._execute_with_wrappers(
netbox-1         |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/utils.py", line 92, in _execute_with_wrappers
netbox-1         |     return executor(sql, params, many, context)
netbox-1         |            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/utils.py", line 100, in _execute
netbox-1         |     with self.db.wrap_database_errors:
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/utils.py", line 91, in __exit__
netbox-1         |     raise dj_exc_value.with_traceback(traceback) from exc_value
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/django/db/backends/utils.py", line 103, in _execute
netbox-1         |     return self.cursor.execute(sql)
netbox-1         |            ^^^^^^^^^^^^^^^^^^^^^^^^
netbox-1         |   File "/opt/netbox/venv/lib/python3.12/site-packages/psycopg/cursor.py", line 117, in execute
netbox-1         |     raise ex.with_traceback(None)
netbox-1         | django.db.utils.ProgrammingError: column "is_staff" of relation "users_user" does not exist
netbox-1         |   Applying users.0013_user_remove_is_staff...⚙️ Applying database migrations

Content of docker-compose.override.yml

Empty

[barmalej1]

I figured it out. The physical location of the data files changed in postgres v18 container. I usually delete the files before the restore, but I didn't this time, so the restore has failed, then the database upgrade has failed as the result