Database error

[JN8086]

I've spent countless hours on this, and I cannot seem to solve it. I have the docker images for the database and the syncserver running, but I keep getting this error:

1761856552051 Sync.LogManager DEBUG Flushing file log
1761856552056 Sync.LogManager DEBUG Log cleanup threshold time: 1760992552056
1761856552060 Sync.LogManager DEBUG Done deleting files.
1761856552846 FirefoxAccounts INFO Polling device commands.
1761856552847 Sync.Service DEBUG User-Agent: LibreWolf/143.0.4-1 (Linux x86_64) FxSync/1.145.0.20251005000040.desktop
1761856552847 Sync.Service INFO Starting sync at 2025-10-30 21:35:52 in browser session ctjSBO_P05Vc
1761856552847 Sync.Service DEBUG In sync: should login.
1761856552847 Sync.Service INFO User logged in successfully - verifying login.
1761856552847 FirefoxAccounts TRACE not checking freshness of profile as it remains recent
1761856552847 Sync.SyncAuthManager DEBUG unlockAndVerifyAuthState already has (or can fetch) sync keys
1761856552847 Sync.Status DEBUG Status.login: error.login.reason.network => success.status_ok
1761856552847 Sync.Status DEBUG Status.service: error.login.failed => error.login.failed
1761856552847 Sync.Service DEBUG Fetching unlocked auth state returned success.status_ok
1761856552847 FirefoxAccounts TRACE not checking freshness of profile as it remains recent
1761856552847 Sync.SyncAuthManager INFO Getting sync key
1761856552847 FirefoxAccounts DEBUG getOAuthToken enter
1761856552848 FirefoxAccounts TRACE getCachedToken returning cached token
1761856552848 FirefoxAccounts DEBUG getOAuthToken returning a cached token
1761856552848 Sync.SyncAuthManager INFO Getting a sync token from: http://192.168.1.8:8000/1.0/sync/1.5
1761856552848 Sync.SyncAuthManager DEBUG Getting a token using OAuth
1761856552848 Services.Common.TokenServerClient DEBUG Beginning OAuth token exchange: http://192.168.1.8:8000/1.0/sync/1.5
1761856552848 Services.Common.RESTRequest DEBUG GET request to http://192.168.1.8:8000/1.0/sync/1.5
1761856552849 Services.Common.RESTRequest DEBUG GET request to https://api.accounts.firefox.com/v1/account/device/commands?index=0
1761856553027 Services.Common.RESTRequest DEBUG GET http://192.168.1.8:8000/1.0/sync/1.5 500
1761856553027 Services.Common.TokenServerClient DEBUG Got token response: 500
1761856553027 Services.Common.TokenServerClient INFO Server-reported error: {"location":"internal","name":"","description":"A database error occurred: NotFound"}
1761856553027 Sync.SyncAuthManager ERROR Non-authentication error in _fetchTokenForUser: TokenServerClientServerError({"now":"2025-10-30T20:35:53.027Z","message":"Server error.","cause":"general","response_body":"{"status":"internal-error","errors":[{"location":"internal","name":"","description":"A database error occurred: NotFound"}]}","response_headers":{"content-length":"124","vary":"Origin, Access-Control-Request-Method, Access-Control-Request-Headers","x-weave-timestamp":"1761856552.85","content-type":"application/json","date":"Thu, 30 Oct 2025 20:35:52 GMT"},"response_status":500})(resource://services-common/tokenserverclient.sys.mjs:28:36) JS Stack trace: TokenServerClientServerError@tokenserverclient.sys.mjs:90:16
_processTokenResponse@tokenserverclient.sys.mjs:306:19
_tokenServerExchangeRequest@tokenserverclient.sys.mjs:239:19
1761856553027 Sync.Status DEBUG Status.login: success.status_ok => error.login.reason.network
1761856553027 Sync.Status DEBUG Status.service: error.login.failed => error.login.failed
1761856553027 Sync.SyncAuthManager INFO Failed to fetch the cluster URL: TokenServerClientServerError({"now":"2025-10-30T20:35:53.027Z","message":"Server error.","cause":"general","response_body":"{"status":"internal-error","errors":[{"location":"internal","name":"","description":"A database error occurred: NotFound"}]}","response_headers":{"content-length":"124","vary":"Origin, Access-Control-Request-Method, Access-Control-Request-Headers","x-weave-timestamp":"1761856552.85","content-type":"application/json","date":"Thu, 30 Oct 2025 20:35:52 GMT"},"response_status":500})(resource://services-common/tokenserverclient.sys.mjs:28:36) JS Stack trace: TokenServerClientServerError@tokenserverclient.sys.mjs:90:16
_processTokenResponse@tokenserverclient.sys.mjs:306:19
_tokenServerExchangeRequest@tokenserverclient.sys.mjs:239:19
1761856553027 Sync.Service DEBUG verifyLogin failed: TokenServerClientServerError({"now":"2025-10-30T20:35:53.027Z","message":"Server error.","cause":"general","response_body":"{"status":"internal-error","errors":[{"location":"internal","name":"","description":"A database error occurred: NotFound"}]}","response_headers":{"content-length":"124","vary":"Origin, Access-Control-Request-Method, Access-Control-Request-Headers","x-weave-timestamp":"1761856552.85","content-type":"application/json","date":"Thu, 30 Oct 2025 20:35:52 GMT"},"response_status":500})(resource://services-common/tokenserverclient.sys.mjs:28:36) JS Stack trace: TokenServerClientServerError@tokenserverclient.sys.mjs:90:16
_processTokenResponse@tokenserverclient.sys.mjs:306:19
_tokenServerExchangeRequest@tokenserverclient.sys.mjs:239:19
1761856553027 Sync.Status DEBUG Status.login: error.login.reason.network => error.login.reason.network
1761856553027 Sync.Status DEBUG Status.service: error.login.failed => error.login.failed
1761856553028 Sync.ErrorHandler ERROR Sync encountered a login error
1761856553028 Sync.SyncScheduler DEBUG Clearing sync triggers and the global score.
1761856553028 Sync.SyncScheduler DEBUG Next sync in 3600000 ms. (why=schedule)
1761856553028 Sync.Service DEBUG Exception calling WrappedLock: Error: Login failed: error.login.reason.network(resource://services-sync/service.sys.mjs:1051:15) JS Stack trace: onNotify@service.sys.mjs:1051:15
1761856553028 FirefoxAccounts TRACE not checking freshness of profile as it remains recent
1761856553028 Sync.Service DEBUG Not syncing: login returned false.
1761856553029 FirefoxAccounts TRACE not checking freshness of profile as it remains recent

What could be the problem?

[Oratorian]

The mozilla project is so badly maintained and documented its practically impossible to do anything.
This project just suffers from incompetence of mozilla.
I am running into the same problems. tried different approaches.. nothing.

[JN8086]

Well that's frustrating. This seemed like a cool project.

[michaelschefczyk]

My experience matches. This is nevertheles a cool and important project.

This issue might be due to the fact that the image gets created with
ARG GIT_COMMIT=1dc421474df2a4ee973d529534cd0eb7189d58ce

[ZackEndboss]

1761856553027 Services.Common.TokenServerClient INFO Server-reported error: {"location":"internal","name":"","description":"A database error occurred: NotFound"}

Your database is not set up correctly.

If you run the following command in the console:
docker exec -it firefox_mariadb mysql -u sync -p tokenserver_rs -e "SELECT * FROM services; SELECT * FROM nodes;"
the result will likely be empty.

You can adjust your app/entrypoint.sh file and add --skip-ssl to the following line:
mysql **--skip-ssl** $db -h $host -P $port -u $user -p"$pass" <<EOF

That should make it work. I had to fight my way through that too. Let me know if you still have trouble.

btw: If you don't use a "real domain", you will run into difficulties synchronizing the Firefox instance, at least with the Android client. I haven't been able to get it to work with self-signed certificates in Android Firefox yet.

[michaelschefczyk]

Thank you very much @ZackEndboss

Adding --skip-ssl does solve this issue: #17

However, at least in my case, the problem descriped in this issue does stay.

In addition to Firefox logs as provided above, my docker container does log:

WARN Error requesting remote jwks: error sending request for url (https://oauth.accounts.firefox.com/v1/jwks)

[Oratorian]

This is not a problem with this docker project, This problem persists even if you built the project from Mozillas source.

The containers itself work, even the connection, but syncing from a FF client always fails with the errors in the OP post.

[michaelschefczyk]

Thank you very much @Oratorian

This is a pitty. The advantage of self hosting was that the data stored in the database is not zero knowledge but just protected by the master secret, correct? Hence, there is a privacy downside of using the public service.

[Oratorian]

Thank you very much @Oratorian

This is a pitty. The advantage of self hosting was that the data stored in the database is not zero knowledge but just protected by the master secret, correct? Hence, there is a privacy downside of using the public service.

The problem is that the project itself is so poorly documented and issues being opened hourly without answers by Mozilla.

If you use googles propierty spannerdb it works, but that shit is expensive as hell.

[michaelschefczyk]

Again, thank you very much @Oratorian

What I wonder about is that/why some descriptions call for http://sync.example.com:8000/1.0/sync/1.5 while the old python one had http://sync.example.com:8000/token/1.0/sync/1.5 and your repo has http://sync.example.com:8000/tokenserver/1.0/sync/1.5

Does a build from your dockerfile at https://github.com/Oratorian/mozilla-syncstorage-rs work currently with MariaDB?

[cho0p]

I had the same issue. Solved it with (you need your MariaDB root password from the .env file):

Execute:

docker compose exec mariadb mariadb -u root -p -e \
'USE tokenserver_rs; INSERT INTO services (service, pattern) VALUES ("sync-1.5", "{node}/1.5/{uid}");'

Check ID:

docker compose exec mariadb mariadb -u root -p -e 'USE tokenserver_rs; SELECT * FROM services;'

In my case the ID was "3".

Execute (e.g. ID "3"):

docker compose exec mariadb mariadb -u root -p -e \
'USE tokenserver_rs; INSERT INTO nodes (service, node, available, capacity, current_load, downed, backoff) VALUES (3, "https://firefox.lan", 1, 10, 0, 0, 0);'

Check:

docker compose exec mariadb mariadb -u root -p -e \
'USE tokenserver_rs; SELECT * FROM nodes;'

Restart all Containers (MariaDB and Syncstorage).

Afterwards the database error was gone and the sync worked for me!

[michaelschefczyk]

Thank you very much @cho0p

Changing the nodes entry does seem to do the trick! So much about lack of documentation by Mozilla for using databases other than Google Spanner.

As a result, I seem to have a working self-hosted Firefox sync again. The only remaining issue is that the old identity.sync.tokenserver.uri did contain "/token" before "/1.0/sync/1.5". That did not make too much sense to me. However, changing it for all profiles of my family members will not be fun either.

[atomheartbrother]

Update: I didn't realize the url in step 3 of @cho0p's post was intended to just be a placeholder! Updating it from https://firefox.lan to my actual domain worked like a charm.

I'm getting a similar, but different error to @JN8086. I wasn't able to find any relevant information in the og syncserver repo either.

It seems that its not able to connect to https://firefox.lan/1.5/4/info/collections for whatever reason, but I'm not sure if that's the cause or side effect of something else upstream.

1767669854919	Sync.LogManager	DEBUG	Flushing file log
1767669854924	Sync.LogManager	DEBUG	Log cleanup threshold time: 1766805854924
1767669854925	Sync.LogManager	DEBUG	Done deleting files.
1767669855041	Services.Common.RESTRequest	DEBUG	GET https://profile.accounts.firefox.com/v1/profile 304
1767669855989	FirefoxAccounts	INFO	Polling device commands.
1767669855989	Sync.Service	DEBUG	User-Agent: Firefox/146.0.1 (Intel Mac OS X 10.15) FxSync/1.148.0.20251217121356.desktop
1767669855989	Sync.Service	INFO	Starting sync at 2026-01-05 21:24:15 in browser session QfIOOdldnL_a
1767669855989	Sync.Service	DEBUG	In sync: should login.
1767669855989	Sync.Service	INFO	User logged in successfully - verifying login.
1767669855990	FirefoxAccounts	TRACE	not checking freshness of profile as it remains recent
1767669855990	Sync.SyncAuthManager	DEBUG	unlockAndVerifyAuthState already has (or can fetch) sync keys
1767669855990	Sync.Status	DEBUG	Status.login: error.login.reason.network => success.status_ok
1767669855990	Sync.Status	DEBUG	Status.service: error.login.failed => error.login.failed
1767669855990	Sync.Service	DEBUG	Fetching unlocked auth state returned success.status_ok
1767669855990	FirefoxAccounts	TRACE	not checking freshness of profile as it remains recent
1767669855992	Services.Common.RESTRequest	DEBUG	GET request to https://api.accounts.firefox.com/v1/account/device/commands?index=0
1767669856012	Sync.Resource	WARN	GET request to https://firefox.lan/1.5/4/info/collections failed: [Exception... "The lookup of the hostname failed"  nsresult: "0x804b001e (NS_ERROR_UNKNOWN_HOST)"  location: "<unknown>"  data: no] No traceback available
1767669856012	Sync.Service	DEBUG	verifyLogin failed: [Exception... "The lookup of the hostname failed"  nsresult: "0x804b001e (NS_ERROR_UNKNOWN_HOST)"  location: "<unknown>"  data: no] No traceback available
1767669856012	Sync.Status	DEBUG	Status.login: success.status_ok => error.login.reason.network
1767669856012	Sync.Status	DEBUG	Status.service: error.login.failed => error.login.failed
1767669856012	Sync.Status	DEBUG	Status.login: error.login.reason.network => error.login.reason.network
1767669856012	Sync.Status	DEBUG	Status.service: error.login.failed => error.login.failed
1767669856012	Sync.ErrorHandler	ERROR	Sync encountered a login error
1767669856013	Sync.SyncScheduler	DEBUG	Clearing sync triggers and the global score.
1767669856013	Sync.SyncScheduler	DEBUG	Next sync in 3600000 ms. (why=schedule)
1767669856013	Sync.Service	DEBUG	Exception calling WrappedLock: Error: Login failed: error.login.reason.network(resource://services-sync/service.sys.mjs:1053:15) JS Stack trace: onNotify@service.sys.mjs:1053:15
1767669856014	Sync.Service	DEBUG	Not syncing: login returned false.
1767669856014	FirefoxAccounts	TRACE	not checking freshness of profile as it remains recent