Stopped downloading from Backblaze B2 (S3) server #772
Description
Abstract
I created a bucket in Backblaze B2 on my Macbook and configured Obsidian to use it. I used the Macbook local data to send to the server. Then I successfully joined this B2 server using the setup URI on my Android phone in a new vault and then my iPad in a new vault. Both of these joined and pulled down my vault content initially.
However, now they are failing to download the new journal files and I have the same problem on a Windows system I'm trying to join from several days since the initial setup. The Windows vault is currently empty and the logs dumps I have below are taken from this system. I'm seeing the same messages about Could not download 1766940543548-docs.jsonl.gz (but with different timestamps) on my Android, iPad, and Windows system. The Macbook is still apparently working. It's at least sending new journals but since nothing else is writing to the server I'm not sure if the Macbook would have the same issue pulling down.
Recap:
- Macbook - Used to initialize B2 server. Still working for sending data, though I have no way of testing if it can receive.
- Android phone - Initially worked to pull data from the B2 server. Now failing to sync with a log message
Could not download ...-docs.jsonl.gz - iPad - Initially worked to pull data from the B2 server. Now failing to sync with a log message
Could not download ...-docs.jsonl.gz - Windows desktop - I'm trying to join to the B2 server for the first time several days after the Android/iPad and is failing to pull down any data with a log message
Could not download ...-docs.jsonl.gz - All are running livesync version 0.25.36
Expected behaviour
- Remove changes are pulled down and merged.
- Local changes are pushed.
Actually happened
- Logs display
Could not download 1766940543548-docs.jsonl.gztwice. I've verified this file does actually exist in the bucket. - No changes are pushed or pulled.
Reproducing procedure
- Configure LiveSync as in the attached material.
- Click the replication button on the ribbon.
- About two or three seconds later, we got the error
Could not download ... .jsonl.jz. - Replication has been stopped. No files synchronised.
If you need the B2 bucket configuration let me know. I tried for a bit to get the CORS settings correct, but ended up checking "Use Internal API" in the livesync plugin to get it to work.
Report materials
I do not see any network errors or dev console Javascript errors.
Report from the LiveSync
For more information, please refer to Making the report.
Report from hatch
# ---- Obsidian info ----
navigator: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) obsidian/1.8.9 Chrome/132.0.6834.210 Electron/34.3.0 Safari/537.36
fileSystem: insensitive
---
# ---- remote config ----
error: Object Storage Synchronisation
---
# ---- Plug-in config ----
version: 0.25.36
remoteType: MINIO
useCustomRequestHandler: true
couchDB_URI: self-hosted(HTTPS)
couchDB_USER: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷
couchDB_PASSWORD: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷
couchDB_DBNAME: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷
liveSync: false
syncOnSave: false
syncOnStart: false
savingDelay: 200
lessInformationInLog: false
gcDelay: 0
versionUpFlash: ""
minimumChunkSize: 20
longLineThreshold: 250
showVerboseLog: false
suspendFileWatching: false
trashInsteadDelete: true
periodicReplication: false
periodicReplicationInterval: 60
syncOnFileOpen: false
encrypt: true
passphrase: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷
usePathObfuscation: true
doNotDeleteFolder: false
resolveConflictsByNewerFile: false
batchSave: false
batchSaveMinimumDelay: 5
batchSaveMaximumDelay: 60
deviceAndVaultName: ""
usePluginSettings: false
showOwnPlugins: false
showStatusOnEditor: false
showStatusOnStatusbar: true
showOnlyIconsOnEditor: false
hideFileWarningNotice: false
usePluginSync: false
autoSweepPlugins: false
autoSweepPluginsPeriodic: false
notifyPluginOrSettingUpdated: false
checkIntegrityOnSave: false
batch_size: 25
batches_limit: 25
useHistory: true
disableRequestURI: true
skipOlderFilesOnSync: true
checkConflictOnlyOnOpen: false
showMergeDialogOnlyOnActive: false
syncInternalFiles: false
syncInternalFilesBeforeReplication: false
syncInternalFilesIgnorePatterns: \/node_modules\/, \/\.git\/, \/obsidian-livesync\/
syncInternalFilesTargetPatterns: ""
syncInternalFilesInterval: 60
additionalSuffixOfDatabaseName: 7dec70f6c7c77dd3
ignoreVersionCheck: false
lastReadUpdates: 25
deleteMetadataOfDeletedFiles: false
syncIgnoreRegEx: ""
syncOnlyRegEx: ""
customChunkSize: 60
readChunksOnline: true
watchInternalFileChanges: true
automaticallyDeleteMetadataOfDeletedFiles: 0
disableMarkdownAutoMerge: false
writeDocumentsIfConflicted: false
useDynamicIterationCount: false
syncAfterMerge: false
configPassphraseStore: ""
encryptedPassphrase: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷
encryptedCouchDBConnection: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷
permitEmptyPassphrase: false
useIndexedDBAdapter: true
useTimeouts: false
writeLogToTheFile: false
doNotPaceReplication: false
hashCacheMaxCount: 300
hashCacheMaxAmount: 50
concurrencyOfReadChunksOnline: 30
minimumIntervalOfReadChunksOnline: 25
hashAlg: xxhash64
suspendParseReplicationResult: false
doNotSuspendOnFetching: false
useIgnoreFiles: false
ignoreFiles: .gitignore
syncOnEditorSave: false
pluginSyncExtendedSetting: {}
syncMaxSizeInMB: 50
settingSyncFile: ""
writeCredentialsForSettingSync: false
notifyAllSettingSyncFile: false
isConfigured: true
settingVersion: 10
enableCompression: false
accessKey: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷
bucket: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(12 letters)
endpoint: self-hosted?((HTTPS))
region: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(4 letters)
secretKey: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷
useEden: false
maxChunksInEden: 10
maxTotalLengthInEden: 1024
maxAgeInEden: 10
disableCheckingConfigMismatch: false
displayLanguage: def
enableChunkSplitterV2: false
disableWorkerForGeneratingChunks: false
processSmallFilesInUIThread: false
notifyThresholdOfRemoteStorageSize: 2000
usePluginSyncV2: true
usePluginEtc: false
handleFilenameCaseSensitive: false
doNotUseFixedRevisionForChunks: true
showLongerLogInsideEditor: false
sendChunksBulk: false
sendChunksBulkMaxSize: 1
useSegmenter: true
useAdvancedMode: true
usePowerUserMode: false
useEdgeCaseMode: false
enableDebugTools: false
suppressNotifyHiddenFilesChange: false
syncMinimumInterval: 2000
P2P_Enabled: false
P2P_AutoAccepting: 0
P2P_AppID: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(20 letters)
P2P_roomID: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(0 letters)
P2P_passphrase: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(0 letters)
P2P_relays: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(27 letters)
P2P_AutoBroadcast: false
P2P_AutoStart: false
P2P_AutoSyncPeers: ""
P2P_AutoWatchPeers: ""
P2P_SyncOnReplication: ""
P2P_RebuildFrom: ""
P2P_AutoAcceptingPeers: ""
P2P_AutoDenyingPeers: ""
P2P_IsHeadless: false
P2P_DevicePeerName: ""
P2P_turnServers: (1 servers configured)
P2P_turnUsername: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(0 letters)
P2P_turnCredential: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(0 letters)
doctorProcessedVersion: 0.25.27
bucketCustomHeaders: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(0 letters)
couchDB_CustomHeaders: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(0 letters)
useJWT: false
jwtAlgorithm: ""
jwtKey: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(0 letters)
jwtKid: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(0 letters)
jwtSub: 𝑅𝐸𝐷𝐴𝐶𝑇𝐸𝐷(0 letters)
jwtExpDuration: 5
useRequestAPI: false
bucketPrefix: ""
chunkSplitterVersion: v3-rabin-karp
E2EEAlgorithm: v2
processSizeMismatchedFiles: false
forcePathStyle: true
syncInternalFileOverwritePatterns: ""
useOnlyLocalChunk: false
Obsidian debug info
Debug info
SYSTEM INFO:
Obsidian version: v1.10.6
Installer version: v1.8.9
Operating system: Windows 10 Pro 10.0.19045
Login status: not logged in
Language: en
Insider build toggle: off
Live preview: on
Base theme: adapt to system
Community theme: none
Snippets enabled: 0
Restricted mode: off
Plugins installed: 1
Plugins enabled: 1
1: Self-hosted LiveSync v0.25.36
RECOMMENDATIONS:
Community plugins: for bugs, please first try updating all your plugins to latest. If still not fixed, please try to make the issue happen in the Sandbox Vault or disable community plugins.
Plug-in log
We can see the log by tapping the Document box icon. If you noticed something suspicious, please let me know.
Note: Please enable Verbose Log. For detail, refer to Logging, please.
Plug-in log
1/1/2026, 12:53:00 PM->[ModuleLiveSyncMain] Loading plugin...
1/1/2026, 12:53:00 PM->[ModuleLiveSyncMain] Self-hosted LiveSync v0.25.36 0.25.36
1/1/2026, 12:53:00 PM->Log window opened
1/1/2026, 12:53:01 PM->[ModuleLocalDatabaseObsidian] Waiting for ready...
1/1/2026, 12:53:01 PM->Opening Database...
1/1/2026, 12:53:01 PM->Database is now ready.
1/1/2026, 12:53:01 PM->[ModuleInitializerFile] Initialize and checking database files
1/1/2026, 12:53:01 PM->[ModuleInitializerFile] Checking deleted files
1/1/2026, 12:53:01 PM->[ModuleInitializerFile] Synchronising...
1/1/2026, 12:53:01 PM->[ModuleInitializerFile] UPDATE DATABASE: Nothing to do
1/1/2026, 12:53:01 PM->[ModuleInitializerFile] UPDATE STORAGE: Nothing to do
1/1/2026, 12:53:01 PM->[ModuleInitializerFile] SYNC DATABASE AND STORAGE: Nothing to do
1/1/2026, 12:53:01 PM->[ModuleInitializerFile] Initialized, NOW TRACKING!
1/1/2026, 12:53:01 PM->Rule satisfied: sendChunksBulk is false
1/1/2026, 12:53:01 PM->Rule satisfied: sendChunksBulkMaxSize is 1
1/1/2026, 12:53:01 PM->Rule satisfied: doNotUseFixedRevisionForChunks is true
1/1/2026, 12:53:01 PM->Rule satisfied: handleFilenameCaseSensitive is false
1/1/2026, 12:53:01 PM->Rule satisfied: useEden is false
1/1/2026, 12:53:01 PM->Rule satisfied: hashAlg is xxhash64
1/1/2026, 12:53:01 PM->Rule satisfied: disableCheckingConfigMismatch is false
1/1/2026, 12:53:01 PM->Rule satisfied: enableCompression is false
1/1/2026, 12:53:01 PM->Rule satisfied: usePluginSyncV2 is true
1/1/2026, 12:53:01 PM->Rule satisfied: chunkSplitterVersion is v3-rabin-karp
1/1/2026, 12:53:01 PM->Rule satisfied: customChunkSize is 60
1/1/2026, 12:53:01 PM->Rule satisfied: E2EEAlgorithm is v2
1/1/2026, 12:53:01 PM->Replication closed
1/1/2026, 12:53:03 PM->Replication closed
1/1/2026, 12:53:03 PM->[ModuleCheckRemoteSize] Remote storage size: 875.95MB
1/1/2026, 12:53:20 PM->Fetched synchronisation parameters
1/1/2026, 12:53:20 PM->Synchronisation parameters fetched successfully
1/1/2026, 12:53:20 PM->Fetched synchronisation parameters
1/1/2026, 12:53:20 PM->Synchronisation parameters fetched successfully
1/1/2026, 12:53:20 PM->Fetched synchronisation parameters
1/1/2026, 12:53:20 PM->Synchronisation parameters fetched successfully
1/1/2026, 12:53:21 PM->Receiving Journal: Getting list of remote journal
1/1/2026, 12:53:21 PM->Receiving Journal: 1 / 529
1/1/2026, 12:53:21 PM->Fetched synchronisation parameters
1/1/2026, 12:53:21 PM->Synchronisation parameters fetched successfully
1/1/2026, 12:53:21 PM->Could not download 1766940543548-docs.jsonl.gz
1/1/2026, 12:53:21 PM->Could not download 1766940543548-docs.jsonl.gz
1/1/2026, 12:53:21 PM->Processing journal: No files needs to be processed!
1/1/2026, 12:53:21 PM->Could not receive remote journal, so we prevent sending local journals to prevent unwanted mass transfers
# ... then these logs whenever I try to replicate again
1/1/2026, 5:02:13 PM->Fetched synchronisation parameters
1/1/2026, 5:02:13 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:02:13 PM->Fetched synchronisation parameters
1/1/2026, 5:02:13 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:02:13 PM->Fetched synchronisation parameters
1/1/2026, 5:02:13 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:02:13 PM->Receiving Journal: Getting list of remote journal
1/1/2026, 5:02:14 PM->Receiving Journal: 1 / 531
1/1/2026, 5:02:14 PM->Fetched synchronisation parameters
1/1/2026, 5:02:14 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:02:14 PM->Could not download 1766940543548-docs.jsonl.gz
1/1/2026, 5:02:14 PM->Could not download 1766940543548-docs.jsonl.gz
1/1/2026, 5:02:14 PM->Processing journal: No files needs to be processed!
1/1/2026, 5:02:14 PM->Could not receive remote journal, so we prevent sending local journals to prevent unwanted mass transfers
Just for good measure, I set up a brand new vault, installed the livesync plugin and used the URI to configure it again.
1/1/2026, 5:19:26 PM->[ModuleLiveSyncMain] Loading plugin...
1/1/2026, 5:19:26 PM->[ModuleLiveSyncMain] Self-hosted LiveSync v0.25.36 0.25.36
1/1/2026, 5:19:26 PM->[ModuleLocalDatabaseObsidian] Waiting for ready...
1/1/2026, 5:19:27 PM->Opening Database...
1/1/2026, 5:19:27 PM->Database is now ready.
1/1/2026, 5:19:34 PM->Replication closed
1/1/2026, 5:19:35 PM->Connected to https://s3.us-east-005.backblazeb2.com successfully!
1/1/2026, 5:19:35 PM->Fetched synchronisation parameters
1/1/2026, 5:19:35 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:19:35 PM->Remote configuration matches local configuration. No changes applied.
1/1/2026, 5:19:35 PM->Replication closed
1/1/2026, 5:19:35 PM->Remote configuration applied.
1/1/2026, 5:19:35 PM->[ModuleRedFlag] Fetching everything with settings: makeLocalChunkBeforeSync=false, makeLocalFilesBeforeSync=false
1/1/2026, 5:19:35 PM->Replication closed
1/1/2026, 5:19:35 PM->Replication closed
1/1/2026, 5:19:35 PM->Replication closed
1/1/2026, 5:19:35 PM->Database closed for reset Database.
1/1/2026, 5:19:35 PM->Replication closed
1/1/2026, 5:19:35 PM->Opening Database...
1/1/2026, 5:19:35 PM->Database is now ready.
1/1/2026, 5:19:35 PM->Local Database Reset
1/1/2026, 5:19:36 PM->Database closed (by close)
1/1/2026, 5:19:36 PM->[ModuleLocalDatabaseObsidian] Waiting for ready...
1/1/2026, 5:19:36 PM->Replication closed
1/1/2026, 5:19:36 PM->Opening Database...
1/1/2026, 5:19:36 PM->Database is now ready.
1/1/2026, 5:19:36 PM->Fetched synchronisation parameters
1/1/2026, 5:19:36 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:19:36 PM->Mark this device as 'resolved'.
1/1/2026, 5:19:37 PM->Fetched synchronisation parameters
1/1/2026, 5:19:37 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:19:38 PM->Fetched synchronisation parameters
1/1/2026, 5:19:38 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:19:38 PM->Fetched synchronisation parameters
1/1/2026, 5:19:38 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:19:38 PM->Receiving Journal: Getting list of remote journal
1/1/2026, 5:19:38 PM->Receiving Journal: 1 / 531
1/1/2026, 5:19:38 PM->Fetched synchronisation parameters
1/1/2026, 5:19:38 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:19:38 PM->Could not download 1766940543548-docs.jsonl.gz
1/1/2026, 5:19:38 PM->Could not download 1766940543548-docs.jsonl.gz
1/1/2026, 5:19:38 PM->Processing journal: No files needs to be processed!
1/1/2026, 5:19:40 PM->Fetched synchronisation parameters
1/1/2026, 5:19:40 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:19:40 PM->Fetched synchronisation parameters
1/1/2026, 5:19:40 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:19:40 PM->Receiving Journal: Getting list of remote journal
1/1/2026, 5:19:41 PM->Receiving Journal: 1 / 531
1/1/2026, 5:19:41 PM->Fetched synchronisation parameters
1/1/2026, 5:19:41 PM->Synchronisation parameters fetched successfully
1/1/2026, 5:19:41 PM->Could not download 1766940543548-docs.jsonl.gz
1/1/2026, 5:19:41 PM->Could not download 1766940543548-docs.jsonl.gz
1/1/2026, 5:19:41 PM->Processing journal: No files needs to be processed!
1/1/2026, 5:19:43 PM->Fetch everything operation completed. Vault files will be gradually synced.
1/1/2026, 5:19:43 PM->Replication closed
1/1/2026, 5:19:43 PM->[ModuleInitializerFile] Initialize and checking database files
1/1/2026, 5:19:43 PM->[ModuleInitializerFile] Checking deleted files
1/1/2026, 5:19:43 PM->[ModuleInitializerFile] Synchronising...
1/1/2026, 5:19:43 PM->[ModuleInitializerFile] UPDATE DATABASE
1/1/2026, 5:19:43 PM->[ModuleInitializerFile] UPDATE STORAGE: Nothing to do
1/1/2026, 5:19:43 PM->[ModuleInitializerFile] SYNC DATABASE AND STORAGE: Nothing to do
1/1/2026, 5:19:43 PM->[ModuleDatabaseFileAccess] STORAGE -> DB (plain) Welcome.md
1/1/2026, 5:19:43 PM->[ModuleInitializerFile] UPDATE DATABASE: DONE:1, FAILED:0, LAST:0
1/1/2026, 5:19:43 PM->[ModuleInitializerFile] Initialized, NOW TRACKING!
1/1/2026, 5:19:43 PM->Checking for incomplete documents...
1/1/2026, 5:19:43 PM->No size mismatches found
1/1/2026, 5:19:43 PM->Rule satisfied: sendChunksBulk is false
1/1/2026, 5:19:43 PM->Rule satisfied: sendChunksBulkMaxSize is 1
1/1/2026, 5:19:43 PM->Rule satisfied: doNotUseFixedRevisionForChunks is true
1/1/2026, 5:19:43 PM->Rule satisfied: handleFilenameCaseSensitive is false
1/1/2026, 5:19:43 PM->Rule satisfied: useEden is false
1/1/2026, 5:19:43 PM->Rule satisfied: hashAlg is xxhash64
1/1/2026, 5:19:43 PM->Rule satisfied: disableCheckingConfigMismatch is false
1/1/2026, 5:19:43 PM->Rule satisfied: enableCompression is false
1/1/2026, 5:19:43 PM->Rule satisfied: usePluginSyncV2 is true
1/1/2026, 5:19:43 PM->Rule satisfied: chunkSplitterVersion is v3-rabin-karp
1/1/2026, 5:19:43 PM->Rule satisfied: customChunkSize is 60
1/1/2026, 5:19:43 PM->Rule satisfied: E2EEAlgorithm is v2
1/1/2026, 5:19:43 PM->Replication closed
1/1/2026, 5:19:43 PM->[ModuleInitializerFile] UPDATE DATABASE All done: DONE:1, FAILED:0
1/1/2026, 5:19:45 PM->Replication closed
1/1/2026, 5:19:45 PM->[ModuleCheckRemoteSize] Remote storage size: 875.97MB
1/1/2026, 5:19:57 PM->Log window opened
Network log
There are no new network entries when I click "replicate now".
Other information, insights and intuition.
- I used to have a self-hosted CouchDB server, but then decided to try the S3 option. You may notice that the CouchDB settings are still filled in, but I have the S3 option as the active one.
- I accidentally initialized the B2 server without encryption. I changed it pretty quickly, but it likely did write some files unencrypted. I'm not sure if that might cause any issues.
- I tried the replication on my phone connected to a cell network (and no VPN) to confirm the problem wasn't related to my home network. I got the same log messages about
Could not download ....jsonl.jz