database disk image is malformed

[Tonylolo]

Hi,

it's my fist export, I want export all my albums with video, photos edited for after import into immich.

osxphotos export /Users/lolotony/Downloads/3 --skip-original-if-edited --touch-file --directory “{folder_album}” --convert-to-jpeg --jpeg-quality 1.0
Using last opened Photos library: /Users/xxx/Pictures/Bibliothèque Photos.photoslibrary
Created export database /Users/xxx/Downloads/3/.osxphotos_export.db
2025-02-28 16:46:04,643 - root - WARNING - photosdb.py - 157 - WARNING: This module has only been tested with macOS versions [10.12, 10.13, 10.14, 10.15, 10.16, 11.0, 11.1, 11.2, 11.3, 11.4, 11.5, 11.6, 11.7, 12.0, 12.1, 12.2, 12.3, 12.4, 12.5, 12.6, 12.7, 13.0, 13.1, 13.2, 13.3, 13.4, 13.5, 13.6, 14.0, 14.1, 14.2, 14.3, 14.4, 14.5, 14.6]: you have Darwin, OS version: 15.2
Processing database /Users/xxx/Pictures/Bibliothèque Photos.photoslibrary/database/photos.db
Database locked, creating temporary copy.
Something went wrong and osxphotos encountered an error:
database disk image is malformed
Crash log written to '/Users/xxx/osxphotos_crash.log'
Please file a bug report at https://github.com/RhetTbull/osxphotos/issues with the crash log attached.

I've repaired library twice, restart Mac, used different folder to export...

Do you have an idea ?

osxphotos_crash.log

[RhetTbull]

Does the library open in Photos?

[Tonylolo]

In photos al is ok.
When i run command Photos is closed

[RhetTbull]

I'm traveling today but when I get back to my Mac will give you some ideas for further debugging. Was this library created on macOS 15.2 or upgraded from a previous version?

[Tonylolo]

It's a old library.

[oPromessa]

@Tonylolo you possibly copied the command from Notes or TextEdit into the terminal which resulted in pasting the special quotes and not regular quotes.

On the crash log you have:

directory', '“{folder_album}�',

Try rerun with typing the " directly on the terminal.

[Tonylolo]

osxphotos_crash.log

same thing

[RhetTbull]

@oPromessa that was a good guess (and would have caused errors when the code got the the quoted template) but this error is happening before the template is even processed. Reference #1437 which will warn of use of "smart quotes" once implemented.

@Tonylolo I don't know why the error is happening but I understand where and how I can implement a work-around. Will try to get a hot-fix pushed out in the next week or so.

What's happening:
Before macOS Catalina (10.15), Photos used a database called Photos Library.photoslibrary/database/photos.db. In 10.15, (Photos 5), Photos switched to a new schema and new database called Photos Library.photoslibrary/database/Photos.sqlite. However, the old photos.db still exists. OSXPhotos needs to know which version of Photos the database was created with so it can adjust to the correct schema (each version of Photos uses a different database schema) and so it first reads the photos.db then once it figures out it's a "new style" database, then reads Photos.sqlite. It appears the photos.db database is corrupt in your case. I don't know what could cause this. This likely causes no problem with Photos because Photos knows to read the Photos.sqlite. I need to catch the error then put in logic to determine what version the database belongs to.

In the meantime, if you have a backup of your library, you could try this which I think will fix the problem:

• Close Photos
• In Terminal navigate to ~/Pictures/Bibliothèque Photos.photoslibrary/database (or right click on the Photos library in the Finder and select Show Package Contents then navigate to the database folder.
• Rename photos.db to photos.db.backup
• Restart Photos

I believe Photos will re-create the missing photos.db and then osxphotos will work. The photos.db in a current Photos library does not contain any data about your photos, only metadata about the version of Photos used to create the library so that if you try to open the library on an old version of macOS, Photos can alert you that it's the wrong version. Photos automatically creates this file if not present.

[Tonylolo]

OK, I've tried, but same result.

osxphotos_crash.log

thank you for your help

[RhetTbull]

OK, I've tried, but same result.

That is very strange. Try running the following commands and let me know what the output is:

file ~/Pictures/Bibliothèque\ Photos.photoslibrary/database/photos.db
file  ~/Pictures/Bibliothèque\ Photos.photoslibrary/database/Photos.sqlite
sqlite3  ~/Pictures/Bibliothèque\ Photos.photoslibrary/database/photos.db "PRAGMA integrity_check;"
sqlite3  ~/Pictures/Bibliothèque\ Photos.photoslibrary/database/Photos.sqlite "PRAGMA integrity_check;"

I may be able to work around the problem in OSXPhotos but it would be helpful to understand why the problem actually is occurring.

[Tonylolo]

/Users/lolotony/Pictures/Bibliothèque Photos.photoslibrary/database/photos.db: SQLite 3.x database, last written using SQLite version 3028000, page size 16384, file counter 10, database pages 3, cookie 0x3, schema 4, UTF-8, version-valid-for 10
/Users/lolotony/Pictures/Bibliothèque Photos.photoslibrary/database/Photos.sqlite: SQLite 3.x database, last written using SQLite version 3043002, writer version 2, read version 2, file counter 5199, database pages 70622, 1st free page 58919, free pages 853, cookie 0x1db, schema 4, largest root page 472, UTF-8, vacuum mode 1, version-valid-for 5199
Error: in prepare, database disk image is malformed (11)
ok

[RhetTbull]

Error: in prepare, database disk image is malformed (11)

This confirms why osxphotos is seeing the error but I am perplexed about why Photos would have re-created a corrupt database after you renamed it. I can likely get osxphotos to work around this but as I said, will take a me a bit to get the fix in place and tested.

[Tonylolo]

Ok
Tell me if i should test other things.
Thk

[Tonylolo]

Hi, do you any news for me ?
Thank you