yes, those logs were SQLITE_CORRUPT issues. If you recall, we initially suspected an unraid issue, but then I reproduced on ubuntu server. If you need me to re-re-re-produce and get fresh logs, let me know! Happy to do whatever to get to the bottom of it
@mrm sorry, I misread your question. Do you want new logs? Or the full debug logs I have sent you by DM previously suffice?
I believe Iāve reviewed all the logs youāve (graciously!) shared with me, and couldnāt find a smoking gun. Ideally (like what weāve discussed previously): thereād be some set of discrete steps I could apply on my own hardware that reproduces the issue.
How big is the library youāre importing? Are there a mix of photos and videos? HEIC/HEVC? How soon into the import do you see the corruption issue?
My library has 22k files or so, photos and videos. Yes, I have HEIC.
The corruption happens pretty quickly - less than an hour maybe? I didnāt exactly time it.
You might also recall from discord that when I set PS_DB_BACKUP_INTERVAL_MINUTES to a large value, that seemed to delay the error long enough that the initial imported completed. Thatās the best hint I could find.
Happy to run a dev build with additional instrumentation if needed⦠Also, would SQL log help? I thought there was a setting for sql logs that is above and beyond what is in debug?
EDIT: well, I just noticed that the fresh install I did to record the video actually completed all the way without error. So no idea ![]()
Iād check your sync report to track down which files are missing. If you see anything suspect with those files, please tell me!
What constitutes āsuspectā:
-
A file is completely missing from the report. This could be due to the parent directory being āskippedāāthe sync report should say why the parent directory was skipped.
-
Thereās a row for the file where itās āenqueuedā, but no other rows. This would indicate a bug in PhotoStructureās work queue.
-
Thereās a row for the file that says ātimeoutā or āfailedā, and the error seems bogus.
(not at my computer)
Itās the same test files incl sync report I did send you over a PMā¦
Ah! If you could DM me which files didnāt get imported this time thatād be swell. Thanks again for the assist.
The same files didnāt get processed ![]()
OK, thanks, Iāll review this after lunch.
