App v.1.1.0 crash and processed photos not changing

Hey!

Firstly, looks a great bit of a software that I somehow found, so thanks for that :slight_smile:

Im trying to import my massive photo and video library (circa 700,000) with countless duplicates from my 3.5" external drive (didnā€™t dare with the NAS alternative with probably slower speeds).

It was going well, but its either my 2013 i5 8gb RAM MacBook that canā€™t handle it, or the app itself, but after so long, perhaps several hours, the entire system freezes up.

Iā€™ve rebooted a couple of times and the sync has continued fine which was amazing, but this last time I donā€™t think it went as wellā€¦ its showing photos coming and going in the progress bar, but the number of ā€˜processedā€™ items is sticking at 15. Some kind of corruption?

I tried a sync pause, and a restart sync (though I wasnā€™t sure what the restart sync actually did) and no change. A reboot did nothing to help either. If its working- thats fine, but I donā€™t want to waste time as its a huge library and I know Iā€™ll be at it for a good few more days at the speed its been going.

I noticed it there are 2 paths in the settings bitā€¦ one being ā€˜staleā€™ which worries me.

I did send logs, or should I say, clicked that button but it didnā€™t give me any dialog box to say anything happened.

P.s. Very confused about the app versions, as I see talk of 2.1.0, but only a download for 1.1.0.

Hope you can help :slight_smile:

Thanks
Adam

Howdy @adamj84 , welcome to PhotoStructure!

A directory is ā€œstaleā€ if it hasnā€™t been synced recently. Only one directory is synced at a given time, so if that gets stuck or runs for a while, other directories may fall into the ā€œstaleā€ state.

Sorry about that!

The current stable release is v1.1.0, which is what youā€™re running. Unfortunately, it has some known issues with syncing, especially as library sizes increase, or if there are any very large directories (typical with smartphone backups, which can have 10k+ files in a single dir). I believe thatā€™s what youā€™re hitting up against here.

I rewrote PhotoStructureā€™s library directory iteration, database persistence, and job scheduling in the version 2.x branch, which is currently in alpha. You can see details about the latest builds in the release notes and in forum posts tagged with alpha, as well as in discord.

Thank you for the reply, I did think that must be the case re the versions, but thought if weā€™re beyond v 2.0 there could be a stable release of the previous.

So with the 2 directories, are we saying that the app has started again and Iā€™m duplicating my efforts, and if so, is there a way back to fix this? just wondering how I should progress.

Unless youā€™d recommend going with the alpha builds and starting again?

There were a ton of moving parts I changed in v2.x. the v2.0-alpha seemed to be looking good, so I did a v2.0-beta build, but after seeing several people have library db corruption, I didnā€™t want to release a stable build without addressing that issue, hence the lack of a v2.0-stable release and why weā€™re on v2.1-alpha.

Letā€™s make sure I understand your setupā€“what does your settings page look like (specifically the ā€œwhere is your libraryā€ and ā€œwhere can I look for photos and videosā€ sections)?

Sure, so this is how weā€™re looking.

I can also update to say there is now no processing happening at all, Iā€™m faced just with the library of images and videos, with no progress bar/sync thing at the top.


The very minimum I would like to get out of this software is to get rid of my many duplicates, and to have the remainder in the date folder structures that its been doing.

OK, that setup is totally reasonable.

Let me release the next alpha build and have you try that.

I want to fix glob support, and then I can release. I hope to have it ready this afternoon, but cross-platform tests can be a bear to get to pass.

Perfect, thank you so much, Iā€™ll keep an eye out

Hey - in the meantime of waiting for this new version, it seems the library has started working againā€¦

Iā€™m trying to workout what this means per say, and couldnā€™t find the details on the docs/faqā€™s so far.

  1. What are ā€˜assetsā€™? seen as there are far fewer of these then there are images and videos? this number hasnā€™t gone up in a long timeā€¦ I donā€™t know what it is, to know f thats right or not. Photos and videos are still ā€˜progressingā€™.

  2. As I have 2 ā€˜pathsā€™ā€¦due to a crash, both seemingly working? I donā€™t know where I stand on the sync situation?

  3. I want to make sure that I only have 1 library, nothing missing (due to the crash), and to know what files or folders PhotoStructure creates? so I know what to copy/backup if need be :slight_smile: I donā€™t want to delete the wrong photos or config files etc.

Thank you and sorry for being a pain.

Adam

@mrm Have you had any luck on the updated build / can help on my above comment please?

Current updateā€¦ still importing, this is taking an absolute age lol.