Processing less than a minute remain, forever

Expected Behavior

First time user, installed Windows version 1.1.0, and ran full scan (currently in trial)
I have several drives.

I expect it to complete the scan

Current Behavior

Drive C completed fine.
Drive D is currently reported (since yesterday)

Processing, less than a minute remains
Processed 58619 photos, 123 videos. 1 remain to be processed.

It seem to be stuck at that 1 item and not progressing forward,

Steps to Reproduce

  1. Install product
  2. Select scan all

Environment

Operating system and version: Windows 11

PhotoStructure edition: PhotoStructure for Desktop, v 1.1.0

Howdy @novice , welcome to PhotoStructure!

Sorry you have a sync glitch. I wrote a ton of code around trying to avoid exactly this situation:

  1. I have timeouts on all I/O operations and sync-file operations, so if anything gets “stuck”, it gives terminates that process and retries one more time. If that retry fails, it marks the file as “un-importable”.

  2. The work queue is stored in another SQLite db, so if sync crashes or you reboot your computer for any reason, the sync will restart from where it left off (rather than restarting from scratch, which meant I could never finish scanning some of my larger hard drives).

  3. Directory content listings are cached if they take longer than a couple seconds to fetch. This is a workaround for directories from smartphone backups, which commonly don’t use sub-directories, resulting in a single directory with 10k+ files

So. Something is still slipping through the cracks here.

Option A

If you have time and want to help me debug what happened:

  1. Shut down PhotoStructure
  2. Set PS_LOG_LEVEL=info
  3. Restart PhotoStructure, wait a couple minutes for sync to retry that last file
  4. Send me the resulting logs

The instructions for how to do this are here: https://photostructure.com/faq/error-reports/#how-to-manually-send-your-logs

Option B

If you just want to scan your other drives, go into your settings page, and instead of using “automatic”, use “manual”, and add the other drive letters (or directories) that you want to import. It’ll look like this:

Thanks for getting back.

I had already done Option B which is currently still scanning.
I would still like to help debug this, would I be able to do so once the manual scanning is completed?

Thanks

Another issue I’m encountering is that Canon Raw files (.CR2) are not detected / added to the library
Isn’t this supposed to be supported in v 1.1?

Am I missing something?

Thanks

I expect most (not all) .CR2 files to be importable by PhotoStructure v1.1.

Note that Canon uses .CR2 and .CR3 to represent a couple (!!) of different RAW formats. Version 1.1 of PhotoStructure uses dcraw, which only supports an older .CR2 format variant.

I updated PhotoStructure in version 2.1 and later to use a custom build of LibRaw, which should work for the newer Canon cameras.

If you want to try the alpha build of v2.1, that should resolve the issue.

I’m working through the bugs found in alpha before I release v2.1–please have current backups if you try an alpha (or beta!) build (but really, backups are always a good idea!)

Thanks,
I’m not sure my camera qualifies as newer Canon,
It’s a Canon 20D and the photos are from 2005 2006
You think alpha 2.1 would help?
I’ll upgrade if you think it would, but from the sound of it, the upgrade would help for newer .CR3 files.

As for backup, is sqlite3 db backup sufficient or do I need to backup the entire .photostructure folder (Windows 11)?

Thanks again.

Hmm, those should import just fine with v1.1. Can you email me (support@photostructure.com) an example .CR2 file that doesn’t have any private content, and isn’t importing, so I can take a look?

Sure can,
Just to be clear what you mean by private content, you want me to strip out the exif data? it has some personal information like Name / Serial number …
Or more about the photo content?
As long as it is not shared publicly, I have no problems sending it to you as is, I’d assume you’d want the exif data intact.

Thanks

No, please email the original file if possible.

I’ll delete the file as soon as we debug the issue, so it’ll stay private. I just don’t want people sending anything with content that they’d consider sensitive.

Done.

Thank you.

Hi,

Any update on this?
Thanks

Sorry for the response delay!

I just tried importing the CR2 you sent me on Ubuntu with the v2.1 alpha build, and it imported fine. I’ll try on windows next.

I just bumped out your trial by a month–I hope to have v2.1 shipped by then.

Thank you very much, appreciated.
I look forward to 2.1

Regards.

Hi,

I’m following up on this, has Photostructure v2.1 released? If not any rough ETA?
Thanks

2.1.0-alpha.7 was released on 7/27 (see post below). If you mean a release of a so-called “stable” 2.1.0 that could be while still. I would not wait for it, try the alpha.7 release, in my opinion it’s not any less stable than the stable release (which is now a year old) and has A LOT of worthwhile improvements.

Thanks
I installed the 2.1.0 alpha yesterday.
After several hours, nothing changed in terms of previously undiscovered images.
I did a slow rebuild, and now the number of the discovered images is around 50% of what it used to be.
And every time I check I get the following message even after waiting several hours.
image.

I’m not sure if this is license related or a bug.
This is what I see when I click on the hamburger menu
image

Thanks

It shouldn’t be license related: both LITE and PLUS should both sync and rebuild libraries reliably. The only difference should be the PLUS-only features (like auto organization) will be available if you have PLUS.

If you have time, can you follow “Option A” and send me your logs? There’s a chance I can determine what’s amiss with PhotoStructure on your machine if you share those.

It looks like it is progressing, it now says 2 hours remain, and Refreshing assets and previews count is decreasing.
I’ll check again when that reaches 0
If it gets stuck, I’ll do the Option A
When the count reaches 0 should I expect cr2 files to be added automatically? or should I set something for that to work?

Thanks

A rebuild won’t pick up new assets: it just revisits all existing files in your current library, rebuilds metadata, re-aggregates, and rebuilds previews. A sync will pick up new files on the filesystem:

Sorry for novice questions and feedback.
After all the rebuild is finished, the When group is now show 280, down from some 34k images.
image

Not sure if I did something wrong or not.

This is my configuration

Next I did Sync | restart Sync
It displayed the following
image

and then
image

and then
image

What happened to the H:\ why didn’t it process it?
Why did the When group ended up with 280 images?

Whereas Camera group has some 13K
image

No way these images are without the date data.
Where do I see the total of all images in the Library?

And lastly, I still don’t see the cr2 files

Thanks, and sorry for novice questions, I’m not finding the application intuitive enough to answer my own questions, and I’m not a novice to computers / software …