Uses excessive memory on import

Recorded on our Trac at http://trac.yorba.org/ticket/1998

this bug is fixed upstream.

Someone reported 1.2gig of memory use for a small problem. I just want to add that in my case it reaches past 11gig before I shut it down.

 5116 markgala 20 0 11.1g 4.9g 3752 T 0 87.2 27:45.98 shotwell

markgalassi, which version are you using?

shotwell 0.6.1 is in Maverick.

Currently 0.7.2 is in maverick and import from f-spot with 20.000 pictures crashes my 8GB machine (out of memory). It seems that shotwell is leaking memory when creating thumbnails.
According to the yorba ticket system the current discussion focuses on the situation *after* the import - but shotwell is unable to scale _during_ the import. This should be fixed, or a multi-step import could be used as a work around.

everflux,

This is a separate problem than the one reported here. Our ticket for this problem is at http://trac.yorba.org/ticket/2566

-- Jim

Clean install of 11.04 and import of photos folder containing over 26,000 photos at 90 GB leads Shotwell 0.9.3 to run at 108% on Quadcore AMD CPU (now 112% -- higher at times) and using 2.5 GB of RAM. Use of RAM keep climbing until maxing out my 4 GB and Shotwell crashes.

We will try to repro in house. However, this sounds like potentially a different issue than the one in the bug (the fix for this was already verified.)

I have not been able to reproduce the memory leak on 11.04 with either Shotwell 0.9.3 or the current 0.10+trunk. My Quadcore CPU runs as high as 240%, but memory usage does not climb above 200MB for importing 30,000 photos.

When importing RAW photos (about 100 files totaling 1GB), memory usage spiked to as high as 500MB but would settle back to 200MB between each photo and after completing the import.

Questions for Dave:
* Were RAW files imported and if so, what kind?
* How was Shotwell installed - from the Yorba PPA or built from source?

Hi Vera,
About 1/3 of the photos would have been RAW, no more, taken with Nikon
digital SLRs, so NEF file formats.
Shotwell was installed as part of the regular Ubuntu 11.04 installation
process. No special debs or ppas involved.
I will try to reproduce myself again to confirm. I've found Unity to have
some problems so will also log into Ubuntu Classic and see if I can
reproduce.

David Schult
Si hoc legere scis, nimis eruditionis habes.
https://sites.google.com/site/filosofic/

On Wed, Jun 1, 2011 at 12:46, Vera Yin <email address hidden> wrote:

> I have not been able to reproduce the memory leak on 11.04 with either
> Shotwell 0.9.3 or the current 0.10+trunk. My Quadcore CPU runs as high
> as 240%, but memory usage does not climb above 200MB for importing
> 30,000 photos.
>
> When importing RAW photos (about 100 files totaling 1GB), memory usage
> spiked to as high as 500MB but would settle back to 200MB between each
> photo and after completing the import.
>
> Questions for Dave:
> * Were RAW files imported and if so, what kind?
> * How was Shotwell installed - from the Yorba PPA or built from source?
>
> --
> You received this bug notification because you are a direct subscriber
> of the bug.
> https://bugs.launchpad.net/bugs/588569
>
> Title:
> Uses excessive memory on import
>
> To unsubscribe from this bug, go to:
> https://bugs.launchpad.net/shotwell/+bug/588569/+subscribe
>

More than ten years later, I still have the same problem. (Ubuntu 20.10; Shotwell 0.30.10)). Shouldn't such a bug also be marked as a security issue? Isn't such a memory overflow potentially dangerous?

Opened a bug report on Gnomes Gitlab: https://gitlab.gnome.org/GNOME/shotwell/-/issues/323

After 12 years, this bug/issue is still present on 21.04 (Shotwell 0.30.11) and Shotwell 0.30.14 from unreleased Ubuntu 22.04 (development).

Updated https://gitlab.gnome.org/GNOME/shotwell/-/issues/323 with details.