Leftover images

Permalink Browser Info Environment
I have around 4400 images in the File Manager, but when you add the leftover old image versions it adds up to 20k image.How long on average will it take to remove all old image versions? so the old version images alone are approx 15400 images. How long will it take to delete those images? Will this affect the server or cause it to stop due to the huge image number?

We also used to use a watermark add-on that add watermark to images, but we dont use it anymore so when I delete the addon it doesn't delete the watermark images in the application/files folder, this is the link to the add-onhttps://www.concrete5.org/marketplace/addons/watermarknn...

Will this add-on help us with removing the leftovers watermark images?

Thank you.

Type: Pre-Sale
Status: Resolved
tarekmostafa2
View Replies:
ramonleenders replied on at Permalink Reply
ramonleenders
Hi there,

How long it will take, depends on the server of course. It can vary. If you know this is a BIG task for the server, you can decide to make a staging site of your production site and do things there. Then, after completion, move your staging to production.

As for deleting old versions of files, you can check/uncheck files. You could for example just do it for the first 10. So in case of deleting just a few (if your server times out or whatnot), you can restart the process again afterwards.

I don't know the watermark Add-On, so I don't know where it stores it (backup) images. There's a section "File Versions Unapproved" and "File Leftovers". The latter will list everything that is not part of the concrete5 core. You then are, again, free to check/uncheck whichever file you want to include/exclude for optimization. Do you know where the watermark images are stored (exactly)? Then I could confirm that for you. Also let me know if it's a location of your "File Storage Locations" (/index.php/dashboard/system/files/storage), if you aren't using the default setup for that. If it it doesn't store in any of your locations, the Add-On isn't/wasn't doing it by the books and the Add-On doesn't look for it.

Kind regards,

Ramon
tarekmostafa2 replied on at Permalink Reply
tarekmostafa2
Hi Ramon,

Thanks for your reply, I understand the process depends on the server. This is our server specs (Duel E5620 @ 2.40GHz, 32gb 6gb/drives and 100mb connection)
Depending on that, what is your best guess to delete over 16,000 leftovers? Could it take minutes, hours, or maybe days?

For the watermark images, they are stored inside the application/files folder and there isn't a specific folder that contains all of them, they are placed randomly inside the application/files.
And the "File Storage Locations" it's using the Default

Thank you,
Tarek.
ramonleenders replied on at Permalink Reply
ramonleenders
Could take a couple of minutes, but could be done in a minute as well. It's all about removing files from your local storage and removing some database entries. Best to do in a staging/test environment anyways I think.

If you want me to test it out, you could send a copy of your site + the database export using WeTransfer. I could test it out on my server to see how it reacts (I have no real quick way of adding that amount of image versions, that's why I ask). Could also compare that to my local setup, to see if there's any difference. That since removing an image within a folder should be a fairly easy task for the server/host.
tarekmostafa3 replied on at Permalink Reply
tarekmostafa3
Thank you for offering to test the add-on, well the website file size is too big it's almost 19GB, mostly because of all the images we have (20,000 images), I can upload it to Mega.nz cloud storage instead because it has 50GB free storage unlike WeTransfer which has 2GB, and I can send you the download link from there, how about that? Tell me if you are okay with this
Thank you very much.
ramonleenders replied on at Permalink Reply
ramonleenders
As you state in a PM, it may be best to go with a staging on your own server. That way we know how the server reacts, instead of other servers (which may be faster/slower or whatever). Let me know the login credentials (FTP + CMS) by PM, so I can test it out for you.

Kind regards,

Ramon
tarekmostafa2 replied on at Permalink Reply
tarekmostafa2
I forgot to include that we are using a shared hosting server but we use 99.9% of the traffic

concrete5 Environment Information

# concrete5 Version
Core Version - 8.3.1
Version Installed - 8.3.1
Database Version - 20171218000000

# concrete5 Packages
Fruitful (1.2), HTML5 Audio Player Basic (2.0.5), Hutman Ads (1.0.0), Responsive Embed (1.0.0), Spacer (0.9.3), Thumbnail Generator (11.0.0), Touch Gallery (2.3.2), WatermarkNN (1.2.3)

# concrete5 Overrides
blocks/image/view.php, blocks/image, js/redactor.js

# concrete5 Cache Settings
Block Cache - Off
Overrides Cache - Off
Full Page Caching - Off
Full Page Cache Lifetime - Every 6 hours (default setting).

# Server Software
Apache

# Server API
fpm-fcgi

# PHP Version
5.6.33

# PHP Extensions
bcmath, calendar, cgi-fcgi, Core, ctype, curl, date, dom, ereg, exif, fileinfo, filter, ftp, gd, gettext, hash, iconv, imap, ionCube Loader, json, libxml, mbstring, mcrypt, mhash, mysql, mysqli, mysqlnd, openssl, pcre, PDO, pdo_mysql, pdo_pgsql, pdo_sqlite, pgsql, Phar, posix, Reflection, session, SimpleXML, sockets, SPL, sqlite3, standard, tokenizer, wddx, xml, xmlreader, xmlwriter, xsl, Zend OPcache, zip, zlib

# PHP Settings
max_execution_time - 120
log_errors_max_len - 1024
max_file_uploads - 20
max_input_nesting_level - 64
max_input_time - 60
max_input_vars - 1000
memory_limit - 2048M
post_max_size - 56M
sql.safe_mode - Off
upload_max_filesize - 200M
mysql.max_links - Unlimited
mysql.max_persistent - Unlimited
mysqli.max_links - Unlimited
mysqli.max_persistent - Unlimited
pcre.backtrack_limit - 1000000
pcre.recursion_limit - 100000
pgsql.max_links - Unlimited
pgsql.max_persistent - Unlimited
session.cache_limiter - <i>no value</i>
session.gc_maxlifetime - 7200
opcache.max_accelerated_files - 4000
opcache.max_file_size - 0
opcache.max_wasted_percentage - 5

Browser User-Agent String

Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36

Hide Post Content

This will replace the post content with the message: "Content has been removed by an Administrator"

Hide Content

Request Refund

You have not specified a license for this support ticket. You must have a valid license assigned to a support ticket to request a refund.