Uploading/optimising File Problems

Permalink Browser Info Environment
Hello Emerii

I wanted to report a problem with the uploader/optimiser.
My client was not able to work on the new version of her website for some time, so I am just getting back to you about this now. We are still in development.

She was having problems uploading/optimising large quantities of pictures, a problem that she did not have with GalleryES in Concrete5.6
I looked through your documentation, and saw the note about uploading in batch, and tried changing the memory limit as suggested. ( I changed to 64M) This broke Concrete5.

I then tried batch uploading/optimising 30 pictures. 4 pictures did not get loaded.
I tried a smaller batch - the same pictures didn't get loaded.
I thereafter tried loading the guilty parties - individually. No go.

Strange is, that the failed uploads all vary in size. The largest is 8mb, the smallest is 3.9.
Other, even larger pictures loaded and were optimised no problem.

It is too bad that this feature is not working. My client is a Photographer/Artist, and she produces files of varying size. I can make her do the batch size/optimisation herself, but it is really one of the great aspects of this add-on. We never expected it wouldn't work in 5.7.

Is there a glimmer of hope? Is this a problem you are working on?

Thanks
Arlene

Type: Discussion
Status: Resolved
arlenesey
View Replies:
arlenesey replied on at Permalink Reply
arlenesey
Okay - this is strange.
I went over to the C5 file manager. All those missing pictures are there, but listed as 0,0 kb. If I click "Edit" they are in the database, but full size (original) not optimised or reduced.
emirii replied on at Permalink Reply
emirii
Hello, can you try to upload those pictures directly in the file manager (rather from my uploader), and does the file manager give you any errors or produce the same result?

I have ran into this problem before, and sometimes it wont upload a file no matter what I do! I had to open the image in photoshop and resave it as a different format/file.

If you can upload to the normal file manager in concrete5, would you please send me a picture sample?
arlenesey replied on at Permalink Reply 1 Attachment
arlenesey
The 8Mb image upload failed - I got a "not enough space" message (attached)
The 3.9 Mb image loaded and created 10 (!) thumbnails.
I will send the 2 pictures by PM
emirii replied on at Permalink Reply
emirii
I managed to upload both files just fine on my server with playing with my PHP settings. here's what I think can help you:

The 10 thumbnails are created because of the default thumbnail settings in Concrete5. If you visit yoursite.com/dashboard/system/files/thumbnails you can see there are 5 thumbnail types. Concrete5.7 automatically creates a regular and a retina version of each type, so 5x2 = 10. This obviously eats up mega resources on large file uploads!!

You can probably safely delete the Small Image, Medium Image, and Large Image types if you don't use them anywhere else.

It looks like you got the max-upload to work for you if you are getting memory errors.

For the out of memory error, you'll have to raise your max memory PHP (memory_limit) can use in your php.ini file, its default somewhere around 128mb if I remember correctly. Try putting it at 256mb to start, if that's still not enough try 512mb, (it depends on how much memory you system can spare after that). Sometimes you might have to restart the PHP process or the server to get the changes to take effect though.

I was able to successfully process the 8MB file when setting my memory_limit to 512mb, but every server is different.

Once I found the right settings I was able to upload both images you sent me at once using my uploader, and also using the Concrete5 manager.

Let me know if you need any help with the php.ini settings, dealing with large pictures is tricky, PHP is meant for smaller things (doesn't mean you can't push it though!) and it also depends on how fast your processor on the server is.
arlenesey replied on at Permalink Reply
arlenesey
Thank you Emerii - this worked.
For others out there, who wish to change server settings - be sure to log out of the Concrete5 dashboard before fiddling around. If you are still logged in, C5 will stop working.

concrete5 Environment Information

# concrete5 Version
Core Version - 5.7.5.3
Version Installed - 5.7.5.3
Database Version - 20150731000000

# concrete5 Packages
Automatic Email Obfuscator (2.0.1), GalleryES (2.3.8), Hi-Vis (1.0.1), Page Redirect (2.0), Page Selector Attribute (2.0), Spacer (0.9.1), Vivid Simple Accordion (1.0.1).

# concrete5 Overrides
blocks/vivid_simple_accordion/templates/anja_accordion/view.php, blocks/vivid_simple_accordion/templates/anja_accordion/view.js, blocks/vivid_simple_accordion/templates/anja_accordion/view.css, blocks/vivid_simple_accordion/templates/anja_accordion, blocks/vivid_simple_accordion/templates, blocks/vivid_simple_accordion, blocks/page_list/templates/anja-3column-grid/view.php, blocks/page_list/templates/anja-3column-grid/view.css, blocks/page_list/templates/anja-3column-grid, blocks/page_list/templates, blocks/page_list, blocks/gallery_e_s_view/view.php, blocks/gallery_e_s_view/controller.php, blocks/gallery_e_s_view, languages/fi_FI/LC_MESSAGES/messages.mo, languages/fi_FI/LC_MESSAGES, languages/fi_FI, languages/sv_SE/LC_MESSAGES/messages.mo, languages/sv_SE/LC_MESSAGES, languages/sv_SE, languages/tr_TR/LC_MESSAGES/messages.mo, languages/tr_TR/LC_MESSAGES, languages/tr_TR, languages/da_DK/LC_MESSAGES/messages.mo, languages/da_DK/LC_MESSAGES, languages/da_DK, languages/ru_RU/LC_MESSAGES/messages.mo, languages/ru_RU/LC_MESSAGES, languages/ru_RU, languages/ja_JP/LC_MESSAGES/messages.mo, languages/ja_JP/LC_MESSAGES, languages/ja_JP, languages/sl_SI/LC_MESSAGES/messages.mo, languages/sl_SI/LC_MESSAGES, languages/sl_SI, languages/nl_NL/LC_MESSAGES/messages.mo, languages/nl_NL/LC_MESSAGES, languages/nl_NL, languages/el_GR/LC_MESSAGES/messages.mo, languages/el_GR/LC_MESSAGES, languages/el_GR, languages/it_IT/LC_MESSAGES/messages.mo, languages/it_IT/LC_MESSAGES, languages/it_IT, languages/fr_FR/LC_MESSAGES/messages.mo, languages/fr_FR/LC_MESSAGES, languages/fr_FR, languages/de_DE/LC_MESSAGES/messages.mo, languages/de_DE/LC_MESSAGES, languages/de_DE, themes/hivis_anja/blog_entry.php, themes/hivis_anja/left_sidebar.php, themes/hivis_anja/default.php, themes/hivis_anja/description.txt, themes/hivis_anja/one_column-left_sidebar.php, themes/hivis_anja/three_column.php, themes/hivis_anja/one_column-three.php, themes/hivis_anja/css/styles.xml, themes/hivis_anja/css/css/typography.less, themes/hivis_anja/css/css/foundation.less, themes/hivis_anja/css/css/app.less, themes/hivis_anja/css/css/normalize.less, themes/hivis_anja/css/css, themes/hivis_anja/css/main.less, themes/hivis_anja/css/presets/defaults.less, themes/hivis_anja/css/presets/anja.less, themes/hivis_anja/css/presets, themes/hivis_anja/css, themes/hivis_anja/three_column-one.php, themes/hivis_anja/images/foundation/orbit/loading.gif, themes/hivis_anja/images/foundation/orbit/pause-black.png, themes/hivis_anja/images/foundation/orbit/right-arrow.png, themes/hivis_anja/images/foundation/orbit/bullets.jpg, themes/hivis_anja/images/foundation/orbit/mask-black.png, themes/hivis_anja/images/foundation/orbit/left-arrow.png, themes/hivis_anja/images/foundation/orbit/left-arrow-small.png, themes/hivis_anja/images/foundation/orbit/right-arrow-small.png, themes/hivis_anja/images/foundation/orbit/timer-black.png, themes/hivis_anja/images/foundation/orbit/rotator-black.png, themes/hivis_anja/images/foundation/orbit, themes/hivis_anja/images/foundation, themes/hivis_anja/images, themes/hivis_anja/right_sidebar.php, themes/hivis_anja/two_column.php, themes/hivis_anja/full.php, themes/hivis_anja/four_column-two.php, themes/hivis_anja/two_column-one.php, themes/hivis_anja/view.php, themes/hivis_anja/js/foundation.min.js, themes/hivis_anja/js/vendor/fastclick.js, themes/hivis_anja/js/vendor/modernizr.js, themes/hivis_anja/js/vendor, themes/hivis_anja/js, themes/hivis_anja/thumbnail.png, themes/hivis_anja/landing_full.php, themes/hivis_anja/four_column-one.php, themes/hivis_anja/one_column-four.php, themes/hivis_anja/one_column-right_sidebar.php, themes/hivis_anja/four_column.php, themes/hivis_anja/page_theme.php, themes/hivis_anja/one_column-two.php, themes/hivis_anja/elements/landingfooter.php, themes/hivis_anja/elements/header.php, themes/hivis_anja/elements/footer.php, themes/hivis_anja/elements, themes/hivis_anja, blocks/vivid_simple_accordion/templates/anja_accordion/view.php, blocks/vivid_simple_accordion/templates/anja_accordion/view.js, blocks/vivid_simple_accordion/templates/anja_accordion/view.css, blocks/vivid_simple_accordion/templates/anja_accordion, blocks/vivid_simple_accordion/templates, blocks/vivid_simple_accordion, blocks/page_list/templates/anja-3column-grid/view.php, blocks/page_list/templates/anja-3column-grid/view.css, blocks/page_list/templates/anja-3column-grid, blocks/page_list/templates, blocks/page_list, blocks/gallery_e_s_view/view.php, blocks/gallery_e_s_view/controller.php, blocks/gallery_e_s_view, languages/fi_FI/LC_MESSAGES/messages.mo, languages/fi_FI/LC_MESSAGES, languages/fi_FI, languages/sv_SE/LC_MESSAGES/messages.mo, languages/sv_SE/LC_MESSAGES, languages/sv_SE, languages/tr_TR/LC_MESSAGES/messages.mo, languages/tr_TR/LC_MESSAGES, languages/tr_TR, languages/da_DK/LC_MESSAGES/messages.mo, languages/da_DK/LC_MESSAGES, languages/da_DK, languages/ru_RU/LC_MESSAGES/messages.mo, languages/ru_RU/LC_MESSAGES, languages/ru_RU, languages/ja_JP/LC_MESSAGES/messages.mo, languages/ja_JP/LC_MESSAGES, languages/ja_JP, languages/sl_SI/LC_MESSAGES/messages.mo, languages/sl_SI/LC_MESSAGES, languages/sl_SI, languages/nl_NL/LC_MESSAGES/messages.mo, languages/nl_NL/LC_MESSAGES, languages/nl_NL, languages/el_GR/LC_MESSAGES/messages.mo, languages/el_GR/LC_MESSAGES, languages/el_GR, languages/it_IT/LC_MESSAGES/messages.mo, languages/it_IT/LC_MESSAGES, languages/it_IT, languages/fr_FR/LC_MESSAGES/messages.mo, languages/fr_FR/LC_MESSAGES, languages/fr_FR, languages/de_DE/LC_MESSAGES/messages.mo, languages/de_DE/LC_MESSAGES, languages/de_DE, themes/hivis_anja/blog_entry.php, themes/hivis_anja/left_sidebar.php, themes/hivis_anja/default.php, themes/hivis_anja/description.txt, themes/hivis_anja/one_column-left_sidebar.php, themes/hivis_anja/three_column.php, themes/hivis_anja/one_column-three.php, themes/hivis_anja/css/styles.xml, themes/hivis_anja/css/css/typography.less, themes/hivis_anja/css/css/foundation.less, themes/hivis_anja/css/css/app.less, themes/hivis_anja/css/css/normalize.less, themes/hivis_anja/css/css, themes/hivis_anja/css/main.less, themes/hivis_anja/css/presets/defaults.less, themes/hivis_anja/css/presets/anja.less, themes/hivis_anja/css/presets, themes/hivis_anja/css, themes/hivis_anja/three_column-one.php, themes/hivis_anja/images/foundation/orbit/loading.gif, themes/hivis_anja/images/foundation/orbit/pause-black.png, themes/hivis_anja/images/foundation/orbit/right-arrow.png, themes/hivis_anja/images/foundation/orbit/bullets.jpg, themes/hivis_anja/images/foundation/orbit/mask-black.png, themes/hivis_anja/images/foundation/orbit/left-arrow.png, themes/hivis_anja/images/foundation/orbit/left-arrow-small.png, themes/hivis_anja/images/foundation/orbit/right-arrow-small.png, themes/hivis_anja/images/foundation/orbit/timer-black.png, themes/hivis_anja/images/foundation/orbit/rotator-black.png, themes/hivis_anja/images/foundation/orbit, themes/hivis_anja/images/foundation, themes/hivis_anja/images, themes/hivis_anja/right_sidebar.php, themes/hivis_anja/two_column.php, themes/hivis_anja/full.php, themes/hivis_anja/four_column-two.php, themes/hivis_anja/two_column-one.php, themes/hivis_anja/view.php, themes/hivis_anja/js/foundation.min.js, themes/hivis_anja/js/vendor/fastclick.js, themes/hivis_anja/js/vendor/modernizr.js, themes/hivis_anja/js/vendor, themes/hivis_anja/js, themes/hivis_anja/thumbnail.png, themes/hivis_anja/landing_full.php, themes/hivis_anja/four_column-one.php, themes/hivis_anja/one_column-four.php, themes/hivis_anja/one_column-right_sidebar.php, themes/hivis_anja/four_column.php, themes/hivis_anja/page_theme.php, themes/hivis_anja/one_column-two.php, themes/hivis_anja/elements/landingfooter.php, themes/hivis_anja/elements/header.php, themes/hivis_anja/elements/footer.php, themes/hivis_anja/elements, themes/hivis_anja

# concrete5 Cache Settings
Block Cache - Off
Overrides Cache - Off
Full Page Caching - Off
Full Page Cache Lifetime - Every 6 hours (default setting).

# Server Software
Apache

# Server API
cgi-fcgi

# PHP Version
5.4.45

# PHP Extensions
bcmath, bz2, calendar, cgi-fcgi, Core, ctype, curl, date, dom, ereg, exif, fileinfo, filter, ftp, gd, gettext, gmp, hash, iconv, imap, intl, ionCube Loader, json, libxml, mbstring, mcrypt, mhash, mysql, mysqli, openssl, pcntl, pcre, PDO, pdo_mysql, pdo_sqlite, Phar, readline, Reflection, session, shmop, SimpleXML, soap, sockets, SPL, sqlite3, standard, tokenizer, wddx, xml, xmlreader, xmlwriter, xsl, Zend Guard Loader, zip, zlib.

# PHP Settings
max_execution_time - 60
log_errors_max_len - 1024
max_file_uploads - 20
max_input_nesting_level - 64
max_input_time - 60
max_input_vars - 1000
memory_limit - 256M
post_max_size - 128M
sql.safe_mode - Off
upload_max_filesize - 128M
mysql.max_links - Unlimited
mysql.max_persistent - Unlimited
mysqli.max_links - Unlimited
mysqli.max_persistent - Unlimited
pcre.backtrack_limit - 1000000
pcre.recursion_limit - 100000
session.cache_limiter - <i>no value</i>
session.gc_maxlifetime - 1440
soap.wsdl_cache_limit - 5

Browser User-Agent String

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_5) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/47.0.2526.106 Safari/537.36

Hide Post Content

This will replace the post content with the message: "Content has been removed by an Administrator"

Hide Content

Request Refund

You may not request a refund that is not currently owned by you.