Import really slow or fails.

Permalink Browser Info Environment
Hello.

We have a problem with our hosting running somewhat slow at the moment, but it highlighted a problem with this plugin, compounding the problem on the server. Another Concrete5 developer looked into the problem for us and came back with the following.

The all-in ajax bump-along appears to be flawed. I think it is supposed to be doing a sequence of requests: check - delete - run - status. What it is actually doing is a continuous loop of check -check -check ..... until it gets a response to a check, then does delete - run - status, before the endless cascade of check -check -check ....... again.
I didn't notice this on my dev system at first because it is fast and there is usually a response from the server within the first few checks, so it doesn't get overloaded.

On our live site, because it is slow, it builds up a backlog of a few hundred pending 'check' actions before it gets an answer from the first one. It then tries to do the delete - run - status part, but that is only occasionally successful because the server is still saturated with the endless check - check - check..... then at some point the server concludes it is completely over-saturated and 'goes away', so a bunch of requests fail.

However, the underlying problem is the all-in javascript saturating the server with repeated 'check' actions without waiting for a response from the first such action.

Type: Pre-Sale
Status: Archived
tangent
View Replies:
ampersandapps replied on at Permalink Reply
ampersandapps
Hi,

Sorry for the delay in response. I'll be traveling over the next few days so I'll have limited time to look at the two issues you posted.

However, if you are okay with it, I'll dedicate a significant portion of time on next Monday 11/27.
tangent replied on at Permalink Reply
tangent
Hello. Thanks for getting back to me. Have a good trip.
tangent replied on at Permalink Reply
tangent
Hello again.

Hope you had a good trip.

Have you managed to have a look at the problem yet?

Thanks,
Russell.
tangent replied on at Permalink Reply
tangent
Just wondering if you have managed to have a look at this yet?

concrete5 Environment Information

# concrete5 Version
Core Version - 8.2.1
Version Installed - 8.2.1
Database Version - 20170802000000

# concrete5 Packages
All In: The Advanced Member Import Add On by ampersandApps (1.0.4), Community Store (1.2.3), Fundamental (4.0.4), Idoit Accordion (1.0.0), Page Redirect (2.0), Page Selector Attribute (2.0), Read More (1.1.0), Vivid Simple Accordion (1.0.1), Whale OWL Carousel (2.5.7.9)

# concrete5 Overrides
blocks/gond_read_more_bottom/view.js, blocks/gond_read_more_bottom, blocks/switch_language/templates/dropflags/view.php, blocks/switch_language/templates/dropflags/view.js, blocks/switch_language/templates/dropflags/view.css, blocks/switch_language/templates/dropflags, blocks/switch_language/templates, blocks/switch_language/controller.php, blocks/switch_language, src/Concrete/Form/Service/Form.php, src/Concrete/Form/Service/Validation.php, src/Concrete/Form/Service/Widget/UserSelector.php, src/Concrete/Form/Service/Widget/Typography.php, src/Concrete/Form/Service/Widget/Attribute.php, src/Concrete/Form/Service/Widget/Rating.php, src/Concrete/Form/Service/Widget/DateTime.php, src/Concrete/Form/Service/Widget/PageSelector.php, src/Concrete/Form/Service/Widget/Color.php, src/Concrete/Form/Service/Widget, src/Concrete/Form/Service, src/Concrete/Form/CustomFormServiceProvider.php, src/Concrete/Form, src/Concrete

# concrete5 Cache Settings
Block Cache - Off
Overrides Cache - Off
Full Page Caching - Off
Full Page Cache Lifetime - Every 6 hours (default setting).

# Server Software
Apache

# Server API
cgi-fcgi

# PHP Version
5.6.22

# PHP Extensions
bcmath, calendar, cgi-fcgi, Core, ctype, curl, date, dom, ereg, exif, fileinfo, filter, ftp, gd, gettext, hash, iconv, imap, intl, ionCube Loader, json, ldap, libxml, mbstring, mcrypt, memcache, memcached, mhash, mssql, mysql, mysqli, mysqlnd, openssl, pcre, PDO, pdo_mysql, pdo_pgsql, pdo_sqlite, pgsql, Phar, posix, Reflection, session, SimpleXML, soap, sockets, SPL, sqlite3, standard, tidy, tokenizer, xml, xmlreader, xmlrpc, xmlwriter, xsl, Zend Guard Loader, zip, zlib

# PHP Settings
max_execution_time - 1200
log_errors_max_len - 1024
max_file_uploads - 20
max_input_nesting_level - 64
max_input_time - 6000
max_input_vars - 1000
memory_limit - 768M
post_max_size - 100M
sql.safe_mode - Off
upload_max_filesize - 100M
ldap.max_links - Unlimited
memcache.max_failover_attempts - 20
memcached.sess_lock_max_wait - 0
mssql.max_links - Unlimited
mssql.max_persistent - Unlimited
mssql.max_procs - Unlimited
mssql.textlimit - Server default
mysql.max_links - Unlimited
mysql.max_persistent - Unlimited
mysqli.max_links - Unlimited
mysqli.max_persistent - Unlimited
pcre.backtrack_limit - 1000000
pcre.recursion_limit - 100000
pgsql.max_links - Unlimited
pgsql.max_persistent - Unlimited
session.cache_limiter - <i>no value</i>
session.gc_maxlifetime - 7200
soap.wsdl_cache_limit - 5

Browser User-Agent String

Mozilla/5.0 (Macintosh; Intel Mac OS X 10_12_6) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/62.0.3202.94 Safari/537.36

Hide Post Content

This will replace the post content with the message: "Content has been removed by an Administrator"

Hide Content

Request Refund

You may not request a refund that is not currently owned by you.