Debugging search index and automated jobs

Permalink
# concrete5 Version
Core Version - 5.7.5.6
Version Installed - 5.7.5.6
Database Version - 20151221000000

I'm not having much luck getting search indexing to work correctly. Pages with the attribute 'Exclude from search index' checked appear in search results.
- pages are children of hp, not folders
- matched keyword is contained in the meta description and not anywhere in the body

I've tried rm -rf application/files/cache/*, deleting the search index under SEO > Search Index, then running the automated job to rebuild it. I get the flashing indicator on the automated jobs page, but more often than not it doesn't ever seem to complete and I end up doing mysql> update Jobs set jStatus='ENABLED' where jID=2; to reset the UI. I have seen index jobs succeed with the green bar but not often.

I don't see anything happening with mysql> show processlist\G; Should there be something going on in mysql while the index is built or is some other mechanism used?

I've tried running the build index job with the automation url /ccm/system/jobs?auth=xxx&jID=2 and get the error below or sometimes a json obj {'error': 'Access Denied'}.

An exception occurred while executing 'INSERT INTO QueueMessages (queue_id, created, body, md5) VALUES (?, ?, ?, ?)' with params [3, 1457504833, "1", xxx""]: SQLSTATE[42S02]: Base table or view not found: 1146 Table 'concrete5.QueueMessages' doesn't exist

table is not there..

mysql> show tables like '%ueue%';
+-------------------------------+
| Tables_in_concrete5 (%ueue%) |
+-------------------------------+
| QueuePageDuplicationRelations |
| Queues |
+-------------------------------+

I see this in Reports > Logs, I have refreshed Database Entities but that didn't seem to help:

Exception Occurred: /home/www/concrete5/updates/concrete5.7.5.6/concrete/vendor/doctrine/dbal/lib/Doctrine/DBAL/Driver/AbstractMySQLDriver.php:53

Are there any other good places to look, queries, tables, or tools that could validate the db or debug the search indexer?