Resolved Bug


This bug has been marked as resolved.

Garbled umlauts in tags - round 3

Permalink 0 0 Browser Info Environment
Could it be something with my setup that is faulty?

* Works
Search for umlauts now also works case insensitive (great!)


* Problem
Tag Cloud search result:
- No part of the main post text is shown when searching via click on tag in a Tag Cloud.
- Text from "Page Properties > Description" is still showing garbled umlauts. (See enclosed image)

* URL's for the clicked tags that generate the result in the enclosed image:
URL generated with Tags block for the tag "åäö":
http://konvolut.se/inspirations/search-inspirations/?akID[11][atSel...

URL generated with Tags block for the tag "åäö" search block set to Custom Template "Tag Cloud".
http://konvolut.se/index.php/inspirations/search-inspirations/?akID...


-----
Version 5.5.1b3 - up to commit 0b6c939df2
Theme: Greek Vanilla
Page attribute for the tags with umlauts was deleted and reinserted via Custom Attributes in Page Properties.
Index was refreshed and cache flushed.
1 Attachment

Tags:

search, tags, umlaut
Status: Resolved
Konvolut
View Replies:
andrew replied on at Permalink
andrew
Ok, try now. I've tweaked the highlighted regex (it's pretty brittle) and reworked some of the way things were highlighting/returning.
Konvolut replied on at Permalink 2 Attachments
Konvolut
Almost done...

* Works
- Text from main content block is now showing.
- Umlauts still work case insensitive in text search.

----------
* Problem
- Umlauts are missing in text from main content block.

----------
* My FIX that makes umlauts visible again (even if they seem to be treated as whitespace?):
(see enclosed images for difference)

Adding the umlauts to /concrete/blocks/search/controller.php (line: 34)

$regex = '([a-z|A-Z|å-ö|Å-Ö|0-9|\'|\.|_|\s]{0,45})'. $highlight .'([a-z|A-Z|å-ö|Å-Ö|0-9|\.|_|\s]{0,45})';


-----
Version 5.5.1b3 - up to commit commit 3b892cd9cd
Konvolut replied on at Permalink
Konvolut
Still works with 5.5.1b3 (concrete5-810c13b)
I'm monitoring this thread as release of 5.5.1 is imminent.
andrew replied on at Permalink
andrew
Whew. Thanks for sticking with this for so long.

I've checked a fix into github that I think will improve this. I'm using [:alnum:] instead of your code but it should match not only ascii alpha numerics but also extended characters like umlauts. Please update and test.
Konvolut replied on at Permalink
Konvolut
Great!
Umlauts now works case insensitive for Swedish åäöÅÄÖ and also German ßüÜ. Both in text search and via Tag Cloud.

Version: 5.5.1b3 (concrete5-1ec7a03)

(see example in enclosed image)
Konvolut replied on at Permalink 1 Attachment
Konvolut
... and here comes the image.
andrew replied on at Permalink
andrew
Awesome. That's good to hear.

concrete5 Environment Information

# concrete5 Version
5.5.1b3

# concrete5 Packages
None

# concrete5 Overrides
elements/header_required.php, jobs/cache_flush.php, themes/konvolut, themes/greek_yogurt

# Server Software
Apache

# Server API
cgi-fcgi

# PHP Version
5.3.6

# PHP Extensions
apc, bz2, calendar, cgi-fcgi, Core, ctype, curl, date, dom, ereg, exif, fileinfo, filter, ftp, gd, gettext, gmp, hash, iconv, igbinary, imap, ionCube Loader, json, libxml, mbstring, mcrypt, memcached, mysql, mysqli, odbc, openssl, pcntl, pcre, PDO, pdo_mysql, PDO_ODBC, pdo_sqlite, Phar, pspell, readline, Reflection, session, shmop, SimpleXML, sockets, SPL, sqlite3, standard, tokenizer, wddx, xml, xmlreader, xmlwriter, xsl, zip, zlib.

# PHP Settings
apc.max_file_size - 1M
log_errors_max_len - 1024
max_execution_time - 5
max_file_uploads - 20
max_input_nesting_level - 64
max_input_time - 60
memory_limit - 128M
post_max_size - 8M
safe_mode - Off
safe_mode_exec_dir - <i>no value</i>
safe_mode_gid - Off
safe_mode_include_dir - <i>no value</i>
sql.safe_mode - Off
upload_max_filesize - 10M
mysql.max_links - Unlimited
mysql.max_persistent - Unlimited
mysqli.max_links - Unlimited
mysqli.max_persistent - Unlimited
odbc.max_links - Unlimited
odbc.max_persistent - Unlimited
pcre.backtrack_limit - 100000
pcre.recursion_limit - 100000
session.cache_limiter - nocache
session.gc_maxlifetime - 7200
safe_mode_allowed_env_vars - PHP_
safe_mode_protected_env_vars - LD_LIBRARY_PATH

Browser User-Agent String

Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:9.0.1) Gecko/20100101 Firefox/9.0.1