charset error

[DmitryShlepkin]

Hi i had some issues with charset in search results. (See attach) Database and database connection use 'utf-8' charset.

I change line 414 in data.search.php:

$excerpt = utf8_encode($excerpt);

with:

$excerpt = iconv('UTF-8', 'UTF-8//IGNORE', $excerpt);

And now have right symbols in search results.

[nitriques]

@animaux Would this be a cool thing to do ?

[animaux]

I have no idea what that line does … so I honestly don’t know.

[nitriques]

Did you ever had any problems with german chars ?
See http://stackoverflow.com/questions/9499467/iconv-vs-utf8-encode
And also, not that iconv is not available on all platforms.

[animaux]

I did have some problems with url-encoding and german characters. I’m not actively using the excerpt function a lot though.

If iconv() is not widely available we could check that first and fall back to utf8_encode() if not.

I recently had a problem with XML-imported data that included UTF-ligature commands that broke processing. I wonder if this could have been avoided like this too.

However, I’m only speculation and have no real insight, so still not sure if there are any other caveats.

[nitriques]

OK I'll leave open then. If you ever have similar problem, we will be able to work on it with that reproducible setup.