utf-8 characters problem.

New Member Joined: Mar 27, 2006 Posts: 17

First of all CONGRATULATION and thanks to all the ravennuke team for the new release.
Im having a problem with unicode characters like persian or arabic language,
before with rn2.4 it was working fine now all im getting is ????????.
I have checked the website and database charset its UTF-8.
Tell me what should i do.
thanks

Posted: Sun Jan 29, 2012 10:26 am

Have you looked at the sites source code and seen what charset the meta tag is defining? I don't know if this will help or not, but it is defined in the language file located in the sites language folder and looks like this:

Code:




define('_CHARSET','ISO-8859-1');

You may need to change that to UTF-8. You might have to open and save the language files as UTF-8 also. These are just ideas, I have no idea if it will work or not so only try it on a test site and backup your site in case it boogers it up.

Posted: Sun Jan 29, 2012 10:36 am

lokasher, are you haveing this problem with language files or when you enter content? Does it happen to new and old content?

Posted: Sun Jan 29, 2012 10:40 am

meta tag is utf-8 i changed it.
<meta http-equiv="Content-Type" content="text/html;charset=UTF-8" />
no not the language file just the content.
Actually im using a random quote block,rest of the site is in english language.

Posted: Sun Jan 29, 2012 10:57 am

Where does the block get its quotes? Are they hard coded, from database, etc?

Posted: Sun Jan 29, 2012 11:12 am

from database.

Posted: Sun Jan 29, 2012 11:41 am

In db/mysqli.php try un-commenting line 122:

Code:




//$this->set_charset();

Code:




$this->set_charset();

Posted: Mon Jan 30, 2012 8:36 am

not working im getting this error
Fatal error: Maximum function nesting level of '100' reached, aborting! in C:\wamp\www\*****\db\mysqli.php on line 407

Posted: Wed Feb 01, 2012 6:21 am

how and where can i add this to mysqli.php

Code:




('SET character_set_results="utf8"');

Posted: Wed Feb 01, 2012 8:07 am

added these lines after line 212 and that solved my problem.

Code:




      //return ($transaction == END_TRANSACTION) ? true : false;


      $this->sql_query('SET character_set_results = utf8');


      $this->sql_query('SET character_set_connection = utf8');


      $this->sql_query('SET character_set_client = utf8');


      $this->sql_query('SET character_set_results = utf8');


      $this->sql_query('SET NAMES utf8');


      mb_internal_encoding('utf8');


      


      return $this->query_result;

Site Admin Joined: Aug 22, 2007 Posts: 1772

same problem here, but i can't save the correct characters in my database. the database is on utf8_general_ci and the lang-constant is:

Code:

define('_CHARSET','UTF-8');

now i want save a string into the database. i use the german special chars, like "öäü" and in the database was stored this:

Code:

Ã¶Ã¤Ã¼

i have try it make the changes from lokasher, but it will not work.
what is now correct?

Code:

$xsmall = $db->sql_escape_string(check_html($xsmall, ''));

or:

Code:

$xsmall = $db->sql_escape_string(check_html($xsmall, 'nohtml'));

or:

Code:

$xsmall = $db->sql_escape_string($xsmall);

Palbin wrote:

In db/mysqli.php try un-commenting line 122:

Code:




//$this->set_charset();

Code:




$this->set_charset();

this one crashed my local apache2...

Posted: Mon Jun 04, 2012 3:34 pm

Has anybody tried to build a complete page in UTF-8? It's really annoying that this does not work.

Posted: Mon Jun 04, 2012 5:12 pm

I have not tried it with RN2.5 but official UTF8 support will be coming in a future RN release. Not to say it's not possible, but I'm pretty sure there would be many changes required.. but Palbin would have to answer that Smile

Not really my area of expertise but what happens when the data is output? It does look somewhat like utf8 encoded data.

Posted: Mon Jun 04, 2012 6:00 pm

Try these two files:
db.php - [ Only registered users can see links on this board! Get registered or login! ]
mysqli.php - [ Only registered users can see links on this board! Get registered or login! ]

Posted: Mon Jun 04, 2012 6:36 pm

it works

YEAH thanks, Palbin!

RavensScripts

Posted: Tue Jun 05, 2012 2:43 am

Question to Palbi.

What is the different with these two lines?

Code:

$db = new sql_db($dbhost, $dbuname, $dbpass, $dbname, false);

new code

Code:

$db = sql_db::getInstance($dbhost, $dbuname, $dbpass, $dbname, false);

Posted: Wed Jun 06, 2012 11:56 pm

The first line is just making a new instance of the "sql_db" class. Since we are tying to use the "singleton" approach in terms of the db class the second line uses the getInstance function defined within the class. This function returns the instance of the class if was already initiated. If it is not initiated it will run the first line from within the function. That is best I can explain the concept.

Posted: Fri Jun 15, 2012 2:39 pm

Hey Palbin,

i have a prob with your files and the backend.php. I can't see the entries but as html version in the module Feeds is all ok. I have the changed back to old files and i can see the entries. Do you have an idea, where i can find the solution? Is it inside the module?

Code:

 <?xml version="1.0" encoding="utf-8"?>


-^

CHARSET and database are on UTF-8...

Edit: Next one to this issue. I can see in the sourcode the entries but the filtering don't work with title and specialchars (äüö). I think here is an bug inside the FeedCreator, too. I have tried utf8_decode and it seems it works in the sourcecode view.

file: includes/feedcreater/feedcreator.class.php

Code:

$feed.= "            <title>".FeedCreator::iTrunc(utf8_decode(strip_tags($this->items[$i]->title)),100)."</title>\n";

Posted: Mon Jun 18, 2012 1:20 pm

Palbin wrote:

Try these two files:
db.php - [ Only registered users can see links on this board! Get registered or login! ]
mysqli.php - [ Only registered users can see links on this board! Get registered or login! ]

neralex wrote:

i have a prob with your files and the backend.php. I can't see the entries but as html version in the module Feeds is all ok. I have the changed back to old files and i can see the entries. Do you have an idea, where i can find the solution? Is it inside the module?

Code:

 <?xml version="1.0" encoding="utf-8"?>


-^

CHARSET and database are on UTF-8...

I found a solution for my problem Smile

I have stored one of this file in ISO mode directly in windows. I always got a freespace at the beginning of the xml feed. After a lot of testing, i have tried to save the files again, but now with my php editor in utf-8 and it works. What should i say to my windows: f*** s*** Smile

Hangin' Around Joined: Nov 26, 2005 Posts: 39

[quote="neralex"]

Palbin wrote:

Try these two files:
db.php - [ Only registered users can see links on this board! Get registered or login! ]
mysqli.php - [ Only registered users can see links on this board! Get registered or login! ]

these links are broken.. any help will be greatly appreciated...

Posted: Mon Feb 16, 2015 10:32 pm

rovshan, sent via PM. You should only use it with a fresh installed database with utf8_general_ci. You have to change the php filterings in many modules because RN25x isn't support utf-8. So do not use it in a running page otherwise you would get many issues with your stored entries e.g. forums etc.

Note: this is not a official supported solution but it has helped me to switch my modded RN25x to utf-8.

Posted: Sat May 30, 2015 2:58 pm

I'm having a kind of same problem with the special characters in Spanish like vowels with accent and ñ
When previewing the post before sending it, and if any of those special characters are in the message, nothing will appear in the preview and the whole message is removed!!
Those links from palbin are broken, so I wasn't able to have a look!!
There must be something to fix in Forums/posting.php in order to enable the special characters. I've installed the ABBC_Box v 2.5 immediately after installing the whole site, so I'm not aware if this might be the cause.

BTW I tried to write some spanish special characters in this message and preview it, but it Works perfect here!!

Any help will be appreciated. Thanks

Posted: Sun May 31, 2015 11:00 am

RN25x doesn't support utf-8. So the best way to use special chars is to leave the charset as it is on ISO and LATIN db colation. As i wrote, if you want use utf-8 on RN25x then you have to recode many many things. It isn't done to use only the both files from Palbin.

Posted: Sat Jul 04, 2015 11:29 am

neralex, can you please provide a link to db.php and mysqli.php??
Many thanks

Posted: Sun Jul 05, 2015 5:43 am

That wouldn't help to solve your issue!