special characters in charname database overwrite

by **lunzet** » Sat Jun 23, 2007 6:56 am

hi all,
I really tried to find a solution inthe forum as always but did not manage to...finally.

Scenario:
same account
charname: Ressi
2nd charname: Ressí (this is not a typo)

data is always used from last upload so both characters do overwrite the data due to unrecognized different charnames i guess.

any idea on how to resolve?
I never had that issue before....but as you might know....strange things happen....especially to user/ charnames....grrhhh

thanks in advance

by **tuigii** » Sun Jun 24, 2007 10:33 am

When you decide to activate "Save images to server" [for signatures & avatars] you have an option named "Convert Accents" on the third line.
Deactivate it if you have name clashes...

This is explained in :

06.16.07 - v0.2.5
SigGen
....
Added: Ability to remove accents from saved images
This will convert accented characters in a player's name to non accented characters when saving images
WARNING: All players with names that map to the same name can and will be overwritten
...

overhere : http://www.wowroster.net/Forums/viewtopic/t=50.html

by **zanix** » Sun Jun 24, 2007 2:18 pm

I wonder if he means SigGen images or Roster data

I would assume Roster data since this isn't in the SigGen forum

by **lunzet** » Sun Jun 24, 2007 4:51 pm

its the roster data and not siggen. i have checked the setting you mentioned for siggen also but it is set to disabled already.

this morning another user who has a char on lvl 70 was showing up in the roster as lvl 36...i still need to check whether this user has a char with similar names. will keep you posted.

so how to resolve the underlying issue? the recognition of accents seems to be weird at the moment. can someone else confirm this issue or reproduce?

thx

edit:
i did some more research and found the following (and this might be reproducable for everyone).

my main char is: turbopala (lvl70)
1) created a test char: Turbopalá
2) logged in with Turbopalá and scanned the char
3) uploaded the data on the rosters website (not uniuploader although it makes no difference)
4) chardata from Turbopalá will overwrite my main char Turbopala although the test char is not even in the guild !!!

see my characterprofiler.lua and update_log.txt attached

I really do think this to be a major issue. Hopefully this can be fixed easily and asap.

Please help....

by **lunzet** » Mon Jun 25, 2007 7:54 pm

has someone tried to reproduce the issue?
any ideas already?

thx

by **tuigii** » Tue Jun 26, 2007 5:41 am

My main character is 'Nowwhat'
I created a 'Nowwhät' (double dottet a here) and had my co-officer guilding it.
Upload to the roster 'with the password'
:thumright:

I had two different persons in the roster : 'Nowwhat' and 'Nowwhät' - there was no character overlap.

Did I miss something here ?

I had a look at the code, but character names are being thrown in the database (and compared with) without any modification.
So, an à is not an a is not an ä is not an â etc....

Proof : http://www.papy-team.fr/roster/index.php
Nowwhat is the second person in this Guild (Papy team)
Nowwhät can be found at the bottom - in the Reroll range.

by **lunzet** » Tue Jun 26, 2007 6:14 am

my testchar is not even guilded and the user data upload will overwrite my main char data. this has been confirmed with 3 different chars until now:

examples:
main: Ataensic
test: Âtaensic

main: Turbopala
test: Turbopalá

main: Ressi
test: Ressí

maybe its handled differently when the chars are guilded and/or when the chars are beeing added to the roster (admin upload). that makes me even more scared...because all my test chars are not in the guild. this would mean that anybody could overwrite my rosterdata with a slightly faked .lua...or am i wrong?

EDIT:
its getting even more weird.
I have tried to check if the data would be fine if i do add my testchar "turbopalá" to the guild. No...the char would not even show up in the members list or in the memberlog :cyclops2:

When i do upload the data I do see the following SQL:

SELECT `member_id` FROM `roster_members` WHERE `name` = 'TurbopalÃ¡' AND `guild_id` = '1'
UPDATE `roster_members` SET `name` = 'TurbopalÃ¡', `class` = 'Krieger', `level` = '1', `note` = '', `guild_rank` = '6', `guild_title` = 'Wanderer', `officer_note` = 'Twink-Turbopala', `zone` = 'Wald von Elwynn', `status` = '', `update_time` = '2007-6-26 0:58:00', `online` = '0', `last_online` = '2007-6-25 23:58:00' WHERE `member_id` = '154' AND `guild_id` = '1'
SELECT `member_id` FROM `roster_members` WHERE `name` = 'TurbopalÃ¡'
SELECT `name` FROM `roster_members` WHERE `member_id` = '154';
SELECT `name` FROM `roster_members` WHERE `member_id` = '154';
SELECT * FROM `roster_addon_altmonitor` WHERE `member_id`=154
SELECT `members`.`member_id`, `members`.`name` FROM `roster_members` as `members` WHERE `members`.`name`='Turbopala'
SELECT `member_id`, `main_id`, `alt_type` FROM `roster_addon_altmonitor` WHERE `member_id`=154
SELECT `member_id` FROM `roster_addon_altmonitor` WHERE `member_id`='154'
UPDATE `roster_addon_altmonitor` SET `member_id` = '154', `main_id` = '154', `alt_type` = '2' WHERE `member_id` = '154'
SHOW TABLES LIKE 'roster_addon_siggen';
SELECT `config_id`,`trigger`,`guild_trigger`,`uniup_compat`,`main_image_size_w`,`main_image_size_h` FROM `roster_addon_siggen`;

member_id=154 is my mainchar...so why is it updating the wrong entry...weird.

I have also tried with a new roster install and a fresh db....same error.

When i do enter the first select command into phpmyadmin...it will return no results....expected somehow but still the upload shows a different output....what is it?

*frustrated*

by **tuigii** » Tue Jun 26, 2007 8:50 am

lunzet wrote:...
When i do upload the data I do see the following SQL:
SELECT `member_id` FROM `roster_members` WHERE `name` = 'TurbopalÃ¡' AND `guild_id` = '1'
.....

When you execute this SQL statement in PHPAdmin, it should return the record of 'Turbopalà' and certainly not [&@$!!#] 154 which is your main mainchar named 'Turbopala'.

I ran this test, it gave me member_id 168, which was Nowwhät, and not Nowwhat, which has member_id 4.

Anyway, these statements couldn't be executed, because your character isn't even Guilded !
This is tested in update.php - line 228 - $guildinfo = $wowdb... will be empty, so the following if (guildInfo && .... will/must fail
A message like "'Gilde nicht in der Datenbank gefunden. ...." would be shown.

What is your text type of the var named 'name' in the roster_members table ?in the datebase ? mine is latin1_swedish_ci (if this mathers... :scratch:

)

Compare also thes evalues :

MySQL - 5.4.21-log
Version du protocole: 10
Serveur: mysql5-1 via TCP/IP
Utilisateur: mybase@123.251.75.64
Jeu de caractères pour MySQL: UTF-8 Unicode (utf8)
Interclassement pour la connexion MySQL: uft8_unicode_ci

PS : edit : I created a non-guilded Nowwhàt
When updating (without roster password) I had a logic :
Updating Character [Nowwhàt]
Nowwhàt is not in the list of guild members so their data will not be inserted.
As it should be.

by **lunzet** » Tue Jun 26, 2007 4:55 pm

my server is set to utf8 also...

my production roster db tables are latin1_swedish_ci
test roster db i have tried with utf also...no changes

how did u get this nice short output?

MySQL - 5.4.21-log
Version du protocole: 10
Serveur: mysql5-1 via TCP/IP
Utilisateur: mybase @ 123.251.75.64
Jeu de caractères pour MySQL: UTF-8 Unicode (utf8)
Interclassement pour la connexion MySQL: uft8_unicode_ci

by **PleegWat** » Tue Jun 26, 2007 5:20 pm

lunzet: Run this query against phpmyadmin and tell me what you get back

Code: Select all: SELECT `member_id` FROM `roster_members` WHERE `name` = 'TurbopalÃ¡'

by **lunzet** » Tue Jun 26, 2007 5:41 pm

SELECT `member_id` FROM `roster_members` WHERE `name` = 'TurbopalÃ¡'
that gives blank result as expected.

doing the same with my main charname will provide
SELECT `member_id` FROM `roster_members` WHERE `name` = 'Turbopala'
gives
member_id=154

server info:
mysql> \s
--------------
mysql Ver 14.7 Distrib 4.1.20, for redhat-linux-gnu (i686) using readline 4.3

Connection id: 1654
Current database:
Current user: root@localhost
SSL: Not in use
Current pager: stdout
Using outfile: ''
Using delimiter: ;
Server version: 4.1.20
Protocol version: 10
Connection: Localhost via UNIX socket
Server characterset: utf8
Db characterset: utf8
Client characterset: utf8
Conn. characterset: utf8
UNIX socket: /var/lib/mysql/mysql.sock
Uptime: 4 hours 15 min 45 sec

Threads: 1 Questions: 80052 Slow queries: 0 Opens: 1144 Flush tables: 1 Open tables: 64 Queries per second avg: 5.217

by **tuigii** » Tue Jun 26, 2007 9:37 pm

How many lines do you have in the roster_guild table ?

Are we hunting a local MySQL setup problem (codepage) here ?
Open up the main settings file for MySQL to see for a possible magic option that kills your roster.... Better yet : upgrade your 4.1.20 - it's "old".

by **lunzet** » Tue Jun 26, 2007 10:05 pm

roster_guild has 1 line.

maybe its a character set issue but everything was and is still working.
you migth wanna check here: http://turbolooser.dyndns.org/roster/index.php

upgrading is not a real option as its a clarkconnect community server and i dont want to mess around with custom packages.

my my.cnf

[mysqld]
datadir=/var/lib/mysql
socket=/var/lib/mysql/mysql.sock
# Default to using old password format for compatibility with mysql 3.x
# clients (those using the mysqlclient10 compatibility package).
old_passwords=1
character-set-server=utf8
default-character-set=utf8
character-set-client=utf8
max-allowed-packet=32M

[mysql]
default-character-set=utf8

[mysql.server]
user=mysql
basedir=/var/lib

[mysqld_safe]
log=/var/log/mysqld.log
err-log=/var/log/mysqld.log
pid-file=/var/run/mysqld/mysqld.pid

Thanks again for any help...highly appreciated.

Thomas

by **PleegWat** » Tue Jun 26, 2007 10:51 pm

I'm guessing at something mysql related. From his bit of sql log it has to be going wrong at the query I asked him to check, where the member ID is requested. After that point, it's using the wrong member id, and there's nothing else that ID could be coming from.

The only thing that roster does to edit data is adding slashes before doing db queries on it.

by **lunzet** » Tue Jun 26, 2007 11:05 pm

Yeah...I do understand by now that its not a general issue but a local one.

Maybe I will transfer my stuff to another server and get things right though.

If you still do have an idea on how to resolve the issue I would be glad to participate..... :thumright: