Maniphest T195359

Encoding problems in labels (Korean, French, etc.)
Closed, ResolvedPublic
Actions

Assigned To

Authored By

	revi
	May 23 2018, 11:11 AM

Description

`L17`	`Q9176`	`Q24905`

The language and Lexical Category value is supposed to be "한국어" and 동사 but it's "íêµì´" and "ëì¬", respectively.

Quick link to lexeme: https://www.wikidata.org/wiki/Lexeme:L17

Details

Subject	Repo	Branch	Lines +/-
Updated php-vuejs-templating to 1.0.2	mediawiki/vendor	wmf/1.32.0-wmf.6	+62 -37
Updated php-vuejs-templating to 1.0.2	mediawiki/vendor	master	+62 -37
Require php-vuejs-templating 1.0.2	mediawiki/extensions/WikibaseLexeme	master	+1 -1

Customize query in gerrit

Related Objects

Mentioned In: rEWLE5bf5cb724713: Require php-vuejs-templating 1.0.2
rEWLE01ceefaf16db: Require php-vuejs-templating 1.0.2
rEWLE918fdc94c785: Require php-vuejs-templating 1.0.2
rEWLEea80af543260: Require php-vuejs-templating 1.0.2
rEWLE8c4929f2cefb: Require php-vuejs-templating 1.0.2
rEWLE48554fdfeca3: Require php-vuejs-templating 1.0.2

Event Timeline

There are a very large number of changes, so older changes are hidden. Show Older Changes

Restricted Application added projects: Wikidata, User-revi. · View Herald TranscriptMay 23 2018, 11:11 AM

Restricted Application added a subscriber: Aklapper. · View Herald Transcript

revi moved this task from Incoming to Radar on the User-revi board.May 23 2018, 11:12 AM

WMDE-leszek subscribed.May 23 2018, 11:12 AM

revi updated the task description. (Show Details)May 23 2018, 11:15 AM

revi updated the task description. (Show Details)

When I click "Edit", it shows fine.

VIGNERON subscribed.May 23 2018, 12:21 PM

Same problem in other languages :

French https://www.wikidata.org/wiki/Lexeme:L1?uselang=fr "sumÃ©rien" instead of "sumérien"
Spanish https://www.wikidata.org/wiki/Lexeme:L2?uselang=es "inglÃ©s" for "Inglés"
Catalan https://www.wikidata.org/wiki/Lexeme:L2?uselang=ca "anglÃ¨s" for "anglès"

etc.

This seems to be a UTF-8 vs. ISO-8859-1 coding problem.

Lea_Lacroix_WMDE renamed this task from Lexeme NS shows wrong label when user interface is in Korean to Encoding problems in labels (Korean, French, etc.).May 23 2018, 12:36 PM

Lydia_Pintscher raised the priority of this task from Medium to High.May 23 2018, 1:35 PM

Lydia_Pintscher moved this task from incoming to features/bugs for next release (editor experience improvements) on the Wikidata Lexicographical data board.

Raymond subscribed.May 23 2018, 1:41 PM

Amire80 awarded a token.May 23 2018, 2:17 PM

Superzerocool subscribed.May 23 2018, 2:31 PM

Urbanecm subscribed.May 23 2018, 3:04 PM

Urbanecm added a project: User-Urbanecm.May 23 2018, 3:07 PM

Urbanecm moved this task from Backlog to Watching on the User-Urbanecm board.

Another example in Hungarian:

Should display "német" and "főnév" instead.

Lydia_Pintscher merged a task: T195388: Encoding problems on Lexeme pages (under language-lexical-category-widget).May 23 2018, 4:07 PM

Lydia_Pintscher added a subscriber: He7d3r.

JAnD subscribed.May 23 2018, 5:48 PM

matej_suchanek merged a task: T195396: Language & lexical category display broken in Russian.May 23 2018, 7:22 PM

matej_suchanek added subscribers: Smalyshev, Mbch331, jmac.

Mbch331 merged a task: T195405: unicode issue in languages.May 23 2018, 7:46 PM

Mbch331 added a subscriber: Maxlath.

mxn subscribed.May 24 2018, 5:08 AM

WMDE-leszek claimed this task.May 24 2018, 7:32 AM

Amire80 subscribed.May 24 2018, 7:53 AM

Ltrlg subscribed.May 24 2018, 9:30 AM

WMDE-leszek removed WMDE-leszek as the assignee of this task.May 24 2018, 12:05 PM

WMDE-leszek added a project: Wikidata-Turtles-Sprint #5.

WMDE-leszek moved this task from To Do to Peer Review on the Wikidata-Turtles-Sprint #5 board.

Addshore merged a task: T195470: UTF-8 parsed as one-byte characters in lexical category.May 24 2018, 1:40 PM

Addshore added a subscriber: Tacsipacsi.

dgstranz subscribed.May 24 2018, 2:03 PM

abian subscribed.May 24 2018, 4:23 PM

Covered in https://github.com/wmde/php-vuejs-templating/pull/12

Liuxinyu970226 subscribed.May 24 2018, 10:58 PM

Change 435131 had a related patch set uploaded (by WMDE-leszek; owner: WMDE-leszek):
[mediawiki/extensions/WikibaseLexeme@master] Require php-vuejs-templating 1.0.2

https://gerrit.wikimedia.org/r/435131

gerritbot added a project: Patch-For-Review.May 25 2018, 8:42 AM

WMDE-leszek mentioned this in rEWLE48554fdfeca3: Require php-vuejs-templating 1.0.2.May 25 2018, 8:43 AM

Change 435156 had a related patch set uploaded (by WMDE-leszek; owner: WMDE-leszek):
[mediawiki/vendor@master] Updated php-vuejs-templating to 1.0.2

https://gerrit.wikimedia.org/r/435156

Maxlath unsubscribed.May 25 2018, 4:52 PM

Aklapper added a project: I18n.May 26 2018, 2:04 PM

Aklapper merged a task: T195731: can't display as Chinese.May 28 2018, 6:46 AM

Aklapper added a subscriber: Shizhao.

WMDE-leszek mentioned this in rEWLE8c4929f2cefb: Require php-vuejs-templating 1.0.2.May 28 2018, 3:15 PM

WMDE-leszek mentioned this in rEWLEea80af543260: Require php-vuejs-templating 1.0.2.May 29 2018, 6:07 AM

• Aleksey_WMDE mentioned this in rEWLE918fdc94c785: Require php-vuejs-templating 1.0.2.May 29 2018, 3:03 PM

WMDE-leszek mentioned this in rEWLE01ceefaf16db: Require php-vuejs-templating 1.0.2.May 29 2018, 3:08 PM

Lydia_Pintscher merged a task: T195859: Wikidata Lexeme interface encoding errors.May 29 2018, 3:32 PM

Lydia_Pintscher added a subscriber: deryckchan.

Wrong encoding for russian

WMDE-leszek mentioned this in rEWLE5bf5cb724713: Require php-vuejs-templating 1.0.2.May 30 2018, 10:26 AM

Change 435131 merged by jenkins-bot:
[mediawiki/extensions/WikibaseLexeme@master] Require php-vuejs-templating 1.0.2

https://gerrit.wikimedia.org/r/435131

Change 435156 merged by jenkins-bot:
[mediawiki/vendor@master] Updated php-vuejs-templating to 1.0.2

https://gerrit.wikimedia.org/r/435156

WMDE-leszek moved this task from Peer Review to Test (Product Review) on the Wikidata-Turtles-Sprint #5 board.May 30 2018, 11:33 AM

Lydia_Pintscher closed this task as Resolved.May 30 2018, 1:21 PM

Lydia_Pintscher claimed this task.

Lydia_Pintscher moved this task from Test (Product Review) to Done on the Wikidata-Turtles-Sprint #5 board.

ReleaseTaggerBot added a project: MW-1.32-notes (WMF-deploy-2018-06-05 (1.32.0-wmf.7)).May 30 2018, 5:02 PM

Liuxinyu970226 unsubscribed.May 31 2018, 8:36 AM

Change 436486 had a related patch set uploaded (by Addshore; owner: WMDE-leszek):
[mediawiki/vendor@wmf/1.32.0-wmf.6] Updated php-vuejs-templating to 1.0.2

https://gerrit.wikimedia.org/r/436486

Change 436486 merged by jenkins-bot:
[mediawiki/vendor@wmf/1.32.0-wmf.6] Updated php-vuejs-templating to 1.0.2

https://gerrit.wikimedia.org/r/436486

Mentioned in SAL (#wikimedia-operations) [2018-05-31T13:23:03Z] <hashar@tin> Synchronized php-1.32.0-wmf.6/vendor: WikibaseLexeme: Encoding problems in labels - T195359 (duration: 03m 12s)

@Lea_Lacroix_WMDE Now unbroken in production: https://www.wikidata.org/wiki/Lexeme:L17?uselang=ko

@Pablo-WMDE Indeed, thanks!

ReleaseTaggerBot edited projects, added MW-1.32-notes (WMF-deploy-2018-05-29 (1.32.0-wmf.6)); removed MW-1.32-notes (WMF-deploy-2018-06-05 (1.32.0-wmf.7)).May 31 2018, 2:00 PM

I purged all Lexeme entities today so the issues should no longer be seen anywhere

09:04 addshore: addshore@terbium:~$ for i in {1..2500}; do echo Lexeme:L$i; done | mwscript purgePage.php --wiki wikidatawiki

• Vvjjkkii renamed this task from Encoding problems in labels (Korean, French, etc.) to ogcaaaaaaa.Jul 1 2018, 1:08 AM

• Vvjjkkii reopened this task as Open.

• Vvjjkkii removed Lydia_Pintscher as the assignee of this task.

• Vvjjkkii added projects: CheckUser, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), Tamil-Sites, Gamepress, Hashtags, Jade, KartoEditor, Language-2018-Apr-June, New-Editor-Experiences, Mail, TCB-Team (now WMDE-TechWish).

• Vvjjkkii updated the task description. (Show Details)

• Vvjjkkii edited subscribers, added: Lydia_Pintscher; removed: gerritbot, Aklapper.

Tacsipacsi renamed this task from ogcaaaaaaa to Encoding problems in labels (Korean, French, etc.).Jul 1 2018, 9:55 AM

Tacsipacsi closed this task as Resolved.

Tacsipacsi assigned this task to Lydia_Pintscher.

Tacsipacsi removed projects: TCB-Team (now WMDE-TechWish), Mail, New-Editor-Experiences, Language-2018-Apr-June, KartoEditor, Jade, Hashtags, Gamepress, Tamil-Sites, Connected-Open-Heritage-Batch-uploads (RAÄ-KMB_1_2017-02), CheckUser.

Tacsipacsi updated the task description. (Show Details)

Tacsipacsi added a subscriber: Aklapper.

Tacsipacsi changed the task status from Duplicate to Resolved.Jul 1 2018, 10:05 AM

Tacsipacsi closed this task as a duplicate of T195470: UTF-8 parsed as one-byte characters in lexical category.

Tacsipacsi merged a task: T195470: UTF-8 parsed as one-byte characters in lexical category.

Urbanecm removed a project: User-Urbanecm.Oct 18 2018, 11:49 AM

revi removed a project: Patch-For-Review.Sep 26 2019, 7:36 PM

	F18491907: unnamed.png
	May 23 2018, 3:20 PM

	F18488831: image.png
	May 23 2018, 11:38 AM

Encoding problems in labels (Korean, French, etc.)Closed, ResolvedPublicActions

Description

Details

Related Objects

Event Timeline

Encoding problems in labels (Korean, French, etc.)
Closed, ResolvedPublic
Actions