Expose user modifications of Machine Translations to help the MT service providers to improve them
Closed, ResolvedPublic1 Estimated Story Points
Actions

Assigned To

Authored By

	Pginer-WMF
	Jan 22 2015, 2:21 AM

Description

Translation services such as Apertium provide a good start for users to create their translation. Since users are correcting those, it would be great if those corrections could be easily accessible so that teams developing the translation services could improve them based on that feedback.

As part of this task a discussion on the information to capture and how to expose it is needed. Some fields that may be helpful:

Source text
MT translation proposed
Final translation by the user
MT provider
Editing distance (so that we can filter big/small differences)?

Details

	Subject	Repo	Branch	Lines +/-
	Expose published translation with source-target URL pairs	mediawiki/extensions/ContentTranslation	master	+140 -1

Customize query in gerrit

Related Objects

Mentioned In: rMEXT358c2f047c27: Updated mediawiki/extensions Project: mediawiki/extensions/ContentTranslation…
rECTX965624af4732: Expose published translation with source-target URL pairs

Event Timeline

Pginer-WMF created this task.Jan 22 2015, 2:21 AM

Pginer-WMF raised the priority of this task from to Needs Triage.

Pginer-WMF updated the task description. (Show Details)

Pginer-WMF added projects: ContentTranslation-Release4, ContentTranslation.

Pginer-WMF subscribed.

Restricted Application added a subscriber: Aklapper. · View Herald TranscriptJan 22 2015, 2:21 AM

Pginer-WMF renamed this task from Expose user modifications of Machine Translations to help their providers to improve them to Expose user modifications of Machine Translations to help the MT service providers to improve them.Jan 22 2015, 2:27 AM

Pginer-WMF set Security to None.

I believe most important fields are the proposed MT and the final translation by user. I think we would do well by storing a (source, proposed, final) triplet in plaintext annotated by mt provider and languages. If we can get sentence alignment, great, but at least by section. I imagine people will be looking for

missing vocabulary
better vocabulary in a certain context
missing or better grammar rules.

Edit distance and other algorithms can be used for evaluation, but those are easy to calculate afterwards if we need them. Btw, this data can also be put in a translation memory, mainly for languages with don't have MT providers..

Arrbee triaged this task as High priority.Feb 2 2015, 6:58 AM

Arrbee moved this task from Needs Triage to Long term on the ContentTranslation board.

Arrbee raised the priority of this task from High to Needs Triage.Feb 2 2015, 9:35 AM

Arrbee subscribed.

Pginer-WMF moved this task from Backlog to Proposed for next release on the ContentTranslation-Release4 board.Feb 3 2015, 9:20 PM

Amire80 triaged this task as High priority.Feb 4 2015, 12:02 AM

Arrbee assigned this task to santhosh.Feb 4 2015, 3:41 PM

Arrbee added a project: LE-Sprint-82.

Arrbee moved this task from Proposed for next release to Sprint 82 on the ContentTranslation-Release4 board.

Arrbee moved this task from Backlog to In Progress on the LE-Sprint-82 board.Feb 19 2015, 7:18 AM

Change 191860 had a related patch set uploaded (by Santhosh):
Expose published translation with source-target URL pairs

https://gerrit.wikimedia.org/r/191860

Patch-For-Review

https://gerrit.wikimedia.org/r/191860 is a quick attempt to provide minimal information. To give more useful information we need to enhance our infrastructure to capture and store user modifications or section level mapping. We have to work towards that.

Aklapper added a project: Patch-For-Review.Feb 20 2015, 12:26 PM

Change 191860 merged by jenkins-bot:
Expose published translation with source-target URL pairs

https://gerrit.wikimedia.org/r/191860

santhosh mentioned this in rECTX965624af4732: Expose published translation with source-target URL pairs.Feb 24 2015, 1:20 PM

Pginer-WMF edited a custom field.Feb 24 2015, 2:31 PM

Arrbee closed this task as Resolved.Feb 24 2015, 3:32 PM

Arrbee moved this task from In Progress to Done on the LE-Sprint-82 board.

Diffusion mentioned this in rMEXT358c2f047c27: Updated mediawiki/extensions Project: mediawiki/extensions/ContentTranslation….Mar 11 2015, 6:27 AM