Page MenuHomePhabricator

Migrate all AutoWikiBrowser Check Pages to json
Closed, ResolvedPublic

Assigned To
Authored By
Reedy
Dec 20 2019, 1:50 AM
Referenced Files
None
Tokens
"Love" token, awarded by Jayprakash12345."Like" token, awarded by IKhitron."Like" token, awarded by MarcoSwart."Love" token, awarded by IGNORE-THIS.

Description

To increase the maintainability and introduce the possibility of onwiki configuration of AutoWikiBrowser, the wikitext based checkpage is being migrated to two json pages.

https://en.wikipedia.org/wiki/Wikipedia:AutoWikiBrowser/CheckPage becomes https://en.wikipedia.org/wiki/Wikipedia:AutoWikiBrowser/CheckPageJSON and https://en.wikipedia.org/wiki/Wikipedia:AutoWikiBrowser/Config

This follows on from https://en.wikipedia.org/wiki/Wikipedia:AutoWikiBrowser/CheckPage/Version being turned into https://en.wikipedia.org/wiki/Wikipedia:AutoWikiBrowser/CheckPage/VersionJSON

Parsing wikitext is awful, and dates back from the days when this was basically the only way of doing it. Now MediaWiki has a JSON ContentModel in core, and on Wikimedia wikis (at least) an editor to help edit it, taking advantage of this helps the developers make the code simpler and easier to understand

Eventually, it'll allow definition of AWB configuration that is site specific on the site, rather than in the code, meaning you don't have to wait for a new release to fix regex bugs, add extra templates and the like.

To facilitate this, the wikitext page is being transformed and split into the json page. Page protection will be copied from the original version (usually sysop)

Next release will start to use these - https://en.wikipedia.org/w/index.php?title=Wikipedia%3AAutoWikiBrowser%2FHistory&type=revision&diff=931839908&oldid=930432118

Event Timeline

Is this something that is going to be needed on EVERY project - I see this only mentions the English Wikipedia in the description?

Is this something that is going to be needed on EVERY project - I see this only mentions the English Wikipedia in the description?

https://www.wikidata.org/wiki/Q79289234

I already automated it, and did one pass to create the pages. I haven't updated them yet, as the code isn't released

What is the failure case for missing page (e.g. for all the non-WMF projects) that one could use AWB on?

What is the failure case for missing page (e.g. for all the non-WMF projects) that one could use AWB on?

I've not looked at the code in a while, but IIRC, it falls back to the old page (for now, if it exists) if the JSON page doesn't exist, before falling back to the "anyone can use AWB" behaviour that existed if no checkpage existed

I don't see meta-wiki updated for example (https://meta.wikimedia.org/wiki/Special:PrefixIndex/Meta:AutoWikiBrowser) doesn't have the JSON pages

Ok, so some got missed... They're easily converted (I still have the code laying around)

It's a while since I created the list, so I can't remember how I did so. Commons got done though.

Looking at https://www.wikidata.org/w/index.php?title=Q11214943&action=history I obviously tried to make sure most of them were linked in the first place

Reedy claimed this task.

Case sensitive: I am registered on the German CheckPage as "jed" and the name was taken over as such in the CheckPageJSON. But when I logged in, AWB 6.2.0.0 told me: Jed is not authorized to perform this action. Only after a while I found out that I have to change "jed" to "Jed" in CheckPageJSON. If every username has to be capitalized, could that be converted automatically during the commit?

Otherwise: thank you very much for the work.

Thanks for the heads up.

MW is first character case insensitive. I'm not sure why it worked on the old version, but not now (will have to look, I probably lost some handling)

It probably can be done in the transfer, but also inside AWB we might aswell handle it too, to catch these sorts of cases.

Hello, @Reedy. Congrats, it's much better. And also:

  1. Why isn't this in the Tech News, so wikis could know to add the new names to the right page?
  2. I understand we can remove names of those who updated to the new version from the old page, eventually deleting it? Because permanent synchronisation doesn't sound like a good idea.

Thanks.

Until we disable the old version, the old checkpage needs to stay around. After that, it can be deleted.

In most case, you can just add people to the new version, as they will be using the latest release...

Until we disable the old version, the old checkpage needs to stay around. After that, it can be deleted.

In most case, you can just add people to the new version, as they will be using the latest release...

And remove them from the old? If they do not run the old version, what does it matter if they are there?
And what about the News? Somehow, I'm one of it's creators, so it's important to me.

Can remove them from the old if you want. Doesn't make much different. There's seemingly no major issues in the new one, so I should disable the old one soon.

If people want to add it to the Tech News, I'm not going to stop you. Most projects had noticed me mass creating the JSON checkpages on wikis, and had been keeping them in sync

Thanks. Well, we didn't. I know because it was mentioned on other wiki.

Unfortunately the message in Tech News for this week uses the Wikipedia: namespace prefix, when it should use the Project: prefix and be wikilinked. If anyone tries to visit this page title in any wiki where the local name of the Project namespace is not Wikipedia, they will be redirected to a nonexistent Wikipedia page. For instance a person attempting to visit Wikipedia:AutoWikiBrowser/CheckPageJSON on English Wiktionary will be redirected to https://en.wikipedia.org/wiki/AutoWikiBrowser/CheckPageJSON rather than the correct https://en.wiktionary.org/wiki/Project:AutoWikiBrowser/CheckPageJSON, which redirects to https://en.wiktionary.org/wiki/Wiktionary:AutoWikiBrowser/CheckPageJSON. I'd edit the Tech News page now, but it's already gone out to all the wikis. Can it be corrected now?