Wikipedia:Wikipedia Signpost/2012-07-16/Technology report

Technology report

Tech talks at Wikimania amid news of a mixed June

Tech talks at Wikimania

Panorama shot from the pre-Wikimania Hackathon
A controversial mockup from the Athena project shown off in one Wikimania talk

As Wikimania, the annual conference targeted at Wikimedians and often well attended by those with a technical slant, draws to a close, comments have already begun to come in from attendees regarding the many tech-related features of the conference.

The Foundation will be pleased with the reception of many of their major projects on show during Wikimania, including Page Triage, a more feature-heavy version of Special:NewPages, and the landmark Visual Editor project (see previous Signpost coverage). The latter, attendees were told, should be live on its first wikis by December, confirming the expected six month delay after a design u-turn earlier this year. Developers also confirmed that the tool would continue to support manual mode for the foreseeable future, much to the relief of several hardened editors in the crowd. It is unclear whether the projects will retain support as they near fruition in the months to come.

Perhaps the most thought provoking of the talks, however, proved to be that of WMF Senior Designer Brandon Harris, whose proposed "Wikipedia in 2015" designs raised numerous eyebrows among the Wikimania attendees. The four-pronged suggestions incorporate not only a drastic new skin for Wikipedia pages (Athena, mockup illustrated right) but also possible designs for the Echo notifications project, Agora (a centralised design and icon repository), and Flow, an eventual replacement for user talk pages. All are marked as being of a strictly "future" nature: but their dramatic difference from current systems and designs no doubt took many in the crowd by surprise. Whether the Foundation has the willpower and legitimacy to push through such large scale design changes remains an open question, but they are aware of the issues that may arise: as Harris stated, "Athena is supposed to be a kick in the head. It's a process, not a final design. It's a conversation about what we need to do; not what we are doing." In the interim, some of the suggestions could find their way into the front pages of WikiProjects – or so a well-received talk by WMF Deputy Director Erik Möller suggested.

Slides for some talks are already available, while many more, plus videos of each of the talks, will be made available over the coming weeks.

June engineering report published

In June 2012:
  • 92 unique committers (up 15 from April) contributed 1401 patchsets of code to MediaWiki.
  • The total number of unreviewed commits [reached] 320 (up 70).
  • About 53 shell requests were processed (up 17).
  • 45 developers received developer access to Git and Wikimedia Labs (down 63).
  • Wikimedia Labs now hosts 100 projects (up 3), 182 (up 5) instances and 468 users (up 37).

Engineering metrics, Wikimedia blog

The Wikimedia Foundation's engineering report for June 2012 was published this week on the Wikimedia Techblog and on the MediaWiki wiki, giving an overview of all Foundation-sponsored technical operations in that month (as well as brief coverage of progress on Wikimedia Deutschland's Wikidata project). Of the four headlines in the report, three have already been covered in the Signpost: the Berlin hackathon, described as "the largest gathering of Wikimedia technologists to-date"; the deployment of a second Visual Editor prototype backed by new parser Parsoid; and the launch of IPv6 support during IPv6 World Launch day. Finally, a fourth headline focussed on the commencement of development work on a new Wiki Loves Monuments mobile app, which is to be built by the Foundation's inhouse mobile team.

The monthly report also included news of a "distributed spam attack on [the Wikimedia] mail system involving what appeared to be a few thousand malicious hosts"; having blocked the attack, it "took a day for the mail system to catch up". Elsewhere, on the mobile platform there was a significant release for both the iOS and Android apps (bringing a "dramatic speed improvement" to both apps); testing conducted to allow telecommunications provider Orange to roll out free Wikipedia access to users in six countries and other providers to roll it out in Bangladesh and Montenegro; and "significant progress" on getting Wikipedia available cheaply over the SMS protocol. Just as significant was work on improving sister projects' mobile sites, and then setting up redirection to those mobile sites for users of mobile devices – a project that upgraded Wiktionary, Wikinews, and Wikisource wikis during June and has since been expanded to include Wikiquote, Wikibooks and Wikiversity wikis.

On the negative side, for the umpteenth month in a row, volunteer developers seem to be struggling to get timely code review, contributing to fears that now that unreviewed code does not block deployment, code could be sitting around for months without a review. In addition to publishing a headline figure of approximately 350 unreviewed revisions, the monthly report also contained the first fruits of the Foundation's attempt to generate proper statistics on the composition of the backlog, showing that just 76 were overtly waiting for the original submitter to take action, 49 were overtly awaiting reviewer action and 203 were in a grey area normally indicative of awaiting a reviewer. There was also little progress on the long-running TimedMediaHandler project (now in its 26th month of active development) but nevertheless good news: a final push is expected in late July to prepare the extension, which dramatically improves MediaWiki's support for video display, for a full Wikimedia deployment.

In brief

Signpost poll
Performance

Not all fixes may have gone live to WMF sites at the time of writing; some may not be scheduled to go live for several weeks.

  • Wikidata deployment plan coming together: Denny Vrandecic, the director of Wikimedia Deutschland's Wikidata project (see previous Signpost coverage) this week proposed a tentative plan for its first round of deployments (wikitech-l mailing list). That round of deployments would bring into effect phase 1 of the project – the provision of a central interwiki repository. Although no dates have been set, the process is expected to begin shortly, starting with the Hungarian Wikipedia and thereafter fanning out. Abnormal (non-one-to-one) interwiki cases will be left as-is for the foreseeable future, but, community consensus notwithstanding, all other interwiki links are set to be replaced with a single Wikidata call in the near future. A new logo for the project was also finalised this week.
  • Find a Wikipedia in your language: A volunteer-developed search box has been added to http://www.wikipedia.org to allow users to find a Wikipedia in their own language (blog post by volunteer developer Robin Pepermans). Although the search engine will require further improvement, the interface already allows users to enter the name of their language and be redirected to the appropriate Wikipedia; currently, there are over 200 such Wikipedias or incubator projects. It is not yet enabled for mobile devices.
  • Contractor joins fulltime staff: Longtime contractor for the Foundation Peter Youngmeister has been hired as a full-time member of the Technical Operations staff (wikitech-l mailing list). Youngmeister joins the operations team, "so that he can continue protecting the data and fighting for the user", wrote WMF Director of Technical Operations CT Woo, announcing the hire. The Foundation currently has over a dozen job vacancies; British chapter Wikimedia UK is also currently seeking a fulltime developer, as they announced this week on the same mailing list.
  • Gerrit evaluation begins: The time is ripe to consider changing code review systems even if the outcome is sticking with Gerrit, Director of Platform Engineering Rob Lanphier argued in a thread on the wikitech-l mailing list on Wednesday, alluding to earlier promises to review Gerrit after users had had time to understand its capabilities. A self-admitted afterthought, few disagree with the need for a review; rather, as points both for and against mount, critics are far more likely to point to describe Gerrit as an unfortunate fait accompli: the costs of moving, even from imperfect software, have already been cited as a reason for sticking with Gerrit, almost certainly to the dismay of those who wanted Gerrit's shortcomings to block the Git switchover. As of time of writing, the review – which, as previously reported, will be headed by Lead Software Architect Brion Vibber – seems to be inextricably heading for a "Gerrit but with fixes" outcome.
  • OAuth a tricky business: Creating a suitable OAuth environment – that is to say, settling on a protocol whereby external "apps" could interact with Wikipedia pages on a user's behalf – could be a tricky business, suggests developer Daniel Friesen in a series of posts this week on the wikitech-l mailing list (1, 2, 3). Considerations for establishing the perfect system include security concerns, extensibility issues and maintenance of essential functionality, such as allowing custom-built mobile apps to ease editing (whether on a Wikimedia wiki or otherwise).
  • Two bots approved: 2 BRFAs were recently approved for use on the English Wikipedia:
    • Svenbot's 3rd and 4th BRfA, taking over tasks previously run by Fbot.
At the time of writing, 11 BRFAs are active. As usual, community input is encouraged.