Jump to content

Growth/Growth team updates: Difference between revisions

From mediawiki.org
Browse history interactively
← Older editNewer edit →
Content deleted Content added
VisualWikitext
Updating description and team list
Tag: 2017 source edit
Imagen
Tags: Reverted Mobile edit Mobile web edit
Line 1: Line 1:
<languages/>
<languages/>Espanis Mexico
{{Growth/Navbar}}
{{Growth/Navbar}}
{{Wikimedia engineering project information
{{Wikimedia engineering project information
Line 24: Line 24:


<translate>
<translate>

== How to get involved == <!--T:6-->
== How to get involved == <!--T:6-->
</translate>
</translate>

Revision as of 01:23, 10 September 2022

Languages:

Espanis Mexico

Wikimedia Foundation projects
Growth team updates
Updates on multiple projects to increase new editor retention
Group: Growth
Start: 2018-07-01
Team members: Gergő Tisza (senior software engineer), Benoît Evellin (community relations specialist), Elena Tonkovidova (QA engineer), Dennis Mburugu (engineering manager), Sergio Gimeno (software engineer), Kirsten Stoller (product manager), Mariya Shilova (Senior Technical Program Manager), Kosta Harlan (senior software engineer), Morten Warncke-Wang (data analyst), Rita Ho (UX designer)

This page contains updates on the Growth team's work to increase new editor activation and retention. The planning for this work began in June 2018. The team works on multiple projects at a time, but they will all be discussed on this page.


How to get involved

It is important that our work is grounded in the reality of the communities we hope to help. If you have thoughts or ideas around this project or our team's work, please comment on this project's talk page.

Project updates

Updates for 2022 are listed below, from this page. Watch 2022 updates. ● See also the Release Timeline ● Growth team updates: 2024, 2023, 2022, 2021, 2020, 2019, 2018.


Update 2022-12-15: Wishathon, article creation for newcomers, and Welcome email campaign analysis

Update 2022-12-08: Impact module, Growth article, and scheduling

  • Positive Reinforcement: Impact Module rollout
    • Growth pilot wikis (Arabic, Czech, Bengali, and Spanish) now have the new impact module by default.  On these wikis we will complete a month-long A/B test, and we are also already starting to look at data to evaluate leading indicators. If results from the A/B test look promising, we will release to more wikis once we've also addressed any major issues or pain points surfaced by our pilot wikis and other testers. The new impact module is testable on all Wikipedias. You can opt in and view the new impact module by adding &new-impact=1 to your homepage URL. Example for English Wikipedia: https://en.wikipedia.org/w/index.php?title=Special:Homepage&new-impact=1
  • End of year schedule
    • Next week, in an effort to fit in as many community requests from the 2022 Community Wishlist, Growth engineers plan to help work on some of the smaller and actionable Community Wishlist requests.
    • There will be no Growth feature changes between Dec 16, 2022 and January 2, 2023 because there are no Release Trains at the end of December. In other words, next week will be the last Growth Update of 2022.

Update 2022-12-02: Impact module testable on all Wikipedias

  • Positive Reinforcement: Impact module rollout
    • We have completed an overhaul of the Impact module, it now incorporates more stats, data visualizations, and other contribution information. The hope is that this information helps newcomers feel more engaged and understand their connection to the larger community. The new Impact module is testable on all Wikipedias. You can opt in and view the new Impact module by adding &new-impact=1 to your homepage URL. Example for English Wikipedia: https://en.wikipedia.org/w/index.php?title=Special:Homepage&new-impact=1
    • Next week we will release the new Impact module to Growth pilot wikis (Arabic, Czech, Bengali, and Spanish) and we will complete a month-long A/B test comparing the old impact module to the new impact module. All users who currently have the newcomer homepage enabled will see the new Impact module, but only 50% newly created accounts will receive the new Impact module. This will allow us to compare new accounts to see if the Impact module changes newcomer behavior or retention in any way. If results look promising, we will release to more wikis once we've also addressed any major issues or pain points surfaced by our pilot wikis and other testers.

Update 2022-11-24: Impact module rollout, community events, and copy edit research

  • Positive reinforcement: Impact module rollout
    • The new impact module has been testable on Beta wiki for a several weeks and after further improvements and a review from the Growth team Ambassadors, we plan to release the new Impact Module to Growth pilot wikis in early December (T323526).  
    • We will closely monitor feedback and leading indicators to ensure the new Impact module is improving the newcomer experience (T323788).  Learn more about the Growth team's measurement and experiment plan on the Positive Reinforcement Project page.
  • Community events reports
    • Growth team members, especially Growth Ambassadors, make an effort to attend community events whenever possible. Two Growth team members recently attended Wikiconvention Francophone. We will start to add summaries of each event we attend, along with the feedback we receive, to a Community events reports page.
  • Copy Edit Structured Task
    • Growth Ambassadors worked with the WMF Research team to complete a second evaluation of LanguageTool as a way to surface copy edits in Wikipedia articles. We evaluated errors in Arabic, English, and Spanish. In the previous evaluation we determined that certain rules often resulted in incorrect suggestions, so we added functionality to filter certain rules. The additional rule filtering improved results and we ended with results with a higher level of accuracy than in the V1 sample.
    • We also explored using common misspelling lists as a way to surface typos and misspellings on Wikipedia. Results were promising, but more research is needed to determine if this is a reasonable approach that will provide the coverage and accuracy needed to be a good structured task for newcomers.  
  • Add a Link
    • As of today, Growth pilot wikis have access to an improvement that ensures that newcomers who complete “add a link” edits are receiving more articles that are considered underlinked (T301096). We previously evaluated this change with Growth Ambassadors and found that the improvement resulted in better suggestions (T314299).
  • Mentorship
    • We have added more mentorship metrics to the Growth KPI dashboard (T318684). Included are graphs that show metrics per wiki, including:
      • Number of automatically assigned mentors: The number of mentors who are actually receiving new mentors. So this number excludes mentors who have “None” selected in their “Number of mentees assigned to me” setting.
      • Newcomers per mentor: This is equal to "numberOfMonthlySignups / numberOfActiveMentors." The Growth team recommends this number to be 500 or less.
      • Number of inactive mentors: An inactive mentor is defined as "Did not save any edit in the last 30 days".
    • Arabic, English and Farsi mentors will have access to the Mentorship filters in Recent changes on Monday, November 21. This is possible, because we fixed the underlying issue that kept us from having this feature at arwiki/enwiki/fawiki (T318457).
The old impact module, which includes a list of edited articles and view counts, is shown next to the new impact module, which displays the same data along with more user stats and data visualizations.

Update 2022-11-10: Impact module improvements and “add a link” updates

  • Positive Reinforcement:
    • The first part of the Positive Reinforcement project is to make further improvements to the newcomer Homepage's Impact module. This is still in progress, but you can now preview the new impact module on Beta wiki (T222310).
  • Add a Link:
    • Growth pilot wikis will soon test an improvement to the Add a Link feature, in which articles which have few links are prioritized (T301096). We have evaluated this change with Growth Ambassadors and found that the improvement should result in better suggestions (T314299).

Update 2022-11-03: Recent changes by mentees and Growth control group changes

  • Mentorship
    • Today we released a small change to the Mentor dashboard (Special:MentorDashboard). In the “Your mentees” module, there is now an easy link to Recent changes filtered to only your mentees (T317821).  This provides mentors who want to quickly review all edits made by their active mentees an easy way to access that view. This filter was already available in Recent changes (only visible to Mentors), but this link from the Mentor dashboard should help expose this functionality to mentors who might not be aware of this option.
  • Growth control group changes
    • We have changed how the Growth control group works (T320876). There will no longer be a 20% control group of new accounts that don’t receive Growth features. This will ensure that all newcomers receive the same Growth onboarding and newcomer homepage. We will still test and evaluate all new Growth features, but we will evaluate them based on the standard newcomer experience rather than evaluate against no Growth features. We are making this change because:
      • The Growth control group is confusing for Teahouse hosts, Mentors, event & workshops hosts, and others attempting to help newcomers. We’ve received feedback from communities asking to remove this control group so that all newcomers receive the same onboarding experience.
      • Growth features have been shown to increase newcomer activation and retention, so all newcomers should have access to them.
  • Growth features in the news
  • Up next:
    • Mentorship: Soon we will re-enable "Your unstarred mentees" at Arabic, English, and French Wikipedias (T318457). This feature was disabled due to performance issues, which we have now found a way to address for these larger wikis.
    • Add a Link: We are testing and preparing to release the “add a link” structured task to another group of wikis (T304550). We will communicate with these wikis once the backend work is complete and checked.
    • Positive Reinforcement: we are making further improvements to the impact module, which is testable on Beta using a query parameter `new-impact=1` on the Homepage. Currently only part of the Impact module is visible in Beta, but the whole module should be testable soon (T222310).

Update 2022-10-27: Structured mentorship list and “add a link” scaling

  • Mentorship
  • Add a link
    • 16 more wikis have receive the “add a link” suggested edit for newcomers (T304549).
      • Bashkir Wikipedia ba
      • Balinese Wikipedia ban
      • Bavarian Wikipedia bar
      • Samogitian Wikipedia bat-smg
      • Bikol Central Wikipedia bcl
      • Belarusian Wikipedia be
      • Belarusian (Taraškievica) Wikipedia be-x-old
      • Bulgarian Wikipedia bg
      • Bhojpuri Wikipedia bh
      • Bislama Wikipedia bi
      • Banjar Wikipedia bjn
      • Bambara Wikipedia bm
      • Breton Wikipedia br
      • Bosnian Wikipedia bs
      • Buryat Wikipedia bxr
      • Indonesian Wikipedia id
  • Up Next:
    • Growth features for all newcomers: We plan to end the Growth control group, so all newcomers receive the same experience (T320876). This should help mentors and other experienced users who help newcomers, as everyone creating an account will have a similar newcomer experience.
    • Copy edit structured task: We are completing a second round of evaluation for the Copy edit project. Previously, we evaluated how LanguageTool and Hunspell would work on Wikipedia articles. We are now evaluating some further improvements to LanguageTool suggestions, along with a separate evaluation of suggestions based on a commonly misspelled words list.
    • Mentor dashboard improvements: On Thursday, November 3, 2022, we will add a small change to the Mentor dashboard's “Your mentees'' module.  The module will have a new footer, called "Recent changes by your mentees" (T317821). This footer will include a link to Recent changes, where mentors can see only edits made by their own mentees.  This change will be deployed to all wikis except arwiki, enwiki and frwiki due to a limitation tracked in (T318457). Once that task is completed, the footer will be deployed to the remaining three wikis as well.

Update 2022-10-19: Mentorship improvements, positive reinforcement, and “add a link” scaling

  • Mentorship
    • The new Structured mentor list was deployed at Arabic, Bengali, Czech, and Spanish Wikipedias and no issues have been identified (T310905). We will release this improvement to all wikis (with Mentorship enabled) on Wednesday, Oct 26, 2022.  This new structured mentor list allows for an easier set  up, better extendibility, is easier to parse, and less prone to error. The project page, documentation and FAQ have been updated.
    • The Mentor Dashboard mentee overview (the “Your mentees” module) has been migrated to Vue (T300532). This is part of a larger effort to migrate Growth features to Vue (T296646) and adopt a modern JavaScript framework across MediaWiki (T241180).
  • Positive reinforcement
    • You can view the first step towards a new and improved Impact module in Beta by using a query parameter `new-impact=1` on the Homepage or the Impact special pages. This is part of our effort to further improve the Impact module based on incorporating stats, graphs, and other contribution information. The revised impact module will provide new editors more context about their impact. Currently only part of the Impact module is visible in Beta, but the whole module should be testable soon (T222310).
  • Add a link
    • We are rolling out “add a link” to another round of wikis. If all goes well, the following wikis will receive the “add a link” structured task on October 27, 2022 (T304549).
      • Bashkir Wikipedia ba
      • Balinese Wikipedia ban
      • Bavarian Wikipedia bar
      • Samogitian Wikipedia bat-smg
      • Bikol Central Wikipedia bcl
      • Belarusian Wikipedia be
      • Belarusian (Taraškievica) Wikipedia be-x-old
      • Bulgarian Wikipedia bg
      • Bhojpuri Wikipedia bh
      • Bislama Wikipedia bi
      • Banjar Wikipedia bjn
      • Bambara Wikipedia bm
      • Breton Wikipedia br
      • Bosnian Wikipedia bs
      • Buryat Wikipedia bxr
      • Indonesian Wikipedia id
  • Core experiences
    • The Growth and Editing teams met for a series of meetings to further develop our team strategies and facilitate some time for our teams to connect and collaborate more effectively.  A highlight was meeting with a group of local Czech Wikimedians. Thanks, Janbery, for taking photos and Martin_Urbanec_(WMF) for arranging the meetup.  

Update 2022-09-28: Mentorship improvements and increase in “add a link” confidence score

  • Mentorship
    • The new Structured mentor list is now deployed at Arabic, Bengali, Czech, and Spanish Wikipedias (T310905) / (T264343). After a period of testing, feedback, and some further improvements, we will release this change to all wikis. The new structured mentor list has several advantages:
      • Easier set up: Previously each community that wanted to adopt Growth mentorship had to create its own mentor list. With the structured mentor list, the only step needed to get Growth mentorship will be to get a sufficient number of mentors on board.
      • Better extendibility: The new system allows mentors to easily update their mentor settings, and allows the Growth team to further improve and extend mentor features.  
      • Less error-prone: One user’s “bad” edit can no longer break a list or enroll the wrong user.  
      • Easier to parse: Among other improvements this will allow the Growth team to provide more meaningful data about mentorship at each wiki. Please let us know in this phabricator task or on a Growth team talk page if you have any feedback about what mentor or mentee data you want to have for your community.  
    • We have several Mentorship improvements in the works, including:
      • When a mentor gets blocked, mark them as "Away" (T318819)
      • Show information about mentees' pending changes on FlaggedRevs wikis (T297811)
      • Change the default values to become a mentor (T318545). Communities can configure this based on their preferences, but for wikis that don't customize, the default will be:
        • Minimum number of days users should be registered to become a mentor : 90
        • Minimum number of edits users need to become a mentor : 500
  • Add a link
    • The Growth team has increased the confidence score on link recommendations (T316079). This means that all future link suggestions added to the Suggested Edits queue are more likely to be accurate. It’s important to note that this change will ensure that more of the “add a link” suggestions are correct, but there will still be link suggestions that are incorrect or unnecessary, which is why human review of these suggestions is necessary. All newcomers who complete this task receive onboarding that explains: Suggested links are machine-generated, and can be incorrect. The suggestions might be on words that don’t need them, or might link to the wrong article. Use your judgment to decide whether they are right or wrong.

Update 2022-09-20: Copy edit research, “add an image” scaling, and structured mentor list release

  • Copy edit structured task
    • The Research team and the Growth team are continuing to investigate the best strategy for introducing a copy edit structured task that would guide newcomers through the process of making a spelling or grammar fix. We just completed an initial evaluation of two different tools across 5 different languages: Arabic, Bengali, Czech, Spanish, and English. You can read about our results here.
  • Add an image
    • The Growth team deployed the “add an image'' suggested edit to 5 more Wikipedias (T314518) on Monday, September 19, 2022. We have communicated with these wikis (T301601), and we will continue to listen to feedback about this newcomer task. The 5 wikis that received "add an image" this week are:
      • Greek Wikipedia (el)
      • Polish Wikipedia (pl)
      • Chinese Wikipedia (zh)
      • Indonesian Wikipedia (id)
      • Romanian Wikipedia (ro)
  • Mentorship
    • This Wednesday, September 21, 2022, a new structured sign-up process will be released for Mentorship to three Growth pilot wikis: Arabic, Bengali, and Czech Wikipedias (Growth Mentorship tools haven’t yet been enabled by the Spanish Wikipedia community). The Structured mentor list is a new way for mentors to sign up. Instead of signing up via a wikitext-based list, mentors will soon be able to use a form to enroll and then utilize the Mentor dashboard to update information, such as their welcome message or number of newcomers they want to be assigned to.  Learn more about this project here: Structured mentor list.

Update 2022–09-14: Onboarding improvements and instrumenting blocked account registration

  • Onboarding improvements for new editors:
    • We continue to carefully measure how Growth tools impact new users across wikis. Although Growth features improve newcomer engagement as a whole, we noticed that the current onboarding wasn’t working as well for newcomers who start their first edit, and then create an account before publishing the edit. We’ve made improvements to help better accommodate this user journey (T310320).
  • Instrument blocked account registration
    • There is concern around the impact that large IP blocks are having on newcomers (wikimedia-l thread). Wide IP ranges that are associated with open proxy services are sometimes blocked to stop persistent sockpuppet accounts and vandals from avoiding blocks. But this IP blocking has the negative side effect of blocking many good-faith newcomers from creating accounts and editing. The Growth team has completed a task to log an event when account creation is denied so that we will have more complete data around account blocks related to local IP blocks, local autoblocks, and global IP blocks (T306018).

Update 2022–09-05: Newcomer & Mentorship data

Mentorship metrics example
  • Growth KPIs
    • We’ve added more data to the Growth KPIs, so you can better understand how Growth tools are utilized on your wiki. If you have any questions, or there is more data you want access to, please let us know.
      • Clicks / Saves / Reverts: You can not only view the total number of each Suggested Edit task type that is clicked on and completed on your wiki, but also the revert counts for each task type.
      • Questions posted to mentors or help desk: You can view the number of questions posted to mentors, along with where those questions originate.
      • Account registration: You can view the number of new accounts created on your wiki and see if there is an experiment running resulting in a certain percentage of newcomers not automatically receiving Growth features.
  • Newcomer task edit type analysis
    • Communities had expressed concern that newcomers whose initial edits were structured tasks wouldn’t go on to learn how to complete more difficult tasks, so a WMF data scientist conducted Newcomer task edit type analysis to see if this was indeed the case. Results from analysis indicate that this likely isn’t a significant concern. In this analysis, we use data from wikis where Add a Link was deployed and examine whether newcomers who start out with Add a Link edits end up continuing to only make those types of article edits. We also do the same for users who started out with a different Newcomer Tasks edit, so we can compare between the two groups. We find that both groups are more likely to go on to make additional article edits compared to those who do not start out with Newcomer Tasks, and that more than 70% of newcomers who start out with Add a Link go on to make a combination of Newcomer Tasks and other article edits or only other kinds of article edits. Read the full analysis and methodology here.

Update 2022-08-22: Copy Edit analysis and Structured mentor list

  • Copy Edit structured task
    • The Research team created a list of 100 samples of potential copy edits in Wikipedia articles for arwiki, bnwiki, cswiki, eswiki (Growth pilot-wikis) and enwiki with two different methods: LanguageTool and Hunspell. LanguageTool is a free and open-source grammar, style, and spell-checker. Hunspell is a free spell checker and morphological analyzer used by LibreOffice, OpenOffice, and many other open source projects. The Growth team Ambassadors will review these copy edit samples to determine the level of suggestion accuracy for each tool using actual Wikipedia articles.  We will share more details here and on the associated Copy Edit page once the evaluation is complete.
  • Mentorship
    • The Growth team hopes to release the new Structured mentor list to Growth pilot wikis in September. We will work to ensure the Structured mentor list documentation is translated and then connect with Arabic, Bengali, Czech, and Spanish communities about the change to ensure the transition goes smoothly for current and future mentors. If you want to know what to expect, the change is already testable at all beta wikis and at test.wikipedia.org. You can view Phabricator task T312102 for more details.

Update 2022-08-17: Copy Edit research, Structured mentor list development, and Positive Reinforcement user testing

  • Copy Edit structured task
    • In the future, the Growth team plans to develop a Copy Edit structured task: a task related to improving article spelling, grammar, punctuation, tone, etc. In our initial community discussions around structured tasks, we found that copyediting was the task that communities desired most. There are many challenges and unknowns associated with supporting so many languages, so we are working with the Research team on reviewing our various options.  We have published initial Research findings here. We are now working towards building a list with examples of automatically suggested copy edits for manual evaluation by the Growth Ambassadors (T315086).
  • Mentorship
    • A new structured sign-up process will be released for Mentorship soon. The Structured mentor list is a new way for mentors to sign up. Instead of signing up via a wikitext-based list, mentors will soon be able to use forms incorporated into the Mentor dashboard to enroll into mentorship and to change their information, such as their message or number of newcomers they want to be assigned to. This update is already testable, please view this Phabricator task if you want to test the changes.  Learn more about this project here: Structured mentor list.
  • Add a link
    • This week we will finish analyzing the impact of prioritizing underlinked articles for “add a link” (T301096). The initial development work is complete, now we are testing results compared with the current baseline to ensure the new method of prioritization is an improvement.
    • When an "add a link" suggestion is rejected by a newcomer, they are asked to select a reason why. Analysis found that "Other" was chosen as the rejection reason for link rejections about 14% of the time. We temporarily gathered free text rejection reasons to help us identify if there is a rejection reason we should add or an improvement to make to the algorithm (T304099 & T313141). We are analyzing responses this week and hope to have a decision made soon.
  • Positive Reinforcement
    • User testing of initial Positive Reinforcement designs was just completed. Interviews were conducted in Arabic, English, and Spanish. We will share this data on the Positive Reinforcement page soon.  
    • We are continuing Impact Module work for the upcoming positive reinforcement project (T313310). The new Impact Module will include a similar overview of edited articles like the current design, but also include other data points and data visualizations to help newcomers understand the value and impact of their contributions.

Update 2022-07-25: Positive Reinforcement development starts

  • Positive Reinforcement
    • We have completed two engineering tasks to kick-off the Positive Reinforcement project. We have a configuration flag set up that will allow for progressive rollout of the new Impact Module (T311299). And we have completed the initial technical research and discussions needed to decide how to handle the backend storage and API for the additional data that will be added to the Impact Module (T309747).
    • We are wrapping up user testing for Positive Reinforcement prototypes this week (T307950), and then we will focus on finalizing designs based this user testing feedback along with previous community feedback (T313271).
  • Mentorship
    • A new structured Mentor sign-up process will be released soon. This new sign up method is already testable on beta Wikipedia, and we welcome any feedback (T312102). We will share documentation and details on our rollout strategy soon.
    • Mentors will see a new Mentee overview soon. This is part of the work our team is completing to migrate the Mentor Dashboard to Vue.js. There should be no feature changes, but this work should move the Growth features closer towards the Design System Team's vision for less feature redundancy, more consistent experience across projects, better accessibility and localization support, and the ability to move faster in the future (T300532).
  • Add a Link
    • We have been working on a task to better prioritize articles that are underlinked. We have a path forward, but first we are validating that the new sorting method is indeed valuable for our communities. Growth team ambassadors will compare before and after results to evaluate the impact of the change (T301096).

Update 2022-07-11: Mentorship improvements

  • Mentorship
    • To make it easy for mentors to sign up without accidentally breaking the list of mentors, the Growth team is working on a sign up page for mentors. Instead of the current wikitext-based mentor list, a structured mentor list will be created. This new structured list, called MediaWiki:GrowthMentors.json, will be the new canonical location for the list of mentors. To ensure this new process is well tested, we have rolled it out on beta English Wikipedia. If you are interested in testing and providing feedback, please see Phabricator task T312102 for testing instructions.
    • After the structured mentor sign up task is complete, it should be easier for us to complete a long standing community request to automatically reassign mentees when a mentor quits mentorship or is removed from mentorship by an Admin (T272376).
    • The structured mentor sign up process will also allow us to validate the maximum length of a mentor message. This should help ensure that a Mentor’s introductory message to mentees is readable and doesn’t get cut-off (T312576).
  • Add an image
    • We have moved from the proof-of-concept image suggestions API, to the new productionized version of the API (T306032). There should be no user-facing changes, but this ensures the future support and scalability of the “add an image” structured task.

Update 2022-07-05: Metrics and improvements for structured tasks

  • Growth team metrics
  • Add an image
  • Add a link
    • We are working on a task to better prioritize underlinked articles for “add a link” (T301096).
  • Positive Reinforcement
    • User testing of initial positive reinforcement designs is underway. Interviews are being conducted in Arabic, English, and Spanish.
    • We have started the initial Impact Module work for the upcoming positive reinforcement project (T311299).
  • Add a link
    • Add a Link Experiment Analysis has been published. The most important points are:
      • Newcomers who get the Add a Link structured task are more likely to be activated (i.e. make a constructive first article edit).
      • They are also more likely to be retained (i.e. come back and make another constructive article edit on a different day).
      • The feature also increases edit volume (i.e. the number of constructive edits made across the first couple weeks), while at the same time improving edit quality (i.e. the likelihood that the newcomer's edits are reverted).
    • A fourth round of wikis have received "add a link" (T304548).
      • This round included: Abkhazian Wikipedia, Achinese Wikipedia, Adyghe Wikipedia, Afrikaans Wikipedia, Akan Wikipedia, Alemannisch Wikipedia, Amharic Wikipedia, Aragonese Wikipedia anwiki, Old English Wikipedia, Aramaic Wikipedia, Egyptian Arabic Wikipedia, Asturian Wikipedia, Atikamekw Wikipedia, Avaric Wikipedia, Aymara Wikipedia, Azerbaijani Wikipedia, and South Azerbaijani Wikipedia.
  • Add an image

Update 2022-06-13: Structured tasks and positive reinforcement feedback

  • Structured Tasks
    • We have been discussing the challenges of patrolling "add a link" and "add an image" structured tasks with patrollers on Arabic Wikipedia, Spanish Wikipedia, and Russian Wikipedia. We are now brainstorming improvements to help address some of the main patroller complaints. We would love to have feedback from an even wider audience, so if you have any thoughts to add about the challenges of reviewing these tasks or how we should improve these tasks further, please let us know.
  • Positive Reinforcement
    • We summarized the initial feedback gathered from community discussions about positive reinforcement ideas, along with how we plan to iterate based on that feedback. The first Positive Reinforcement idea (an overhaul of the impact module based on incorporating stats, graphs, and other contribution information) received the widest support and we plan to move forward with impact module design A.

Update 2022-06-06: Community configuration for "add a link" and "add an image"

  • Add a link
    • Communities can set the maximum number of "add a link" suggested tasks a newcomer can complete daily. In other words, communities can limit the number of "add a link" tasks newcomers can complete, which is helpful if patrollers are overwhelmed by the quantity of these edits. Privileged users can configure this task limit, and other Growth feature settings, from Special:EditGrowthConfig. (T308543).
    • The backend work is complete for the 4th round of wikis to receive "add a link" (T304548).
    • We posted an overview of what is included in "add a link" iteration 2.
  • Add an image
    • A bug was fixed in which the "view image details" option was no longer visible when a newcomer was adding a caption.
    • Communities can set the maximum number of "add an image" suggested tasks a newcomer can complete daily (T308543).
  • Positive reinforcement
    • We are continuing discussions with communities in Arabic, Bengali, Czech, English, and French, and starting to compile a summary we will share.
    • User testing of positive reinforcement designs will start soon. Tests will be conducted in Arabic, English, and Spanish.

Update 2022-05-30: positive reinforcement discussion, mentorship update, and "add a link" improvements

  • Positive reinforcement
    • We have started community discussions about the positive reinforcement project in Arabic, Bengali, Czech, English, and French. We would love to hear from more people, so please join one of these discussions if you are interested.
    • Based on community feedback, we added a few more designs to the "leveling up" idea. You can see one of our ideas in the accompanying image. Please join the discussion to share your thoughts.
Design idea showing how newcomers making poor quality “fast edits” could receive guidance
  • Mentorship module:
    • We completed some improvements to the newcomer homepage that allows newcomers to better understand the mentorship feature, and allow them to opt out of mentorship.
      • Provide more information about the public nature of the mentors and talk pages in the Mentor module (T292627).
      • Allow newcomers to opt-in and opt-out of mentorship (T287915).
Screenshot of the "About mentors" explanation from the newcomer homepage
  • Add a link
    • The next group of wikis that will receive "add a link" will be:
      • Abkhazian Wikipedia
      • Achinese Wikipedia
      • Adyghe Wikipedia
      • Afrikaans Wikipedia
      • Akan Wikipedia
      • Alemannisch Wikipedia
      • Amharic Wikipedia
      • Aragonese Wikipedia
      • Old English Wikipedia
      • Aramaic Wikipedia
      • Egyptian Arabic Wikipedia
      • Asturian Wikipedia
      • Atikamekw Wikipedia
      • Avaric Wikipedia
      • Aymara Wikipedia
      • Azerbaijani Wikipedia
      • South Azerbaijani Wikipedia
    • We have tested and evaluated the models used for "add a link" for all of these languages. To stay informed, you can subscribe to Phabricator Task 304548.
    • We are working on two more "Add a link" improvements:
      • Prioritize suggestions of underlinked articles (T301096).
      • Allow communities to customize the "add a link" quality gate threshold easily within Special:EditGrowthConfig (T308543).
    • In our "add a link" analysis we found that this feature helps engage newcomers and has a low reversion rate. However, the ease of the task also means that on some wikis there are many of these newcomer edits appearing for patroller review. We are engaged in discussions with community members from several wikis regarding improvements we could make to the "add a link" feature or even the "Recent Changes" feed to ensure the feature is sustainable for patrollers.

Update 2022-05-23: positive reinforcement updates and other Growth team work

  • Annual planning
    • We are planning for our coming year, and we’ll post our thoughts in the next couple weeks so that community members can react to our plans and help make sure we’re on the right track.
Impact module: design A
  • Positive reinforcement
    • This is the next big project that the Growth team will focus on. We want newcomers to understand there is progression and value to sustained contributions on Wikipedia, and we want to improve new editor retention.
    • We have started a Positive Reinforcement discussion with contributors in English, and we will also discuss the project in more detail with our pilot wikis (Arabic, Czech, and Bengali Wikipedias) who receive Growth team features first. You can see some of our ideas in the accompanying image. Please join the discussion to share your thoughts!
    • The three main ideas part of the Positive Reinforcement project are:
      • Impact: An overhaul of the Impact module based on incorporating stats, graphs, and other contribution information.
      • Leveling up: It is important to communities that newcomers progress to more valuable tasks. For those who do many easy tasks, we want to nudge them toward trying more difficult tasks.
      • Personalized praise: Research shows that praise and encouragement from other users increases newcomer retention. We want to think about how to encourage experienced users to thank and award newcomers for good contributions.
  • Add an image
    • There have been no changes lately to this feature, but we are gathering data and community thoughts to plan iteration 2.  So far, over 5,000 images have been added to articles.
    • Add an image was used in four successful GLAM events, in which 67 people made 198 image edits.  We also learned many of these contributors returned and continued to make edits following the GLAM event.
  • Add a link
    • We have completed "iteration 2", which involved several improvements that came from community discussion and from data analysis:
      • Algorithm improvements:
        • Avoid recommending links in sections that usually don't have links.
        • Avoid suggesting first names.
        • Limit each article to only having three link suggestions by default (limited to the highest accuracy suggestions of all the available ones in the article.)
      • User experience improvements:
        • Add a confirmation dialog when exiting out of suggestion mode prior to making changes.
        • Improved post-edit dialog experience.
        • Allow newcomers to browse through task suggestions from the post-edit dialog.
      • Community configuration:
        • Allow communities to set a maximum number of links per article via Special:EditGrowthConfig
    • With those improvements, we are confident about releasing "add a link" to more wikis, and so this past week the feature was released to these wikis:
      • Catalan Wikipedia
      • Hebrew Wikipedia
      • Hindi Wikipedia
      • Korean Wikipedia
      • Norwegian Bokmål Wikipedia
      • Portuguese Wikipedia
      • Simple English Wikipedia
      • Swedish Wikipedia
      • Ukrainian Wikipedia
    • The next group of wikis that will receive "add a link" are documented in this this Phabricator task. The list may change slightly as we test and evaluate models and ensure the level of precision and recall in each language is adequate.
  • Marketing:
    • We are currently partnering with the Marketing team to test the efficacy of social media ads (bringing users into our projects) and welcoming emails (retaining new users). This newcomer experience marketing pilot includes an inspiring video full of community members.  We’ll post results in a few weeks.
  • Fundraising:
    • We are working with Fundraising on ideas for how to give donors the opportunity to learn to edit.  Next week we will start an experiment (in fundraising campaigns in Latin America, South Africa, and India) that shows donors a thank you message that also encourages them to create an account to start editing and improving Wikipedia.
    • Donors included in this fundraising campaign who create accounts will then be brought to the newcomer homepage to get started.

Between January and May 2022, some team members transitioned to new positions and responsibilities. As a consequence, only the main events have been written down below.

Update 2022-02-25: positive reinforcement project beginning

  • Add an image
    • This feature was originally deployed on mobile on 2021-11-29. On 2022-01-28, we deployed a desktop version so that newcomers can use it on either platform.
    • On 2022-02-16, we added Spanish Wikipedia to the test. Now, 40% of newcomers on Spanish, Arabic, Bengali, and Czech Wikipedias are receiving "add an image" as their first task.
    • Usage of the feature remains low, but with some users completing many edits day after day. We are now analyzing the full conversion funnel in detail to understand how to increase participation. We are also analyzing the captions users write to understand their quality and how those can be improved.
    • This feature will be used in a GLAM event by Wikimedia Argentina on March 7, to help museum professional illustrate articles in Spanish Wikipedia. If it goes well, it will be used in several subsequent events in Latin America.
  • Add a link
  • Positive reinforcement
    • In building suggested edits, the Growth team has successfully caused more newcomers to make their first edits to Wikipedia. But our analysis shows that although the features increase how many people make their first edits, they do not additionally increase the share who come back and edit again another day (retention). For this reason, we are prioritizing a project called "positive reinforcement", which is about helping newcomers be proud of their impact and be excited about coming back to continue their editing.
    • This project has three main ideas, and we'll begin conversations about them with communities:
      • Impact: the newcomer homepage contains a rudimentary impact module that we could improve to make more interesting.
      • Leveling up: it is important to communities that newcomers progress to more valuable tasks. For those who do many easy tasks, we want to nudge them toward trying more difficult tasks.
      • Personalized praise: research shows that praise and encouragement from other users increases newcomer retention. We want to think about how to encourage experienced users to thank and award newcomers for good contributions.
Retrieved from "https://www.mediawiki.org/w/index.php?title=Growth/Growth_team_updates&oldid=5454197"