Grants:Project/WM HU/Editor retention program/Final/2
This project is funded by a Project Grant
proposal | people | timeline & progress | finances | midpoint report | final report |
- Report under review
- To read the approved grant submission for this project, please visit Grants:Project/WM HU/Editor retention program/Final.
- Review the reporting requirements to better understand the reporting process.
- Review all Project Grant reports under review.
- Please Email projectgrantswikimedia.org if you have additional questions.
Welcome to this project's final report! This report shares the outcomes, impact and learnings from the grantee's project.
Part 1: The Project
[edit]Summary
[edit]This grant funded the extension of the editor retention program in the Hungarian Wikipedia between July 2021 and August 2022. (The project was originally running between April 2019 and December 2020, and used about half of the grant). The project aims to retain editors by helping and motivating both new and old editors; improving the community atmosphere and strengthening the community cohesion, the Wikipedian identity, the sense of mission and pride in Wikipedia. The extension period focused on the following topics:
- improvement the local technical environment (tools, gadgets, editing surface),
- development of the statistical portal,
- preparation of a new experimental communication channel for the community,
- translation of important policies and software surfaces to local language,
- offering frequent community meetups.
Project Goals
[edit]Through solving the problems that have negative influences on the editor retention in the Hungarian community, the goals of the project are
- decreasing the negative experiences and
- strengthening the positive experiences
of editors in order to allow a larger part of the newly registered users to become active members of the volunteer community, and to keep the activity and enthusiasm of the experienced editors.
Additional goals of the project are
- improving the community atmosphere and friendliness and
- strengthening the community cohesion, the Wikipedia identity, the sense of mission and pride in Wikipedia.
Project Impact
[edit]Important: The Wikimedia Foundation is no longer collecting Global Metrics for Project Grants. We are currently updating our pages to remove legacy references, but please ignore any that you encounter until we finish.
Targets
[edit]- In the first column of the table below, please copy and paste the measures you selected to help you evaluate your project's success (see the Project Impact section of your proposal). Please use one row for each measure. If you set a numeric target for the measure, please include the number.
- In the second column, describe your project's actual results. If you set a numeric target for the measure, please report numerically in this column. Otherwise, write a brief sentence summarizing your output or outcome for this measure.
- In the third column, you have the option to provide further explanation as needed. You may also add additional explanation below this table.
Planned measure of success (include numeric target, if applicable) |
Actual result | Explanation |
Surveys, statistics
|
Surveys, statistics | The new modules of the statistical portal provides up-to-date values of the manually generated user lists used in the earlier phase of the project (see more in the #Methods and activities section) |
Guidelines
|
Guidelines
|
The gradual learning process has been developed by the Growth Team, but feedback from the Hungarian Wikipedia (as early adopter) has been taken into account |
Welcoming new editors
|
Welcoming new editors
|
The newcomer's homepage has been developed by the Growth Team, but feedback from the Hungarian Wikipedia (as early adopter) has been taken into account, and operation of it (for example mentoring) is being done by local community members |
Motivate the contributors
|
Motivate the contributors
|
|
Events for in-person meetings
|
Events for in-person meetings
|
Note 1: Because of COVID-19 measures, until June 2021 and between October 2021 and March 2022 we organized only online events. Note 2: The original grant period ended December 2020 and the extended period started in July 2021. The 6 online meetups were organized in between the two granted periods are considered as part of the project but outside of the granted periods. No costs have been charged for this time interval. |
Communication, online community building outside of Wikipedia
|
Communication, online community building outside of Wikipedia
|
|
Technological environment, tools, gadgets
|
Technological environment, tools, gadgets
|
Story
[edit]Looking back over your whole project, what did you achieve? Tell us the story of your achievements, your results, your outcomes. Focus on inspiring moments, tough challenges, interesting anecdotes or anything that highlights the outcomes of your project. Imagine that you are sharing with a friend about the achievements that matter most to you in your project.
- This should not be a list of what you did. You will be asked to provide that later in the Methods and Activities section.
- Consider your original goals as you write your project's story, but don't let them limit you. Your project may have important outcomes you weren't expecting. Please focus on the impact that you believe matters most.
During the project, the project manager was responsible for the coordination and management, and to a lesser extent the implementation of the tasks, while at the same time being responsible for the administration and running of the association (part-time in total). During the extended project period, it became clear that this was a bottleneck, which the association tried to solve by hiring a (part-time) project assistant to take over part of the administrative tasks (organizational capacity building). However, this solution temporarily delayed the project implementation, as the process of calling for applications, evaluating the hundreds of applications received, conducting several rounds of interviews (oral and written), signing a contract with the selected staff member, then training and gradually delegating the tasks took about half a year between November 2021 and June 2022.
Similarly, the implementation of the project was slowed down by other unforeseen/unplanned tasks such as legal issues related to the termination of the association's headquarters contract and the management of the new headquarters (search and agreement, convening a general assembly, contract conclusion, filing of amended by laws with the court); following the flooding of the warehouse where the association's assets were stored, salvage, inventory, then finding, agreeing, contracting, moving to a new warehouse provider due to the termination of the warehouse contract (by the service provider); finding, agreeing and contracting a new accountant due to the termination of the accountant contract, then setting up the appropriate access, establishing workflows; or adapting to unexpected changes in the national legal environment. Overall, the past year has required virtually continuous crisis management. These unexpected, but essential tasks for the legitimate functioning of the organization, in addition to the chapter's normal business (article writing and other competitions, editathons and other events, fundraising campaign, submission of statutory reports and statements), have meant a continuous extra workload and tasks between autumn 2021 and September 2022, slowing down and hindering the effective implementation of the planned project.
Survey(s)
[edit]If you used surveys to evaluate the success of your project, please provide a link(s) in this section, then briefly summarize your survey results in your own words. Include three interesting outputs or outcomes that the survey revealed.
Other
[edit]Is there another way you would prefer to communicate the actual results of your project, as you understand them? You can do that here!
Methods and activities
[edit]Please provide a list of the main methods and activities through which you completed your project.
- Improvements to the editorial interface: Based on the evaluation (priorities and feasibility) of the local technical wishlist (performed in the earlier phase of the project) and of the list of technical problems that have not been solved for many years, two groups of tasks were selected. The first group consisted mainly of entry-level tasks requiring JavaScript knowledge, while the second group consisted of MediaWiki development tasks requiring advanced PHP knowledge. Due to the lack of active technical and developer volunteers within the Hungarian community, the search for a contractor for both groups of tasks was based on the criterion that the person selected should be useful for the Wikimedia projects in the long term, someone who could use his/her experience for the projects after the completion of the specific development task. This means either an active contributor within the project or an external developer with an interest in Wikimedia projects. The job advertisements (Junior JavaScript developer, MediaWiki developer) were published in mid-October, the applications received were evaluated in early November and interviews took place during November. Following the selection, contracts were signed at the end of December.
- The tasks of the junior JavaScript developer were as follows:
- Implementation of a more modern syntax highlighter for VisualEditor on the Hungarian Wikipedia
- Implementation of the ArticleInfo gadget on the Hungarian Wikipedia
- Replacement of IPA characters of the Edittools based on community requests
- Finding and fixing the bug of RollbackConfirm gadget (did not work properly together with the Gadget-modrollback and Gadget-rollback gadgets)
- Bug fixes for WikEd based on bug reports and requests of the Hungarian community. Although this tool is used intensively by a significant group of very active editors, after examining the problem, it was not finally solved. It turned out that there were many more problems with the code, so the task would have been beyond both the capabilities of the junior programmer and the scope of his contract, and the general lack of maintenance put the future of the tool in question.
- Implementation of the Cite Q template and module (and several other depending modules) on the Hungarian Wikipedia.
- Tasks for the PHP (MediaWiki) developer were the following, but unfortunately, none of them have been completed (yet):
- Translations of important policies and software surfaces: The task was undertaken and carried out with great enthusiasm by one of our volunteers who signed up for the project. In connection with this project, a Hungarian translation of the following pages has been completed:
- Developments in connection with Matrix/Element: After discontinuation of the promising Wikimedia Discuss Space, the team looked for a more independent, secure and open-source alternative, and decided to make an experiment with Element, based on the Matrix protocol. After setting up a local Matrix server, it is being used successfully for the Hungarian Wikipedia community and for the Board of the Hungarian chapter (and as an open service, it became popular for other communities, like OpenStreetMap as well). Following the initial success, it is planned to use it as a wider and supported channel for the community (not only for experienced users, but for newcomers looking for answers as well), and to integrate it into the Wikipedia surface on a longer term. For this, we translated the interface of the software into Hungarian, and looked for a developer to investigate the possibilities of automatic Wikimedia login. Eventually we found someone, who had volunteered before, to look at it because he was interested in the question and found the task relatively easy, however there were problems with the non-ASCII characters. The actual implementation and testing of the task has not yet taken place, but is planned for the near future.
- Statistical portal: The purpose of the statistical portal is twofold: on the one hand, it can provide statistical data on editorial retention, showing trends and the impact of specific interventions, and on the other hand, it can provide top-lists for active editors, which in itself has a motivational, proud factor, and can be the basis for community recognition and awards. The first module of the statistics portal was completed in the first phase of the project and provides lists (user pyramids or funnels) of size of pre-defined user groups for the current day or any past day (multiple days with comparison as well), like:
- Edits made in the last 30 days I (number of anons and registered users with different activity level)
- Edits made in the last 30 days II (number of registered users with different activity level)
- Total edits (number of users with at least X number of edits)
- Activity of users registered in the last 30 days (and has X number of edits)
- Activity of users registered 30-60 days ago (and has X number of edits in the last 30 days)
- Activity of users registered 60-90 days ago (and has X number of edits in the last 30 days)
- Size of user groups
- Dropout of users registered 61-90 days ago (users registered 61-90 days ago and has at least 10 edits in the last X days)
- Quick activation funnel (added in the current phase of the project)
- Slow activation funnel (added in the current phase of the project)
- The second module of the statistical portal was developed in the current (extended) phase of the project and provides user (top)lists that sort contributors by different criteria (with additional data about activity for each user; including an export option of the results for CSV and wikicode table formats):
- List of users by edit count
- List of users by edit count in a selected period
- List of administrators by log events
- List of administrators by log events in a selected period
- List of patrollers by patrol count
- List of patrollers by patrol count in a selected period
- List of bots by edit count (with an option to add flagless bots)
- List of bots by edit count in a selected period (with an option to add flagless bots)
- List of template editors by template and module edit count
- List of template editors by template and module edit count in a selected period
- List of interface editors by interface edit count
- List of interface editors by interface edit count in a selected period
- List of logged-in users with at least 100 edits
- List of anonymous users with at least 100 edits
- List of the first 1000 registered users
- List of new users
- List of users to welcome
- List of newcomers to celebrate
- List of good newcomers (based on edits)
- List of good newcomers (based on received thanks)
- Edit milestones
- Administrator activity
- Bureaucrat activity
- Interface editor activity
- Interface admin activity
- Bot inactivity
- User inactivity
- List of users with Service Award
- List of users with Service Award (grouped)
- List of users who leveled up in the selected period
- List of users who leveled up in the selected period (grouped)
- From the very beginning, an important aspect in the development of the statistical portal was to be modular and extendable with new features, easy to add other wikis (especially for smaller wikis and language communities, for large wikis a performance analysis has to be done beforehand) and to have a translatable interface (currently available in English and Hungarian).
- Meetups: Regularly organized meetups for the community have always been an important and effective means to keep contact between the contributors and build up personal connections. Moreover, they provided an excellent opportunity to train editors, introduce new tools, celebrate anniversaries and award prizes for Wikimedia competitions. Due to the restrictions imposed by the pandemic, many of them were held online, but whenever it was possible, in-person meetups were offered. They were organized in the first phase of the project (closed in December 2020), and the series kept going between the first and the second phase of the project (beginning of January 2021 and end of June 2021). These meetups are listed below, but they were organized online without additional cost, therefore they had no effect on the budget of the project.
- Online meetup in January 2021 (Wikipedia 20 celebration) (outside of the granted period)
- Online meetup in February 2021 (outside of the granted period)
- Online meetup in March 2021 (outside of the granted period)
- Online meetup in April 2021 (outside of the granted period)
- Online meetup in May 2021 (outside of the granted period)
- Online meetup in June 2021 (outside of the granted period)
- In-person meetup in July 2021
- In-person meetup in August 2021
- In-person meetup in September 2021
- Online meetup in October 2021
- Online meetup in November 2021
- Online meetup in January 2022
- Online meetup in February 2022
- Online meetup in March 2022
- In-person meetup in April 2022
- In-person meetup in May 2022
- In-person meetup in June 2022
- In-person meetup in August 2022
- Knowledge and resource sharing: Retention of our volunteer contributors is a key priority for the whole movement, and it is vital to share experiences, learn from each other about the most effective activities and share the tools and resources available. Some of our project members participated in Wikimania 2021 (online), in Wikimedia CEE Online Meeting 2021, in Wikimania 2022 (online) and in Wikimedia CEE Meeting 2022, and shared their experience and ideas in the session discussions, unconference talks and meetups. We have also exchanged ideas with the Polish and Spanish chapter members to help similar efforts related to editor retention, and have agreed with the Spanish chapter on further development of the statistical portal in the next months to support their activities as well. Similarly, closely followed other experiments, like email campaign of the German chapter for onboarding new volunteers, Polish experience to avoid volunteer burnout, software experiments of the WMF, experience of the Volunteer Supporters Network and the Community Health Metrics.
Project resources
[edit]Please provide links to all public, online documents and other artifacts that you created during the course of this project. Even if you have linked to them elsewhere in this report, this section serves as a centralized archive for everything you created during your project. Examples include: meeting notes, participant lists, photos or graphics uploaded to Wikimedia Commons, template messages sent to participants, wiki pages, social media (Facebook groups, Twitter accounts), datasets, surveys, questionnaires, code repositories... If possible, include a brief summary with each link.
- Meetups: each meetup has a dedicated Wikipedia page with a summary of the topics discussed with useful links and feedback on the event. This section also contains links to uploaded pictures and recorded videos (if the training sessions and presentations were recorded and uploaded). So far, 39 screenshots, 587 photos and 6 tutorial videos have been uploaded as part of the project extension:
- Summary of the online meetup in January 2021 (Wikipedia 20 celebration), Commons category with 7 uploaded screenshots
- Summary of the online meetup in February 2021, Commons category with 5 uploaded screenshots
- Summary of the online meetup in March 2021, Commons category with 1 screenshot, video recording of a training about patrolling
- Summary of the online meetup in April 2021, video recordings of the presentations
- Summary of the online meetup in May 2021, Commons category with 4 screenshots, video recordings
- Summary of the online meetup in June 2021, Commons category with 1 screenshot
- Summary of the in-person meetup in July 2021, Commons category with 73 photos
- Summary of the in-person meetup in August 2021, Commons category with 71 photos
- Wikipedia page of the in-person meetup in September 2021, (photos will be uploaded later)
- Summary of the online meetup in October 2021
- Summary of the online meetup in November 2021
- Summary of the online meetup in January 2022
- Summary of the online meetup in February 2022, Commons category with 6 screenshots
- Wikipedia page of the online meetup in March 2022, Commons category with 15 screenshots and 1 video recordings, additional video recordings about copyright on Wikipedia, Manual of Style, Cite Q
- Wikipedia page of the in-person meetup in April 2022, Commons category with 57 photos
- Wikipedia page of the in-person meetup in May 2022, Commons category with 99 photos
- Wikipedia page of the in-person meetup in June 2022, Commons category with 246 photos
- Wikipedia page of the in-person meetup in August 2022, Commons category with 41 photos
- Improvements to the editorial interface: new, updated and fixed tools are available for the community. For example, the Dot's syntax highlighter and XTool's ArticleInfo are available in the Settings as optional gadgets, and their effect is illustrated in the first and second pictures above. At the request and wishes of the community, the updated Edittools are available in the 2010 wikitext editor, illustrated in the first picture.
- Developments in connection with Matrix/Element:
- Statistical portal:
- Main page of the portal
- Extended first module of the portal (focusing on editor retention), illustrated in the third picture above
- Second module of the portal (focusing on user lists based on their activity), illustrated in the fourth picture above
- Source code on GitHub
- Translations of important policies and software surfaces: Listed already in the #Methods and activities section:
Learning
[edit]The best thing about trying something new is that you learn from it. We want to follow in your footsteps and learn along with you, and we want to know that you took enough risks in your project to have learned something really interesting! Think about what recommendations you have for others who may follow in your footsteps, and use the below sections to describe what worked and what didn’t.
What worked well
[edit]What did you try that was successful and you'd recommend others do? To help spread successful strategies so that they can be of use to others in the movement, rather than writing lots of text here, we'd like you to share your finding in the form of a link to a learning pattern.
- Learning patterns/How to find the right person for a specific task
- Volunteers do not want to be paid, but rather help as volunteers (even if the financial recognition is offered). A few good words and convincing of the usefulness of the completed work can be more effective. See the translator in the project and the investigating work about the Matrix development.
- Finding a new contractor can also be used as a recruitment tool (but it requires a lot of time), they can stay as volunteers on long term. See the junior developer of the project.
- One of the former volunteer developers is now working as a programmer and has developed the project's statistics portal. Despite his limited free time (and relatively low salary agreement), he worked on it with great enthusiasm, adding several ideas and features that were not part of his contract, and improving and modifying it several times even after the contract was closed.
What didn’t work
[edit]What did you try that you learned didn't work? What would you think about doing differently in the future? Please list these as short bullet points.
- The time needed to complete the tasks of the junior developer (both on the client and contractor side) was several times longer than originally planned, and some of the tasks ended up being solved by a WMF developer instead.
- High potential payment in a contract is not a guarantee that it will be completed, if the applicant is not interested enough in the task (lack of intrinsic motivation). The project team spent about 3-4 months with the MediaWiki developer to help and guide him, without final result.
Other recommendations
[edit]If you have additional recommendations or reflections that don’t fit into the above sections, please list them here.
- The introduction of a healthy lifestyle was a new element at the 2022 meetups. Wikipedia and Wikimedia contributors typically spend a lot of time sitting in one place, in front of a monitor (which got worse by the restrictions during the pandemic), so we organized several meetups that took place outside in the nature, in the fresh air, and we made excursions and forest trips as well’, which provided active pastime. In addition, the range of food and drinks offered at the meetings has been modified and become more varied. Previously, it was only for sweet and salty snacks, but this has been expanded to include fruits and vegetables depending on the given season, bio and organic products with more natural ingredients. In some cases, we preferred the better quality products of local producers over the unhealthy mass products of supermarkets. Furthermore, during the meetings we took into account the needs of participants who required a special diet (e.g. gluten or lactose sensitive / intolerant), and we also offered them food options.
Next steps and opportunities
[edit]Are there opportunities for future growth of this project, or new areas you have uncovered in the course of this grant that could be fruitful for more exploration (either by yourself, or others)? What ideas or suggestions do you have for future projects based on the work you’ve completed? Please list these as short bullet points.
- The WMF-funded project between 2019 and 2022 provided excellent foundations on which to build in the future, and Wikimedia Hungary is committed to continuing and expanding the editor retention program in the following years.
- New feature roadmap and the new contract for the third module of the statistical portal is being prepared, and the Spanish chapter requested that their requirements for monitoring the impact of their activities be integrated into the portal, which Wikimedia Hungary had undertaken. (The statistical portal was developed in a way that adding other languages, wikis or modules with local configuration is relatively easy, so it can serve multiple communities in the future, upon request.)
- There are still some uncompleted tasks listed in the project plan, there are some research related tasks which need to be repeated, and there are new ideas how to help increase retention rate and community growth on the Hungarian Wikipedia.
Part 2: The Grant
[edit]Finances
[edit]Actual spending
[edit]Please copy and paste the completed table from your project finances page. Check that you’ve listed the actual expenditures compared with what was originally planned. If there are differences between the planned and actual use of funds, please use the column provided to explain them.
Expense | Approved amount | Actual funds spent | Difference |
Community and project manager | 1,402,149 HUF | 1,530,752 HUF | -128,603 HUF |
Occasional contractors (developer, translator, tutorials) | 394,537 HUF | 277,565 HUF | 116,972 HUF |
State taxes | 1,230,947 HUF | 1,331,866 HUF | -100,919 HUF |
Event space | 240,830 HUF | 254,061 HUF | -13,231 HUF |
Wikicamp | 125,781 HUF | 0 HUF | 125,781 HUF |
Total | 3,394,244 HUF (~ 7,920 USD) |
3,394,244 HUF (~ 7,920 USD) |
0 HUF |
Notes:
- The actual costs documented by the invoices exceeded the budget for the grant by 6147 HUF (about 14 USD), which Wikimedia Hungary supplemented from its own budget.
- The transfer between expense groups did not exceed 300 USD (see column Difference).
- The MediaWiki developer has not been paid.
- It was not possible to organize a WikiCamp in 2022.
- The USD amounts are based on the exchange rate of 30 September 2022 (428,57 HUF/USD). Exchange rate on 30 December 2022 was 375,68 HUF/EUR, which would make the indicated amounts 9035 USD. (official exchange rates of the Hungarian National Bank)
Remaining funds
[edit]Do you have any unspent funds from the grant?
Please answer yes or no. If yes, list the amount you did not use and explain why.
- No
If you have unspent funds, they must be returned to WMF. Please see the instructions for returning unspent funds and indicate here if this is still in progress, or if this is already completed:
Documentation
[edit]Did you send documentation of all expenses paid with grant funds to grantsadminwikimedia.org, according to the guidelines here?
Please answer yes or no. If no, include an explanation.
- Yes
Confirmation of project status
[edit]Did you comply with the requirements specified by WMF in the grant agreement?
Please answer yes or no.
- Yes
Is your project completed?
Please answer yes or no.
- Yes
Note: Not all planned activities were implemented, but this was not the goal of the project either. The goals undertaken during the project application were already realized in the first phase of the project, and further developed in the extended period.
Grantee reflection
[edit]We’d love to hear any thoughts you have on what this project has meant to you, or how the experience of being a grantee has gone overall. Is there something that surprised you, or that you particularly enjoyed, or that you’ll do differently going forward as a result of the Project Grant experience? Please share it here!