Wikimédia France/Indicateurs (Metrics)/2018-2019
| Impact&Metrics | |
|---|---|
| Courriel | remy.gerbet wikimedia.fr |
| Référent·es | Rémy Gerbet WMFr |
| Sous-pages | |
| Indicateurs (Métrics 2018-2019) Indicateurs (Métrics 2019-2020) Outils | |
Impacts et indicateurs
[edit]
Pour l'année 2018 - 2019, en matière d'évaluation, sont mis en place trois indicateurs communs à tous les chapitres et définis par la Fondation, et des indicateurs définis par chaque chapitre.
Indicateurs partagés
[edit]Les trois indicateurs partagés par tous les chapitres (shared metrics) sont :
- nombre de participants à une action (un participant n'est pas un organisateur) ;
- nombre de nouveaux comptes utilisateurs créés (jusqu'à 2 semaines avant l'action) ;
- nombre de médias, articles, entrées.. créés et/ou améliorés sur l'ensemble des projets Wikimédia
Indicateurs Wikimédia France spécifiques :
[edit]Les deux indicateurs définis par l'association (grantee-defined measures) sont :
- nombre d'heures bénévoles ;
- satisfaction des partenaires (évaluée une fois par an à l'aide d'un questionnaire)
Indicateurs Wikimédia France spécifiques par action
[edit]D'autres indicateurs permettant de mesurer l'impact des actions menées ont été définies par thématique et action (liste non-exhaustive) :
- nombre d’actions visant à réduire le faussé des genres sur les projets Wikimedia soutenues par WMFr
- nombre de partenaires linguistiques impliqués
- nombre d’actions organisées à l’initiative d’un groupe local
- nombre de fois que l’espace contributeur est utilisé.
- nombre d’accréditations accordées lors d'un évènement international
- nombre de photos réutilisées dans le cadre des concours photo
- nombre d’établissements scolaires qui mènent une action utilisant les projets Wikimédia
Page de travail recensant les indicateurs utilisés par Wikimedia France qui servira également à rassembler les métrics pour le process FDC
Progress Report 2018-2019
[edit]| Axe 1: Partnerships and Content improvement | ||||
|---|---|---|---|---|
| Metrics | 2018/19 Target | Progress (at end of Q2) | Projected (end of year) | Explanation |
| Participants | 8,075 | 1,083 | Opportunity for improvement | The delay accumulated on certain projects and in particular in terms of communication has impacted the participation of the general public (Ma Commune Wikipedia, Lingua Libre). We expect to make up most of this delay in the next 6 months with concrete actions in this direction. |
| Newly registered editors | 500 | 322 | On track | We plan to reach our goal by creating new accounts via the Lingua Libre project but also by GLAM activities already planned. |
| Pages added/improved | 94,600 | 84,911 | On track | We should reach and exceed the intended goal because some content-providing actions have not yet been realized. In the same way, Lingua Libre workshops should still produce tens of thousands of contents. |
| Volunteer hours | 1,745 | 1,092 | On track | We have included participation in working meetings, activities carried out within GLAM partner organisations and the time required for a photo competition jury. |
| Partners satisfaction | 85% | To be evaluated in June 2019 | On track | This result will be collected by means of an annual survey sent out to all partners having supported a contribution-related activity during the year. |
| Images/media added to Commons | 90,600 | 84,911 | On track | As explained above, we should exceed our goal. Even if the number of partnerships has not substantially increased, the number of contributions belonging to GLAM projects on Wikimedia commons has exceeded our expectations. |
| % uploaded media used in content pages | 50% | 50.5% | Achieved | Among the GLAM activities, the photo competitions, Lingua Libre and Ma Commune Wikipedia, we have set a target of 50% of files reused in other Wikimedia projects. This figure is based on an average between the reuse rates of these different projects |
| Leading volunteers (WLM+WLE) | 11 | 14 | Achieved | Here, we take account of people involved in the organisation of the competition, the selection of photos and participation in the jury’s decisions. We managed to mobilize new people in the organization of competitions |
| Numbers of page views of Lingua Libre | 2,000/days | 135/days (32500/6 month) | On track | We have modified this indicator to take into account the number of pages viewed on Lingua Libre, which seems to us, all the same, indicative of the traffic generated by the site. The number of visitors required the setting up of an ethically problematic tracking system. |
| Numbers of recording session with Lingua Libre | 10 | 4 | On track | Wikimédia France has committed to organising 10 recording workshops in various languages on its premises. |
| Number of photo accreditation granted | 10 | 3 | On track | Some shows and public event are coming |
| Leading GLAM partners of WMFr | 5 | 3 | On track | We currently have three partners involved as ambassadors for the movement. We would like to see two other partners take on this role thanks to the organisation of a GLAM meeting conférence. |
| Contributing activities organized within a GLAM partnership | 24 | 23 | Achieved | We have already achieved this goal and should therefore exceed it. |
Axe 2: Working with communities
[edit]| Axe 2. Working with Communities | ||||
|---|---|---|---|---|
| Indicator | 2018/19 Target |
Progress (at end of Q2) | Projected (end of year) | Comments |
| Participants | 700 | 356 | On track | The photographic competition devoted to Overseas France and Wikiconvention francophone 2018 are the two main actions that brought the most participation. |
| Newly registered editors | 330 | 70 | On track | The delays in the minority languages program and the difficulty of measuring the activities of local groups will certainly not allow us to achieve the expected objective. On the other hand, actions such as the Wiki4women or the month of the francophone contribution that will take place in March 2019 attract new contributors. |
| Pages added/improved | 15,000 | 1,051 | Attention required | The decision taken by Wikimedia France to stop its partnership with Signes de Sens deprives us of a gift of 10,000 videos in French sign languages which will not allow us to achieve our goal. |
| Volunteer hours | 1,950 | 1,020 | On track | The organization of the Wikiconvention francophone 2018, the jury of the photo competition dedicated to Overseas, contribution activities related to gender gap but also the involvement of the members of the micro-financing commission are the main activities requiring time volunteer. |
| Partners satisfaction | 85% | To be evaluated in June 2019 | On track | This result will be obtained by means of an annual survey sent out to all partners having supported at least one contribution-related activity during the year. |
| Contribution activities to reduce the gender gap on Wikimedia projects | 25 | 11 | On track | The Wikisource contribution workshops organized at Wikimedia France or the workshops conducted by the Sans Pages in Paris and Marseille bring new dynamics of beneficial contribution to the association. |
| Number of contributors involved in the Languages of France project | 10 | 10 | On track | The working group around the languages of France is dynamic and voluntary for new projects. We lack a direction of development because the group can not engage with the sixty linguistic communities existing in France. There is a real need for prioritization. |
| numbers of local leading volunteer organizers | 35 | 20 | On track | We currently have 20 leading volunteers in France, they organize, coordinate or run a large part of the contribution activities in France. These volunteers will be meeting in 2019 in Paris to discuss with them the relationship between the chapter and local groups. |
| Numbers of events organized by local groups | 100 | 71 | On track | We count all the activities listed in the agenda of Wikimedia France. We incorporate activities in the main objective is not necessarily the contribution but participates in the consistency of groups and the reception of potential new members. |
| Numbers of volunteers granted | 60 | 25 | On track | The enlargement of the micro-financing commission has allowed us to improve transparency on the use of the funds of the association. We note, however, that some volunteers are reluctant to use the microfinance commission or ignore its existence. We need to improve this for the next six months while creating a real reporting system. |
| Contribution activities organized into Cléry contributor space | 30 | 21 | On track | The contributor area of Wikimedia France is occupied very regularly for contribution activities (Archeotopia, Wikisource, the Sans Pages ...). This is a real asset for the community that has seized this space to organize both convivial and contributory events but has also brought the salaried team closer to the volunteers. |
| Number of document package requested | 60 | 20 | On track | The month of francophone contribution is a moment of strong demand. In addition, some local groups participate in forums in the period from January to June and request documentation at that time. |
| Percentage of contributors claiming to have been supported by Wikimédia France | 55% | To be evaluated in June 2019 | On track | During the survey carried on February 2018, of the 172 respondents 43.9% stated that they received support from Wikimedia France. We would like to increase this figure to 55% in 2018-2019. |
Axe 3: Education et Formation
[edit]| Axe 3. Education and Training | ||||
|---|---|---|---|---|
| Metric | 2018/19 Target |
Progress (at end of Q2) | Projected (end of year) | Explanation |
| Participants | 5,300 | 2,438 | On track | This number includes WikiMOOC subscribers until December 31, 2018. The MOOC currently counts 8 registrations per day which allows us to project a figure for the next 6 months. We did not count participants in the Wikiconcours high school student. |
| Newly registered editors | 1,350 | 200 | On track | We have included WikiMOOC participants who have created an account on Wikipedia and plan to exceed the target set due to the large number of Wikiconcours high school students. |
| Pages added/improved | 21,500 | 4,805 | On track | We expect to achieve the goal in view of the expected contributions in the WikiMOOC and Wikiconcours high school student. |
| Volunteer hours | 460 | 194 | On track | Via the Wikiconcours which should see its number of registered participants increase and a MOOC which will not require new filming, the number of volunteer hours reflects the long-term involvement linked to support for teachers’ educational projects. |
| Partners satisfaction | 85% | to be evaluated in June 2019 | On track | This result will be collected by means of an annual survey sent out to partners having supported at least one contribution-related activity during the year. |
| Numbers of educational establishment using Wikipedia in a educational project | 70 | 73 | Achieved | As part of the Wikiconcours high school student, 70 institutions are registered and lead a teaching project with Wikipedia. 3 other institutions are also conducting a pedagogical project. We are in conversation with 2 other institutions that should integrate a project in the next 6 months. |
| Numbers of volunteers involved into Wikiconcours | 10 | To be evaluated in June 2019 | On track | We would like to get non-member contributors more involved, in the same way as Wiki Loves Monuments and the checkers. |
| Numbers of diploma courses integrating the contribution to Wikimedia projects | 5 | 3 | On track | Calculating the integration of contributions to Wikimedia projects in diploma courses is a relevant indicator regarding the efforts made by the association. |
| Numbers of consultation of the educational kit | 4,800 | 3,000 | On track | The number of visits has increased significantly from 3,000 visits per year to 3,000 visits every 6 months. |
| Numbers of participants having completed the Wikimooc 3 | 400 | To be evaluated in June 2019 | On track | Based on data from the previous years, but in view of the new format chosen this year, we hope to reach this goal. |
| Numbers of new editors still editing Wikimedia project a year after completed the Wikimooc | 40 | to be evaluated in June 2019 | On track | Based on data from the previous years, we believe that 40 people will continue contributing a year after the MOOC ends, i.e.10% |
| Percentage of volunteers expressing an increased level of skills | 75% | to be evaluated in June 2019 | On track | A survey will be sent out to volunteers having completed a training course run by Wikimedia France. We estimate that three quarters of the participants will declare that they have acquired new skills during the year. |
Impact report 2018-2019
[edit]Axe 1
[edit]| Axe 1: Partnerships and Content improvement | ||||
|---|---|---|---|---|
| Metrics | 2018/19 Target | Progress (at end of Q2) | Impact report (end of year) | Explanation |
| Participants | 8,075 | 1,083 | 1346 | We stopped working on Ma Commune Wikipedia and Lingua Libre has seen significant improvements. A major communication campaign will be initiated around Lingua Libre in early 2020. |
| Newly registered editors | 500 | 322 | 543 | We reached our goal by creating new accounts via the Lingua Libre project but also by GLAM activities already planned. |
| Pages added/improved | 94,600 | 84,911 | 195518 | The goal has been exceeded, especially because of Lingua Libre which generated more than 100,000 new audio files in the space of 6 months. |
| Volunteer hours | 1,745 | 1,092 | 1758 | We have included participation in working meetings, activities carried out within GLAM partner organisations and the time required for a photo competition jury. |
| Partners satisfaction | 85% | To be evaluated in June 2019 | 83% | This result comes from an annual survey sent out to all partners having supported a contribution-related activity during the year. |
| Images/media added to Commons | 90,600 | 84,911 | 185232 | As explained above, we should exceed our goal. Even if the number of partnerships has not substantially increased, the number of contributions belonging to GLAM projects on Wikimedia commons has exceeded our expectations.Lingua Libre is particularly responsible for this result |
| % uploaded media used in content pages | 50% | 50.5% | 58% | Among the GLAM activities, the photo competitions, Lingua Libre and Ma Commune Wikipedia, we have set a target of 50% of files reused in other Wikimedia projects. This figure is based on an average between the reuse rates of these different projects |
| Leading volunteers (WLM+WLE) | 11 | 14 | 24 | Here, we take account of people involved in the organisation of the competition, the selection of photos and participation in the jury’s decisions. We managed to mobilize new people in the organization of competitions |
| Numbers of recording session with Lingua Libre | 10 | 4 | 10 | Wikimédia France has committed to organising 10 recording workshops in various languages on its premises. |
| Number of photo accreditation granted | 10 | 3 | 7 | |
| Leading GLAM partners of WMFr | 5 | 3 | 3 | We currently have three partners involved as ambassadors for the movement. We would like to see two other partners take on this role thanks to the organisation of a GLAM meeting conférence. |
| Contributing activities organized within a GLAM partnership | 24 | 23 | 55 | We have already achieved this goal in January but other actions carried out during the period lead us to far exceed our forecasts. |
Axe 2
[edit]| Axe 2. Working with Communities | ||||
|---|---|---|---|---|
| Indicator | 2018/19 Target |
Progress (at end of Q2) | Impact (end of year) | Comments |
| Participants | 700 | 356 | 1.069 | The photographic competition devoted to Overseas France and Wikiconvention francophone 2018 are the two main actions that brought the most participation. |
| Newly registered editors | 330 | 70 | 247 | The delays in the minority languages program and the difficulty of measuring the activities of local groups will certainly not allow us to achieve the expected objective. On the other hand, actions such as the Wiki4women or the month of the francophone contribution that will take place in March 2019 attract new contributors. |
| Pages added/improved | 15,000 | 1,051 | 3.415 | The decision taken by Wikimedia France to stop its partnership with Signes de Sens deprives us of a gift of 10,000 videos in French sign languages which not allow us to achieve our goal. |
| Volunteer hours | 1,950 | 1,020 | 3273 | The organization of the Wikiconvention francophone 2018, the jury of the photo competition dedicated to Overseas, contribution activities related to gender gap but also the involvement of the members of the micro-financing commission are the main activities requiring time volunteer. |
| Partners satisfaction | 85% | To be evaluated in June 2019 | 83% | This result comes from our annual survey sent out to all partners have supported at least one contribution-related activity during the year. |
| Contribution activities to reduce the gender gap on Wikimedia projects | 25 | 11 | 43 | The Wikisource contribution workshops organized at Wikimedia France or the workshops conducted by the Sans Pages in Paris and Marseille bring new dynamics of a beneficial contribution to the association. |
| Number of contributors involved in the Languages of France project | 10 | 10 | 10 | The working group around the languages of France is dynamic and voluntary for new projects. We lack a direction of development because the group can not engage with the sixty linguistic communities existing in France. There is a real need for prioritization. |
| numbers of local leading volunteer organizers | 35 | 20 | 25 | We currently have 25 leading volunteers in France, they organize, coordinate or run a large part of the contribution activities in France. These volunteers have met in 2019 in Paris to discuss with them the relationship between the chapter and local groups. |
| Numbers of events organized by local groups | 100 | 71 | 134 | We count all the activities listed in the agenda of Wikimedia France. We incorporate activities in the main objective is not necessarily the contribution but participates in the consistency of groups and the reception of potential new members. |
| Numbers of volunteers granted | 60 | 25 | 86 | The enlargement of the micro-financing commission has allowed us to improve transparency on the use of the funds of the association. We note, however, that some volunteers are reluctant to use the microfinance commission or ignore its existence. We don't succeed yet to create a clear reporting system but we are working on it. |
| Contribution activities organized into Cléry contributor space | 30 | 21 | 33 | The contributor area of Wikimedia France is occupied very regularly for contribution activities (Archeotopia, Wikisource, the Sans Pages ...). This is a real asset for the community that has seized this space to organize both convivial and contributory events but has also brought the salaried team closer to the volunteers. |
| Number of document package requested | 60 | 20 | 40 | |
| Percentage of contributors claiming to have been supported by Wikimédia France | 55% | To be evaluated in June 2019 | 40.2% | We have not been able to increase this percentage this year, and this is partly unaccounted for on the date used to send this form (July 2019) and the few answers received to the questionnaire about 70 or 100 less than the last year |
Axe 3
[edit]| Axe 3. Education and Training | ||||
|---|---|---|---|---|
| Metric | 2018/19 Target |
Progress (at end of Q2) | Impact (end of year) | Explanation |
| Participants | 5,300 | 2,438 | 5350 | This number includes all WikiMOOC participants and the participants into the Wikiconcours high school student. |
| Newly registered editors | 1,350 | 200 | 1077 | We have included WikiMOOC participants who have created an account on Wikipedia and students who have been engaged in the Wikiconcours in high school |
| Pages added/improved | 21,500 | 4,805 | 23,328 | |
| Volunteer hours | 460 | 194 | 575 | Volunteers participated by correcting and annotating students' productions and also by offering advice to WikiMOOC participants |
| Partners satisfaction | 85% | to be evaluated in June 2019 | 83% | This result comes from the annual survey sent out to partners having supported at least one contribution-related activity during the year. |
| Numbers of educational establishment using Wikipedia in an educational project | 70 | 73 | 73 | As part of the Wikiconcours high school student, 70 institutions led a teaching project with Wikipedia. 3 other institutions have conducted a pedagogical project. |
| Numbers of volunteers involved into Wikiconcours | 10 | To be evaluated in June 2019 | 8 | We |
| Numbers of diploma courses integrating the contribution to Wikimedia projects | 5 | 3 | 3 | Despite the opportunities and ongoing issues, there have been no new trainings initiated this year. Several projects are awaiting validation by the academies. |
| Numbers of consultation of the educational kit | 4,800 | 3,000 | 5569 | The number of visits has increased significantly from 3,000 visits per year to 3,000 visits every 6 months. This demonstrates the need for teachers to be accompanied |
| Numbers of participants having completed the Wikimooc 3 | 400 | To be evaluated in June 2019 | 467 | This is a very good result compared to the other MOOCs hosted by the FUN platform |
| Numbers of new editors still editing Wikimedia project a year after completing the Wikimooc | 40 | to be evaluated in June 2019 | not evaluated yet | |
| Percentage of volunteers expressing an increased level of skills | 75% | to be evaluated in June 2019 | not evaluated yet | A survey will be sent out to volunteers having completed a training course run by Wikimedia France. |