Jump to content

Global metrics/Review/ja

From Meta, a Wikimedia project coordination wiki
This page is a translated version of the page Global metrics/Review and the translation is 80% complete.

Thank you everyone who provided feedback on updating Global Metrics! Global Metrics has been updated based on all the community feedback received. A summary of the new grant metrics requirement and a summary of all the feedback (and changes made based on the feedback) can be found here.

The new page for grant metrics now up as well.


'プロジェクトの概要

グローバルな指標(Global Metrics)とは、2014年9月時点でウィキメディア財団(WMF)の助成金プログラムに導入された6件の指標の組み合わせ(に加えて問い1件)であり、対象プログラム - IEG、PEG、SAPG、APG - の受給者全員に対し、その活動や目標に関わる場合は報告義務が課されるものです。

2015年12月末を迎え、受給者すべてからグローバル指標の報告が完結した時点で、コミュニティ資源チーム(Community Resources)はrogram Capacity and Learningチーム(プログラム範囲学習チーム)と共同でグローバル指標を遡及的に見直しつつ更新する作業に取り掛かることとして、以下を目標とします。

  1. 現状の指標は委員、受給者ならびに関与する職員にとってどのくらい役に立つのか
  2. 目立つ課題を理解する
  3. それらの課題をどのように述べるとよいか理解する
プロジェクトの日程

  • Phase 1: Collecting feedback – February 2016 to March 25 2016
  • Phase 2: Designing solutions – April 24 to end of May 2016
    • Voting and collecting feedback: June 6 to end of June 2016
  • Phase 3: Update – July 2016
    • A summary of the new grant metrics requirement and a summary of all the feedback (and changes made based on the feedback) can be found here.
Phase 1: Collecting feedback - COMPLETE

The first phase of the project involves collecting feedback from across all grant programs, Committee members, and relevant WMF staff. This feedback can be provided in three ways:

  • Publicly, through the discussion page
  • Privately, through a Qualtrics survey
  • Privately, through interviews in small groups

This first phase will result in a report of the summarized feedback that will include:

  • A more detailed history on the development of Global Metrics, and lessons learned from past mistakes
  • The benefits and issues associated with the current form Global Metrics
Phase 2: Designing solutions and voting - COMPLETE

The second phase of the project focus on addressing the issues raised in Phase 1, by brainstorming and designing solutions openly on Meta based on ideas and suggestions gathered in Phase 1.

A proposal has been drafted on IdeaLab, with a three pronged solution:

  1. Simplify the requirement of Global Metrics, i.e. the structure, the measures used, and the way it is included in grant proposals and reports. The goal of simplifying the information requested by WMF is that it will hopefully provide more space for the other metrics and data that grantees find useful. As Global Metrics will never be comprehensive, it will aways need to complement other measures and data.
  2. Update, simplify and integrate the extensive existing documentation and resources (e.g. the learning patterns), as well a create a new resource: The Metrics Library. This library will aggregate the many quantitative metrics and qualitative measures for capturing outputs & outcomes, that have already been used by current or past grantees, as well as link to the relevant grant or tool (if it exists). This new resource aims to answer the commonly reported issue of "What could I be capturing for my project? How could I do it? Who has done it before?", by aggregating the collective knowledge in grants and moving toward a community of practice.
  3. Update Wikimetrics to become the primary tool for collecting Global Metrics, e.g. resolve long-standing user-interface issues, update the metrics included and their definition, etc.

While it is these three solutions together that can address the three problems stated, the second and third parts depend on the first, and need a longer timeframe to implement. As such, right now we are collecting feedback on the first part of the solution: simplifying and updating the requirement of Global Metrics.

Go to the IdeaLab page on redesigning Global Metrics to learn more and give feedback either publicly or privately.

Phase 3: Update - IN PROGRESS

A summary of the new grant metrics requirement and a summary of all the feedback (and changes made based on the feedback) can be found here.

Next steps include:

  • Emailing Project and Annual Plan Grantees, notifying them about the upcoming changes and timeline.
  • Update Collecting Global Metrics learning pattern - August 12th
  • Update grant proposal and reporting templates - Will vary by grant program, according to the dates the grant rounds start.
  • Begin scoping the Metrics Library project - August 15th
  • Begin scoping the tool for shared metrics project - September 5th
  • Select the final replacement for Global Metrics
    • Communicating this updated "Global Metrics", including Q&A