Jump to content

CentralNotice/Request/Toolforge Newcomer Experience and Recruitment Survey

Add links
From Meta, a Wikimedia project coordination wiki

Toolforge Newcomer Experience and Recruitment Survey

[edit]
Central Notice Settings
What is the campaign duration?
  • Jan 27, 2025 → Feb 10, 2025. (Extension might be requested due to potential low participation)
Which projects will you be targeting?
  • Wikitech. The banner has been implemented to only be displayed on Wikitech pages with "Help:Toolforge" in their domain.
What languages will you be targeting?
  • English
Do you wish to show banners to Logged In users, Anonymous Users or Both? Do you want to target users with a specific number of edits or average monthly?
  • Any

What countries will your campaign target?

  • All

Banner/Campaign Diet:

  • To be determined by Central Notice admin

What is the purpose of the campaign? How will you measure the success of the campaign?

[edit]
Description - We plan to distribute a survey to capture the challenges faced by new Toolforge users during their tools' set up process. Users with this profile are not active in (or generally haven't joined yet) public communication channels or mailing lists, and we don't have express permission from them to be contacted. If CN admins could recommend a more suitable communication channel, we'll of course evaluate the option.

The survey will help us gather initial feedback about these users' experience, and recruit them for future in-depth interviews to validate a UI-based solution we've been working on. All in all, the goal is to collect insights to inform the design requirements of a proof of concept (Phabricator task: T381266)

Metrics - We'd like to get at least 10 valid responses to the survey and recruit a minimum of 5 participants from the same target group to participate in future usability testing sessions.

Pinging @User:TAndic_(WMF) as specified in the Usage guidelines

What banner(s) will you use? What will be your landing page?

[edit]
Banners - https://meta.wikimedia.org/wiki/Special:CentralNoticeBanners/edit/Toolforge_Newcomer_Exp_Recruitment_Survey, Preview Landing Page - Survey welcome page (LimeSurvey). (We have obtained a privacy statement and will link to it from both the banner and the survey)
[edit]
Type of grant - –

Link to grant - –

Discussion

[edit]

Central Notice admin comments

[edit]

Google forms can't be a landing page for a banner. Per CentralNotice/Usage_guidelines#Banner_requirements, "Wikimedia Domains Only — Banners must link only to Wikimedia Foundation or Affiliate-controlled websites, except when using officially approved surveys (see below). They should not include trademarks owned by for-profit entities." Also, please reach out to your colleague's at the Foundation to agree on the usage of CN for survey's. Ciell (talk) 20:37, 3 December 2024 (UTC)[reply]

ping for visibility @SSanchez-WMF. Ciell (talk) 20:38, 3 December 2024 (UTC)[reply]
Non-fundraising campaigns need to be checked, approved and activated by volunteer CN admins, too. Best, —DerHexer (Talk) 23:41, 3 December 2024 (UTC) PS: The request template should be filled at some point.[reply]
Thanks for the helpful comments! The request was updated: I added further details regarding our goals and reflected latest decisions (e.g., use of LimeSurvey, change in campaign dates). Conversations with CN coordinators and survey specialists are taking place internally to validate the request or – in lack of approval – find suggestions for alternative channels aligned with our limitations. SSanchez-WMF (talk) 21:28, 5 December 2024 (UTC)[reply]
Once your CN coordinators have created both the banner as well as the campaign in line with the mentioned guidelines, volunteer CN admins can take a look. The campaign duration looks reasonable and WWikitech is a project which rarely receives banners, so once we hear that the survey itself has been approved, we should be able to give our approval as volunteer CN admins as well.
@TAndic (WMF) fyi, I think the ping probably didn't reach you. Johannnes89 (talk) 18:57, 11 December 2024 (UTC)[reply]
Hello @Johannnes89 and all! It looks like SSanchez-WMF has added all of the components needed for a survey.
  • @SSanchez-WMF: this banner only displays for Help:Toolforge subpages and not the whole wiki, correct? If yes, I think it would make sense to display at 100% coverage (or a similarly high coverage).
  • I've reviewed the survey and banner (direct link button with privacy statement linked in banner, similar to the 2024 WMDE wikidata survey) and it is approved from the WMF side. The rest is up to CN admins for changes and approval, let me know if I can be helpful with anything :) -TAndic (WMF) (talk) 15:23, 23 January 2025 (UTC)[reply]
looks good to me, approved. Johannnes89 (talk) 19:20, 24 January 2025 (UTC)[reply]
Thanks @Johannnes89 and all for helping to guide this! I'll be working with @SSanchez-WMF to help on the survey side, and I agree this seems like a good candidate for a wikitech banner after discussing off-wiki with Sarai :). I assume this request may stay open into January as the team works to get all the components together (in case it's affecting the CN admins' workflows, no action needed for now). - TAndic (WMF) (talk) 19:51, 11 December 2024 (UTC)[reply]
My apologies for completely misinterpreting @DerHexer's point about filling the survey request template. And thanks for the heads-up and help filling it, @TAndic (WMF). Here's the required information:
What type of survey is this?
Other type (please specify): I want to gather information about a unique population: new Toolforge users (who are not present on other communication channels). We need to understand their experience and challenges to inform the planning of a Wikimedia Foundation project (Toolforge UI).
How many responses do you hope to get?
At least 10 valid responses, with a minimum of 5 participants agreeing to participate in follow-up interviews.
Which populations should the survey banner be displayed to?
Specific criteria: Logged-in and Logged-out users (banner is made to only display on Help:Toolforge subpages on Wikitech)
Which wikis and countries will the banner display to?
Wikitech, no country targeting
Will you be collecting any of these types of data?
Emails – for optional research participation contact)
Demographic information (country) – only for determining whether we can share thank-you gifts for research participation
How will you publish or share your data?
It will only be used internally.
Link to your project page (where the survey will be linked and respondents can find out more about the project): This survey does not have a project page as it's for a small population. The WMF staff email and username for contact is available in both the survey and WMF privacy statement.
Link to your privacy statement** (it can be on the same page as the project page): https://foundation.wikimedia.org/wiki/Legal:Toolforge_UI_Newcomer_Survey_Privacy_Statement
Link to the survey: https://wikimediafoundation.limesurvey.net/463627 SSanchez-WMF (talk) 16:43, 23 January 2025 (UTC)[reply]

Sarai needed some JS magic, which got more Foundation staff involved, including me - so I thought it didn't make sense to ask for volunteers' time anymore. The banner is created, the campaign is set up, we can consider this request as approved. SGrabarczuk (WMF) (talk) 16:06, 24 January 2025 (UTC)[reply]

@SGrabarczuk (WMF) I don't want to be overly bureaucratic and from our comments it was basically clear, that we agreed with this campaign, but I want to point out that the new CentralNotice/Usage guidelines (which were revised by CN admins & WMF staff) require volunteer approval for all campaigns with the only exemption being fundraising banners.
If you / other WMF members believe this takes to much time, we should probably start a discussion about further exemptions. But the way the approval guidelines are currently written doesn't leave a different option than asking volunteer CN admins to give their final approval to a prepared campaign + banner (it's of course approved, see my comment above). Best --Johannnes89 (talk) 19:27, 24 January 2025 (UTC)[reply]
@SGrabarczuk (WMF): Can you please add the links to the campaign, banner and preview here as it is standard practice for any kind of campaigns? Thanks in advance! Best, —DerHexer (Talk) 13:40, 28 January 2025 (UTC)[reply]
Hey @DerHexer 👋🏻 The requested banner links were added to the "What banner(s) will you use? What will be your landing page?" section in the above request. Does that suffice? Thank you! SSanchez-WMF (talk) 16:50, 28 January 2025 (UTC)[reply]
Retrieved from "https://meta.wikimedia.org/w/index.php?title=CentralNotice/Request/Toolforge_Newcomer_Experience_and_Recruitment_Survey&oldid=28185187"