Talk:Community Engagement Insights

If you have any questions about CE Insights - use this talk page. If you had ideas for the future, please share those ideas on the feedback page.

Translation/Survey Previews/Testing

Hi there! Sounds like a very interesting initiative, with some great insights to-be that will allow chapters to understand other volunteers better, identify areas needing attention in the movement, as well as accurately identify trends/shifts happening in different regions. Saw your project announcement via WMDE, and saw you will be translating the surveys during early October. Just wanted to know if there will be a link/page coordinating those efforts, where the translators could even preview the survey and understand it better. I tried to check the section in the timeline: September 15 // Questions 1.0 - First draft published (link) But it doesn't seem activated yet. Look forward to getting to know more about the process, best of luck on the development! :) Saludos --Pineapples100 (talk) 15:39, 6 October 2016 (UTC)

Please remember to give consistent information to translators and to make your translatable pages reachable. I updated the page for you this time. However, we lack information on the deadline for translations (and 10 days are not enough). Nemo 14:17, 27 December 2016 (UTC)

Survey fatigue

On the goal «Avoid survey fatigue»: how does making multiple more surveys help avoid survey fatigue? Can you make a list of surveys which will not be done thanks to these additional surveys? --Nemo 14:06, 27 December 2016 (UTC)

Hi Nemo! Thanks for the question - Here are a few I can remember off the top of my head: Community Tech's poll, Evaluation pulse, incorporating a new volunteer developer survey (see this ticket), harassment survey follow up, Affiliates survey (a new one from affcom). I can't think of others at the moment, but just a quick list :). Many teams have also been itching to do their own surveys, but haven't had the chance. So this helps to consolidate efforts from those teams. --EGalvez (WMF) (talk) 19:44, 7 January 2017 (UTC)

Multilingualism

Community Engagement Insights/Audiences doesn't address the matter of non-English speaking audiences. It's important to focus on producing better English text (see also Writing clearly) and to evolve the obsolete translation methods currently used for surveys, e.g. by using a modern survey system which can take l10n files in a standard format supported by the Translate extension. There is little value in doing surveys, if you consistently fail to reach your real audience. Nemo 14:11, 27 December 2016 (UTC)

Hi Nemo - We definitely had this in mind. The survey is now translated into 11 languages. I have yet to update that page - I've been trying hard to get the survey out the door so some of these pages still need to be updated. I have a lot to share about the sampling strategy (it's all written up but needs to be reviewed and posted - hopefully next week). But to answer your question, the languages the survey is translated into are: es, fr, de, it, pt-br, zh (simplified), ja, pl, uk, ar and en. This also our first go around this survey and this process - we have built on the past editor surveys and are trying to make the process more robust. If you have any ideas for the future, please share them here. Thanks! --EGalvez (WMF) (talk) 20:05, 7 January 2017 (UTC)

A purchase will not increase your chances of winning.

"contest rules" for "winning" in a survey?! C'mon, are you serious? --.js (((☎))) 07:15, 14 January 2017 (UTC)

Hi .js (((☎))) - Sorry for taking so long to get back - I just realized that I haven't been watching this page. So this is the langauge we needed to use for the survey to give out the tshirts. We might not do it again next year since it makes us use language like this. Does this answer your question? Thanks!--EGalvez (WMF) (talk) 00:28, 25 February 2017 (UTC)

Suppress mass delivery to a blocked user

Hi, you sent the invitation "Share your experience and feedback as a Wikimedian in this global survey" to b:de:User talk:JoachimStillerMünster‎. This user is blocked infinitely inside de-Wikibooks, see Log 2016-05-11. -- Juetho (talk) 08:22, 14 January 2017 (UTC)

Hi Juetho - We've realized this was a mistake this year and we plan to fix it next year. We also might use a different way to send the message so we don't use talk pages, but we will see. Thanks! --EGalvez (WMF) (talk) 00:28, 25 February 2017 (UTC)

Missing translations

In addition to the remarks above: It's helpful that the survey itself is translated. But none of the related pages is translated, especially About CE Insights – Frequently asked questions. This lack may prevent a lot of active users to take part in the survey. -- Juetho (talk) 11:12, 15 January 2017 (UTC)

Thanks Juetho - I totally realize this. We focused our efforts on getting the survey questions translated since its so long and as the survey gets more formalized, we can start to mark things for translation that are less likely to change each year. Does this answer your question? Thanks! --EGalvez (WMF) (talk) 00:28, 25 February 2017 (UTC)

PS. "... this survey is run by Qualtrics and their use of your information and responses are governed by their Privacy Policy and Terms of Service." Qualtrics offers a German version of its homepage but their Privacy Statement is available in English only. Clearly, an official site is legal in the original language only and mostly unintelligible to foreign language speakers. A translation is necessary to be understood. Sorry, I'm not willing to take part in the survey. -- Juetho (talk) 11:30, 15 January 2017 (UTC)

Thanks for that feedback as well and helping me to realize this. I realize that we might have to fix that somehow next year and will try to figure that out. We have lots ot learn about how to do this better and we are trying to hear all the feedback we can. Thanks! --EGalvez (WMF) (talk) 00:28, 25 February 2017 (UTC)

Message should include <references/> tag

The notes for the message used <ref> parser hooks. However, since the message did not include a <references/> tag, it causes the footnote to appear at the very bottom of the talk page. This can cause confusion when another message is added to the talk page, as the footnote carries over to the bottommost section, making it appear like a part of another conversation. See this version of my talk page for an example. Proposed remedy is to either (a) include a <references/> at the end of your message; or (b) markup the notes using means other than the <ref> parser hooks.

朝彦 | Asahiko (talk) 11:03, 16 January 2017 (UTC)

This is already widely discussed at User talk:EGalvez (WMF) --.js (((☎))) 14:03, 16 January 2017 (UTC)

Glad to hear that. Thanks for the link. 朝彦 | Asahiko (talk) 00:11, 17 January 2017 (UTC)

Tracking-Blocker

Hi, i'm currently using Firefox with Ghostery and i can't access the link to qualtrics. So i quess i'm out due to privacy settings? Cheers, --Ghilt (talk) 12:18, 28 January 2017 (UTC)

Hi Ghilt - I am sorry for taking a bit for getting back to you I realized I forgot to watch this page. This is a great point. We probably need to figure out a way for you to take the survey or others who do have trackers blocked. Thank you for your feedback! --EGalvez (WMF) (talk) 00:28, 25 February 2017 (UTC)

Survey Instrument

Now that the survey period is closed, will the instrument (questions) be made available? (and there are loads of other links on the page which are also missing.) - Amgine/^{meta wikt wnews blog wmf-blog goog news} 17:50, 11 February 2017 (UTC)

YES! We will be sharing the questions. Sorry for taking a bit to get back - I realized I forgot to add this to my watchlist. Have had a lot to do and its going to take some time (There are 260 questions to wikify!) The questions changed a lot so I need to go back to wikify them and will be sharing them publicly :) Thanks Amgine! --EGalvez (WMF) (talk) 00:28, 25 February 2017 (UTC)

Two weeks is too short time to get feedback :-(

"Data collection begins March 27, 2018 and Ends April 9, 2018." this is a very small time, particularly for smaller wikis contributors, to even receive your message (not to mention responding). If possible I would suggest to extend it to a month instead. Gryllida 19:34, 20 March 2018 (UTC)

What's the delay?

When will the survey be coming out? It's over a day late. Will the closing date be extended to compensate? BethNaught (talk) 07:34, 29 March 2018 (UTC)

Sister projects

"A survey process for hearing diverse Wikimedia voices". Does the recent survey include sister projects, e.g. Wiktionary, Wikiquote, Wikisource? --Nemo 21:03, 29 March 2018 (UTC)

Incorrect translations

• Incorrect names "Wikipedia Commons", "Wictionary" --Nemo 21:08, 29 March 2018 (UTC)

Problems with the questions

• The page about encouraging diversity etc. assumes that there is such a thing as a/the "leadership".
• The questions about "my project or community" (singular) forces to identify a single such entity.

--Nemo 21:25, 29 March 2018 (UTC)

Anonymity

Does the recent survey track IP address and other personal information, or were the anonymity features enabled in Qualtrics? --Nemo 21:26, 29 March 2018 (UTC)

Discriminating options for “age”

The question “How old are you?” only allows answers from 18 years on. Why do you not allow to answer anything under 18? There are not only a few underaged Wikimedians and it is fairly discriminating that you just ignore this fact and don’t even offer a option to let those people show. Regards, KPFC 💬 19:32, 30 March 2018 (UTC)

@KPFC: You're absolutely right. Although I'm over 18 now, I started editing Wikimedia projects at the age of 16. I know more than a dozen contributors, which are below the age of 18 by now. These won't be represented in the results of this poll. Ageism shouldn't be part of a movement which seeks to bridge gaps of any kind, whether age, gender, cultural, demographic or knowledge. --Ptolusque (talk) 20:22, 30 March 2018 (UTC)

Errors in the survey

Is this the right place to report errors in the current survey? I filled out the German version and there were some strange things as well as outright errors in the survey. Errors:

• Following the question "Zu welchen Wikimedia-Projekten haben Sie in den letzten 12 Monaten beigetragen?", two of the checkboxes are labeled "Wikimedia Commons" (I selected both, as I didn't know which one is the "real" Commons box...). On the other hand, Wikisource is missing there (can be only entered manually under "Andere") which I find strange (though I personally haven't contributed to Wikisource in the last years, I think it's an important project).

• Fixed!

• Also, in "Welche Wikimedia-Projekte editieren Sie mindestens einmal pro Monat?", "Wikimedia Commons" is again doubled. Wikisource is also missing and there's no option to enter other projects this time. I'm starting to suspect that maybe one of the two "Wikimedia Commons" is actually supposed to be labeled "Wikisource"...?

• Fixed!

• A minor error (typo) in "In meinem Wikimedia-Projekt oder meiner Wikimedia-Gemeinschaft respektieten die Mitwirkenden den Einzelnen und schätzen ihre Unterschiede" (should be respektieren). But the sentence is a a bit shaky anyway ("den Einzelnen" is singular generic masculine, "ihre Unterschiede" is referring to persons in the plural).

• Fixed!

Other slightly strange things:

• Following "Welche der folgenden Dinge haben Sie in den vergangenen 12 Monaten mindestens einmal getan?" is an option "Beiträge zu Wikimedia-Projekten verfasst oder Inhalte kuratiert (z.B. Redaktion, USA-Talk-Seiten, USA-Administrator/Sysop-Privilegien)". I have no idea what USA-Administrator/Sysop-Privilegien are supposed to mean as we have, to the best of my knowledge, no US-specific administrator/sysop privileges in any of the Wikimedia projects.

• I think the translators weren't sure how to translate, so they marked it as "USA" meaning "This word is in English"

• "Wie schwerwiegend oder gering sind diese sozialen Probleme in den Wikimedia-Projekten, zu denen Sie beitragen?" - The translation of the two options that should be chosen if you think the social issues are very severe as "Streng" and "Sehr streng" are not idiomatic and wouldn't be chosen by a native speaker, I think, because you don't say "das Problem ist streng" (it's "schwerwiegend", "gravierend", maybe "ernst" oder "schlimm"...) - my guess is that the original word was "severe" (which can be translated as "streng", but not in this context).

• Yes - the original was "severe" and "very severe". I'm not sure I'll be able to make changes in time, but can you share with me what a correct translation might be?

Gestumblindi (talk) 23:50, 31 March 2018 (UTC)

@ Gestumblindi You are right, it is a translation mistake: Wikimedia Commons is the first one, that below is Wikisource in the other languages. I don’t know how something like that could happen, it makes this point a bit useless. The USA-… are also some kind of weird translations. Very strange … – KPFC 💬 15:50, 3 April 2018 (UTC)

@EGalvez (WMF): I'm not sure you're watching this page, so this is a ping to make sure you're aware of these translation issues which will make some of the data from German-language users unreliable, it seems to me. Gestumblindi (talk) 15:13, 9 April 2018 (UTC)

Thanks Gestumblindi and KPFC- Really appreciate the ping! I've made what changes I can. --EGalvez (WMF) (talk) 00:30, 10 April 2018 (UTC)

Thanks for the fixes, EGalvez (WMF)! Probably should have pinged earlier, now the survey has run for several days with these errors in it... If you haven't done so already, you can just remove the "USA" from ''USA-Administrator/Sysop-Privilegien, I suppose, because it's confusing and "Administrator/Sysop-Privilegien" is perfectly fine and understandable for German-language readers (we're calling these privileges "Administrator" or "Admin" as well in German-language Wikipedia). Gestumblindi (talk) 09:17, 10 April 2018 (UTC)

Oh, and on the translation of "severe" and "very severe", I would suggest "schwerwiegend" and "sehr schwerwiegend". Gestumblindi (talk) 09:19, 10 April 2018 (UTC)

Unclear privacy policy

I'm sorry, but I find the present "Privacy Policy" of Qualtrics unclear, and parts of it do seem to permit the company to employ aggregated but non-anonymised collected data for commercial purposes, by Qualtrics and by its "affiliates and business partners". If this is not clarified, I'm not taking the survey, and would regretfully also recommend others not to do it.

The text I find suspicious.
Under the relevant heading 3, DATA COLLECTED BY CUSTOMERS, I find the following long paragraph: Qualtrics will process Data for the purpose of providing the software and services to customers. Qualtrics may also anonymize and/or aggregate the Data and use such anonymized and/or aggregated data for its business purposes, including but not limited to deriving statistical, usage data, and other data related to the functionality of the software and the services, improving the software and the services, developing and making available other products and services, and sharing such data with affiliates and business partners, and may combine or incorporate it with or into other data and information available, derived or obtained from other licensees, users, and/or any other sources. Customers must ensure that they follow applicable laws when distributing surveys. This includes following applicable law when collecting personal and health information, preventing unsolicited emails from being sent, and deleting personal information when no longer required. I had to read this a couple of times, in order to see what it seems to allow Qualtrics to do. There are other, short paragraphs, which seem to contradict the long one, like Qualtrics will never transfer Data to a third-party without the written permission of the customer. In other words, there is no onward transfer. I am no lawyer, and do not know how to interpret the apparent contradictions. (A guess might be that Qualtrics does not count their "business partners" as "third-parties".)

I maybe am a bit overcautious here; but considering the revelations about Facebook and its business partners, I think we at least should take some care. Best regards, JoergenB (talk) 14:40, 6 April 2018 (UTC)

Unable to select text (2018 Survey)

.Skin .QuestionBody {
    -ms-user-select: none;
    -moz-user-select: none;
    -webkit-user-select: none;
    cursor: default;
}

That keeps me from selecting the text and running it through my text-to-speech program? This is an accessibility issue. Dispenser (talk) 01:04, 14 April 2018 (UTC)

Thanks Dispenser - it looks like this could be related to a new visual design of the survey. I will ask Qualtrics for help with this. I'm not yet sure I'll be able to fix this for the survey this year. I really appreciate you letting me know. --EGalvez (WMF) (talk) 19:47, 18 April 2018 (UTC)

No back button

Why is there no back button in the survey? I answered wrongly on one question, but then there were no way to go back and correct it, so I just left the survey instead. Danmichaelo (talk) 18:38, 21 April 2018 (UTC)

Gender and Country

Hello. Are there any data regarding gender relation specific to Countries and te person groups? Means the report with his primary data? Thanks in advance (and for pinging me in case of answer)