Research talk:Ideas/The effect of abuse filter

Portuguese Wikipedia experience

I have made some researches in Portuguese Wikipedia about filters, I created a graph that shows the filter actions in the last 30 days in toollabs:ptwikis/Filtros, this tool works for other languages and projects too, e.g. toollabs:ptwikis/Filtros:enwiki. I have also made a list of most catch bad words by anti-vandalism filters in here. And I also made this search in dumps using the bad words regex of disallow anti-vandalism filters, searching for pages where the some terms are valid entries, as these terms can be potential false positives. Other Portuguese Wikipedia users have also made some researches in filters, like registration of false positives and other very interesting researches. Danilo.mac talk 19:40, 9 November 2013 (UTC) Sorry english mistakes

Quick timeseries for enwiki.

Monthly abuse filter counts are plotted for action="edit" by the actions provided in the English Wikipedia.

Data table

1 2009-03-01 edit 24412 2 2009-03-01 edit warn 74596 3 2009-04-01 edit warn 112200 4 2009-04-01 edit tag 23785 5 2009-04-01 edit 43169 6 2009-05-01 edit warn 129652 7 2009-05-01 edit 39430 8 2009-05-01 edit tag 42797 9 2009-06-01 edit warn 101976 10 2009-06-01 edit 17228 11 2009-06-01 edit tag 59972 12 2009-07-01 edit tag 72495 13 2009-07-01 edit warn 84293 14 2009-07-01 edit 4205 15 2009-08-01 edit tag 85433 16 2009-08-01 edit warn 59665 17 2009-08-01 edit 10688 18 2009-08-01 edit disallow 6495 19 2009-09-01 edit warn 95902 20 2009-09-01 edit tag 110106 21 2009-09-01 edit 7200 22 2009-10-01 edit warn 119025 23 2009-10-01 edit tag 107840 24 2009-11-01 edit tag 96872 25 2009-11-01 edit warn 99814 26 2009-11-01 edit disallow 13542 27 2009-12-01 edit tag 65526 28 2009-12-01 edit warn 84517 29 2009-12-01 edit disallow 16463 30 2010-01-01 edit tag 103469 31 2010-01-01 edit warn 59775 32 2010-01-01 edit 6345 33 2010-01-01 edit disallow 23787 34 2010-02-01 edit tag 92313 35 2010-02-01 edit warn 114067 36 2010-03-01 edit warn 75719 37 2010-03-01 edit disallow 24374 38 2010-03-01 edit tag 111734 39 2010-03-01 edit 5265 40 2010-04-01 edit warn 70445 41 2010-04-01 edit tag 121740 42 2010-04-01 edit disallow 5198 43 2010-05-01 edit tag 83322 44 2010-05-01 edit 11209 45 2010-05-01 edit disallow 43703 46 2010-05-01 edit warn 68588 47 2010-06-01 edit tag 103993 48 2010-06-01 edit 9926 49 2010-06-01 edit disallow 12837 50 2010-06-01 edit warn 19408 51 2010-07-01 edit tag 79880 52 2010-07-01 edit warn 39751 53 2010-07-01 edit disallow 3370 54 2010-07-01 edit 4686 55 2010-08-01 edit tag 74574 56 2010-08-01 edit warn 36437 57 2010-08-01 edit disallow 13302 58 2010-08-01 edit 14024 59 2010-09-01 edit warn 67993 60 2010-09-01 edit tag 85040 61 2010-09-01 edit 3919 62 2010-09-01 edit disallow 17764 63 2010-10-01 edit warn 69894 64 2010-10-01 edit tag 116966 65 2010-10-01 edit disallow 19888 66 2010-11-01 edit tag 123614 67 2010-11-01 edit warn 54314 68 2010-11-01 edit disallow 17424 69 2010-12-01 edit warn 31029 70 2010-12-01 edit disallow 25456 71 2010-12-01 edit tag 101299 72 2011-01-01 edit tag 112073 73 2011-01-01 edit warn 57391 74 2011-01-01 edit disallow 11675 75 2011-02-01 edit tag 108955 76 2011-02-01 edit warn 41565 77 2011-02-01 edit disallow 22742 78 2011-03-01 edit tag 109714 79 2011-03-01 edit warn 57322 80 2011-03-01 edit disallow 10511 81 2011-04-01 edit tag 82658 82 2011-04-01 edit warn 55277 83 2011-04-01 edit disallow 10249 84 2011-04-01 edit 12535 85 2011-05-01 edit warn 43417 86 2011-05-01 edit tag 95221 87 2011-05-01 edit disallow 12505 88 2011-05-01 edit 22379 89 2011-06-01 edit tag 66788 90 2011-06-01 edit warn 46254 91 2011-06-01 edit 26848 92 2011-06-01 edit disallow 3823 93 2011-07-01 edit tag 67346 94 2011-07-01 edit warn 35004 95 2011-07-01 edit 21601 96 2011-07-01 edit disallow 9316 97 2011-08-01 edit 4181 98 2011-08-01 edit tag 67439 99 2011-08-01 edit warn 41202 100 2011-08-01 edit disallow 21205 101 2011-09-01 edit warn 75337 102 2011-09-01 edit tag 68987 103 2011-09-01 edit 9118 104 2011-09-01 edit disallow 18563 105 2011-10-01 edit tag 54431 106 2011-10-01 edit warn 123396 107 2011-10-01 edit disallow 30159 108 2011-10-01 edit 16680 109 2011-11-01 edit warn 68458 110 2011-11-01 edit tag 93988 111 2011-11-01 edit 10274 112 2011-11-01 edit disallow 38538 113 2011-12-01 edit warn 36972 114 2011-12-01 edit tag 89705 115 2011-12-01 edit disallow 35044 116 2011-12-01 edit 13751 117 2012-01-01 edit tag 98417 118 2012-01-01 edit disallow 26456 119 2012-01-01 edit warn 67273 120 2012-02-01 edit tag 64489 121 2012-02-01 edit warn 78794 122 2012-02-01 edit disallow 36739 123 2012-02-01 edit 17110 124 2012-03-01 edit tag 68398 125 2012-03-01 edit warn 77407 126 2012-03-01 edit disallow 24733 127 2012-03-01 edit 13546 128 2012-04-01 edit warn 72450 129 2012-04-01 edit tag 62058 130 2012-04-01 edit disallow 27518 131 2012-04-01 edit 11829 132 2012-05-01 edit warn 76645 133 2012-05-01 edit disallow 64548 134 2012-05-01 edit tag 36812 135 2012-06-01 edit warn 63197 136 2012-06-01 edit tag 23802 137 2012-06-01 edit disallow 15344 138 2012-06-01 edit 16704 139 2012-07-01 edit tag 65621 140 2012-07-01 edit warn 34001 141 2012-07-01 edit disallow 11288 142 2012-08-01 edit warn 56521 143 2012-08-01 edit tag 34766 144 2012-08-01 edit disallow 20188 145 2012-08-01 edit 8106 146 2012-09-01 edit warn 62204 147 2012-09-01 edit tag 53762 148 2012-09-01 edit disallow 31015 149 2012-09-01 edit 5815 150 2012-10-01 edit disallow 69244 151 2012-10-01 edit tag 48167 152 2012-10-01 edit warn 78452 153 2012-11-01 edit tag 71631 154 2012-11-01 edit disallow 55209 155 2012-11-01 edit warn 60151 156 2012-12-01 edit warn 45614 157 2012-12-01 edit tag 60734 158 2012-12-01 edit disallow 29443 159 2013-01-01 edit tag 51863 160 2013-01-01 edit disallow 31014 161 2013-01-01 edit warn 50864 162 2013-01-01 edit 12053 163 2013-02-01 edit disallow 33765 164 2013-02-01 edit tag 79915 165 2013-02-01 edit warn 72690 166 2013-03-01 edit tag 48021 167 2013-03-01 edit disallow 44962 168 2013-03-01 edit warn 51380 169 2013-04-01 edit disallow 23088 170 2013-04-01 edit tag 39377 171 2013-04-01 edit 5108 172 2013-04-01 edit warn 78925 173 2013-05-01 edit disallow 56560 174 2013-05-01 edit warn 53004 175 2013-05-01 edit tag 34253 176 2013-05-01 edit 6561 177 2013-06-01 edit warn 37337 178 2013-06-01 edit tag 37615 179 2013-06-01 edit disallow 28917 180 2013-06-01 edit 2585 181 2013-07-01 edit warn 50679 182 2013-07-01 edit tag 35820 183 2013-07-01 edit disallow 11221 184 2013-07-01 edit 8752 185 2013-08-01 edit disallow 20384 186 2013-08-01 edit warn 47887 187 2013-08-01 edit tag 40671 188 2013-09-01 edit warn 41324 189 2013-09-01 edit tag 41440 190 2013-09-01 edit disallow 39606 191 2013-10-01 edit warn 82054 192 2013-10-01 edit tag 52120 193 2013-10-01 edit disallow 17689 194 2013-10-01 edit 11223 195 2013-11-01 edit tag 14515 196 2013-11-01 edit 3011 197 2013-11-01 edit disallow 12504 198 2013-11-01 edit warn 6512

--EpochFail (talk) 22:03, 9 November 2013 (UTC)

Evaluations

I made a comparison between the amount of disallowed edits by filters, reverts by users and by bots and found out the filters were responsible for avoiding 38% of bad faith actions by IPs during last 2º trimester. I think we could improve this comparison to evaluete how relevant abusefilter is.OTAVIO1981 (talk) 16:39, 11 November 2013 (UTC)

Edit Filter on EN

I was involved in some discussions about this on EN wiki a couple of years ago when I was trying to work out how much higher editing figures would be if we didn't have these. A few points emerged:

1. On EN we had renamed the abuse filter the edit filter because it wasn't just being used to prevent abuse such as vandalism. I suspect this includes changes from one version of English to another but don't know how bitey such revision would be. In theory not being able to do something is less bitey than being able to do something that was not allowed and then being reverted and warned.
2. In terms of raw edit count the edit filter loses you as many "good" edits as bad. Not from overkill but because we lose the vandal reverting and vandal warning edits.
3. The greying of the pedia with the community ageing by more than a year a year is not just down to our recruiting more silver surfers, it is also because we have not just lost most of our vandalism, we have also lost the vandal fighters that it recruited.
4. the effect on vandals was different - they behave differently if they can't replace a paragraph with the word poop than if they can but it doesn't last long.
5. While it isn't easy to work out how much higher the adjusted editing figure in 2011 would have been than the actual figure, it was obviously going to have been higher than any previous year, including the raw peak year of 2007.

Great to see someone taking on an uber complex but uber important project. WereSpielChequers (talk) 07:14, 30 July 2014 (UTC)