This is an old revision of this page, as edited by Sturmvogel 66 (talk | contribs) at 09:20, 15 December 2024 (→Increase points for GA reviews). The present address (URL) is a permanent link to this revision, which may differ significantly from the current revision.
Revision as of 09:20, 15 December 2024 by Sturmvogel 66 (talk | contribs) (→Increase points for GA reviews)(diff) ← Previous revision | Latest revision (diff) | Newer revision → (diff)This is the talk page for the WikiCup, for asking questions about the contest. edit header
|
Archives: | |
|
|
WikiCup (WP:CUP) |
---|
WikiCup content needing review view • edit | |
---|---|
Featured content Featured/good topic candidates DYK GAN PR |
Why aren't points carried over each round?
I am new to the WikiCup so forgive me if this has already been discussed, but why aren't points carried over to the next round? From my understanding, the point of the WikiCup is to create and promote quality content. Having the points carried over would encourage people to consistently push out quality content over the course of a couple of months instead of saving all of it till the last month. Kind of a "marathon not a race" approach. I do understand that some people may enjoy the competitiveness of the final round but having points carry over would also help to deter gaming the system a bit as it would be harder to do so for many months. IntentionallyDense (talk) 22:09, 4 November 2024 (UTC)
- Carrying over would be helpful in alleviating the "timing" aspect a little bit. The downside would be that a few people would likely break into the thousands very quickly and it would feel really insurmountable for the people who didn't. Thebiguglyalien (talk) 22:13, 4 November 2024 (UTC)
- I think allowing points to carry over would eliminate most of the gamey-ness of it. At the moment, you basically don't even have to bother to get past the first round, while you can be subject to more matters of luck (like FAC promotion timing) on the final round. It'd also make it more accessible in case you happen to not have much free time in September/October (common for students, I imagine).
- This would put "tortoise" editors on equal footing with "hare" editors, so to speak, which is very much not the case currently. Generalissima (talk) (it/she) 22:39, 4 November 2024 (UTC)
- Those are my thoughts. It might be more unforgiving to those who have an off month and can't put out as much content one month but I also really like the point you brought up about having less time in Septemebr and October as that is a huge factor for me as a student. IntentionallyDense (talk) 22:41, 4 November 2024 (UTC)
- I'm not entirely sure I understand what specific gaming of the system would be deterred, and how. ~~ AirshipJungleman29 (talk) 23:28, 4 November 2024 (UTC)
- I'm not sure if it would be deterred altogether however if there was problematic behaviour going on there would be much more time to address it. IntentionallyDense (talk) 23:30, 4 November 2024 (UTC)
- What is "it" IntentionallyDense—what specific examples of gaming the system do you think would be deterred, and how? ~~ AirshipJungleman29 (talk) 23:40, 4 November 2024 (UTC)
- It is a game. That's the whole point. It's a competition, and folks can be strategic. That's not gaming the system. Resetting the points each round encourages people to steadily make content. Of course people will try to time content, figure out how to get those extra points, that's what makes it fun and exciting! If we want a marathon kind of competition, then I suggest creating a new competition. I think that could be pretty cool actually, to have a separate competition that recognizes the person who overall contributed the most content to EnWP in a year. It might be tricky to iron out the details, but I think it should be separate from the WikiCup, if it exists at all. CaptainEek ⚓ 23:49, 4 November 2024 (UTC)
- (edit conflict)I am inclined to agree. It seems fairly easy to "game" the new system too. The main difference is that all variability disappears—in the current WikiCup, even if you plan to "game" the final round, you still need to be active enough in all four preceding ones to get there. In the proposed version, there is still no need for consistent content production: just nominate 100 GANs in the first month, sit back and probably win, with 95% of competitors losing all interest by February to boot. ~~ AirshipJungleman29 (talk) 00:03, 5 November 2024 (UTC)
- I don't think many people are sitting on a pile of 100 articles ready for GA. (Sammi Brie probably is, but she is having trouble getting them all reviewed quickly enough). Anyway, the question is whether we can reward people more for content creation and less for timing/social engineering skills. —Kusma (talk) 09:15, 5 November 2024 (UTC)
- Based on this years cup, there actually is evidence to say that people are sitting on tons of quality articles. IntentionallyDense (talk) 15:09, 5 November 2024 (UTC)
- I don't think many people are sitting on a pile of 100 articles ready for GA. (Sammi Brie probably is, but she is having trouble getting them all reviewed quickly enough). Anyway, the question is whether we can reward people more for content creation and less for timing/social engineering skills. —Kusma (talk) 09:15, 5 November 2024 (UTC)
- (edit conflict)I am inclined to agree. It seems fairly easy to "game" the new system too. The main difference is that all variability disappears—in the current WikiCup, even if you plan to "game" the final round, you still need to be active enough in all four preceding ones to get there. In the proposed version, there is still no need for consistent content production: just nominate 100 GANs in the first month, sit back and probably win, with 95% of competitors losing all interest by February to boot. ~~ AirshipJungleman29 (talk) 00:03, 5 November 2024 (UTC)
- The examples I was thinking of may not be particularly "bad" but have been questioned by others. I'm not trying to say that these practices are breaking any rules or anything I've just noticed others voicing their concerns about them. Something like teaming up with another editor (as in one or two editors agree to review every nom for a certain person) may be discouraged as this would be much harder to keep up over the course of several months. Additionally any lower qaulity reviews (if those exist) would most likely be picked up on. Again I'm not saying these practices need to be discouraged persay but they have been brought up in the past. IntentionallyDense (talk) 00:02, 5 November 2024 (UTC)
- It is a game. That's the whole point. It's a competition, and folks can be strategic. That's not gaming the system. Resetting the points each round encourages people to steadily make content. Of course people will try to time content, figure out how to get those extra points, that's what makes it fun and exciting! If we want a marathon kind of competition, then I suggest creating a new competition. I think that could be pretty cool actually, to have a separate competition that recognizes the person who overall contributed the most content to EnWP in a year. It might be tricky to iron out the details, but I think it should be separate from the WikiCup, if it exists at all. CaptainEek ⚓ 23:49, 4 November 2024 (UTC)
- What is "it" IntentionallyDense—what specific examples of gaming the system do you think would be deterred, and how? ~~ AirshipJungleman29 (talk) 23:40, 4 November 2024 (UTC)
- I'm not sure if it would be deterred altogether however if there was problematic behaviour going on there would be much more time to address it. IntentionallyDense (talk) 23:30, 4 November 2024 (UTC)
- This is a bit of a tricky situation. On one hand, switching to a cumulative points system would reduce the incentive for people to wait for later rounds to nominate content. It would just be easier on us judges, since we wouldn't have to reset everyone's submissions page every 2 months. On the other hand, if a competitor were to open a commanding lead in the first few rounds, it might actually exacerbate the disparity between the highest-scoring users and the lowest-scoring users. For example, if someone were to nominate multiple high-multiplier featured articles in round 1, they would have a sizable advantage going into round 2, which means there's less competition for the top few spots in later rounds. – Epicgenius (talk) 00:01, 5 November 2024 (UTC)
Raise featured list points?
I've discussed this in passing on Discord, but I think we should consider adjusting the points that are given for featured lists. I'm going to just spew some reasons and thoughts of mine on the matter;
- Featured lists cannot be spammed like good articles, DYKs, or ITNs because of the limit on the number of featured list candidates you can have at any given time (2)
- Far fewer lists are eligible for the interwiki bonus point multipliers
- Should featured articles really be more than 4x the value of featured lists?
- The most featured lists in any round this year was 6 (by myself), for a base point total of 270.
- The most featured articles in any round this year was 3 (by Generalissima), for a base point total of 600.
- I pulled some numbers, and this is only the second time that we've had more featured lists than articles.
- I feel as though we're simply not incentivizing the FL process for the cup, and I think the points could be increased to encourage a greater mix of content from participants.
- Featured list points were last increased from 40 to 45 prior the 2012 cup
- Featured article points were doubled from 100 to 200 prior to the 2014 cup
- The ratio was 2.5 lists being worth 1 FA from 2010–2011
- 2010–2011: 40 pts per FL vs 100 pts per FA (2.5 FL:1 FA)
- 2012–2014: 45 pts per FL vs 100 pts per FA (2.22 FL:1 FA)
- 2015–present: 45 pts per FL vs 200 pts per FA (4.44 FL:1 FA)
In short, I believe the value of featured lists is not properly reflected with the current scoring. As such, I am proposing that featured list points be raised to 65 (3.08 FL per FA), 70 (2.86 FL per FA), or 80 (2.5 FL per FA) starting with the 2025 WikiCup. I'd very much appreciate any feedback on the matter. Hey man im josh (talk) 17:54, 19 September 2024 (UTC)
- I think these are good ideas to consider. Actually, perhaps it might be time for another scoring reform; the last such reform took place in 2019, when competitors were much less likely to submit FLs for points. We haven't changed the scoring rules substantially since then. – Epicgenius (talk) 18:18, 19 September 2024 (UTC)
- I think it could be beneficial to examine. Though not exploited in the most recent iteration of the cup, there have been concerns voiced on Discord about the gameability of ITN items. Hey man im josh (talk) 18:23, 19 September 2024 (UTC)
- I mean, at the moment, an FP is only worth ⅔ a FL, and less than a GA. If FLs get raised by themselves, FPs get more marginal. Adam Cuerden Has about 8.9% of all FPs. 18:26, 19 September 2024 (UTC)
- @Adam Cuerden: I disagree actually because of the fact there's no limits (to my knowledge) on the number of featured picture nominations you can have. My suggestion is meant to compensate for the limits in place for featured lists. I think there's just not a lot of cross over between FP nominators and WikiCup participants. Looking at the 2022 stats as an example, you had 12 pictures in round 1 (360 base pts), 13 pictures in round 2 (390 base points), and 14 pictures in round 3 (420 base points). These base point values just aren't possible with featured lists, so in a sense, it's actually moving things closer to being equal instead of further apart. Hey man im josh (talk) 18:37, 19 September 2024 (UTC)
- Yes. As far as I can tell, I have more FPs than any other person on Misplaced Pages, and I still generally lost every year, even years I was literally spending entire days morning to night working on restoration.
- On my best year ever, 2019 - and, remember, no-one is more productive than me - I had 99 FPs. That's 1970 points for the entire year. Last year, the winner had 2582 points in the final round alone. In 2021, the winner had over 5000, again, last round alone.
- If I don't participate, no-one would be stupid enough to participate who works with FPs. Whic is very, very much against the original goal of the Wikicup, to celebrate all varieties of featured content. Adam Cuerden Has about 8.9% of all FPs. 20:13, 19 September 2024 (UTC)
- I think it would make sense to increase the value of FPs a bit, since nobody actually seems to submit any and they certainly don't seem easy. QuicoleJR (talk) 16:23, 21 October 2024 (UTC)
- @Adam Cuerden: I disagree actually because of the fact there's no limits (to my knowledge) on the number of featured picture nominations you can have. My suggestion is meant to compensate for the limits in place for featured lists. I think there's just not a lot of cross over between FP nominators and WikiCup participants. Looking at the 2022 stats as an example, you had 12 pictures in round 1 (360 base pts), 13 pictures in round 2 (390 base points), and 14 pictures in round 3 (420 base points). These base point values just aren't possible with featured lists, so in a sense, it's actually moving things closer to being equal instead of further apart. Hey man im josh (talk) 18:37, 19 September 2024 (UTC)
- In terms of article writing (as someone who has written all three), I feel that FLs are only slightly more difficult to accomplish than GAs, but are significantly less difficult to write than FAs. The current ratio of FL:FA points seems about right to me; I would not support increasing over 55. ~~ AirshipJungleman29 (talk) 18:35, 19 September 2024 (UTC)
- There actually are some high-multiplier FLs in the current WikiCup submission round. I do not see a good argument to support a massive change to the points awarded to FLs. I agree with Airship that we need to compare to GAs as well. —Kusma (talk) 10:05, 20 September 2024 (UTC)
- @Kusma: If we're comparing to GAs, then I'd like to point out that featured list candidates require 3 reviews, one of them being a source review, and a rough minimum of 20 days of time to be promoted. We've seen it plenty where certain types of GAs can be nominated quite quickly and reviewed the same day by only a single nominator. This doesn't make the work less valuable, but they can and have been "spammed", in that, someone can make a lot of nominations and they are reviewed and promoted the same day. This is not possible with FLs because of the number of reviewers and
- As far as the high-multiplier FLs in the current WikiCup, a 3x multiplier still doesn't compete with FAs, and there are not a ton of high-multiplier FL opportunities out there aside from lists of cities. It was actually my goal to see how far I could get in the cup solely based on FLs and my pending elimination was the reason I actually started working on the Olympics lists. Besides the Olympics lists, the other opportunities are typically very large lists that would be a lot more work than GAs. Hey man im josh (talk) 13:30, 20 September 2024 (UTC)
- I'm not part of the Wikicup much, but there should be some serious consideration to increasing the points for reviews, which is the area most lacking these days on Misplaced Pages. Maybe triple points for completing a review of a fellow Wikicup participant's article (which could also promote comradery within the competition)? « Gonzo fan2007 (talk) @ 20:17, 18 October 2024 (UTC)
- Noting that I did propose increasing points after this comment was made. Hey man im josh (talk) 13:34, 18 November 2024 (UTC)
- I'm not part of the Wikicup much, but there should be some serious consideration to increasing the points for reviews, which is the area most lacking these days on Misplaced Pages. Maybe triple points for completing a review of a fellow Wikicup participant's article (which could also promote comradery within the competition)? « Gonzo fan2007 (talk) @ 20:17, 18 October 2024 (UTC)
- I've unarchived this thread temporarily as it seems to not have been discussed too much. Do we have a consensus on how many points each FL should be worth? If so, I'll email Jarry1250 and ask him to modify his bot's code based on this discussion. – Epicgenius (talk) 00:56, 18 November 2024 (UTC)
- I would support bumping them up to 65 points, making a featured article worth three featured lists (without multipliers). I also support 80 points, making one FA worth 2.5 FLs, but that seems less likely to gain consensus because of the larger shift. Anyone else have a different opinion? QuicoleJR (talk) 02:12, 18 November 2024 (UTC)
- Also, if 55 points is the only option that can gain consensus, I would support that as a compromise, although I would prefer 65 points. QuicoleJR (talk) 16:56, 29 November 2024 (UTC)
- I think there's rough consensus, at this point, that an increase of some kind may be appropriate, with Airship noting they would not support an increase to anything higher than 55 pts, though I do still maintain that a ratio of 3 FLs being worth 1 FA (by bumping to 65 points) is more appropriate. Hey man im josh (talk) 13:37, 18 November 2024 (UTC)
- I would support bumping them up to 65 points, making a featured article worth three featured lists (without multipliers). I also support 80 points, making one FA worth 2.5 FLs, but that seems less likely to gain consensus because of the larger shift. Anyone else have a different opinion? QuicoleJR (talk) 02:12, 18 November 2024 (UTC)
- Thanks for the feedback, everyone. Despite the relatively low number of responses to this thread, I think there is a rough consensus to raise the value of each successful FL nomination to 55 points. Unless anyone objects to this move, I'll reach out to @Jarry1250 about raising the points, either this weekend or early next week. – Epicgenius (talk) 17:09, 29 November 2024 (UTC)
- While I do believe 65 would have been more appropriate, I'm at least grateful to see the points go up. Thanks EpicGenius. Hey man im josh (talk) 17:13, 29 November 2024 (UTC)
- You're welcome. I'm going to leave this open for about 48 hours in case there are objections. If there are no objections, then I will email Jarry. – Epicgenius (talk) 17:37, 29 November 2024 (UTC)
- While I do believe 65 would have been more appropriate, I'm at least grateful to see the points go up. Thanks EpicGenius. Hey man im josh (talk) 17:13, 29 November 2024 (UTC)
What is a FREQUERIE?
When I came to this heading, I was completely surprised by this word (pluralized) I had never seen in my life. A quick online search for its meaning brought up nothing.
Does anyone know? Something perhaps related to FREQUENCY? But if the word doesn’t exist, then … Augnablik (talk) 21:52, 2 December 2024 (UTC)
- I believe its a juxtaposition of "Frequent Queries" (like FAQs) @Augnablik:. The C of E God Save the King! (talk) 22:05, 2 December 2024 (UTC)
- That is correct. It's basically another way of saying FAQs. – Epicgenius (talk) 23:03, 2 December 2024 (UTC)
- do you mean portmanteau? Nub098765 (talk) 08:02, 10 December 2024 (UTC)
- Apparently that’s another meaning of portmanteau, yes. I didn’t know that alternate meaning of the word till I just now went to check it out in the dictionary. Interesting neologism. Augnablik (talk) 08:37, 10 December 2024 (UTC)
To @The C of E and @Epicgenius…
Thank you for deciphering this term. The more I work with Misplaced Pages, the more I see of incredibly creative wordsmithing. It may get a bit overwhelming at times but I’m sure it will keep us young.
As will frequeries! Augnablik (talk) 01:01, 4 December 2024 (UTC)
Proposal: Multi-round scoring, not elimination
I live in a beach town. I have a lot of time on my hands in the cold months, and much less in the hot ones. Very much relatedly, both years that I've competed, I've done pretty well in the first two rounds, and then not cracked 100pts in the third round (May 1 to June 28). I can't be the only person in this situation. Anyone who is a student, or a teacher, or works a seasonal job, or lives in a part of the world where Internet access is less reliable some parts of the year, can really only compete in the current powers-of-2-elimination model if their schedule happens to equate to having progressively more time for Misplaced Pages as the rounds go on. This strikes me as at once unfair, not a very entertaining competition, and a suboptimal way of encouraging people to create content. Consider that by the final two rounds we're only encouraging 16, then 8 people, many of whom would already be creating lots of content regardless. Furthermore, an elimination framework makes it impossible to join late, meaning that if someone learns of the Cup during the year and wants to sign up, they'll have to remember to do so between November and January.
There was some discussion above of carrying points over, but I'd like to formally propose this: The WikiCup should not eliminate competitors, but instead determine victory based on success over multiple rounds. I don't think this should be done just by adding up all points, as this creates a demoralizing effect on those trailing the leader, if the leader racks up a bunch of points, and increases incentives to game the system. Retaining a multi-round framework makes for a better competition. However, there's a variety of ways to combine scores over multiple rounds, two of which I've proposed below (B & C). I welcome people to add other approaches if they'd like. The one thing I'd ask is that people not combine this with proposals to changes in scoring; structure and the fine-tuning of scoring should be separate considerations.
- Status quo: Final placement is determined through scores in the final round after four rounds of elimination.
- Final placement is determined by the average of a person's placements in each round. No elimination.
- The top 16 in each round get a number of Tournament Points equal to —i.e., from 1st downward, {256, 225, 196, 169, 144, 121, 100, 81, 64, 49, 36, 25, 16, 9, 4, 1}. Final placement is determined by total Tournament Points. No elimination.
- Pure cumulative scoring: Final placement is determined by total points across all rounds.
Late joiners would be retroactively assigned a score of 0 in any round they missed. -- Tamzin (they|xe|🤷) 01:55, 4 December 2024 (UTC)
- My preference is C > B > D > A, because C creates increasing incentives the closer you get to the top. I've added D per below; I don't love the idea, for reasons explained above regarding runaway victories and increased gaming, but I still think it's preferable to elimination. -- Tamzin (they|xe|🤷) 01:55, 4 December 2024 (UTC)
- Sure, I like the sound of C. Why not? (fwiw, the status quo is five rounds not four). ~~ AirshipJungleman29 (talk) 04:47, 4 December 2024 (UTC)
- Four elimination rounds, and a fifth round that determines final placement. -- Tamzin (they|xe|🤷) 06:35, 4 December 2024 (UTC)
- C sounds great! IntentionallyDense 05:06, 4 December 2024 (UTC)
- I think a system like this would be much better than the current one; at a glance, I'd be happy with B, C, or some other variation. With that said, it might be helpful to create some samples or consider different scenarios before implementing one. Perhaps trying different scales for C, though simpler is better. Obviously we can't foresee everything, but it would be good to avoid any likely scenarios where the result doesn't "feel" right and the apparent winner doesn't actually win. Thebiguglyalien (talk) 05:22, 4 December 2024 (UTC)
- C sounds great, though I think the scale should be tweaked as a new scoring system might attract more competition and lead to more than 16 big contributors. DoctorWhoFan91 (talk) 15:53, 4 December 2024 (UTC)
- I very much like this proposal; it eliminates my biggest gripe with the cup as it's currently implemented (the frequent incentive not to promote content until opportune moments, such as the beginning or very end of the round). It's unlikely someone would be able to game it in a way that isn't obviously rule-breaking, since it'd require doing it for multiple rounds. It also keeps people engaged for longer, which is better for the spirit of it being about improving the wiki. Mark me down for option C.
- Though a secondary question; this would take ties from "almost impossible" to "fairly plausible", right? We'd have to figure out a tiebreaker (or be okay with multiple winners sometimes). Generalissima (talk) (it/she) 06:19, 4 December 2024 (UTC)
- Oh, one more idea before I go to bed: What if you also got Tournament Points by having the most points in a category? IE, if you're the person with the most GAN review points or FL points or GA points over the course of the cup, that counts as winning a round in your own right. This would allow editors with kinda niche areas of focus that don't rank in the points as much to still make quite respectable showings (and probably lead to like, competition over who does the most FAC reviews, which would never happen otherwise) Generalissima (talk) (it/she) 06:41, 4 December 2024 (UTC)
- Oooh an end-of-tournament set of "vertical" bonuses would be really cool, and reminds me of some very fun boardgames like 7 Wonders. An elegant way to do that would be pegging the Tournament Point values of winning a category to the in-round value of one of that type, so like 200 Tournament Points for the most FAs (making it almost equal to winning a round, which sounds about right). For DYK we could round to 8, or take the average number of points the user got from DYKs. -- Tamzin (they|xe|🤷) 06:47, 4 December 2024 (UTC)
- That could work, though my thought is we don't particularly need to incentivize players to go for the most FAs, since that's already the best way to win rounds. Equalizing the forms of scoring would benefit play styles like heymanimjosh's (Who consistently got tons of FLs and finished in the top few places most rounds) or sammi Brie's (only got first place in one round, but backed it up with a BUNCH of GAN reviews).
- Overall, the effort to be the person with the most GAN reviews is gonna be similar to the effort to be the person with the most FAs, since you might only need like 6 FAs vs like 100 gan reviews Generalissima (talk) (it/she) 06:59, 4 December 2024 (UTC)
- That's a good point. It could be a flat 128 points for winning an individual category maybe? Exactly half the score of winning a round, a tenth of the highest possible pre-bonuses score, and a nod to our powers-of-two heritage. -- Tamzin (they|xe|🤷) 07:10, 4 December 2024 (UTC)
- Oooh an end-of-tournament set of "vertical" bonuses would be really cool, and reminds me of some very fun boardgames like 7 Wonders. An elegant way to do that would be pegging the Tournament Point values of winning a category to the in-round value of one of that type, so like 200 Tournament Points for the most FAs (making it almost equal to winning a round, which sounds about right). For DYK we could round to 8, or take the average number of points the user got from DYKs. -- Tamzin (they|xe|🤷) 06:47, 4 December 2024 (UTC)
- For an individual round, I think it's fine to say that if multiple editors get the same score, they all get the same number of Tournament Points, with a corresponding number of spots skipped afterward. So if you, me, and Eek all tie for 1st in a round, then we each get 256, and if Alien is next behind us, he's fourth and gets 169. For ties in Tournament Points, I think best single-round performance could make for a cool tiebreaker; it would partly offset any feeling of "wasted" points for winning by too much in one round. (And then secondary tiebreaker is second-best single-round performance, and so on... If two people somehow get the exact same score in every round, we call it a true tie and tell them to go play the lottery.) -- Tamzin (they|xe|🤷) 06:41, 4 December 2024 (UTC)
- Oh, one more idea before I go to bed: What if you also got Tournament Points by having the most points in a category? IE, if you're the person with the most GAN review points or FL points or GA points over the course of the cup, that counts as winning a round in your own right. This would allow editors with kinda niche areas of focus that don't rank in the points as much to still make quite respectable showings (and probably lead to like, competition over who does the most FAC reviews, which would never happen otherwise) Generalissima (talk) (it/she) 06:41, 4 December 2024 (UTC)
- As I said above, if we want a marathon kind of competition, then I suggest creating a new competition. I think that could be pretty cool actually, to have a separate competition that effectively recognizes the person who overall contributed the most content to EnWP in a year. I think Tamzin has identified a rather nifty scoring system for that competition (in option C). Now all we need is a catchy name... CaptainEek ⚓ 06:24, 4 December 2024 (UTC)
- I really don't think the enwiki editorial base is big enough at the moment to support two big competitions on the scale of the Wikicup. If we have one big prestigious one (well as prestigious as a contest for internet points can be), it'll incentivize more editors to get involved. If we have two, we run the risk of both fizzling out. Generalissima (talk) (it/she) 06:30, 4 December 2024 (UTC)
- Hmmm, that is actually a pretty good point. I'm not opposed to C, and think it would be interesting to give it a try. Tamzin's scoring system really is innovative. I will note that I'm opposed to B though, I think that takes some of the competitive fun out of it. CaptainEek ⚓ 06:36, 4 December 2024 (UTC)
- I agree with Eek that C seems the best and B seems the worst. I like the idea of bonus points for the top person in non-FA verticals, either each round or over the year. -- Guerillero 09:01, 4 December 2024 (UTC)
- Hmmm, that is actually a pretty good point. I'm not opposed to C, and think it would be interesting to give it a try. Tamzin's scoring system really is innovative. I will note that I'm opposed to B though, I think that takes some of the competitive fun out of it. CaptainEek ⚓ 06:36, 4 December 2024 (UTC)
- I really don't think the enwiki editorial base is big enough at the moment to support two big competitions on the scale of the Wikicup. If we have one big prestigious one (well as prestigious as a contest for internet points can be), it'll incentivize more editors to get involved. If we have two, we run the risk of both fizzling out. Generalissima (talk) (it/she) 06:30, 4 December 2024 (UTC)
- I like the general idea, especially C (B doesn't sound so convincing). There would still some end-of-round excitement but perhaps less of a feeling of wasted effort by doing things too early. So I guess support C. —Kusma (talk) 14:39, 4 December 2024 (UTC)
- If we are to rank all choices, I vote C > D > B > A. —Kusma (talk) 10:13, 7 December 2024 (UTC)
- I think this is an interesting idea that warrants discussion. I will leave more comments later, but I'm going to briefly say that, even if there is a consensus on this idea, there might not be enough time to implement this for 2025. (I'm not even sure yet whether LivingBot will be updated in time to reflect the much more minor change to FL scoring, which was discussed a few weeks ago.) It can, however, be rolled out for 2026. Epicgenius (talk) 15:39, 4 December 2024 (UTC)
- I don't see why LivingBot would need to be updated at all -- the basic scores are the same, there is just a different way of adding scores from different rounds. —Kusma (talk) 15:46, 4 December 2024 (UTC)
- Oh yeah - isn't the between round stuff manual? And tabulating the total quantity of "tournament points" seems trivial to do by hand at the end of each round. Generalissima (talk) (it/she) 16:52, 4 December 2024 (UTC)
- Yeah, we manually clear the submissions pages after each round. I was mentioning LivingBot in the name of efficiency, since I think a bot would be able to distribute these points more accurately if it were done automatically. Blanking the submissions pages and determining which contestants advance to the next round don't require calculations, like the proposed "tournament points" system does. Epicgenius (talk) 19:41, 4 December 2024 (UTC)
- Well the calculations are just matching the top 16 to 16 predetermined values, plus sometimes a few tweaks for ties. That could be done with a Lua module, JS script, or bot if desired, but I just tried the following for round 1 of this year and it was pretty straightforward:
- Open a round's table in VE.
- Copy-paste the table into Google Sheets (I assume Excel/etc. would work as well).
- Add another column called "Tournament Points", giving all cells the value
=IF(ROW() < 17, (17-ROW())^2, 0)
- Manually check for ties. (In this case, that means The Night Watch and NegativeMP1 tie for 12th and both get 25; Tails Wx is still considered 14th, getting 9.)
- Copy the spreadsheet and overwrite the table in VE. (VE at this point will freeze for about a minute.)
- Optional: If you care about preserving {{Misplaced Pages:WikiCup/Participant15}}, the calls to which get substed during the above steps, then switch to code editing and do a find-and-replace for
\+)\|\1\]\] \(\\]\)
→{{Misplaced Pages:WikiCup/Participant15|$1}}
- There would presumably be a table on the main WikiCup page listing round-by-round and total Tournament Points for anyone who's scored any. (No need to bog things down with a bunch of 0s.) This can be done quickly by VE-to-VE copypasting of cell values and then some quick arithmetic (or maybe there's some module to sum the cells in a row?).
- That looks complicated, but it's actually just a few minutes every two months, most of which is spent waiting for step 5 to unfreeze. -- Tamzin (they|xe|🤷) 21:57, 4 December 2024 (UTC)
- Thanks for that, @Tamzin. This would be helpful if there is a consensus to implement the new tournament points system. I wanted to find an efficient way to do this (i.e. I'm lazy), so that's why I was thinking that the bot would need additional code, but I guess that works too. We just have to find a way to get LivingBot to not malfunction when I add the extra column to the WikiCup table. Alternatively, to avoid the need to ask Jarry1250 to edit the bot's code, I can configure these tables so the "tournament points" only appear in the archives for each round (e.g. Misplaced Pages:WikiCup/History/2024/Round 1) and not in the main Misplaced Pages:WikiCup page.Incidentally, I had a few thoughts written up about this, including some commentary in case the tournament points were not separate from the existing points system. However, your comment confirmed that these two were separate, so I will leave some thoughts on this later. – Epicgenius (talk) 00:42, 5 December 2024 (UTC)
- @Epicgenius: I've added a subsection below to hopefully clarify any remaining questions. Let me know if there's anything that's still unclear. -- Tamzin (they|xe|🤷) 01:38, 5 December 2024 (UTC)
- Thanks for that, @Tamzin. This would be helpful if there is a consensus to implement the new tournament points system. I wanted to find an efficient way to do this (i.e. I'm lazy), so that's why I was thinking that the bot would need additional code, but I guess that works too. We just have to find a way to get LivingBot to not malfunction when I add the extra column to the WikiCup table. Alternatively, to avoid the need to ask Jarry1250 to edit the bot's code, I can configure these tables so the "tournament points" only appear in the archives for each round (e.g. Misplaced Pages:WikiCup/History/2024/Round 1) and not in the main Misplaced Pages:WikiCup page.Incidentally, I had a few thoughts written up about this, including some commentary in case the tournament points were not separate from the existing points system. However, your comment confirmed that these two were separate, so I will leave some thoughts on this later. – Epicgenius (talk) 00:42, 5 December 2024 (UTC)
- Well the calculations are just matching the top 16 to 16 predetermined values, plus sometimes a few tweaks for ties. That could be done with a Lua module, JS script, or bot if desired, but I just tried the following for round 1 of this year and it was pretty straightforward:
- Yeah, we manually clear the submissions pages after each round. I was mentioning LivingBot in the name of efficiency, since I think a bot would be able to distribute these points more accurately if it were done automatically. Blanking the submissions pages and determining which contestants advance to the next round don't require calculations, like the proposed "tournament points" system does. Epicgenius (talk) 19:41, 4 December 2024 (UTC)
- Oh yeah - isn't the between round stuff manual? And tabulating the total quantity of "tournament points" seems trivial to do by hand at the end of each round. Generalissima (talk) (it/she) 16:52, 4 December 2024 (UTC)
- I don't see why LivingBot would need to be updated at all -- the basic scores are the same, there is just a different way of adding scores from different rounds. —Kusma (talk) 15:46, 4 December 2024 (UTC)
- Oppose B and C there's usually a very big gap between the first couple of high-scorers and everyone else: this scoring system doesn't adequately reflect that gap. I'm opposed to any scoring system that assigns points based on relative position instead of the actual content someone's making. AryKun (talk) 08:18, 5 December 2024 (UTC)
- The content scoring system would not change. What is being proposed is that instead of some people being eliminated and others taking zero points from the previous round into the next, the top 16 people (by the standard content scoring) would keep some points, and the final winner would be decided not just by the position in the final round, but by a cumulative score. Note also that the proposed system includes a large gap between top scorers (who get up to 256 points) and everyone else (who score a handful points). I understand that you are opposed to the change, but I do not understand your argument. —Kusma (talk) 09:57, 5 December 2024 (UTC)
- The system doesn't change within rounds, but the tournament points are not related to the amount of content someone is writing. The differences between positions are not nearly significant enough; in round one of this year's cup, Generalissima (in first) had 60% more points than AJ29 (in third), but this points system only gives them 30% more points for that. My argument is that we should not award points on the relative position you're in, but the actual work you're doing, since that's what the cup is presumably about. AryKun (talk) 15:53, 5 December 2024 (UTC)
- OK, a different suggestion would simply be to have a 10-month WikiCup without eliminating contestants, something that would also fix Tamzin's problem of having more wikitime early in the year than over the Northern hemisphere summer. —Kusma (talk) 17:28, 5 December 2024 (UTC)
- @AryKun and Kusma: I've added an Option D for pure cumulative scoring, although I personally prefer C or B to it. This preserves a 5-round structure because winning a round is a good incentive for people and it's also easier administratively (I think?); but if someone wants to propose a nonstop round-less approach, feel free to. -- Tamzin (they|xe|🤷) 18:47, 5 December 2024 (UTC)
- OK, a different suggestion would simply be to have a 10-month WikiCup without eliminating contestants, something that would also fix Tamzin's problem of having more wikitime early in the year than over the Northern hemisphere summer. —Kusma (talk) 17:28, 5 December 2024 (UTC)
- The system doesn't change within rounds, but the tournament points are not related to the amount of content someone is writing. The differences between positions are not nearly significant enough; in round one of this year's cup, Generalissima (in first) had 60% more points than AJ29 (in third), but this points system only gives them 30% more points for that. My argument is that we should not award points on the relative position you're in, but the actual work you're doing, since that's what the cup is presumably about. AryKun (talk) 15:53, 5 December 2024 (UTC)
- The content scoring system would not change. What is being proposed is that instead of some people being eliminated and others taking zero points from the previous round into the next, the top 16 people (by the standard content scoring) would keep some points, and the final winner would be decided not just by the position in the final round, but by a cumulative score. Note also that the proposed system includes a large gap between top scorers (who get up to 256 points) and everyone else (who score a handful points). I understand that you are opposed to the change, but I do not understand your argument. —Kusma (talk) 09:57, 5 December 2024 (UTC)
- We have good participation above but arguably not a quorum given the size of the changes being proposed. Would anyone object to me mass-pinging everyone who's signed up for '25? -- Tamzin (they|xe|🤷) 23:58, 6 December 2024 (UTC)
- Seems like a relevant group to alert. Generalissima (talk) (it/she) 04:48, 7 December 2024 (UTC)
- @The C of E, Hey man im josh, Skyshifter, DoctorWhoFan91, Ixtal, Arconning, Kusma, Dylan620, Generalissima, LunaEclipse, BeanieFan11, PCN02WPS, Fritzmann2002, Matthewrb, KEmel49, Vestrian24Bio, Queen of Hearts, Tails Wx, SounderBruce, Voorts, Kline, IntentionallyDense, Wolverine X-eye, LEvalyn, Amir Ghandi, OlifanofmrTennant, Lord Clayton7, Pbritti, Riley1012, Guettarda, Zwerg Nase, TheDoctorWho, History6042, MaranoFan, ActuallyNeverHappened02, Lazman321, and BennyOnTheLoose: Hello! You've all signed up for the 2025 WikiCup. If you're interested in discussing proposed changes to the tournament's format, please see ↑↑ the top of this thread ↑↑. If not, feel free to ignore this ping. Happy editing and/or holidays to all.
:)
-- Tamzin (they|xe|🤷) 04:59, 7 December 2024 (UTC)- Apologies to anyone I pinged who'd already commented. All that time wrangling the sign-ups list into one {{re}} with just regex and prayers, and I forgot the last step. -- Tamzin (they|xe|🤷) 05:36, 7 December 2024 (UTC)
- @The C of E, Hey man im josh, Skyshifter, DoctorWhoFan91, Ixtal, Arconning, Kusma, Dylan620, Generalissima, LunaEclipse, BeanieFan11, PCN02WPS, Fritzmann2002, Matthewrb, KEmel49, Vestrian24Bio, Queen of Hearts, Tails Wx, SounderBruce, Voorts, Kline, IntentionallyDense, Wolverine X-eye, LEvalyn, Amir Ghandi, OlifanofmrTennant, Lord Clayton7, Pbritti, Riley1012, Guettarda, Zwerg Nase, TheDoctorWho, History6042, MaranoFan, ActuallyNeverHappened02, Lazman321, and BennyOnTheLoose: Hello! You've all signed up for the 2025 WikiCup. If you're interested in discussing proposed changes to the tournament's format, please see ↑↑ the top of this thread ↑↑. If not, feel free to ignore this ping. Happy editing and/or holidays to all.
- Seems like a relevant group to alert. Generalissima (talk) (it/she) 04:48, 7 December 2024 (UTC)
- Option B or C. I teach, which in America means that I'll kill it with whatever I do during winter break, have no time in February or March, trudge through May, and come out the other side with nothing but time in June. This would give me an opportunity to feel better about reviewing relatively few GANs and FACs during one round while doing quite a few in another. I hope it'll also spare us a massive backlog at GAN next month. ~ Pbritti (talk) 05:11, 7 December 2024 (UTC)
- Support B or C, I'm fine with both. I think it would encourage more participation over a longer period of time. TheDoctorWho (talk) 05:23, 7 December 2024 (UTC)
- Option C is my favorite, since it gets rid of elimination but still assigns some valuable meaning to the rounds themselves. B would be my second choice but definitely could still present some issues with people not wanting to nominate articles "at the wrong time" like Generalissima said, which I also agree is an issue. PCN02WPS (talk | contribs) 05:55, 7 December 2024 (UTC)
- Support option C and D I'm inclined to go with options C and D, because they work best for me. I think awarding users points based on their positioning is a great idea that should promote more participation, and of course, more competition for the fellas who really want the trophy and those juicy 16² points. Opinion D will be helpful for those who become less active as the year progresses, only picking up at around the time Thanksgiving comes around which, unfortunately, would already be too late. For me personally, I'm most active in Jan–Mar, and least active in Jun & Oct–Nov, so a cumulative result would make the competition somewhat more fair, and that's the bottom line because I said so :) Wolverine X-eye 06:17, 7 December 2024 (UTC)
- Support C. I've never made it out of round 3 - I always plan big, and then life gets in the way. I like the idea of a more forgiving system that allows you to plan your work through the year, instead of just figuring out how to get get the right amount of points in a round, without wasting points in a round where you've already qualified or abandoning your plans for an FA when you realise you'll never make it through the current round. Guettarda (talk) 06:32, 7 December 2024 (UTC)
- Support C. Honestly had a good round before the finals then... This'd probably be better for a lot of competitors. Arconning (talk) 07:08, 7 December 2024 (UTC)
- D, C, A, B is my vote on it. Makes more sense to just make it a whole year league rather than encouraging tactical knockout work as happens nowadays. I think the bonus system in C is fine but just seems a little complicated. The C of E God Save the King! (talk) 09:13, 7 December 2024 (UTC)
- This is my ranking; A C D B. I absolutely hate the idea of a one round contest but A and C are pretty even for me. History6042 (talk) 14:03, 7 December 2024 (UTC)
- Support C and D, I like that we're trying to move away from a simple elimination-style tournament and into a more sustained "league". C is probably the best way to go to keep the OG Cup idea but option D as a league like The C of E said isn't a bad idea either. Kline • talk • contribs 16:51, 7 December 2024 (UTC)
- C > B > D I've participated in a couple of WikiCups where I've had featured content gets stuck. I feel that C is more fair when it comes to issues outside of one's control like featured content processes. ~ Matthewrb 19:23, 7 December 2024 (UTC)
- Support C. Thanks Tamzin for the ping. I think this will certainly make the competition throughout the year much more exciting. — ♠ Ixtal ⁂ Non nobis solum ♠ 19:33, 8 December 2024 (UTC)
- Wondering: what would 2024's results have looked like under option C? (1st, 2nd, 3rd) BeanieFan11 (talk) 19:53, 8 December 2024 (UTC)
- I crunched the numbers, including the "most (X)" bonuses at the end, because I was interested (including only people who made it to the final round, cause obviously eliminated contestants didnt have the chance to submit content)
- Generalissima: 1189 tp
- Sammi Brie: 1028 tp
- AirshipJungleman29: 788 tp
- Hey man im josh: 777 tp
- BeanieFan11: 666 tp
- BennyOnTheLoose: 475 tp
- Arconning: 406 tp
- AryKun: 350 tp
- Generalissima (talk) (it/she) 20:28, 8 December 2024 (UTC)
- I guess at least SounderBruce, Skyshifter and perhaps MaranoFan would have beaten some of these when scoring everybody. —Kusma (talk) 07:35, 9 December 2024 (UTC)
- Bonuses for josh??? Well that certainly helps to get me to buy in! Anything to help with my featured-list-only agenda! I also plan on doing just featured lists again this year :P Hey man im josh (talk) 13:30, 9 December 2024 (UTC)
- Worth noting that I'm the first overall winner to not produce the most content in any category. ~~ AirshipJungleman29 (talk) 14:40, 9 December 2024 (UTC)
- Support D, I'm still fundamentally opposed to any contest that determines winners based on relative positions in each round; it sounds like a stupid idea to me tbh. I'm much more partial to a continuous contest, maybe with bonuses based on the positions at the end of each round. AryKun (talk) 14:33, 9 December 2024 (UTC)
- I don't feel strongly about really any of these options, I just like participating, but out of curiosity, this is determining the scoring system for 2026 and beyond, right? I strongly believe that for 2025 this is way too short notice. λ NegativeMP1 00:54, 10 December 2024 (UTC)
- This is a proposal for 2025, and I think people commenting have read it as such. As discussed above in my exchange with Epicgenius, there's nothing about this that would take a lot of time to set up. Running another year of elimination mode, when essentially everyone to comment has said that one of the three multi-round scoring proposals would be better, wouldn't make much sense to me. -- Tamzin (they|xe|🤷) 01:20, 10 December 2024 (UTC)
- My concerns aren't necessarily about how hard it would be to set up, just in terms of the entire way the competition works changing to an objectively more complicated system with less than a month leading up to it. Not that I personally have any problems with it. λ NegativeMP1 01:21, 10 December 2024 (UTC)
- Well that's why I pinged everyone who'd signed up. If you have ideas of better ways to advertise this, by all means. It's important to stress that, from the individual contestant's point of view in a given round, not much changes here: They're still trying to do as well as possible, using the same scoring system as before. The main change is what doesn't happen, which is them getting eliminated. -- Tamzin (they|xe|🤷) 01:31, 10 December 2024 (UTC)
- @NegativeMP1, I was actually contemplating sending out a mass message about this, since it constitutes a major change to the rules. but that might be both an unnecessary use of the WP:MMS right while also not being particularly relevant to non-competitors. However, Tamzin has already pinged everyone who has signed up. I agree with them that, iff there's a consensus to implement Tournament Points, implement rolling signups, and stop disqualifying people in between rounds, it shouldn't be very hard to do any of these. (In fact, the hardest part might be figuring out what to do with the tables at the end of each round.) – Epicgenius (talk) 01:36, 11 December 2024 (UTC)
- Any major rule change discussions outside of November/December usually fail because people first want to see the current competition play out to the end. So we need to discuss and implement changes in November/December, just before the contest starts, and we need to ignore any calls to delay implementation because it is so close to the contest. Just see where the discussion is standing in a week or so and then go with the consensus. —Kusma (talk) 08:59, 11 December 2024 (UTC)
- My concerns aren't necessarily about how hard it would be to set up, just in terms of the entire way the competition works changing to an objectively more complicated system with less than a month leading up to it. Not that I personally have any problems with it. λ NegativeMP1 01:21, 10 December 2024 (UTC)
- This is a proposal for 2025, and I think people commenting have read it as such. As discussed above in my exchange with Epicgenius, there's nothing about this that would take a lot of time to set up. Running another year of elimination mode, when essentially everyone to comment has said that one of the three multi-round scoring proposals would be better, wouldn't make much sense to me. -- Tamzin (they|xe|🤷) 01:20, 10 December 2024 (UTC)
Crystallizing what C would look like
This subsection is just for summarizing the emerging consensus above regarding Option C. It's framed in the form of a modified Misplaced Pages:WikiCup/Scoring § Scores. Where ambiguous, "Points" would be changed to "Round Points" elsewhere in that document. The highlighted portion indicates less solid consensus than the rest.
The WikiCup takes place over the course of five rounds, in which entrants compete to get the most Round Points.
<Round Point table goes here>
At the end of each round, those who placed 16th or better are awarded a number of Tournament Points based on their placement, equal to the square of how many places above 17 they were. All other contestants receive 0 points.
<Table of {256, 225, ... 1} goes here>
At the end of the tournament, 128 Bonus Tournament Points are awarded to whoever had the most total Round Points in each submission category across all five rounds. This does not count Bonus Round Points, but does count the differing base points for DYKs. Categories are defined by column, even if the column covers multiple things (e.g. GAR and PR).
Final placement is determined by total Tournament Points.
=== Tiebreaking ===
If two contestants receive the same number of Round Points, they tie in placement and both get the corresponding number of Tournament Points. Placement is based on the number of contestants ahead of a person, so a three-way tie for first means that all get 256 and the next person places fourth, not second. Ties may cause more than 16 people to receive points, but in no circumstance may someone with a lower placement than 16th win points.
If two contestants have the same number of Tournament Points, the tie is broken by comparing contestants' best single-round scores. If still tied, their second-best rounds are compared, etc. If still tied, this is treated as a true draw, resolved in the same manner as Round-Point ties, although by the fifth round this is very unlikely to occur.
-- Tamzin (they|xe|🤷). Last edited 18:58, 10 December 2024 (UTC).
- Sounds like a good start if option C is implemented. I'm going to ping my co-judges, @Cwmhiraeth and @Frostly, for their thoughts on this. – Epicgenius (talk) 03:05, 5 December 2024 (UTC)
- I don't really get why FA's would be excluded from the "most in category" thing, but I like it otherwise. ~~ AirshipJungleman29 (talk) 13:34, 9 December 2024 (UTC)
- Should be fine to include FA, especially if it the "round total" does not include bonus points. —Kusma (talk) 14:27, 9 December 2024 (UTC)
- Yes, excluding bonus points should be standard for all "most in category" counts. ~~ AirshipJungleman29 (talk) 14:42, 9 December 2024 (UTC)
- Hadn't even thought of that, but I agree. The only reason it says most Round Points, and not most submissions, was to concisely get around the question of 5-point versus 10-point DYKs. As to FAs, no strong feeling here, it's just that @Guerillero suggested they not get their own Bonus Tournament Points, and no one had argued against that when I wrote the above. -- Tamzin (they|xe|🤷) 23:53, 9 December 2024 (UTC)
- Personally I think most FAs is still a topic worthy of bonuses, especially if it's not taking into account bonuses. I think taking the base DYK points including the 5 points bonus (should be viewable on the submission pages right?) would be good though.
- My only question: should FACRs, FLCRs, GANRs, and PRs all count as separate bonuses? I think we oughta reward reviewing whenever possible, so that could encourage different people to focus on different areas. Generalissima (talk) (it/she) 16:01, 10 December 2024 (UTC)
My only question: should FACRs, FLCRs, GANRs, and PRs all count as separate bonuses?
– Keep it as is in my opinion, in that, FACR/FACL are grouped together while GAR/PR are grouped together. Hey man im josh (talk) 17:57, 10 December 2024 (UTC)- @Generalissima and Hey man im josh: Okay, I think the above should now reflect what we've discussed here. -- Tamzin (they|xe|🤷) 18:58, 10 December 2024 (UTC)
- I don't think the last sentence of that paragraph is even needed. ~~ AirshipJungleman29 (talk) 08:55, 11 December 2024 (UTC)
- @Generalissima and Hey man im josh: Okay, I think the above should now reflect what we've discussed here. -- Tamzin (they|xe|🤷) 18:58, 10 December 2024 (UTC)
- Hadn't even thought of that, but I agree. The only reason it says most Round Points, and not most submissions, was to concisely get around the question of 5-point versus 10-point DYKs. As to FAs, no strong feeling here, it's just that @Guerillero suggested they not get their own Bonus Tournament Points, and no one had argued against that when I wrote the above. -- Tamzin (they|xe|🤷) 23:53, 9 December 2024 (UTC)
- Yes, excluding bonus points should be standard for all "most in category" counts. ~~ AirshipJungleman29 (talk) 14:42, 9 December 2024 (UTC)
- Should be fine to include FA, especially if it the "round total" does not include bonus points. —Kusma (talk) 14:27, 9 December 2024 (UTC)
Request: Better sorting for points table
There are a few issues with how we sort the table and I'd really appreciate if could be addressed:
- The table's default sort last year was based on when you signed up, as in, whoever signed up first and was still in the competition, was listed first
- Ideally, I think the default sort should be based on the current score, followed by alphabetical listing
- When you try to sort the User column it sorted based on the flag, not based on the user name
It's definitely not ideal that we weren't able to sort by user name last year, and I think this is something that would be a great quality of life fix. Hey man im josh (talk) 16:05, 13 December 2024 (UTC)
- Honestly, the main reason I signed up so early this year was so I could get near the top of the list. It was a bit of a struggle to find myself last year. An option of alphabetic sorting would probably make this easier for everyone. —Kusma (talk) 16:56, 13 December 2024 (UTC)
- Glad I wasn't the only one lol Hey man im josh (talk) 23:29, 13 December 2024 (UTC)
- @Hey man im josh, unfortunately sorting by number of points by default would be difficult, because this would require constantly changing the order of the rows based on the number of points each contestant has. If we decide to sort by contestant score, it would be better for a bot (like LivingBot) to handle this. In the meantime, we can sort the rows by username rather than by the flag. – Epicgenius (talk) 17:05, 13 December 2024 (UTC)
- Alternatively, the first file alphabetically on Commons is File:!!!!!!!!!!Tucson House 20130616 124859 543 - Copy.jpg, so just use that as your flag. -- Tamzin (they|xe|🤷) 23:27, 13 December 2024 (UTC)
Increase points for GA reviews
There's been some discussions over the past year about raising the score for GA reviews. For one, GA reviews require a large amount of time and effort from a single individual, not quite on the level of writing the article, but enough that such a low score fundamentally disincentivises WikiCup participants from reviewing GA nominations. This creates a problem for the GA process, which is already facing a constant struggle trying to incentivise reviews; the GA backlog regularly sits at hundreds of articles, which sometimes have to wait for up to a year for a review.
I think, given the strain that the GAN project has been under for a while, it would be very much appreciated if the WikiCup could encourage reviews more. As such, I would like to propose that the scoring for a completed GA review be raised to 10 or 15 points, with bonus points for longer and more in-depth reviews. Keeping it lower than half the score for a GA would prevent gaming of the system, as 2 reviews for every nomination helps reduce the backlog, while bonus points would encourage people to engage thoroughly with the review process. --Grnrchst (talk) 12:29, 14 December 2024 (UTC)
- Recent discussions: Wikipedia_talk:WikiCup/Archive/2024/1#GAN reviewer points and Misplaced Pages talk:WikiCup/Archive/2024/3#Should reviews be worth more?. The main problem is that if we give many points, we need to ensure some review quality, especially with bonus points, but we should not ask judges to do significantly more work than they do now (or pay them twice as much as now). —Kusma (talk) 13:41, 14 December 2024 (UTC)
- Personally I'm still all for a flat increase to 7 points for all types of reviews just to encourage and reward reviewing more than we currently do. Perhaps if we wanted to evaluate the quality of GA reviews we could add 2 additional coords next year and implement it then. Hey man im josh (talk) 14:25, 14 December 2024 (UTC)
- In my personal experience, GA reviewing is usually more time effort than PR or FAC reviewing, so I would prefer it if GA reviews were worth more than other types of reviews. (Also, PR and FAC reviews can be done and then immediately claimed at any time, while with GA reviews you typically need to wait for the reviewer to respond, which slows down scoring). —Kusma (talk) 15:13, 14 December 2024 (UTC)
- @Kusma, just as a quick note, GAN reviews and peer reviews are currently tabulated together; contestants submit PRs under the "Good article nomination review or peer review" section of their submissions page. There can be a separate discussion if we want to instead tabulate peer reviews with FAC reviews, or if we want to tabulate peer reviews on their own. – Epicgenius (talk) 16:47, 14 December 2024 (UTC)
- If we have different scores for different types of reviews, I would suggest to put PR together with FAC reviews, as FAC/PR are more similar to each other than to GA reviews (in a FAC or PR you can just concentrate on parts of the article or parts of the criteria, while for GA you need to do everything, plus the difference in when you can score them). Having PR as a separate category would give another bonus under Tamzin's scoring, which may or may not be a good idea. —Kusma (talk) 18:49, 14 December 2024 (UTC)
- A specific bonus for peer reviews might not be a bad thing if it encourages more activity there. Thebiguglyalien (talk) 19:43, 14 December 2024 (UTC)
- If we have different scores for different types of reviews, I would suggest to put PR together with FAC reviews, as FAC/PR are more similar to each other than to GA reviews (in a FAC or PR you can just concentrate on parts of the article or parts of the criteria, while for GA you need to do everything, plus the difference in when you can score them). Having PR as a separate category would give another bonus under Tamzin's scoring, which may or may not be a good idea. —Kusma (talk) 18:49, 14 December 2024 (UTC)
- @Kusma: That may be so in some cases, but that also depends on the quality of the reviews as we know. For instance, when I do source reviews at FLC I imagine it takes longer than some GA reviews.
- Never the less, I believe that whether we want to make GANRs worth more or not, both deserve a bump, and that's a quick improvement that can encourage reviews. I don't think bumping GAs up to 10/15 points and doing nothing for featured content reviews is something we should do either. After all, our biggest bottleneck does seem to be having people actually review things, and I more or less viewed it as a bandaid suggestion for improvement while a more thorough approach for evaluating GANRs can be crafted.
- I guess I'm just not confident we can get the GANR scoring system that's been suggested down pat for the upcoming drive, and I'd prefer we move the needle in the right direction at least somewhat as opposed to not at all for the upcoming cup. Hey man im josh (talk) 17:08, 14 December 2024 (UTC)
- If we just uniformly bump all types of reviews, I would suggest not to bump by too much. I can live with 7, but I would oppose 15 as too high (even though I would probably benefit from this, as I usually review more than I nominate). Some PR and some FAC prose reviews can be done very quickly while thorough source spotchecks can take a very long time. —Kusma (talk) 18:53, 14 December 2024 (UTC)
- @Kusma, just as a quick note, GAN reviews and peer reviews are currently tabulated together; contestants submit PRs under the "Good article nomination review or peer review" section of their submissions page. There can be a separate discussion if we want to instead tabulate peer reviews with FAC reviews, or if we want to tabulate peer reviews on their own. – Epicgenius (talk) 16:47, 14 December 2024 (UTC)
- I actually raised the exact same point here just today. A bump up to 7 points (or even higher) sounds good, but we should also incentivize harder reviews more with bonus points-maybe based on how vital or large the article being reviewed is- say 0.2x bonus for every 1000 words, capped at 1.5. As for evaluating GANR quality- I assume they are already given a cursory glance, so basing it on an objective criteria wouldn't make it harder. DoctorWhoFan91 (talk) 18:28, 14 December 2024 (UTC)
- In my personal experience, GA reviewing is usually more time effort than PR or FAC reviewing, so I would prefer it if GA reviews were worth more than other types of reviews. (Also, PR and FAC reviews can be done and then immediately claimed at any time, while with GA reviews you typically need to wait for the reviewer to respond, which slows down scoring). —Kusma (talk) 15:13, 14 December 2024 (UTC)
- Personally I'm still all for a flat increase to 7 points for all types of reviews just to encourage and reward reviewing more than we currently do. Perhaps if we wanted to evaluate the quality of GA reviews we could add 2 additional coords next year and implement it then. Hey man im josh (talk) 14:25, 14 December 2024 (UTC)
- Agree that the overall amount for reviews, whether GANs or overall, should be raised. Seven to ten points sounds like a reasonable range. I'd also be okay with stricter enforcement of GAN review quality. Reviews that are just a few bullet points or solely focus on style/grammar issues rather than the full criteria might be worth scrutinizing. Thebiguglyalien (talk) 19:43, 14 December 2024 (UTC)
- I think most GANRs are good- usually bad reviews happen bcs someone is trying to game the system. That can be done with a cursory glance I think, on the size of the review page and a general glance on what it's checking. Even GAN backlog drives do not give points for reviews under 1000 bytes, so maybe something like can that can used. DoctorWhoFan91 (talk) 20:14, 14 December 2024 (UTC)
- IMO 10 points for GANRs and 7 points for PRs/FLCRs/FACRs sounds like a reasonable proposal. I think a GANR is about equal in difficulty and time investment to writing a 10 pt DYK worthy article (albeit a different skill set). Generalissima (talk) (it/she) 20:54, 14 December 2024 (UTC)
- I second Generalissima's opinion here. λ NegativeMP1 22:35, 14 December 2024 (UTC)
- At the upper limit of effort for either, I agree. But the lower limit for GANRs is much lower than for a 10-point DYK, IMO. I received credit for Talk:Fernanda Farias de Albuquerque/GA1. The rules allow scoring detailed quickfails like that one, and I think that's a good thing, but I also don't think it took me anywhere near the effort of Ray cat, probably my easiest 10-point DYK. One solution, then, might be making the review categories "5 or 10" or "5 or 7" based on length. -- Tamzin (they|xe|🤷) 22:52, 14 December 2024 (UTC)
- Length of the article or length of the review? Because if it's the latter, that would probably just encourage unhelpful comments like "place a comma here" or "add ISSNs to your references". Thebiguglyalien (talk) 23:46, 14 December 2024 (UTC)
- Length of the review. I see your point, but we do already have
As a rough guide, no review shorter than 1000 bytes will be considered, though the judges reserve the right to decline other short reviews
, so that incentive already exists with a 5-point differential, just 0-to-5 not 5-to-10. There's also the standing warning about disqualifications for gaming GANR in particular. Maybe making 1,000 to 2,000B of substantive review the 5-point range would work? For context, my Farias review was 2,016B, of which 1,769 was substantive review (i.e. not the salutation or valediction). -- Tamzin (they|xe|🤷) 00:04, 15 December 2024 (UTC)- I think length of the article would be better- there are ways to game a review: copy-editing is by far the biggest section, and if the reviewer decides to just do it themself- can reduce the review by like half. A full review for any article would always take time and effort, and the hardness might not be seen in the length of the review: a 5000+ word article with no typos might get a shorter review than a 1000+ one with many typos, especially if the nom for the latter one is more combative, even though it takes around 4-5 times more work to review the bigger one. DoctorWhoFan91 (talk) 06:46, 15 December 2024 (UTC)
- Perhaps we could count lists of typos against the word count so reviewers will stop creating additional work for themselves and for the nominator by listing them out and describing them one at a time. Only joking. Mostly. Thebiguglyalien (talk) 07:16, 15 December 2024 (UTC)
- I think length of the article would be better- there are ways to game a review: copy-editing is by far the biggest section, and if the reviewer decides to just do it themself- can reduce the review by like half. A full review for any article would always take time and effort, and the hardness might not be seen in the length of the review: a 5000+ word article with no typos might get a shorter review than a 1000+ one with many typos, especially if the nom for the latter one is more combative, even though it takes around 4-5 times more work to review the bigger one. DoctorWhoFan91 (talk) 06:46, 15 December 2024 (UTC)
- Length of the review. I see your point, but we do already have
- Length of the article or length of the review? Because if it's the latter, that would probably just encourage unhelpful comments like "place a comma here" or "add ISSNs to your references". Thebiguglyalien (talk) 23:46, 14 December 2024 (UTC)
I'm not at all sure that additional points are necessary given that we've significantly reviewed more GANs that we've submitted for many years now, often by large numbers. This year it was by a nearly 40% margin. The backlog at GAN is systemic due to people's desire to collect all the shinies and disinclination to review as many as they nominate. I appreciate editors' desires to help reduce the backlog, but that's not necessarily the task of the Cup. Just pointing this out, I'm not opposed to increasing the points; it's a laudable goal.--Sturmvogel 66 (talk) 09:20, 15 December 2024 (UTC)
Call for new judges
If anyone is interested, I'd like to bring on one or two more judges for the 2025 contest. Given the above discussion about changing the points system, it looks like a rough consensus is forming for option C (permanent link), which entails the following:
- Allow people to sign up for the Cup on a rolling basis, rather than only allowing people to sign up from November to January
- Discontinue the elimination of the lowest-scoring competitors in each round; instead, all competitors will be allowed to compete in rounds 1-5, unless they withdraw.
- Introduce a "Tournament Points" system, separate from the current round-points system, that will be used to determine the highest-scoring contestants at the end of round 5. The top 16 in each round get a number of tournament points as outlined above by @Tamzin. The round points will still be cleared at the end of each round (the same as the current system), but the tournament points will carry over between rounds.
This will likely result in a substantial increase in submissions during later rounds, compared with the current system. During the past year, I've handled perhaps two-thirds of the work of running the Cup. However, I won't be able to do this as much in 2025, so additional help would be appreciated.
I'm also pinging my current co-judges, @Cwmhiraeth and @Frostly, for their thoughts. – Epicgenius (talk) 01:47, 15 December 2024 (UTC)