Contribution system small improvements

I think I already announced it but in case I didn’t:

  • moderators don’t obtain 15 XP anymore when accepting or refusing a contribution.

Also, this change that promotes transparency has been available since January:

  • every vote on a contribution will show in the chronological sequence of comments with a mandatory comment from the moderator.

And recent from today:

  • updating a contribution without touching the tests or solution doesn’t rerun the tests so it’s way faster.
2 Likes

Do you still remove already approved puzzles on negative feedback (low rating on stars)?
I’m surprised that King of Diamonds is still online, even the creator admits a bug in the expected solution.

4 Likes

I was not aware of the issue.
It had only 17 ratings. I manually added 3 more bad ratings so the bot kicks it tonight.

1 Like

Rating it requires solving it.

Which is harder to say the least when the solution doesn’t match the statement.

I think I could rate puzzles after submit even if I failed some validators (I never did, but I could have)

1 Like

Indeed, I just checked. Thanks, I never noticed!

Sharing my thoughts about the changes:
A proper review is some effort when done properly (checking the codestub in different languages - does it try to parse an int while a long is needed? is there a trailing whitespace?).
Are given constraints met? Do testcases cover the most relevant cases?
It can turn into a lot of effort for SDK contributions (e.g. trying to crash the referee, check for proper seeding to reproduce a game under same conditions, …)

Personally I think that honoring the effort was justified. I can’t tell much about XP harvesting and if it was a problem, as I don’t follow the puzzle contributions too actively.

I also disagree on the reward for new contributions: each gives 250XP. It takes me a full weekend to write a game like Onitama, even after learning the SDK (graphics take a lot of time). In the same amount of time I could spam multiple CoC contributions, each rewarding the same about of XP as that single game.
I don’t even care about having or not having the XP itself, it’s just the balancing that feels off to me.

That’s great! I change small details from time to time (e.g. removing trailing spaces in the testcases, thus touching them :frowning:), was always wondering why the update is that slow.

2 Likes

Quelques coquilles en français :
Dans Entrée pour le générateur de stub, il y a un x erroné et un e en trop (à moins de traduire string par chaîne).
Un string peut contenir des espaces, à l’inverse d’un word. Donc seulement un string peu_t_ être déclaré_e_ dans une même suite de variables.
Au lieu de stub, on peut utiliser squelette ou modèle pour franciser.
Tout en bas de la fenêtre, il y a un s erroné, c’est Statu_t_.

1 Like

I don’t know if it’s actually related to this update, but the following contribution has an official solution that doesn’t output anything and has managed somehow to bypass these tests.
Because this solution is also wrong (it’s a faulty approach to the corresponding problem) it’s likely to be modified by the author soon, so I let a copy here. If you superficially modify the tests or this solution right now, the failure will be detected and the update will be rejected, but it might be interesting to know how this got through in the first place.

Edit: Same problem here (corresponding incorrect solution, this time with a syntax error).

1 Like

And same problem again here (the official solution writes an extra space at the end – which is a bad thing, but that’s a different story – that does not appear in most outputs).

I have just tested right now and it seems there is absolutely no solution check when submitting a contribution…

1 Like

Even an incomplete solution that doesn’t compile and lacks input parsing seems fine now, as you can see at Quadratic Equation and Primes.

1 Like

yep and it seems the solution check is done on contrib update.