I want to suggest an idea that popped into my mind while I was considering the current problem with the new feature: Private Betas
It could be useful that a selection of users that are active or really frequent users may be allowed to test new feature beforehand, so that they could report problems encountered before releasing the feature to everyone else.
That way if we keep the beta to less than, say, a hundred person, if a huge problem appears, it will only affect those and even better, if someone can toggle between beta and live, any changes made in beta could be discarded with no trouble and without affecting a lot of people either.
I could even create a special category in forum limited to those person only (I’ve looked into it, It’s possible to do so) so that every beta member could talk freely in those topics without risking spoiling the fun to other users.
What do you think?