I can truthfully say that I dont think I've used it against you, Grog, but I have both said no & yes to a few other posts, even though I dont like the system.
The reason I'd drop it is that some people could see the absence of several Yes votes as some sort of indication that no-one was interested in what they had to say.
You dont have to be very bright to realise there are quite a few people here who desperately lack self confidence and self esteem, so I'm not in favour of anything that might appear to further diminish them, in their own eyes.