Additionally, down-voting an already grey comment which is not simply a trolling comment (or one the user likely knows will get down-voted such as for excessive snark), and then not leaving a comment simply makes for a terrible community.

I have a greater issue when a well-written, even if brief, comment gets down-voted heavily and nobody leaves a reply to explain why than when someone down-votes for disagreeing.