Downvote him if you think he gets too many rewards.
When you downvote someone their rewards are returned to the reward pool. Its fairly simple.