Maybe some type of reputation system could help. ie: "karma" but for github. Increases whenever you make good contributions that get merged, decreased if you submit slop that gets rejected.
One problem with it is that a good contribution might be used even if it cannot be merged directly for whatever reason (although they might be listed as a co-author in that case).
