You indirectly pay for all fraudulent charges because they're included in the fees the merchants pay to the credit card companies (and obviously just include in their pricing as well). With a secure system those fees could be much lower.