Sets being the foundation is a historical accident. It is convenient and well-studied, and if you can encode your objects and axioms in set theory, you have a sure footing (at least as sure as it gets) with respect to consistency.

Otherwise, of course, lists, graphs, etc. are all objects on their own and exist independently of any encoding as sets.